[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:06:19.896130 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:44029
I20260709 13:06:19.897943 21390 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:06:19.899111 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:19.918221 21397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:19.918227 21399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:19.919826 21390 server_base.cc:1061] running on GCE node
W20260709 13:06:19.918259 21396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:21.195974 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:21.196292 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:21.196520 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602381196496 us; error 0 us; skew 500 ppm
I20260709 13:06:21.197469 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:21.204406 21390 webserver.cc:533] Webserver started at http://127.20.227.190:38397/ using document root <none> and password file <none>
I20260709 13:06:21.205459 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:21.205749 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:21.206312 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:21.212412 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "f0874f3434cb4a3a89c48d87f4a23fbe"
format_stamp: "Formatted at 2026-07-09 13:06:21 on dist-test-slave-078m"
I20260709 13:06:21.221577 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:06:21.227802 21405 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:21.229557 21390 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:06:21.230034 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "f0874f3434cb4a3a89c48d87f4a23fbe"
format_stamp: "Formatted at 2026-07-09 13:06:21 on dist-test-slave-078m"
I20260709 13:06:21.230481 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:21.299853 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:21.301555 21390 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:06:21.302089 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:21.381520 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:44029
I20260709 13:06:21.381619 21456 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:44029 every 8 connection(s)
I20260709 13:06:21.390017 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:21.413394 21457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe: Bootstrap starting.
I20260709 13:06:21.419461 21457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.421415 21457 log.cc:826] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe: Log is configured to *not* fsync() on all Append() calls
I20260709 13:06:21.426182 21457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe: No bootstrap required, opened a new log
I20260709 13:06:21.448788 21457 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" member_type: VOTER }
I20260709 13:06:21.449441 21457 raft_consensus.cc:385] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.449656 21457 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0874f3434cb4a3a89c48d87f4a23fbe, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.450665 21457 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" member_type: VOTER }
I20260709 13:06:21.451159 21457 raft_consensus.cc:399] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:21.451408 21457 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:21.451697 21457 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.455986 21457 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" member_type: VOTER }
I20260709 13:06:21.456807 21457 leader_election.cc:304] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0874f3434cb4a3a89c48d87f4a23fbe; no voters: 
I20260709 13:06:21.458618 21457 leader_election.cc:290] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:21.459188 21460 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.462070 21460 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 1 LEADER]: Becoming Leader. State: Replica: f0874f3434cb4a3a89c48d87f4a23fbe, State: Running, Role: LEADER
I20260709 13:06:21.462994 21460 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" member_type: VOTER }
I20260709 13:06:21.464085 21457 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:21.475694 21462 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0874f3434cb4a3a89c48d87f4a23fbe. Latest consensus state: current_term: 1 leader_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" member_type: VOTER } }
I20260709 13:06:21.476300 21462 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:21.477449 21461 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0874f3434cb4a3a89c48d87f4a23fbe" member_type: VOTER } }
I20260709 13:06:21.478184 21461 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:21.479734 21468 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:21.494029 21468 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:21.496604 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:21.516739 21468 catalog_manager.cc:1383] Generated new cluster ID: 7bfc94957f6b40daa7524a1e54d18786
I20260709 13:06:21.517287 21468 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:21.533375 21468 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:21.535101 21468 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:21.558931 21468 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe: Generated new TSK 0
I20260709 13:06:21.559988 21468 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:21.628548 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:21.638612 21479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:21.640707 21480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:21.645074 21482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:21.645488 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:21.646355 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:21.646584 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:21.646759 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602381646745 us; error 0 us; skew 500 ppm
I20260709 13:06:21.647468 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:21.652256 21390 webserver.cc:533] Webserver started at http://127.20.227.129:38211/ using document root <none> and password file <none>
I20260709 13:06:21.653107 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:21.653376 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:21.653708 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:21.655014 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "edb1267b04f741798446a9483bfc984c"
format_stamp: "Formatted at 2026-07-09 13:06:21 on dist-test-slave-078m"
I20260709 13:06:21.661315 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:21.666314 21487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:21.667526 21390 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:06:21.668068 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "edb1267b04f741798446a9483bfc984c"
format_stamp: "Formatted at 2026-07-09 13:06:21 on dist-test-slave-078m"
I20260709 13:06:21.668450 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:21.695042 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:21.696743 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:21.700021 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:21.705258 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:21.705514 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:21.705876 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:21.706054 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:21.830956 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:39633
I20260709 13:06:21.831061 21549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:39633 every 8 connection(s)
I20260709 13:06:21.840179 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:21.858875 21554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:21.861809 21555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:21.869689 21557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:21.872383 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:21.874378 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:21.874740 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:21.874948 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602381874931 us; error 0 us; skew 500 ppm
I20260709 13:06:21.875802 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:21.880367 21550 heartbeater.cc:344] Connected to a master server at 127.20.227.190:44029
I20260709 13:06:21.881260 21550 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:21.881683 21390 webserver.cc:533] Webserver started at http://127.20.227.130:34771/ using document root <none> and password file <none>
I20260709 13:06:21.882416 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:21.882684 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:21.883030 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:21.883077 21550 heartbeater.cc:507] Master 127.20.227.190:44029 requested a full tablet report, sending...
I20260709 13:06:21.884642 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
format_stamp: "Formatted at 2026-07-09 13:06:21 on dist-test-slave-078m"
I20260709 13:06:21.887121 21422 ts_manager.cc:194] Registered new tserver with Master: edb1267b04f741798446a9483bfc984c (127.20.227.129:39633)
I20260709 13:06:21.889784 21422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36056
I20260709 13:06:21.894193 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:21.901134 21562 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:21.902290 21390 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:06:21.902935 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
format_stamp: "Formatted at 2026-07-09 13:06:21 on dist-test-slave-078m"
I20260709 13:06:21.903471 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:21.935137 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:21.937024 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:21.939127 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:21.943367 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:21.943686 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:21.944010 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:21.944236 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:22.048931 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:39687
I20260709 13:06:22.049300 21624 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:39687 every 8 connection(s)
I20260709 13:06:22.056476 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:22.068784 21628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:22.073411 21629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:22.077837 21625 heartbeater.cc:344] Connected to a master server at 127.20.227.190:44029
I20260709 13:06:22.078715 21625 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:22.079989 21625 heartbeater.cc:507] Master 127.20.227.190:44029 requested a full tablet report, sending...
I20260709 13:06:22.082490 21390 server_base.cc:1061] running on GCE node
W20260709 13:06:22.082326 21631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:22.083946 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:22.084195 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:22.084503 21422 ts_manager.cc:194] Registered new tserver with Master: c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:22.084398 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602382084377 us; error 0 us; skew 500 ppm
I20260709 13:06:22.086086 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:22.086731 21422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36072
I20260709 13:06:22.090922 21390 webserver.cc:533] Webserver started at http://127.20.227.131:44045/ using document root <none> and password file <none>
I20260709 13:06:22.091547 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:22.091778 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:22.092165 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:22.094247 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "4718c076590744d0baeb2a39cfb95007"
format_stamp: "Formatted at 2026-07-09 13:06:22 on dist-test-slave-078m"
I20260709 13:06:22.102221 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:22.108551 21636 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:22.109644 21390 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:06:22.110081 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "4718c076590744d0baeb2a39cfb95007"
format_stamp: "Formatted at 2026-07-09 13:06:22 on dist-test-slave-078m"
I20260709 13:06:22.110445 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:22.154277 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:22.155632 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:22.157915 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:22.161803 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:22.162086 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:22.162365 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:22.162555 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:22.278400 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:46257
I20260709 13:06:22.278513 21698 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:46257 every 8 connection(s)
I20260709 13:06:22.300431 21699 heartbeater.cc:344] Connected to a master server at 127.20.227.190:44029
I20260709 13:06:22.300927 21699 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:22.301985 21699 heartbeater.cc:507] Master 127.20.227.190:44029 requested a full tablet report, sending...
I20260709 13:06:22.304417 21422 ts_manager.cc:194] Registered new tserver with Master: 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:22.305261 21390 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019653245s
I20260709 13:06:22.306192 21422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36086
I20260709 13:06:22.368614 21422 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36102:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:22.374076 21422 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:22.481101 21664 tablet_service.cc:1511] Processing CreateTablet for tablet 331f15a816f74e3e92d79e657403d98f (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION VALUES < 238609294
W20260709 13:06:22.485487 21470 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:22.485005 21664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331f15a816f74e3e92d79e657403d98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.491811 21663 tablet_service.cc:1511] Processing CreateTablet for tablet 9c35009893444c80a6de470645980cdc (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:22.494459 21663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c35009893444c80a6de470645980cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.510959 21590 tablet_service.cc:1511] Processing CreateTablet for tablet 331f15a816f74e3e92d79e657403d98f (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:22.513844 21590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331f15a816f74e3e92d79e657403d98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.511869 21589 tablet_service.cc:1511] Processing CreateTablet for tablet 9c35009893444c80a6de470645980cdc (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:22.517997 21588 tablet_service.cc:1511] Processing CreateTablet for tablet 026363b411d14d1185eb74def8b0a694 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:22.519075 21662 tablet_service.cc:1511] Processing CreateTablet for tablet 026363b411d14d1185eb74def8b0a694 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:22.521188 21662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026363b411d14d1185eb74def8b0a694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.523119 21589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c35009893444c80a6de470645980cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.526647 21588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026363b411d14d1185eb74def8b0a694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.526386 21586 tablet_service.cc:1511] Processing CreateTablet for tablet 77ccf80beb524ef59f56c198421187c7 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:22.534731 21586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ccf80beb524ef59f56c198421187c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.532342 21661 tablet_service.cc:1511] Processing CreateTablet for tablet 77ccf80beb524ef59f56c198421187c7 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:22.541941 21661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ccf80beb524ef59f56c198421187c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.548031 21587 tablet_service.cc:1511] Processing CreateTablet for tablet dc266609e4cd454b9b051376f5335192 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:22.552899 21587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc266609e4cd454b9b051376f5335192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.557999 21663 tablet_service.cc:1511] Processing CreateTablet for tablet dc266609e4cd454b9b051376f5335192 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:22.567087 21663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc266609e4cd454b9b051376f5335192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.578605 21515 tablet_service.cc:1511] Processing CreateTablet for tablet 331f15a816f74e3e92d79e657403d98f (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:22.594491 21515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331f15a816f74e3e92d79e657403d98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.593397 21514 tablet_service.cc:1511] Processing CreateTablet for tablet 9c35009893444c80a6de470645980cdc (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:22.596607 21585 tablet_service.cc:1511] Processing CreateTablet for tablet d19124bd6a934bf984627a120197ae25 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:22.604741 21660 tablet_service.cc:1511] Processing CreateTablet for tablet d19124bd6a934bf984627a120197ae25 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:22.609479 21512 tablet_service.cc:1511] Processing CreateTablet for tablet 77ccf80beb524ef59f56c198421187c7 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:22.623322 21514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c35009893444c80a6de470645980cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.623548 21660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19124bd6a934bf984627a120197ae25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.624557 21513 tablet_service.cc:1511] Processing CreateTablet for tablet 026363b411d14d1185eb74def8b0a694 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:22.618149 21510 tablet_service.cc:1511] Processing CreateTablet for tablet d19124bd6a934bf984627a120197ae25 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:22.628327 21512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ccf80beb524ef59f56c198421187c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.628382 21585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19124bd6a934bf984627a120197ae25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.615819 21511 tablet_service.cc:1511] Processing CreateTablet for tablet dc266609e4cd454b9b051376f5335192 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:22.630927 21510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19124bd6a934bf984627a120197ae25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.632706 21513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026363b411d14d1185eb74def8b0a694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.637040 21511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc266609e4cd454b9b051376f5335192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.643014 21717 tablet_bootstrap.cc:492] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:22.646831 21509 tablet_service.cc:1511] Processing CreateTablet for tablet 374333da89f94139b162973426a321fc (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:22.649096 21509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374333da89f94139b162973426a321fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.677112 21584 tablet_service.cc:1511] Processing CreateTablet for tablet 374333da89f94139b162973426a321fc (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:22.680538 21584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374333da89f94139b162973426a321fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.685879 21664 tablet_service.cc:1511] Processing CreateTablet for tablet 374333da89f94139b162973426a321fc (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:22.687464 21508 tablet_service.cc:1511] Processing CreateTablet for tablet e994f715adcd4ecabe7368a37a776023 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:22.690085 21664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374333da89f94139b162973426a321fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.708463 21508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e994f715adcd4ecabe7368a37a776023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.730120 21583 tablet_service.cc:1511] Processing CreateTablet for tablet e994f715adcd4ecabe7368a37a776023 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:22.732478 21583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e994f715adcd4ecabe7368a37a776023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.753103 21662 tablet_service.cc:1511] Processing CreateTablet for tablet e994f715adcd4ecabe7368a37a776023 (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:22.757002 21507 tablet_service.cc:1511] Processing CreateTablet for tablet b59aa7f458b24da1ad6db4b09760922f (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:22.763264 21507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59aa7f458b24da1ad6db4b09760922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.771865 21662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e994f715adcd4ecabe7368a37a776023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.803324 21587 tablet_service.cc:1511] Processing CreateTablet for tablet b59aa7f458b24da1ad6db4b09760922f (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:22.808429 21587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59aa7f458b24da1ad6db4b09760922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.816792 21661 tablet_service.cc:1511] Processing CreateTablet for tablet b59aa7f458b24da1ad6db4b09760922f (DEFAULT_TABLE table=test-workload [id=8915fc4193014d0e9d7bf0d6842a6b92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:22.818228 21661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59aa7f458b24da1ad6db4b09760922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.848548 21718 tablet_bootstrap.cc:492] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:22.856276 21719 tablet_bootstrap.cc:492] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:22.869561 21717 tablet_bootstrap.cc:654] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.876485 21718 tablet_bootstrap.cc:654] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.887002 21719 tablet_bootstrap.cc:654] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.887128 21717 tablet_bootstrap.cc:492] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:22.887802 21717 ts_tablet_manager.cc:1403] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.278s	user 0.011s	sys 0.011s
I20260709 13:06:22.892060 21718 tablet_bootstrap.cc:492] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:22.891657 21717 raft_consensus.cc:359] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:22.892553 21718 ts_tablet_manager.cc:1403] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.009s
I20260709 13:06:22.892951 21717 raft_consensus.cc:385] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.893399 21717 raft_consensus.cc:740] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.894557 21550 heartbeater.cc:499] Master 127.20.227.190:44029 was elected leader, sending a full tablet report...
I20260709 13:06:22.898150 21717 consensus_queue.cc:260] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:22.899245 21718 raft_consensus.cc:359] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:22.900130 21718 raft_consensus.cc:385] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.901117 21718 raft_consensus.cc:740] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.902614 21718 consensus_queue.cc:260] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:22.907470 21719 tablet_bootstrap.cc:492] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:22.907960 21719 ts_tablet_manager.cc:1403] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.010s
I20260709 13:06:22.910851 21719 raft_consensus.cc:359] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:22.911950 21719 raft_consensus.cc:385] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.912285 21719 raft_consensus.cc:740] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.915458 21625 heartbeater.cc:499] Master 127.20.227.190:44029 was elected leader, sending a full tablet report...
I20260709 13:06:22.916582 21718 ts_tablet_manager.cc:1434] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:06:22.917768 21718 tablet_bootstrap.cc:492] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:22.922551 21719 consensus_queue.cc:260] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:22.926846 21718 tablet_bootstrap.cc:654] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.928187 21699 heartbeater.cc:499] Master 127.20.227.190:44029 was elected leader, sending a full tablet report...
I20260709 13:06:22.928610 21717 ts_tablet_manager.cc:1434] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.040s	user 0.015s	sys 0.018s
I20260709 13:06:22.929539 21717 tablet_bootstrap.cc:492] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:22.936378 21717 tablet_bootstrap.cc:654] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.937628 21719 ts_tablet_manager.cc:1434] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.007s
I20260709 13:06:22.938674 21719 tablet_bootstrap.cc:492] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:22.944365 21718 tablet_bootstrap.cc:492] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:22.944905 21718 ts_tablet_manager.cc:1403] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.007s
I20260709 13:06:22.945499 21719 tablet_bootstrap.cc:654] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.948576 21718 raft_consensus.cc:359] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:22.949698 21718 raft_consensus.cc:385] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:22.950122 21718 raft_consensus.cc:740] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:22.951190 21718 consensus_queue.cc:260] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:22.954098 21718 ts_tablet_manager.cc:1434] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:06:22.955372 21718 tablet_bootstrap.cc:492] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:22.984269 21718 tablet_bootstrap.cc:654] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:22.997977 21723 raft_consensus.cc:493] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.998797 21723 raft_consensus.cc:515] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:23.003237 21718 tablet_bootstrap.cc:492] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:23.003998 21718 ts_tablet_manager.cc:1403] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.002s
I20260709 13:06:23.008164 21723 leader_election.cc:290] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), edb1267b04f741798446a9483bfc984c (127.20.227.129:39633)
I20260709 13:06:23.009549 21718 raft_consensus.cc:359] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.010540 21718 raft_consensus.cc:385] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.011224 21718 raft_consensus.cc:740] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.012589 21718 consensus_queue.cc:260] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.027329 21718 ts_tablet_manager.cc:1434] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.005s
I20260709 13:06:23.029096 21718 tablet_bootstrap.cc:492] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:23.038399 21717 tablet_bootstrap.cc:492] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
W20260709 13:06:23.038897 21700 tablet.cc:2406] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:23.040550 21717 ts_tablet_manager.cc:1403] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.111s	user 0.044s	sys 0.062s
I20260709 13:06:23.045977 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:23.049788 21600 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 0.
I20260709 13:06:23.054926 21719 tablet_bootstrap.cc:492] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.055610 21719 ts_tablet_manager.cc:1403] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.117s	user 0.036s	sys 0.042s
I20260709 13:06:23.051647 21718 tablet_bootstrap.cc:654] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.063356 21717 raft_consensus.cc:359] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.066200 21717 raft_consensus.cc:385] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.067394 21717 raft_consensus.cc:740] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.067086 21637 leader_election.cc:304] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:23.069044 21723 raft_consensus.cc:2804] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.069916 21723 raft_consensus.cc:493] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.070386 21723 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.070159 21717 consensus_queue.cc:260] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.073104 21719 raft_consensus.cc:359] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.074462 21719 raft_consensus.cc:385] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.074767 21719 raft_consensus.cc:740] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.075685 21719 consensus_queue.cc:260] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.078073 21719 ts_tablet_manager.cc:1434] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:06:23.079020 21719 tablet_bootstrap.cc:492] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:23.102854 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.105854 21525 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 0.
I20260709 13:06:23.110029 21717 ts_tablet_manager.cc:1434] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.019s
I20260709 13:06:23.111141 21717 tablet_bootstrap.cc:492] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:23.111171 21723 raft_consensus.cc:515] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:23.114743 21723 leader_election.cc:290] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), edb1267b04f741798446a9483bfc984c (127.20.227.129:39633)
I20260709 13:06:23.115583 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:23.115850 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:23.116247 21600 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.116442 21525 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.129462 21719 tablet_bootstrap.cc:654] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.130978 21718 tablet_bootstrap.cc:492] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:23.131497 21718 ts_tablet_manager.cc:1403] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.103s	user 0.024s	sys 0.034s
I20260709 13:06:23.137585 21600 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 1.
I20260709 13:06:23.138921 21717 tablet_bootstrap.cc:654] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.140838 21637 leader_election.cc:304] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:23.141655 21525 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 1.
I20260709 13:06:23.141893 21723 raft_consensus.cc:2804] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.142455 21723 raft_consensus.cc:697] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:23.143261 21723 consensus_queue.cc:237] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:23.145314 21719 tablet_bootstrap.cc:492] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.145747 21719 ts_tablet_manager.cc:1403] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.003s
I20260709 13:06:23.148663 21719 raft_consensus.cc:359] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.148881 21718 raft_consensus.cc:359] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.149575 21719 raft_consensus.cc:385] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.149689 21718 raft_consensus.cc:385] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.149966 21719 raft_consensus.cc:740] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.150056 21718 raft_consensus.cc:740] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.151038 21719 consensus_queue.cc:260] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.153932 21719 ts_tablet_manager.cc:1434] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:06:23.151616 21718 consensus_queue.cc:260] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.155020 21719 tablet_bootstrap.cc:492] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:23.160280 21718 ts_tablet_manager.cc:1434] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 13:06:23.161433 21718 tablet_bootstrap.cc:492] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:23.159976 21421 catalog_manager.cc:5697] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.169625 21719 tablet_bootstrap.cc:654] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.174230 21718 tablet_bootstrap.cc:654] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.180358 21717 tablet_bootstrap.cc:492] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:23.180888 21717 ts_tablet_manager.cc:1403] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.070s	user 0.006s	sys 0.015s
I20260709 13:06:23.184525 21717 raft_consensus.cc:359] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.185509 21717 raft_consensus.cc:385] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.185912 21717 raft_consensus.cc:740] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.186662 21723 raft_consensus.cc:493] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.186769 21717 consensus_queue.cc:260] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.187235 21723 raft_consensus.cc:515] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.188560 21718 tablet_bootstrap.cc:492] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:23.189051 21718 ts_tablet_manager.cc:1403] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 13:06:23.189414 21723 leader_election.cc:290] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:23.189394 21717 ts_tablet_manager.cc:1434] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:06:23.190197 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.190531 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:23.190858 21717 tablet_bootstrap.cc:492] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:23.191098 21600 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 0.
W20260709 13:06:23.192131 21639 leader_election.cc:343] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb1267b04f741798446a9483bfc984c (127.20.227.129:39633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.191987 21718 raft_consensus.cc:359] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.192806 21718 raft_consensus.cc:385] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.192800 21637 leader_election.cc:304] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: edb1267b04f741798446a9483bfc984c
I20260709 13:06:23.193233 21718 raft_consensus.cc:740] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.193796 21723 raft_consensus.cc:2804] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.194173 21723 raft_consensus.cc:493] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.194041 21718 consensus_queue.cc:260] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.194533 21723 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.200413 21719 tablet_bootstrap.cc:492] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.200989 21719 ts_tablet_manager.cc:1403] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.003s
I20260709 13:06:23.201808 21723 raft_consensus.cc:515] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.204059 21723 leader_election.cc:290] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:23.203948 21719 raft_consensus.cc:359] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.204764 21719 raft_consensus.cc:385] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.205017 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:23.205315 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:23.205255 21719 raft_consensus.cc:740] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.205981 21600 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:23.206578 21639 leader_election.cc:343] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edb1267b04f741798446a9483bfc984c (127.20.227.129:39633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.206354 21719 consensus_queue.cc:260] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.208712 21719 ts_tablet_manager.cc:1434] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:23.209735 21719 tablet_bootstrap.cc:492] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:23.212524 21717 tablet_bootstrap.cc:654] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.213400 21600 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 1.
I20260709 13:06:23.215240 21637 leader_election.cc:304] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: edb1267b04f741798446a9483bfc984c
I20260709 13:06:23.215788 21718 ts_tablet_manager.cc:1434] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:06:23.216101 21723 raft_consensus.cc:2804] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.216884 21718 tablet_bootstrap.cc:492] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:23.216799 21723 raft_consensus.cc:697] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:23.217744 21723 consensus_queue.cc:237] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.225652 21719 tablet_bootstrap.cc:654] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.235316 21717 tablet_bootstrap.cc:492] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:23.236476 21717 ts_tablet_manager.cc:1403] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.006s
I20260709 13:06:23.237990 21718 tablet_bootstrap.cc:654] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.246208 21717 raft_consensus.cc:359] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.247020 21717 raft_consensus.cc:385] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.247334 21717 raft_consensus.cc:740] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.248062 21717 consensus_queue.cc:260] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.250797 21717 ts_tablet_manager.cc:1434] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:06:23.253264 21717 tablet_bootstrap.cc:492] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:23.256656 21418 catalog_manager.cc:5697] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.258369 21719 tablet_bootstrap.cc:492] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.258920 21719 ts_tablet_manager.cc:1403] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.018s
I20260709 13:06:23.261337 21717 tablet_bootstrap.cc:654] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.262661 21719 raft_consensus.cc:359] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.263592 21719 raft_consensus.cc:385] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.263931 21719 raft_consensus.cc:740] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.264699 21719 consensus_queue.cc:260] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.272662 21719 ts_tablet_manager.cc:1434] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:06:23.273753 21719 tablet_bootstrap.cc:492] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:23.280336 21719 tablet_bootstrap.cc:654] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.284641 21725 raft_consensus.cc:493] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.285241 21725 raft_consensus.cc:515] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.288286 21725 leader_election.cc:290] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.312247 21725 raft_consensus.cc:493] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.313473 21724 raft_consensus.cc:493] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.313513 21725 raft_consensus.cc:515] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.314177 21724 raft_consensus.cc:515] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.320717 21725 leader_election.cc:290] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.327431 21724 leader_election.cc:290] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.346491 21725 raft_consensus.cc:493] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.347121 21725 raft_consensus.cc:515] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.349131 21719 tablet_bootstrap.cc:492] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.349995 21719 ts_tablet_manager.cc:1403] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.012s
I20260709 13:06:23.354262 21725 leader_election.cc:290] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.357788 21717 tablet_bootstrap.cc:492] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:23.359274 21717 ts_tablet_manager.cc:1403] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.106s	user 0.028s	sys 0.024s
I20260709 13:06:23.356412 21718 tablet_bootstrap.cc:492] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:23.360562 21719 raft_consensus.cc:359] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.362295 21719 raft_consensus.cc:385] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.368978 21719 raft_consensus.cc:740] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.363992 21718 ts_tablet_manager.cc:1403] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.147s	user 0.033s	sys 0.023s
I20260709 13:06:23.368026 21724 raft_consensus.cc:493] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.369892 21724 raft_consensus.cc:515] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.373824 21724 leader_election.cc:290] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.374651 21719 consensus_queue.cc:260] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.384789 21719 ts_tablet_manager.cc:1434] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:06:23.380276 21718 raft_consensus.cc:359] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.385262 21718 raft_consensus.cc:385] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.385609 21718 raft_consensus.cc:740] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.385921 21719 tablet_bootstrap.cc:492] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:23.386416 21718 consensus_queue.cc:260] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.391350 21718 ts_tablet_manager.cc:1434] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:06:23.392458 21718 tablet_bootstrap.cc:492] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:23.396710 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.398801 21717 raft_consensus.cc:359] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.399734 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.401160 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:23.401396 21717 raft_consensus.cc:385] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.401242 21673 raft_consensus.cc:2468] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 0.
I20260709 13:06:23.402094 21717 raft_consensus.cc:740] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.402087 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
W20260709 13:06:23.403806 21489 leader_election.cc:343] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.404448 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.405192 21489 leader_election.cc:304] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:23.407438 21725 raft_consensus.cc:2804] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.408085 21725 raft_consensus.cc:493] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.407622 21724 raft_consensus.cc:493] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.408262 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:23.409413 21724 raft_consensus.cc:515] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.409943 21599 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 0.
I20260709 13:06:23.408958 21725 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.405874 21717 consensus_queue.cc:260] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.412590 21674 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 0.
I20260709 13:06:23.414857 21717 ts_tablet_manager.cc:1434] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.009s
I20260709 13:06:23.417132 21717 tablet_bootstrap.cc:492] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
W20260709 13:06:23.417002 21488 leader_election.cc:343] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.416134 21724 leader_election.cc:290] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.419373 21488 leader_election.cc:304] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb1267b04f741798446a9483bfc984c; no voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13
W20260709 13:06:23.429117 21488 leader_election.cc:343] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.425689 21489 leader_election.cc:304] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:23.431844 21718 tablet_bootstrap.cc:654] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.437063 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc266609e4cd454b9b051376f5335192" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.437234 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.441080 21525 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 0.
I20260709 13:06:23.443493 21754 raft_consensus.cc:2749] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:23.438783 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.446080 21565 leader_election.cc:304] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:23.447124 21724 raft_consensus.cc:2804] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:23.447242 21565 leader_election.cc:343] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb1267b04f741798446a9483bfc984c (127.20.227.129:39633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.447523 21724 raft_consensus.cc:493] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.447664 21719 tablet_bootstrap.cc:654] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.438218 21524 raft_consensus.cc:2468] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 0.
I20260709 13:06:23.438850 21725 raft_consensus.cc:515] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.447944 21724 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.450812 21725 leader_election.cc:290] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.451683 21565 leader_election.cc:304] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:23.452646 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:23.453341 21674 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.459370 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
W20260709 13:06:23.465844 21488 leader_election.cc:343] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.467811 21724 raft_consensus.cc:515] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.468328 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.469312 21673 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 0.
I20260709 13:06:23.470700 21671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.471438 21755 raft_consensus.cc:2804] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.474822 21755 raft_consensus.cc:493] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.475267 21755 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:23.477521 21564 leader_election.cc:343] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.477648 21724 leader_election.cc:290] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.478070 21564 leader_election.cc:304] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c
I20260709 13:06:23.471423 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc266609e4cd454b9b051376f5335192" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.479929 21674 raft_consensus.cc:2468] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 1.
I20260709 13:06:23.481024 21724 raft_consensus.cc:2749] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:23.482515 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:23.483390 21524 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.483914 21489 leader_election.cc:304] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:23.485858 21754 raft_consensus.cc:2804] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.486503 21754 raft_consensus.cc:697] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:23.486958 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:23.488632 21674 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.487718 21754 consensus_queue.cc:237] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
W20260709 13:06:23.489023 21564 leader_election.cc:343] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.491245 21717 tablet_bootstrap.cc:654] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.495661 21524 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 1.
W20260709 13:06:23.496351 21470 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:23.496996 21565 leader_election.cc:304] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:23.494057 21756 raft_consensus.cc:2804] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.497869 21724 raft_consensus.cc:2804] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.498186 21756 raft_consensus.cc:493] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.500934 21719 tablet_bootstrap.cc:492] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.500566 21755 raft_consensus.cc:515] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.498831 21756 raft_consensus.cc:3060] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.501767 21719 ts_tablet_manager.cc:1403] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.116s	user 0.027s	sys 0.011s
I20260709 13:06:23.506031 21755 leader_election.cc:290] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.506469 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:23.507486 21599 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.507648 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:23.508220 21672 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.509301 21718 tablet_bootstrap.cc:492] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:23.510468 21718 ts_tablet_manager.cc:1403] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.005s
I20260709 13:06:23.512472 21724 raft_consensus.cc:697] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:23.513043 21719 raft_consensus.cc:359] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.513840 21719 raft_consensus.cc:385] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.513448 21724 consensus_queue.cc:237] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.514154 21719 raft_consensus.cc:740] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.517701 21599 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 1.
I20260709 13:06:23.518920 21719 consensus_queue.cc:260] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.520771 21488 leader_election.cc:304] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:23.522948 21718 raft_consensus.cc:359] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.519320 21672 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 1.
I20260709 13:06:23.523957 21718 raft_consensus.cc:385] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.524307 21718 raft_consensus.cc:740] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.525573 21755 raft_consensus.cc:2804] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.525358 21718 consensus_queue.cc:260] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.526046 21755 raft_consensus.cc:697] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:23.527150 21755 consensus_queue.cc:237] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.527238 21674 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 1.
I20260709 13:06:23.533591 21719 ts_tablet_manager.cc:1434] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:06:23.534476 21719 tablet_bootstrap.cc:492] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:23.540820 21421 catalog_manager.cc:5697] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 0 to 1, leader changed from <none> to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.536890 21419 catalog_manager.cc:5697] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 0 to 1, leader changed from <none> to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 1 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.557163 21717 tablet_bootstrap.cc:492] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:23.557972 21717 ts_tablet_manager.cc:1403] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.027s
I20260709 13:06:23.562342 21756 raft_consensus.cc:515] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.565162 21719 tablet_bootstrap.cc:654] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.566910 21717 raft_consensus.cc:359] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.567672 21717 raft_consensus.cc:385] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.567983 21717 raft_consensus.cc:740] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.568780 21717 consensus_queue.cc:260] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.570768 21755 raft_consensus.cc:493] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.571231 21717 ts_tablet_manager.cc:1434] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:06:23.571424 21755 raft_consensus.cc:515] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.572261 21717 tablet_bootstrap.cc:492] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:23.574801 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.571002 21718 ts_tablet_manager.cc:1434] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:06:23.575328 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:23.578061 21599 raft_consensus.cc:2468] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 0.
W20260709 13:06:23.578207 21489 leader_election.cc:343] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.579733 21488 leader_election.cc:304] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:23.580700 21754 raft_consensus.cc:2804] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.580848 21756 leader_election.cc:290] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.581115 21754 raft_consensus.cc:493] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.581516 21754 raft_consensus.cc:3060] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.577409 21755 leader_election.cc:290] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.582432 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc266609e4cd454b9b051376f5335192" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:23.583009 21524 raft_consensus.cc:3060] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.583446 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc266609e4cd454b9b051376f5335192" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:23.584373 21719 tablet_bootstrap.cc:492] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.584805 21719 ts_tablet_manager.cc:1403] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.004s
W20260709 13:06:23.585124 21564 leader_election.cc:343] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.589920 21719 raft_consensus.cc:359] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.590584 21718 tablet_bootstrap.cc:492] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:23.590683 21719 raft_consensus.cc:385] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.591179 21719 raft_consensus.cc:740] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.592007 21719 consensus_queue.cc:260] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.594311 21719 ts_tablet_manager.cc:1434] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:06:23.596149 21719 tablet_bootstrap.cc:492] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c: Bootstrap starting.
I20260709 13:06:23.597312 21717 tablet_bootstrap.cc:654] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.596271 21754 raft_consensus.cc:515] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.601017 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:23.601625 21600 raft_consensus.cc:3060] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.602583 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007"
W20260709 13:06:23.604212 21489 leader_election.cc:343] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.604959 21723 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:23.606330 21754 leader_election.cc:290] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.609902 21524 raft_consensus.cc:2468] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 1.
I20260709 13:06:23.612317 21565 leader_election.cc:304] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:23.613780 21756 raft_consensus.cc:2804] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.614286 21756 raft_consensus.cc:697] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:23.614416 21600 raft_consensus.cc:2468] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 1.
I20260709 13:06:23.615250 21756 consensus_queue.cc:237] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.615681 21488 leader_election.cc:304] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:23.614943 21421 catalog_manager.cc:5697] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 0 to 1, leader changed from <none> to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 1 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.617733 21754 raft_consensus.cc:2804] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.621096 21754 raft_consensus.cc:697] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:23.622656 21754 consensus_queue.cc:237] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.623842 21719 tablet_bootstrap.cc:654] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.630520 21718 tablet_bootstrap.cc:654] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.645164 21717 tablet_bootstrap.cc:492] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:23.645750 21717 ts_tablet_manager.cc:1403] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.019s
I20260709 13:06:23.659224 21733 consensus_queue.cc:1048] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:23.663373 21421 catalog_manager.cc:5697] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 0 to 1, leader changed from <none> to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.674180 21717 raft_consensus.cc:359] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.673794 21418 catalog_manager.cc:5697] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 0 to 1, leader changed from <none> to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 1 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.675328 21717 raft_consensus.cc:385] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.675822 21717 raft_consensus.cc:740] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.685075 21717 consensus_queue.cc:260] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.693382 21717 ts_tablet_manager.cc:1434] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 13:06:23.695055 21717 tablet_bootstrap.cc:492] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:23.705071 21756 raft_consensus.cc:493] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.705703 21756 raft_consensus.cc:515] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.709286 21756 leader_election.cc:290] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.709715 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.710147 21717 tablet_bootstrap.cc:654] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.718551 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.719571 21672 raft_consensus.cc:2393] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c34ef797ebe34a7390e9ed21fdcd0f13 in current term 1: Already voted for candidate edb1267b04f741798446a9483bfc984c in this term.
I20260709 13:06:23.721002 21564 leader_election.cc:304] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c
I20260709 13:06:23.722291 21756 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.725929 21754 raft_consensus.cc:493] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.726595 21754 raft_consensus.cc:515] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.730033 21754 leader_election.cc:290] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.732998 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
W20260709 13:06:23.739012 21488 leader_election.cc:343] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.740121 21718 tablet_bootstrap.cc:492] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:23.740585 21718 ts_tablet_manager.cc:1403] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.150s	user 0.020s	sys 0.005s
I20260709 13:06:23.744205 21718 raft_consensus.cc:359] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.745010 21718 raft_consensus.cc:385] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.745337 21718 raft_consensus.cc:740] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.747720 21719 tablet_bootstrap.cc:492] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c: No bootstrap required, opened a new log
I20260709 13:06:23.748265 21719 ts_tablet_manager.cc:1403] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.011s
I20260709 13:06:23.747795 21717 tablet_bootstrap.cc:492] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:23.748497 21718 consensus_queue.cc:260] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.748987 21717 ts_tablet_manager.cc:1403] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.004s
I20260709 13:06:23.751019 21718 ts_tablet_manager.cc:1434] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
W20260709 13:06:23.751442 21639 consensus_peers.cc:597] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 -> Peer edb1267b04f741798446a9483bfc984c (127.20.227.129:39633): Couldn't send request to peer edb1267b04f741798446a9483bfc984c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.751931 21718 tablet_bootstrap.cc:492] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13: Bootstrap starting.
I20260709 13:06:23.751951 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:23.752729 21672 raft_consensus.cc:2468] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 0.
I20260709 13:06:23.755156 21489 leader_election.cc:304] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:23.757977 21754 raft_consensus.cc:2804] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.759393 21719 raft_consensus.cc:359] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.760331 21756 raft_consensus.cc:2749] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:23.762005 21717 raft_consensus.cc:359] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.762825 21719 raft_consensus.cc:385] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.763229 21717 raft_consensus.cc:385] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.763398 21719 raft_consensus.cc:740] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.763576 21717 raft_consensus.cc:740] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.764387 21719 consensus_queue.cc:260] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.764438 21717 consensus_queue.cc:260] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.758548 21754 raft_consensus.cc:493] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.767036 21754 raft_consensus.cc:3060] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.768955 21719 ts_tablet_manager.cc:1434] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:06:23.768934 21717 ts_tablet_manager.cc:1434] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:23.769522 21718 tablet_bootstrap.cc:654] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.770128 21717 tablet_bootstrap.cc:492] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007: Bootstrap starting.
I20260709 13:06:23.777105 21717 tablet_bootstrap.cc:654] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.788888 21717 tablet_bootstrap.cc:492] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007: No bootstrap required, opened a new log
I20260709 13:06:23.789392 21717 ts_tablet_manager.cc:1403] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 13:06:23.792174 21717 raft_consensus.cc:359] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.793036 21717 raft_consensus.cc:385] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.793349 21717 raft_consensus.cc:740] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.794018 21717 consensus_queue.cc:260] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.798481 21717 ts_tablet_manager.cc:1434] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:06:23.805152 21772 raft_consensus.cc:493] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.805785 21772 raft_consensus.cc:515] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.809365 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:23.810055 21599 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 0.
I20260709 13:06:23.811595 21637 leader_election.cc:304] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:23.812536 21723 raft_consensus.cc:2804] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:23.812976 21723 raft_consensus.cc:493] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.813342 21723 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.820463 21723 raft_consensus.cc:515] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.821879 21754 raft_consensus.cc:515] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.822722 21772 leader_election.cc:290] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:23.825367 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:23.826071 21599 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.825919 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
W20260709 13:06:23.828344 21488 leader_election.cc:343] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:23.833907 21599 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 1.
I20260709 13:06:23.835747 21637 leader_election.cc:304] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:23.836882 21772 raft_consensus.cc:2804] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.837628 21772 raft_consensus.cc:697] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:23.838469 21772 consensus_queue.cc:237] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.843004 21723 leader_election.cc:290] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:23.849385 21772 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:23.852131 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.852909 21524 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 0.
I20260709 13:06:23.855278 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:23.855931 21523 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.858278 21772 raft_consensus.cc:493] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.858908 21772 raft_consensus.cc:515] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.862617 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc266609e4cd454b9b051376f5335192" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:23.863456 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc266609e4cd454b9b051376f5335192" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:23.864552 21772 leader_election.cc:290] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:23.864265 21422 catalog_manager.cc:5697] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.864286 21524 raft_consensus.cc:2393] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4718c076590744d0baeb2a39cfb95007 in current term 1: Already voted for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in this term.
I20260709 13:06:23.867113 21639 leader_election.cc:304] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007; no voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c
I20260709 13:06:23.867916 21523 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 1.
I20260709 13:06:23.867141 21754 leader_election.cc:290] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:23.869128 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:23.869385 21772 raft_consensus.cc:3060] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.869736 21672 raft_consensus.cc:3060] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.872166 21718 tablet_bootstrap.cc:492] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13: No bootstrap required, opened a new log
I20260709 13:06:23.872712 21718 ts_tablet_manager.cc:1403] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent bootstrapping tablet: real 0.121s	user 0.052s	sys 0.048s
I20260709 13:06:23.875447 21718 raft_consensus.cc:359] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.876225 21718 raft_consensus.cc:385] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.876597 21718 raft_consensus.cc:740] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.876720 21772 raft_consensus.cc:2749] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:23.876773 21672 raft_consensus.cc:2468] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 1.
I20260709 13:06:23.877482 21718 consensus_queue.cc:260] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.878008 21489 leader_election.cc:304] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:23.879187 21754 raft_consensus.cc:2804] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.879833 21754 raft_consensus.cc:697] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:23.880074 21718 ts_tablet_manager.cc:1434] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:23.881233 21754 consensus_queue.cc:237] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:23.908305 21754 consensus_queue.cc:1048] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:23.911019 21420 catalog_manager.cc:5697] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 0 to 1, leader changed from <none> to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 1 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.924499 21725 consensus_queue.cc:1048] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:23.961692 21672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
mode: GRACEFUL
new_leader_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:51974
I20260709 13:06:23.962090 21784 consensus_queue.cc:1048] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:23.962493 21672 raft_consensus.cc:606] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Received request to transfer leadership to TS edb1267b04f741798446a9483bfc984c
I20260709 13:06:23.968812 21672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c35009893444c80a6de470645980cdc"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
mode: GRACEFUL
new_leader_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:51974
I20260709 13:06:23.969528 21672 raft_consensus.cc:606] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Received request to transfer leadership to TS edb1267b04f741798446a9483bfc984c
I20260709 13:06:23.986526 21784 consensus_queue.cc:1048] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:24.004539 21599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
mode: GRACEFUL
new_leader_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:60092
I20260709 13:06:24.005474 21599 raft_consensus.cc:606] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 LEADER]: Received request to transfer leadership to TS edb1267b04f741798446a9483bfc984c
I20260709 13:06:24.019601 21674 raft_consensus.cc:3060] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.026000 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d19124bd6a934bf984627a120197ae25"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:58264
I20260709 13:06:24.026686 21525 raft_consensus.cc:606] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:24.028453 21784 consensus_queue.cc:1048] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:24.034117 21672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374333da89f94139b162973426a321fc"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:51974
I20260709 13:06:24.034837 21672 raft_consensus.cc:606] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:24.043150 21784 consensus_queue.cc:1048] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:24.044757 21755 raft_consensus.cc:493] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.045152 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:58264
I20260709 13:06:24.045367 21755 raft_consensus.cc:515] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.045770 21525 raft_consensus.cc:606] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:24.047521 21755 leader_election.cc:290] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:24.051038 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" is_pre_election: true
I20260709 13:06:24.051074 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:24.053905 21489 leader_election.cc:304] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb1267b04f741798446a9483bfc984c; no voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:24.055078 21755 raft_consensus.cc:2749] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:24.059670 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
mode: GRACEFUL
new_leader_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:58264
I20260709 13:06:24.060246 21525 raft_consensus.cc:606] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Received request to transfer leadership to TS 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:24.065393 21755 raft_consensus.cc:993] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:24.066097 21784 raft_consensus.cc:1081] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:24.067898 21599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60090
I20260709 13:06:24.068485 21599 raft_consensus.cc:493] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.068885 21599 raft_consensus.cc:3060] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.075764 21599 raft_consensus.cc:515] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.079226 21599 leader_election.cc:290] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:24.079231 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:24.080049 21525 raft_consensus.cc:3055] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.080410 21525 raft_consensus.cc:740] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:24.080811 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e994f715adcd4ecabe7368a37a776023" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:24.081435 21672 raft_consensus.cc:3060] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.081348 21525 consensus_queue.cc:260] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.082959 21525 raft_consensus.cc:3060] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.088583 21672 raft_consensus.cc:2468] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 2.
I20260709 13:06:24.088475 21756 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:24.090039 21564 leader_election.cc:304] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:24.090881 21756 raft_consensus.cc:2804] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.091378 21756 raft_consensus.cc:697] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:24.091547 21525 raft_consensus.cc:2468] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 2.
I20260709 13:06:24.092587 21756 consensus_queue.cc:237] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.107467 21756 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:24.103643 21422 catalog_manager.cc:5697] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 1 to 2, leader changed from edb1267b04f741798446a9483bfc984c (127.20.227.129) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.133498 21794 raft_consensus.cc:993] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: : Instructing follower edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:24.134217 21756 raft_consensus.cc:1081] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 LEADER]: Signalling peer edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:24.135907 21525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:58252
I20260709 13:06:24.136415 21525 raft_consensus.cc:493] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.136762 21525 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.141775 21525 raft_consensus.cc:515] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.144310 21525 leader_election.cc:290] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 2 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:24.144667 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:24.144917 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:24.145578 21599 raft_consensus.cc:3055] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.145638 21674 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.146193 21599 raft_consensus.cc:740] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:24.147183 21599 consensus_queue.cc:260] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.147781 21756 raft_consensus.cc:493] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.148556 21599 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.148309 21756 raft_consensus.cc:515] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.151511 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb1267b04f741798446a9483bfc984c" is_pre_election: true
I20260709 13:06:24.152942 21674 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 2.
I20260709 13:06:24.153945 21489 leader_election.cc:304] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:24.154786 21755 raft_consensus.cc:2804] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.155252 21755 raft_consensus.cc:697] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:24.156215 21756 leader_election.cc:290] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:24.156069 21755 consensus_queue.cc:237] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.158645 21599 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 2.
I20260709 13:06:24.160449 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4718c076590744d0baeb2a39cfb95007" is_pre_election: true
I20260709 13:06:24.161127 21674 raft_consensus.cc:2393] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c34ef797ebe34a7390e9ed21fdcd0f13 in current term 1: Already voted for candidate edb1267b04f741798446a9483bfc984c in this term.
I20260709 13:06:24.162240 21564 leader_election.cc:304] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c
I20260709 13:06:24.163026 21756 raft_consensus.cc:3060] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.164708 21419 catalog_manager.cc:5697] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 1 to 2, leader changed from c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130) to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 2 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.167872 21756 raft_consensus.cc:2749] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:24.195006 21756 consensus_queue.cc:1048] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:24.208669 21794 consensus_queue.cc:1048] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:24.233982 21525 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.249603 21723 raft_consensus.cc:993] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007: : Instructing follower edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:24.250293 21772 raft_consensus.cc:1081] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Signalling peer edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:24.251960 21525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c35009893444c80a6de470645980cdc"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:58244
I20260709 13:06:24.252539 21525 raft_consensus.cc:493] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.252970 21525 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.259692 21525 raft_consensus.cc:515] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.261863 21525 leader_election.cc:290] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 2 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:24.262830 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:24.263412 21599 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.263633 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:24.264204 21674 raft_consensus.cc:3055] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.264541 21674 raft_consensus.cc:740] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:24.265446 21674 consensus_queue.cc:260] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.266721 21674 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.268734 21599 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 2.
I20260709 13:06:24.270107 21488 leader_election.cc:304] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:24.271059 21784 raft_consensus.cc:2804] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.271533 21784 raft_consensus.cc:697] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:24.272394 21784 consensus_queue.cc:237] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.274353 21674 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 2.
I20260709 13:06:24.275365 21755 consensus_queue.cc:1048] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:24.282366 21422 catalog_manager.cc:5697] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 1 to 2, leader changed from 4718c076590744d0baeb2a39cfb95007 (127.20.227.131) to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 2 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.286345 21754 raft_consensus.cc:993] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c: : Instructing follower 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:24.287015 21754 raft_consensus.cc:1081] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Signalling peer 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:24.289052 21672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:51962
I20260709 13:06:24.289620 21672 raft_consensus.cc:493] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.290010 21672 raft_consensus.cc:3060] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.292393 21784 consensus_queue.cc:1048] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:24.300999 21672 raft_consensus.cc:515] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.302577 21674 raft_consensus.cc:1240] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Rejecting Update request from peer edb1267b04f741798446a9483bfc984c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:24.311182 21672 leader_election.cc:290] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 2 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:24.312249 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:24.312938 21525 raft_consensus.cc:3055] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.313299 21525 raft_consensus.cc:740] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:24.313879 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59aa7f458b24da1ad6db4b09760922f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:24.314530 21599 raft_consensus.cc:3060] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.314248 21525 consensus_queue.cc:260] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.315642 21525 raft_consensus.cc:3060] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.322110 21599 raft_consensus.cc:2468] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 2.
I20260709 13:06:24.322737 21525 raft_consensus.cc:2468] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 2.
I20260709 13:06:24.324033 21637 leader_election.cc:304] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:24.325073 21772 raft_consensus.cc:2804] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.325594 21772 raft_consensus.cc:697] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 2 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:24.326593 21772 consensus_queue.cc:237] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.334174 21422 catalog_manager.cc:5697] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 1 to 2, leader changed from edb1267b04f741798446a9483bfc984c (127.20.227.129) to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.358748 21723 raft_consensus.cc:993] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: : Instructing follower edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:24.359258 21802 raft_consensus.cc:1081] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Signalling peer edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:24.360927 21525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:58244
I20260709 13:06:24.361454 21525 raft_consensus.cc:493] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.361801 21525 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.372045 21525 raft_consensus.cc:515] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:24.375923 21525 leader_election.cc:290] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 2 election: Requested vote from peers 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:24.381029 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:24.381717 21672 raft_consensus.cc:3055] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.382088 21672 raft_consensus.cc:740] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:24.382756 21672 consensus_queue.cc:260] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:24.384202 21672 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.385990 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:24.386806 21599 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.389382 21802 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:24.392484 21672 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 2.
I20260709 13:06:24.395506 21489 leader_election.cc:304] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:24.396514 21599 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 2.
I20260709 13:06:24.396735 21784 raft_consensus.cc:2804] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.397387 21784 raft_consensus.cc:697] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:24.398201 21784 consensus_queue.cc:237] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:24.402541 21723 raft_consensus.cc:993] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:24.403059 21723 raft_consensus.cc:1081] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:24.410190 21723 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:24.412928 21599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374333da89f94139b162973426a321fc"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60078
I20260709 13:06:24.411947 21422 catalog_manager.cc:5697] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 1 to 2, leader changed from 4718c076590744d0baeb2a39cfb95007 (127.20.227.131) to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 2 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.413947 21599 raft_consensus.cc:493] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.414631 21599 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.434276 21599 raft_consensus.cc:515] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.436350 21600 raft_consensus.cc:1240] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Rejecting Update request from peer 4718c076590744d0baeb2a39cfb95007 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:24.436591 21755 raft_consensus.cc:993] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:24.437170 21755 raft_consensus.cc:1081] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:24.447448 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:24.448726 21772 consensus_queue.cc:1059] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:24.449823 21600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d19124bd6a934bf984627a120197ae25"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60090
I20260709 13:06:24.450407 21600 raft_consensus.cc:493] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.448046 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:24.450817 21600 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.449839 21723 raft_consensus.cc:3055] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.453364 21723 raft_consensus.cc:740] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:24.454209 21723 consensus_queue.cc:260] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.454861 21723 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.461464 21600 raft_consensus.cc:515] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.464584 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:24.466284 21525 raft_consensus.cc:3055] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.466732 21525 raft_consensus.cc:740] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:24.467664 21525 consensus_queue.cc:260] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.448351 21599 leader_election.cc:290] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:24.465703 21600 leader_election.cc:290] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:24.469097 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:24.469713 21674 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.470757 21525 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.477509 21525 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 2.
I20260709 13:06:24.477511 21674 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 2.
I20260709 13:06:24.478929 21672 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 2.
I20260709 13:06:24.479084 21564 leader_election.cc:304] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:24.480309 21760 raft_consensus.cc:2804] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.480794 21760 raft_consensus.cc:697] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:24.480962 21564 leader_election.cc:304] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: edb1267b04f741798446a9483bfc984c
I20260709 13:06:24.481958 21756 raft_consensus.cc:2804] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.481612 21760 consensus_queue.cc:237] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.482458 21756 raft_consensus.cc:697] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:24.483258 21756 consensus_queue.cc:237] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:24.492069 21419 catalog_manager.cc:5697] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 1 to 2, leader changed from edb1267b04f741798446a9483bfc984c (127.20.227.129) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.493952 21419 catalog_manager.cc:5697] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 1 to 2, leader changed from 4718c076590744d0baeb2a39cfb95007 (127.20.227.131) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.507146 21674 raft_consensus.cc:1275] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.508489 21756 consensus_queue.cc:1048] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.522469 21525 raft_consensus.cc:1275] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.524094 21806 consensus_queue.cc:1048] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.557017 21599 raft_consensus.cc:1275] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.558482 21754 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.566972 21672 raft_consensus.cc:1275] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.568581 21754 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.730953 21525 raft_consensus.cc:1275] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.732580 21723 consensus_queue.cc:1048] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.737977 21599 raft_consensus.cc:1275] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.739693 21755 consensus_queue.cc:1048] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.744504 21598 raft_consensus.cc:1275] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.747697 21772 consensus_queue.cc:1048] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.752775 21672 raft_consensus.cc:1275] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.755658 21754 consensus_queue.cc:1048] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:24.866667 21672 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.868186 21784 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.878942 21525 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.883162 21599 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.888242 21755 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.897080 21525 raft_consensus.cc:1275] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.900162 21797 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:24.907924 21672 raft_consensus.cc:1275] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.911672 21797 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:25.053368 21525 raft_consensus.cc:1275] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.054971 21806 consensus_queue.cc:1048] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:25.065079 21672 raft_consensus.cc:1275] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.069965 21794 consensus_queue.cc:1048] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.099611 21390 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:06:27.100597 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.139427 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
mode: GRACEFUL
new_leader_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:60538
I20260709 13:06:27.139912 21525 raft_consensus.cc:606] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Received request to transfer leadership to TS 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:27.153506 21599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374333da89f94139b162973426a321fc"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
mode: GRACEFUL
new_leader_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:44580
I20260709 13:06:27.154101 21599 raft_consensus.cc:606] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Received request to transfer leadership to TS 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:27.155578 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:27.156038 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:27.299422 21794 raft_consensus.cc:993] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13: : Instructing follower 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:27.299916 21815 raft_consensus.cc:1081] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Signalling peer 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:27.301898 21674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374333da89f94139b162973426a321fc"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:06:27.302521 21674 raft_consensus.cc:493] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.302879 21674 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.308281 21674 raft_consensus.cc:515] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:27.310199 21674 leader_election.cc:290] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 3 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:27.311424 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:27.311290 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:27.312042 21525 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.312069 21599 raft_consensus.cc:3055] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.312731 21599 raft_consensus.cc:740] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:27.313589 21599 consensus_queue.cc:260] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:27.314813 21599 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.318996 21525 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 3.
I20260709 13:06:27.320591 21639 leader_election.cc:304] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:27.321338 21599 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 3.
I20260709 13:06:27.321430 21804 raft_consensus.cc:2804] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:27.322939 21804 raft_consensus.cc:697] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:27.323742 21804 consensus_queue.cc:237] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:27.333237 21420 catalog_manager.cc:5697] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 2 to 3, leader changed from c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130) to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.417774 21822 raft_consensus.cc:993] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c: : Instructing follower 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:27.418310 21725 raft_consensus.cc:1081] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Signalling peer 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:27.420197 21674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:51962
I20260709 13:06:27.420687 21674 raft_consensus.cc:493] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.421000 21674 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.426656 21674 raft_consensus.cc:515] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:27.428406 21674 leader_election.cc:290] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 3 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), edb1267b04f741798446a9483bfc984c (127.20.227.129:39633)
I20260709 13:06:27.429565 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:27.429926 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:27.430270 21599 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.430521 21525 raft_consensus.cc:3055] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.430898 21525 raft_consensus.cc:740] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:27.431564 21525 consensus_queue.cc:260] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:27.432670 21525 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.435477 21599 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 3.
I20260709 13:06:27.437067 21525 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 3.
I20260709 13:06:27.436764 21637 leader_election.cc:304] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:27.438719 21804 raft_consensus.cc:2804] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:27.439332 21804 raft_consensus.cc:697] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:27.440299 21804 consensus_queue.cc:237] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:27.448802 21420 catalog_manager.cc:5697] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 2 to 3, leader changed from edb1267b04f741798446a9483bfc984c (127.20.227.129) to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.762300 21599 raft_consensus.cc:1275] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.763548 21804 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.774132 21525 raft_consensus.cc:1275] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.775434 21804 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.848109 21599 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.849435 21804 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.859602 21525 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.861368 21804 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.157068 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.167627 21674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:51974
I20260709 13:06:28.168159 21674 raft_consensus.cc:606] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:28.173488 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c35009893444c80a6de470645980cdc"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:58264
I20260709 13:06:28.173967 21525 raft_consensus.cc:606] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:28.179226 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "026363b411d14d1185eb74def8b0a694"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:58264
I20260709 13:06:28.179719 21525 raft_consensus.cc:606] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:28.185278 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:58264
I20260709 13:06:28.185791 21525 raft_consensus.cc:606] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:28.197713 21674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374333da89f94139b162973426a321fc"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
mode: GRACEFUL
new_leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:51974
I20260709 13:06:28.198280 21674 raft_consensus.cc:606] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Received request to transfer leadership to TS c34ef797ebe34a7390e9ed21fdcd0f13
I20260709 13:06:28.289793 21830 raft_consensus.cc:993] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.290258 21804 raft_consensus.cc:1081] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.291895 21599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60078
I20260709 13:06:28.292434 21599 raft_consensus.cc:493] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.292725 21599 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.296828 21599 raft_consensus.cc:515] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:28.298521 21599 leader_election.cc:290] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 4 election: Requested vote from peers 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257), edb1267b04f741798446a9483bfc984c (127.20.227.129:39633)
I20260709 13:06:28.299574 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:28.299659 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:28.300195 21674 raft_consensus.cc:3055] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:28.300308 21525 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.300536 21674 raft_consensus.cc:740] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:28.301292 21674 consensus_queue.cc:260] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:28.302260 21674 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.305919 21525 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 4.
I20260709 13:06:28.306998 21565 leader_election.cc:304] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:28.307809 21815 raft_consensus.cc:2804] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:28.307843 21674 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 4.
I20260709 13:06:28.309155 21815 raft_consensus.cc:697] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:28.309947 21815 consensus_queue.cc:237] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:28.316239 21420 catalog_manager.cc:5697] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 3 to 4, leader changed from 4718c076590744d0baeb2a39cfb95007 (127.20.227.131) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.340585 21725 raft_consensus.cc:993] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.341097 21836 raft_consensus.cc:1081] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.342049 21830 raft_consensus.cc:993] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.342515 21804 raft_consensus.cc:1081] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.343072 21599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c35009893444c80a6de470645980cdc"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60090
I20260709 13:06:28.343612 21599 raft_consensus.cc:493] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.343912 21599 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.344148 21598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374333da89f94139b162973426a321fc"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60078
I20260709 13:06:28.344645 21598 raft_consensus.cc:493] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.344990 21598 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.348227 21599 raft_consensus.cc:515] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.349664 21598 raft_consensus.cc:515] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.350039 21599 leader_election.cc:290] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 3 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:28.350831 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:28.351177 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:28.351385 21525 raft_consensus.cc:3055] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:28.351806 21598 leader_election.cc:290] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 4 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:28.351863 21525 raft_consensus.cc:740] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:28.352113 21674 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.352680 21525 consensus_queue.cc:260] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.354051 21525 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.354126 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:28.355494 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374333da89f94139b162973426a321fc" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:28.356119 21523 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.354875 21672 raft_consensus.cc:3055] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:28.359206 21672 raft_consensus.cc:740] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:28.359720 21674 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 3.
I20260709 13:06:28.360118 21672 consensus_queue.cc:260] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.361027 21525 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 3.
I20260709 13:06:28.361091 21564 leader_election.cc:304] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:28.361522 21672 raft_consensus.cc:3060] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.361915 21815 raft_consensus.cc:2804] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.362448 21815 raft_consensus.cc:697] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:28.363296 21815 consensus_queue.cc:237] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.363281 21523 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 4.
I20260709 13:06:28.365325 21565 leader_election.cc:304] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34ef797ebe34a7390e9ed21fdcd0f13, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:28.366322 21832 raft_consensus.cc:2804] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:28.368783 21832 raft_consensus.cc:697] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:28.369720 21832 consensus_queue.cc:237] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.375916 21672 raft_consensus.cc:2468] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 4.
I20260709 13:06:28.378237 21419 catalog_manager.cc:5697] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 2 to 3, leader changed from edb1267b04f741798446a9483bfc984c (127.20.227.129) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.391597 21419 catalog_manager.cc:5697] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 3 to 4, leader changed from 4718c076590744d0baeb2a39cfb95007 (127.20.227.131) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.556120 21836 raft_consensus.cc:993] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.556533 21725 raft_consensus.cc:1081] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.558187 21598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60090
I20260709 13:06:28.558645 21598 raft_consensus.cc:493] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.558916 21598 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.563410 21598 raft_consensus.cc:515] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.565529 21598 leader_election.cc:290] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 3 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:28.566256 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:28.566694 21523 raft_consensus.cc:3055] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:28.566897 21523 raft_consensus.cc:740] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:28.568527 21523 consensus_queue.cc:260] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.569476 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:28.570626 21523 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.570541 21672 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.575641 21672 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 3.
I20260709 13:06:28.576720 21564 leader_election.cc:304] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:28.577586 21815 raft_consensus.cc:2804] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.578238 21815 raft_consensus.cc:697] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:28.578994 21815 consensus_queue.cc:237] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.577917 21523 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 3.
I20260709 13:06:28.585870 21419 catalog_manager.cc:5697] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 2 to 3, leader changed from edb1267b04f741798446a9483bfc984c (127.20.227.129) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.688522 21836 raft_consensus.cc:993] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c: : Instructing follower c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.689038 21836 raft_consensus.cc:1081] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Signalling peer c34ef797ebe34a7390e9ed21fdcd0f13 to start an election
I20260709 13:06:28.690856 21598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "026363b411d14d1185eb74def8b0a694"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
 from {username='slave'} at 127.0.0.1:60090
I20260709 13:06:28.691377 21523 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:28.691591 21598 raft_consensus.cc:493] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.691995 21598 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.692955 21815 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.698244 21598 raft_consensus.cc:515] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.701297 21598 leader_election.cc:290] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:28.701339 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:28.702126 21672 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.704349 21674 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:28.705907 21815 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.706899 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:28.707491 21525 raft_consensus.cc:3055] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.707784 21525 raft_consensus.cc:740] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:28.708508 21525 consensus_queue.cc:260] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.709424 21672 raft_consensus.cc:2468] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 2.
I20260709 13:06:28.709715 21525 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.714684 21564 leader_election.cc:304] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:28.715569 21815 raft_consensus.cc:2804] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.716058 21815 raft_consensus.cc:697] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Becoming Leader. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:28.717129 21815 consensus_queue.cc:237] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:28.721240 21525 raft_consensus.cc:2468] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34ef797ebe34a7390e9ed21fdcd0f13 in term 2.
I20260709 13:06:28.727572 21419 catalog_manager.cc:5697] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 reported cstate change: term changed from 1 to 2, leader changed from edb1267b04f741798446a9483bfc984c (127.20.227.129) to c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.803755 21525 raft_consensus.cc:1275] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:28.805461 21815 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.814934 21674 raft_consensus.cc:1275] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:28.816877 21837 consensus_queue.cc:1048] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.835804 21525 raft_consensus.cc:1275] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:28.837455 21837 consensus_queue.cc:1048] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.846894 21674 raft_consensus.cc:1275] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:28.849377 21837 consensus_queue.cc:1048] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.100659 21525 raft_consensus.cc:1275] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:29.102032 21845 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.112314 21674 raft_consensus.cc:1275] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:29.115767 21845 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:29.142956 21525 raft_consensus.cc:1275] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.144411 21845 consensus_queue.cc:1048] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.153784 21674 raft_consensus.cc:1275] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Refusing update from remote peer c34ef797ebe34a7390e9ed21fdcd0f13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.155764 21832 consensus_queue.cc:1048] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.207083 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:31.215417 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "026363b411d14d1185eb74def8b0a694"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
mode: GRACEFUL
new_leader_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:44580
I20260709 13:06:31.216221 21598 raft_consensus.cc:606] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Received request to transfer leadership to TS edb1267b04f741798446a9483bfc984c
I20260709 13:06:31.219769 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
mode: GRACEFUL
new_leader_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:44580
I20260709 13:06:31.220331 21598 raft_consensus.cc:606] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 LEADER]: Received request to transfer leadership to TS edb1267b04f741798446a9483bfc984c
I20260709 13:06:31.223299 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
mode: GRACEFUL
new_leader_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:44580
I20260709 13:06:31.223829 21598 raft_consensus.cc:606] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Received request to transfer leadership to TS 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:31.227403 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c35009893444c80a6de470645980cdc"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
mode: GRACEFUL
new_leader_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:44580
I20260709 13:06:31.228060 21598 raft_consensus.cc:606] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Received request to transfer leadership to TS edb1267b04f741798446a9483bfc984c
I20260709 13:06:31.231091 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d19124bd6a934bf984627a120197ae25"
dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
mode: GRACEFUL
new_leader_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:44580
I20260709 13:06:31.231602 21598 raft_consensus.cc:606] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Received request to transfer leadership to TS 4718c076590744d0baeb2a39cfb95007
I20260709 13:06:31.232831 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:31.233556 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:31.247505 21855 raft_consensus.cc:993] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13: : Instructing follower 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:31.248040 21855 raft_consensus.cc:1081] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Signalling peer 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:31.249713 21854 raft_consensus.cc:993] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13: : Instructing follower edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:31.250160 21855 raft_consensus.cc:1081] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Signalling peer edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:31.249858 21672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d19124bd6a934bf984627a120197ae25"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:06:31.250741 21672 raft_consensus.cc:493] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.251215 21672 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.252436 21523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "026363b411d14d1185eb74def8b0a694"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:58252
I20260709 13:06:31.253017 21523 raft_consensus.cc:493] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.253319 21523 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.256996 21672 raft_consensus.cc:515] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.258833 21523 raft_consensus.cc:515] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.260282 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:31.260999 21672 leader_election.cc:290] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 3 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:31.261380 21525 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.260396 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19124bd6a934bf984627a120197ae25" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:31.261880 21523 leader_election.cc:290] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 3 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:31.262164 21598 raft_consensus.cc:3055] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:31.262534 21598 raft_consensus.cc:740] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:31.263190 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:31.263741 21674 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.263597 21598 consensus_queue.cc:260] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.265045 21598 raft_consensus.cc:3060] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.267097 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026363b411d14d1185eb74def8b0a694" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:31.267695 21599 raft_consensus.cc:3055] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:31.267973 21599 raft_consensus.cc:740] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:31.268743 21599 consensus_queue.cc:260] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.269166 21525 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 3.
I20260709 13:06:31.270190 21599 raft_consensus.cc:3060] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.270821 21639 leader_election.cc:304] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:31.271983 21804 raft_consensus.cc:2804] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:31.272127 21674 raft_consensus.cc:2468] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 3.
I20260709 13:06:31.273409 21598 raft_consensus.cc:2468] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 3.
I20260709 13:06:31.273801 21489 leader_election.cc:304] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:31.274539 21804 raft_consensus.cc:697] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:31.275588 21804 consensus_queue.cc:237] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.276701 21857 raft_consensus.cc:2804] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:31.278129 21857 raft_consensus.cc:697] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 3 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:31.278056 21599 raft_consensus.cc:2468] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 3.
I20260709 13:06:31.279203 21857 consensus_queue.cc:237] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.286599 21420 catalog_manager.cc:5697] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 2 to 3, leader changed from c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130) to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:31.287784 21419 catalog_manager.cc:5697] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 2 to 3, leader changed from c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130) to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 3 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.313748 21855 raft_consensus.cc:993] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13: : Instructing follower edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:31.314270 21845 raft_consensus.cc:1081] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Signalling peer edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:31.316035 21525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c35009893444c80a6de470645980cdc"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:58252
I20260709 13:06:31.316525 21525 raft_consensus.cc:493] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.316803 21525 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.321115 21525 raft_consensus.cc:515] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.322600 21525 leader_election.cc:290] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 4 election: Requested vote from peers c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687), 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257)
I20260709 13:06:31.323601 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:31.323710 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c35009893444c80a6de470645980cdc" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:31.324144 21599 raft_consensus.cc:3055] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.324344 21674 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.324460 21599 raft_consensus.cc:740] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:31.325314 21599 consensus_queue.cc:260] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.326222 21599 raft_consensus.cc:3060] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.328755 21674 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 4.
I20260709 13:06:31.329960 21489 leader_election.cc:304] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:31.330506 21599 raft_consensus.cc:2468] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 4.
I20260709 13:06:31.330849 21857 raft_consensus.cc:2804] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.331367 21857 raft_consensus.cc:697] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 4 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:31.332145 21857 consensus_queue.cc:237] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.338814 21419 catalog_manager.cc:5697] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 3 to 4, leader changed from c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130) to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 4 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.629508 21855 raft_consensus.cc:993] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: : Instructing follower 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:31.630162 21845 raft_consensus.cc:1081] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Signalling peer 4718c076590744d0baeb2a39cfb95007 to start an election
I20260709 13:06:31.632210 21674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7"
dest_uuid: "4718c076590744d0baeb2a39cfb95007"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:06:31.632793 21674 raft_consensus.cc:493] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.633169 21674 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.637594 21674 raft_consensus.cc:515] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.639309 21674 leader_election.cc:290] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 4 election: Requested vote from peers edb1267b04f741798446a9483bfc984c (127.20.227.129:39633), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:31.640254 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edb1267b04f741798446a9483bfc984c"
I20260709 13:06:31.640456 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ccf80beb524ef59f56c198421187c7" candidate_uuid: "4718c076590744d0baeb2a39cfb95007" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:31.640702 21845 raft_consensus.cc:993] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13: : Instructing follower edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:31.640920 21525 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.641055 21599 raft_consensus.cc:3055] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.641252 21855 raft_consensus.cc:1081] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 LEADER]: Signalling peer edb1267b04f741798446a9483bfc984c to start an election
I20260709 13:06:31.641454 21599 raft_consensus.cc:740] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:31.642277 21599 consensus_queue.cc:260] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.643183 21523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f"
dest_uuid: "edb1267b04f741798446a9483bfc984c"
 from {username='slave'} at 127.0.0.1:58252
I20260709 13:06:31.643504 21599 raft_consensus.cc:3060] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.643779 21523 raft_consensus.cc:493] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.644202 21523 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.649022 21599 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 4.
I20260709 13:06:31.649055 21525 raft_consensus.cc:2468] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4718c076590744d0baeb2a39cfb95007 in term 4.
I20260709 13:06:31.650382 21637 leader_election.cc:304] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, c34ef797ebe34a7390e9ed21fdcd0f13; no voters: 
I20260709 13:06:31.651144 21804 raft_consensus.cc:2804] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.651670 21804 raft_consensus.cc:697] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 4 LEADER]: Becoming Leader. State: Replica: 4718c076590744d0baeb2a39cfb95007, State: Running, Role: LEADER
I20260709 13:06:31.651917 21523 raft_consensus.cc:515] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:31.652426 21804 consensus_queue.cc:237] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } }
I20260709 13:06:31.654575 21523 leader_election.cc:290] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 5 election: Requested vote from peers 4718c076590744d0baeb2a39cfb95007 (127.20.227.131:46257), c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130:39687)
I20260709 13:06:31.654935 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13"
I20260709 13:06:31.654918 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331f15a816f74e3e92d79e657403d98f" candidate_uuid: "edb1267b04f741798446a9483bfc984c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4718c076590744d0baeb2a39cfb95007"
I20260709 13:06:31.655712 21599 raft_consensus.cc:3055] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:31.655946 21674 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.656118 21599 raft_consensus.cc:740] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c34ef797ebe34a7390e9ed21fdcd0f13, State: Running, Role: LEADER
I20260709 13:06:31.659092 21599 consensus_queue.cc:260] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:31.660326 21599 raft_consensus.cc:3060] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.661397 21419 catalog_manager.cc:5697] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 reported cstate change: term changed from 3 to 4, leader changed from c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130) to 4718c076590744d0baeb2a39cfb95007 (127.20.227.131). New cstate: current_term: 4 leader_uuid: "4718c076590744d0baeb2a39cfb95007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:31.662662 21674 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 5.
I20260709 13:06:31.663604 21489 leader_election.cc:304] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4718c076590744d0baeb2a39cfb95007, edb1267b04f741798446a9483bfc984c; no voters: 
I20260709 13:06:31.664350 21857 raft_consensus.cc:2804] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:31.664803 21857 raft_consensus.cc:697] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 5 LEADER]: Becoming Leader. State: Replica: edb1267b04f741798446a9483bfc984c, State: Running, Role: LEADER
I20260709 13:06:31.665726 21857 consensus_queue.cc:237] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } }
I20260709 13:06:31.666513 21599 raft_consensus.cc:2468] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb1267b04f741798446a9483bfc984c in term 5.
I20260709 13:06:31.674639 21419 catalog_manager.cc:5697] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c reported cstate change: term changed from 4 to 5, leader changed from c34ef797ebe34a7390e9ed21fdcd0f13 (127.20.227.130) to edb1267b04f741798446a9483bfc984c (127.20.227.129). New cstate: current_term: 5 leader_uuid: "edb1267b04f741798446a9483bfc984c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:31.677466 21674 raft_consensus.cc:1275] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:31.678996 21857 consensus_queue.cc:1048] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:31.690471 21599 raft_consensus.cc:1275] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:31.693032 21871 consensus_queue.cc:1048] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:31.763876 21598 raft_consensus.cc:1275] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:31.765784 21856 consensus_queue.cc:1048] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:31.775933 21523 raft_consensus.cc:1275] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:31.777770 21804 consensus_queue.cc:1048] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.785252 21674 raft_consensus.cc:1275] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:31.786623 21871 consensus_queue.cc:1048] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.797161 21598 raft_consensus.cc:1275] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:31.800112 21857 consensus_queue.cc:1048] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:32.168891 21674 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 5 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:32.170673 21871 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4718c076590744d0baeb2a39cfb95007" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:32.180081 21523 raft_consensus.cc:1275] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:32.180995 21598 raft_consensus.cc:1275] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 5 FOLLOWER]: Refusing update from remote peer edb1267b04f741798446a9483bfc984c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:32.181845 21876 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb1267b04f741798446a9483bfc984c" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:32.184389 21857 consensus_queue.cc:1048] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.195757 21598 raft_consensus.cc:1275] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Refusing update from remote peer 4718c076590744d0baeb2a39cfb95007: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:32.197765 21804 consensus_queue.cc:1048] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34ef797ebe34a7390e9ed21fdcd0f13" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:32.234501 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.239938 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
I20260709 13:06:32.274775 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:32.275570 21390 tablet_replica.cc:333] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.276988 21390 raft_consensus.cc:2243] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.277496 21390 raft_consensus.cc:2272] T b59aa7f458b24da1ad6db4b09760922f P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.279744 21390 tablet_replica.cc:333] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.280249 21390 raft_consensus.cc:2243] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.280663 21390 raft_consensus.cc:2272] T e994f715adcd4ecabe7368a37a776023 P edb1267b04f741798446a9483bfc984c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.282899 21390 tablet_replica.cc:333] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.283406 21390 raft_consensus.cc:2243] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.283787 21390 raft_consensus.cc:2272] T 77ccf80beb524ef59f56c198421187c7 P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.286091 21390 tablet_replica.cc:333] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.286545 21390 raft_consensus.cc:2243] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.287241 21390 raft_consensus.cc:2272] T 331f15a816f74e3e92d79e657403d98f P edb1267b04f741798446a9483bfc984c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.289345 21390 tablet_replica.cc:333] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.289813 21390 raft_consensus.cc:2243] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.290464 21390 raft_consensus.cc:2272] T 026363b411d14d1185eb74def8b0a694 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.292945 21390 tablet_replica.cc:333] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.293432 21390 raft_consensus.cc:2243] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.294133 21390 raft_consensus.cc:2272] T 9c35009893444c80a6de470645980cdc P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.296015 21390 tablet_replica.cc:333] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.296478 21390 raft_consensus.cc:2243] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.296823 21390 raft_consensus.cc:2272] T dc266609e4cd454b9b051376f5335192 P edb1267b04f741798446a9483bfc984c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.298517 21390 tablet_replica.cc:333] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.298921 21390 raft_consensus.cc:2243] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.299265 21390 raft_consensus.cc:2272] T 374333da89f94139b162973426a321fc P edb1267b04f741798446a9483bfc984c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.300740 21390 tablet_replica.cc:333] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c: stopping tablet replica
I20260709 13:06:32.301187 21390 raft_consensus.cc:2243] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.301539 21390 raft_consensus.cc:2272] T d19124bd6a934bf984627a120197ae25 P edb1267b04f741798446a9483bfc984c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:32.308882 21565 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:32.312245 21565 consensus_peers.cc:597] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 -> Peer edb1267b04f741798446a9483bfc984c (127.20.227.129:39633): Couldn't send request to peer edb1267b04f741798446a9483bfc984c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.428506 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
W20260709 13:06:32.430970 21639 consensus_peers.cc:597] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 -> Peer edb1267b04f741798446a9483bfc984c (127.20.227.129:39633): Couldn't send request to peer edb1267b04f741798446a9483bfc984c. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:39633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.450521 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
I20260709 13:06:32.482137 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:32.482936 21390 tablet_replica.cc:333] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.483886 21390 raft_consensus.cc:2243] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.484324 21390 raft_consensus.cc:2272] T b59aa7f458b24da1ad6db4b09760922f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.486090 21390 tablet_replica.cc:333] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.486563 21390 raft_consensus.cc:2243] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.487279 21390 raft_consensus.cc:2272] T 374333da89f94139b162973426a321fc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.488996 21390 tablet_replica.cc:333] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.489491 21390 raft_consensus.cc:2243] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.490223 21390 raft_consensus.cc:2272] T e994f715adcd4ecabe7368a37a776023 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.491823 21390 tablet_replica.cc:333] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.492264 21390 raft_consensus.cc:2243] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.492990 21390 raft_consensus.cc:2272] T dc266609e4cd454b9b051376f5335192 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.494685 21390 tablet_replica.cc:333] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.495124 21390 raft_consensus.cc:2243] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.495464 21390 raft_consensus.cc:2272] T 9c35009893444c80a6de470645980cdc P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.498361 21390 tablet_replica.cc:333] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.498814 21390 raft_consensus.cc:2243] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.499158 21390 raft_consensus.cc:2272] T d19124bd6a934bf984627a120197ae25 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.501439 21390 tablet_replica.cc:333] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.501869 21390 raft_consensus.cc:2243] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.502213 21390 raft_consensus.cc:2272] T 026363b411d14d1185eb74def8b0a694 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.504112 21390 tablet_replica.cc:333] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.504551 21390 raft_consensus.cc:2243] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.504985 21390 raft_consensus.cc:2272] T 331f15a816f74e3e92d79e657403d98f P c34ef797ebe34a7390e9ed21fdcd0f13 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.507073 21390 tablet_replica.cc:333] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13: stopping tablet replica
I20260709 13:06:32.507474 21390 raft_consensus.cc:2243] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.507805 21390 raft_consensus.cc:2272] T 77ccf80beb524ef59f56c198421187c7 P c34ef797ebe34a7390e9ed21fdcd0f13 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.536938 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
I20260709 13:06:32.553730 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
I20260709 13:06:32.578233 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:32.579177 21390 tablet_replica.cc:333] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.580125 21390 raft_consensus.cc:2243] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.580758 21390 raft_consensus.cc:2272] T e994f715adcd4ecabe7368a37a776023 P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.582621 21390 tablet_replica.cc:333] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.583104 21390 raft_consensus.cc:2243] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.583786 21390 raft_consensus.cc:2272] T b59aa7f458b24da1ad6db4b09760922f P 4718c076590744d0baeb2a39cfb95007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.585575 21390 tablet_replica.cc:333] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.586059 21390 raft_consensus.cc:2243] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.586416 21390 raft_consensus.cc:2272] T 374333da89f94139b162973426a321fc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.587965 21390 tablet_replica.cc:333] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.588378 21390 raft_consensus.cc:2243] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.589133 21390 raft_consensus.cc:2272] T 77ccf80beb524ef59f56c198421187c7 P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.590986 21390 tablet_replica.cc:333] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.591434 21390 raft_consensus.cc:2243] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.591796 21390 raft_consensus.cc:2272] T 331f15a816f74e3e92d79e657403d98f P 4718c076590744d0baeb2a39cfb95007 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.594611 21390 tablet_replica.cc:333] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.595077 21390 raft_consensus.cc:2243] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.595474 21390 raft_consensus.cc:2272] T 026363b411d14d1185eb74def8b0a694 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.597819 21390 tablet_replica.cc:333] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.598322 21390 raft_consensus.cc:2243] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.598685 21390 raft_consensus.cc:2272] T dc266609e4cd454b9b051376f5335192 P 4718c076590744d0baeb2a39cfb95007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.600337 21390 tablet_replica.cc:333] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.600787 21390 raft_consensus.cc:2243] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.601332 21390 raft_consensus.cc:2272] T 9c35009893444c80a6de470645980cdc P 4718c076590744d0baeb2a39cfb95007 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.603223 21390 tablet_replica.cc:333] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007: stopping tablet replica
I20260709 13:06:32.603698 21390 raft_consensus.cc:2243] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.604480 21390 raft_consensus.cc:2272] T d19124bd6a934bf984627a120197ae25 P 4718c076590744d0baeb2a39cfb95007 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.634166 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
I20260709 13:06:32.656598 21390 master.cc:562] Master@127.20.227.190:44029 shutting down...
I20260709 13:06:32.814200 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.814894 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.815312 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P f0874f3434cb4a3a89c48d87f4a23fbe: stopping tablet replica
I20260709 13:06:32.835826 21390 master.cc:584] Master@127.20.227.190:44029 shutdown complete.
4718c076590744d0baeb2a39cfb95007  1
c34ef797ebe34a7390e9ed21fdcd0f13  4
edb1267b04f741798446a9483bfc984c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12990 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:06:32.879181 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:35623
I20260709 13:06:32.880347 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:32.886309 21887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:32.887202 21888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:32.887653 21890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:32.887691 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:32.889039 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:32.889230 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:32.889415 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602392889401 us; error 0 us; skew 500 ppm
I20260709 13:06:32.890003 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:32.893805 21390 webserver.cc:533] Webserver started at http://127.20.227.190:44761/ using document root <none> and password file <none>
I20260709 13:06:32.894352 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:32.894519 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:32.894876 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:32.896046 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "8bef6a49689a437a8e0acaa611d627ab"
format_stamp: "Formatted at 2026-07-09 13:06:32 on dist-test-slave-078m"
I20260709 13:06:32.900672 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:06:32.904739 21895 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:32.905786 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:32.906268 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "8bef6a49689a437a8e0acaa611d627ab"
format_stamp: "Formatted at 2026-07-09 13:06:32 on dist-test-slave-078m"
I20260709 13:06:32.906571 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:32.922300 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:32.923982 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:32.970212 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:35623
I20260709 13:06:32.970305 21946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:35623 every 8 connection(s)
I20260709 13:06:32.974403 21947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:32.985061 21947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab: Bootstrap starting.
I20260709 13:06:32.990520 21947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:32.995424 21947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab: No bootstrap required, opened a new log
I20260709 13:06:32.998039 21947 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bef6a49689a437a8e0acaa611d627ab" member_type: VOTER }
I20260709 13:06:32.998457 21947 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:32.998728 21947 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bef6a49689a437a8e0acaa611d627ab, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.999339 21947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bef6a49689a437a8e0acaa611d627ab" member_type: VOTER }
I20260709 13:06:32.999807 21947 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:33.000031 21947 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:33.000316 21947 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.005079 21947 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bef6a49689a437a8e0acaa611d627ab" member_type: VOTER }
I20260709 13:06:33.005661 21947 leader_election.cc:304] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bef6a49689a437a8e0acaa611d627ab; no voters: 
I20260709 13:06:33.007107 21947 leader_election.cc:290] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:33.007543 21950 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.009188 21950 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 1 LEADER]: Becoming Leader. State: Replica: 8bef6a49689a437a8e0acaa611d627ab, State: Running, Role: LEADER
I20260709 13:06:33.009850 21950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bef6a49689a437a8e0acaa611d627ab" member_type: VOTER }
I20260709 13:06:33.010567 21947 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:33.015558 21952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bef6a49689a437a8e0acaa611d627ab. Latest consensus state: current_term: 1 leader_uuid: "8bef6a49689a437a8e0acaa611d627ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bef6a49689a437a8e0acaa611d627ab" member_type: VOTER } }
I20260709 13:06:33.016345 21952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:33.018064 21951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bef6a49689a437a8e0acaa611d627ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bef6a49689a437a8e0acaa611d627ab" member_type: VOTER } }
I20260709 13:06:33.019093 21951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:33.022670 21959 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:33.028283 21959 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:33.029349 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:33.038930 21959 catalog_manager.cc:1383] Generated new cluster ID: 6e80ec8848fd487f8fd135a8b316df8e
I20260709 13:06:33.039294 21959 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:33.060647 21959 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:33.061934 21959 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:33.074105 21959 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab: Generated new TSK 0
I20260709 13:06:33.074761 21959 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:33.096235 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:33.103487 21968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.104933 21969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.106441 21971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.107366 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:33.108429 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:33.108625 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:33.108829 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602393108810 us; error 0 us; skew 500 ppm
I20260709 13:06:33.109491 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:33.112389 21390 webserver.cc:533] Webserver started at http://127.20.227.129:39321/ using document root <none> and password file <none>
I20260709 13:06:33.113004 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:33.113235 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:33.113517 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:33.114648 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "ddf63d49bd8c464989bbcd752e01c57d"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-078m"
I20260709 13:06:33.119601 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:06:33.123747 21976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.124693 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:06:33.125205 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "ddf63d49bd8c464989bbcd752e01c57d"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-078m"
I20260709 13:06:33.125519 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:33.159899 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:33.161479 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:33.163324 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:33.165683 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:33.165931 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.166225 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:33.166476 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.210136 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:44993
I20260709 13:06:33.210220 22038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:44993 every 8 connection(s)
I20260709 13:06:33.215373 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:33.222962 22043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.225099 22044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.229169 22046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.230224 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:33.231295 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:33.231525 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:33.231757 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602393231738 us; error 0 us; skew 500 ppm
I20260709 13:06:33.232115 22039 heartbeater.cc:344] Connected to a master server at 127.20.227.190:35623
I20260709 13:06:33.232393 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:33.232468 22039 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:33.233345 22039 heartbeater.cc:507] Master 127.20.227.190:35623 requested a full tablet report, sending...
I20260709 13:06:33.235453 21390 webserver.cc:533] Webserver started at http://127.20.227.130:36937/ using document root <none> and password file <none>
I20260709 13:06:33.235940 21912 ts_manager.cc:194] Registered new tserver with Master: ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993)
I20260709 13:06:33.236153 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:33.236465 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:33.236799 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:33.238408 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "8fe3252687494580be00bcbfc0ab70dd"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-078m"
I20260709 13:06:33.238461 21912 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57222
I20260709 13:06:33.243880 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:33.247752 22051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.248807 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:06:33.249163 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "8fe3252687494580be00bcbfc0ab70dd"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-078m"
I20260709 13:06:33.249475 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:33.264973 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:33.266256 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:33.267886 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:33.270509 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:33.270717 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.271081 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:33.271236 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.315689 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:43225
I20260709 13:06:33.315793 22113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:43225 every 8 connection(s)
I20260709 13:06:33.320412 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:33.327741 22117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.328286 22118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.333079 21390 server_base.cc:1061] running on GCE node
W20260709 13:06:33.333091 22120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.334797 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:06:33.334792 22114 heartbeater.cc:344] Connected to a master server at 127.20.227.190:35623
W20260709 13:06:33.335386 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:33.335749 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602393335727 us; error 0 us; skew 500 ppm
I20260709 13:06:33.335785 22114 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:33.336508 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:33.336943 22114 heartbeater.cc:507] Master 127.20.227.190:35623 requested a full tablet report, sending...
I20260709 13:06:33.339347 21912 ts_manager.cc:194] Registered new tserver with Master: 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:33.339614 21390 webserver.cc:533] Webserver started at http://127.20.227.131:36989/ using document root <none> and password file <none>
I20260709 13:06:33.340276 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:33.340485 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:33.340795 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:33.341193 21912 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57224
I20260709 13:06:33.342144 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "e78b9651034f4e7abe3c73472158b256"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-078m"
I20260709 13:06:33.347365 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:06:33.351197 22125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.352289 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:06:33.352725 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "e78b9651034f4e7abe3c73472158b256"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-078m"
I20260709 13:06:33.353292 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:33.368830 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:33.370069 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:33.371737 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:33.374362 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:33.374569 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.374922 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:33.375079 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.421259 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:39125
I20260709 13:06:33.421363 22187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:39125 every 8 connection(s)
I20260709 13:06:33.439327 22188 heartbeater.cc:344] Connected to a master server at 127.20.227.190:35623
I20260709 13:06:33.439916 22188 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:33.440774 22188 heartbeater.cc:507] Master 127.20.227.190:35623 requested a full tablet report, sending...
I20260709 13:06:33.443740 21912 ts_manager.cc:194] Registered new tserver with Master: e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:33.445381 21912 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57240
I20260709 13:06:33.445262 21390 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019608902s
I20260709 13:06:33.477577 21912 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57250:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:33.480908 21912 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:33.557307 22153 tablet_service.cc:1511] Processing CreateTablet for tablet fcb104d4e77048ec9ea542701e5e359b (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:33.558797 22153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb104d4e77048ec9ea542701e5e359b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.561872 22152 tablet_service.cc:1511] Processing CreateTablet for tablet 99af18886b6f47f9b177ed22a51e4eca (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:33.563460 22152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99af18886b6f47f9b177ed22a51e4eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.564917 22151 tablet_service.cc:1511] Processing CreateTablet for tablet 64938268c48b4e84a6c001608630df49 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:33.567737 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64938268c48b4e84a6c001608630df49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.570565 22078 tablet_service.cc:1511] Processing CreateTablet for tablet 99af18886b6f47f9b177ed22a51e4eca (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:33.572175 22078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99af18886b6f47f9b177ed22a51e4eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.572652 22001 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4d361936bd4ac2af2584343cfd2856 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:33.574069 22001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4d361936bd4ac2af2584343cfd2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.576061 22150 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4d361936bd4ac2af2584343cfd2856 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:33.577178 22003 tablet_service.cc:1511] Processing CreateTablet for tablet 99af18886b6f47f9b177ed22a51e4eca (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:33.576047 22002 tablet_service.cc:1511] Processing CreateTablet for tablet 64938268c48b4e84a6c001608630df49 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:33.578668 22003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99af18886b6f47f9b177ed22a51e4eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.579919 22150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4d361936bd4ac2af2584343cfd2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.580994 22002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64938268c48b4e84a6c001608630df49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.581684 22004 tablet_service.cc:1511] Processing CreateTablet for tablet fcb104d4e77048ec9ea542701e5e359b (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:33.583730 22004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb104d4e77048ec9ea542701e5e359b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.586885 22077 tablet_service.cc:1511] Processing CreateTablet for tablet 64938268c48b4e84a6c001608630df49 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:33.588322 22077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64938268c48b4e84a6c001608630df49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.589294 22075 tablet_service.cc:1511] Processing CreateTablet for tablet 2170b37fa9774b89b1f29478993964e4 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:33.590466 22076 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4d361936bd4ac2af2584343cfd2856 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:33.591096 22075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2170b37fa9774b89b1f29478993964e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.591028 22149 tablet_service.cc:1511] Processing CreateTablet for tablet 2170b37fa9774b89b1f29478993964e4 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:33.591992 22076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4d361936bd4ac2af2584343cfd2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.592576 22149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2170b37fa9774b89b1f29478993964e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.568785 22079 tablet_service.cc:1511] Processing CreateTablet for tablet fcb104d4e77048ec9ea542701e5e359b (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:33.594154 22079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb104d4e77048ec9ea542701e5e359b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.597900 22074 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5a06a759f74fe98ed1beb8f2560864 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:33.599412 22074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5a06a759f74fe98ed1beb8f2560864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.599202 22148 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5a06a759f74fe98ed1beb8f2560864 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:33.600571 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5a06a759f74fe98ed1beb8f2560864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.603156 22073 tablet_service.cc:1511] Processing CreateTablet for tablet ab8e106e08204a2a94286e024ffe2ecc (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:33.604671 22073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8e106e08204a2a94286e024ffe2ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.607321 21999 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5a06a759f74fe98ed1beb8f2560864 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:33.610136 22000 tablet_service.cc:1511] Processing CreateTablet for tablet 2170b37fa9774b89b1f29478993964e4 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:33.611060 22072 tablet_service.cc:1511] Processing CreateTablet for tablet f595b5aea11942d9acd7f3c25092a159 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:33.612402 22072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f595b5aea11942d9acd7f3c25092a159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.612600 21998 tablet_service.cc:1511] Processing CreateTablet for tablet ab8e106e08204a2a94286e024ffe2ecc (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:33.615059 21997 tablet_service.cc:1511] Processing CreateTablet for tablet f595b5aea11942d9acd7f3c25092a159 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:33.618400 21996 tablet_service.cc:1511] Processing CreateTablet for tablet e6a46b0ea4644ee98eecf71dad46b225 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:33.608793 21999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5a06a759f74fe98ed1beb8f2560864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.622397 21998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8e106e08204a2a94286e024ffe2ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.624050 22000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2170b37fa9774b89b1f29478993964e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.625846 21997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f595b5aea11942d9acd7f3c25092a159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.627496 21996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a46b0ea4644ee98eecf71dad46b225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.634315 22147 tablet_service.cc:1511] Processing CreateTablet for tablet ab8e106e08204a2a94286e024ffe2ecc (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:33.634567 22071 tablet_service.cc:1511] Processing CreateTablet for tablet e6a46b0ea4644ee98eecf71dad46b225 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:33.636047 22071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a46b0ea4644ee98eecf71dad46b225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.637545 22146 tablet_service.cc:1511] Processing CreateTablet for tablet f595b5aea11942d9acd7f3c25092a159 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:33.639135 22147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8e106e08204a2a94286e024ffe2ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.647749 21995 tablet_service.cc:1511] Processing CreateTablet for tablet dd6a798acb9f4be3a184f81b6d62edb5 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:33.649317 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6a798acb9f4be3a184f81b6d62edb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.661487 22070 tablet_service.cc:1511] Processing CreateTablet for tablet dd6a798acb9f4be3a184f81b6d62edb5 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:33.662292 22145 tablet_service.cc:1511] Processing CreateTablet for tablet e6a46b0ea4644ee98eecf71dad46b225 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:33.662880 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f595b5aea11942d9acd7f3c25092a159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.663779 22070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6a798acb9f4be3a184f81b6d62edb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.673388 22145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a46b0ea4644ee98eecf71dad46b225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.719897 22144 tablet_service.cc:1511] Processing CreateTablet for tablet dd6a798acb9f4be3a184f81b6d62edb5 (DEFAULT_TABLE table=test-workload [id=2f12d0fac3614433abedd554b01078e5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:33.721963 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6a798acb9f4be3a184f81b6d62edb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.773102 22204 tablet_bootstrap.cc:492] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:33.788053 22204 tablet_bootstrap.cc:654] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.803239 22203 tablet_bootstrap.cc:492] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:33.811486 22205 tablet_bootstrap.cc:492] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:33.820106 22205 tablet_bootstrap.cc:654] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.826769 22203 tablet_bootstrap.cc:654] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.859575 22204 tablet_bootstrap.cc:492] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:33.861583 22204 ts_tablet_manager.cc:1403] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.131s	user 0.036s	sys 0.021s
I20260709 13:06:33.862183 22205 tablet_bootstrap.cc:492] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:33.862653 22205 ts_tablet_manager.cc:1403] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.051s	user 0.030s	sys 0.017s
I20260709 13:06:33.864501 22204 raft_consensus.cc:359] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.865296 22204 raft_consensus.cc:385] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.865638 22205 raft_consensus.cc:359] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.865994 22204 raft_consensus.cc:740] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.866438 22205 raft_consensus.cc:385] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.866797 22205 raft_consensus.cc:740] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.867100 22204 consensus_queue.cc:260] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.867949 22205 consensus_queue.cc:260] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.870520 22203 tablet_bootstrap.cc:492] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:33.871264 22203 ts_tablet_manager.cc:1403] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.005s
I20260709 13:06:33.876163 22203 raft_consensus.cc:359] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.876958 22203 raft_consensus.cc:385] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.877388 22203 raft_consensus.cc:740] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.877851 22039 heartbeater.cc:499] Master 127.20.227.190:35623 was elected leader, sending a full tablet report...
I20260709 13:06:33.878322 22203 consensus_queue.cc:260] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.880491 22188 heartbeater.cc:499] Master 127.20.227.190:35623 was elected leader, sending a full tablet report...
I20260709 13:06:33.881013 22205 ts_tablet_manager.cc:1434] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.011s
I20260709 13:06:33.881265 22114 heartbeater.cc:499] Master 127.20.227.190:35623 was elected leader, sending a full tablet report...
I20260709 13:06:33.882006 22205 tablet_bootstrap.cc:492] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:33.877401 22204 ts_tablet_manager.cc:1434] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:06:33.883736 22204 tablet_bootstrap.cc:492] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:33.890365 22205 tablet_bootstrap.cc:654] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.890417 22204 tablet_bootstrap.cc:654] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.894197 22203 ts_tablet_manager.cc:1434] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:06:33.895797 22203 tablet_bootstrap.cc:492] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:33.903223 22203 tablet_bootstrap.cc:654] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.915349 22203 tablet_bootstrap.cc:492] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:33.915884 22203 ts_tablet_manager.cc:1403] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:06:33.919164 22203 raft_consensus.cc:359] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.919988 22203 raft_consensus.cc:385] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.920683 22211 raft_consensus.cc:493] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.921324 22211 raft_consensus.cc:515] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.936973 22211 leader_election.cc:290] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:33.920295 22203 raft_consensus.cc:740] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.949872 22203 consensus_queue.cc:260] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.952733 22203 ts_tablet_manager.cc:1434] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:06:33.954028 22203 tablet_bootstrap.cc:492] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:33.954494 22209 raft_consensus.cc:493] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.955315 22209 raft_consensus.cc:515] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.964728 22203 tablet_bootstrap.cc:654] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.965408 22204 tablet_bootstrap.cc:492] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:33.969879 22204 ts_tablet_manager.cc:1403] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.087s	user 0.028s	sys 0.048s
I20260709 13:06:33.971776 22205 tablet_bootstrap.cc:492] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:33.973006 22209 leader_election.cc:290] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:33.972735 22204 raft_consensus.cc:359] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.973626 22204 raft_consensus.cc:385] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.973215 22205 ts_tablet_manager.cc:1403] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.091s	user 0.035s	sys 0.038s
I20260709 13:06:33.973948 22204 raft_consensus.cc:740] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.980360 22204 consensus_queue.cc:260] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.985451 22203 tablet_bootstrap.cc:492] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:33.986028 22203 ts_tablet_manager.cc:1403] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.008s
I20260709 13:06:33.986965 22204 ts_tablet_manager.cc:1434] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:06:33.988010 22204 tablet_bootstrap.cc:492] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:33.988837 22203 raft_consensus.cc:359] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.984340 22205 raft_consensus.cc:359] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.989624 22203 raft_consensus.cc:385] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.989765 22205 raft_consensus.cc:385] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.990401 22205 raft_consensus.cc:740] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.989970 22203 raft_consensus.cc:740] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.991492 22205 consensus_queue.cc:260] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:33.994637 22205 ts_tablet_manager.cc:1434] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:33.995652 22205 tablet_bootstrap.cc:492] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:33.998755 22204 tablet_bootstrap.cc:654] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.000535 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.002734 22205 tablet_bootstrap.cc:654] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:34.002904 22053 leader_election.cc:343] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:33.992038 22203 consensus_queue.cc:260] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.006601 22203 ts_tablet_manager.cc:1434] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:06:34.007606 22203 tablet_bootstrap.cc:492] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:34.012552 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4d361936bd4ac2af2584343cfd2856" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
W20260709 13:06:34.023622 21960 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:34.024763 22014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
W20260709 13:06:34.026674 22055 leader_election.cc:343] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.027330 22055 leader_election.cc:304] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd; no voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.028514 22203 tablet_bootstrap.cc:654] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.028367 22211 raft_consensus.cc:2749] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:34.026906 21977 leader_election.cc:343] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.032935 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4d361936bd4ac2af2584343cfd2856" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.036000 22204 tablet_bootstrap.cc:492] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.036612 22204 ts_tablet_manager.cc:1403] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.017s
I20260709 13:06:34.033890 22163 raft_consensus.cc:2468] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
I20260709 13:06:34.038915 21978 leader_election.cc:304] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:34.040140 22209 raft_consensus.cc:2804] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.040601 22209 raft_consensus.cc:493] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.040964 22209 raft_consensus.cc:3060] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.041049 22204 raft_consensus.cc:359] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.041994 22204 raft_consensus.cc:385] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.042220 22203 tablet_bootstrap.cc:492] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:34.042398 22204 raft_consensus.cc:740] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.042713 22203 ts_tablet_manager.cc:1403] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.013s
I20260709 13:06:34.043304 22205 tablet_bootstrap.cc:492] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.043805 22205 ts_tablet_manager.cc:1403] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.010s
I20260709 13:06:34.043790 22204 consensus_queue.cc:260] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.046087 22203 raft_consensus.cc:359] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.047017 22203 raft_consensus.cc:385] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.046936 22205 raft_consensus.cc:359] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.047554 22203 raft_consensus.cc:740] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.047814 22205 raft_consensus.cc:385] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.048159 22205 raft_consensus.cc:740] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.048910 22209 raft_consensus.cc:515] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.049063 22205 consensus_queue.cc:260] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.048720 22203 consensus_queue.cc:260] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.051411 22205 ts_tablet_manager.cc:1434] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:34.052481 22205 tablet_bootstrap.cc:492] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:34.054077 22203 ts_tablet_manager.cc:1434] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:06:34.055157 22203 tablet_bootstrap.cc:492] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:34.056442 22204 ts_tablet_manager.cc:1434] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.006s
I20260709 13:06:34.059589 22205 tablet_bootstrap.cc:654] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.060458 22204 tablet_bootstrap.cc:492] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:34.062031 22203 tablet_bootstrap.cc:654] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.068518 22210 raft_consensus.cc:493] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.069453 22204 tablet_bootstrap.cc:654] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.069284 22210 raft_consensus.cc:515] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.076751 22203 tablet_bootstrap.cc:492] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:34.077468 22203 ts_tablet_manager.cc:1403] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.006s
I20260709 13:06:34.080953 22204 tablet_bootstrap.cc:492] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.080837 22203 raft_consensus.cc:359] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.081617 22204 ts_tablet_manager.cc:1403] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:06:34.081670 22203 raft_consensus.cc:385] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.082110 22203 raft_consensus.cc:740] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.083053 22203 consensus_queue.cc:260] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.085080 22204 raft_consensus.cc:359] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.085940 22204 raft_consensus.cc:385] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.086333 22204 raft_consensus.cc:740] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.087278 22204 consensus_queue.cc:260] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.087816 22203 ts_tablet_manager.cc:1434] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:34.089037 22203 tablet_bootstrap.cc:492] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:34.090220 22204 ts_tablet_manager.cc:1434] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:06:34.091457 22204 tablet_bootstrap.cc:492] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:34.096001 22203 tablet_bootstrap.cc:654] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.098397 22204 tablet_bootstrap.cc:654] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.099174 22210 leader_election.cc:290] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.116050 22203 tablet_bootstrap.cc:492] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:34.116816 22203 ts_tablet_manager.cc:1403] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.008s
I20260709 13:06:34.121730 22203 raft_consensus.cc:359] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.122679 22224 raft_consensus.cc:493] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.122849 22203 raft_consensus.cc:385] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.123332 22203 raft_consensus.cc:740] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.123175 22224 raft_consensus.cc:515] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.124286 22203 consensus_queue.cc:260] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.125494 22224 leader_election.cc:290] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.126991 22203 ts_tablet_manager.cc:1434] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:06:34.128171 22203 tablet_bootstrap.cc:492] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:34.128232 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
W20260709 13:06:34.130167 21978 leader_election.cc:343] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.131841 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.132293 22209 leader_election.cc:290] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.132548 22089 raft_consensus.cc:2468] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
I20260709 13:06:34.134616 21977 leader_election.cc:304] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.136813 22203 tablet_bootstrap.cc:654] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.137210 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4d361936bd4ac2af2584343cfd2856" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:34.137926 22163 raft_consensus.cc:3060] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.141386 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4d361936bd4ac2af2584343cfd2856" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
W20260709 13:06:34.143651 21977 leader_election.cc:343] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.157500 22204 tablet_bootstrap.cc:492] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.158234 22204 ts_tablet_manager.cc:1403] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.010s
I20260709 13:06:34.162385 22204 raft_consensus.cc:359] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.163422 22204 raft_consensus.cc:385] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.163829 22204 raft_consensus.cc:740] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.165187 22204 consensus_queue.cc:260] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.169526 22163 raft_consensus.cc:2468] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 1.
I20260709 13:06:34.175614 22205 tablet_bootstrap.cc:492] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.170053 22224 raft_consensus.cc:2804] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.176149 22205 ts_tablet_manager.cc:1403] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.124s	user 0.055s	sys 0.066s
I20260709 13:06:34.176033 21978 leader_election.cc:304] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:34.176514 22203 tablet_bootstrap.cc:492] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:34.177035 22203 ts_tablet_manager.cc:1403] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.023s
I20260709 13:06:34.176172 22224 raft_consensus.cc:493] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.178609 22224 raft_consensus.cc:3060] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.179924 22203 raft_consensus.cc:359] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.180686 22203 raft_consensus.cc:385] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.180439 22205 raft_consensus.cc:359] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.181030 22203 raft_consensus.cc:740] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.181249 22205 raft_consensus.cc:385] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.172089 22204 ts_tablet_manager.cc:1434] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:06:34.181581 22205 raft_consensus.cc:740] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.181810 22203 consensus_queue.cc:260] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.182484 22205 consensus_queue.cc:260] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.184418 22203 ts_tablet_manager.cc:1434] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:34.185462 22203 tablet_bootstrap.cc:492] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:34.185802 22210 raft_consensus.cc:493] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.186286 22210 raft_consensus.cc:515] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.188376 22209 raft_consensus.cc:2804] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.188434 22210 leader_election.cc:290] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.195837 22205 ts_tablet_manager.cc:1434] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:06:34.196990 22205 tablet_bootstrap.cc:492] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:34.191390 22203 tablet_bootstrap.cc:654] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.201779 22014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.202409 22204 tablet_bootstrap.cc:492] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:34.191426 22224 raft_consensus.cc:515] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.205438 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.205802 22224 leader_election.cc:290] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.207154 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
W20260709 13:06:34.207437 22126 leader_election.cc:343] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.207918 22088 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 0.
I20260709 13:06:34.203166 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.203554 22205 tablet_bootstrap.cc:654] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.203778 22211 raft_consensus.cc:493] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.209580 22211 raft_consensus.cc:515] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
W20260709 13:06:34.210311 22129 leader_election.cc:343] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.210896 22204 tablet_bootstrap.cc:654] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.210763 22129 leader_election.cc:304] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78b9651034f4e7abe3c73472158b256; no voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:34.211827 22211 leader_election.cc:290] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125), ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993)
I20260709 13:06:34.203835 22209 raft_consensus.cc:697] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:34.212517 22210 raft_consensus.cc:2749] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.213106 22209 consensus_queue.cc:237] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.214517 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.214741 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.214546 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
W20260709 13:06:34.216111 22055 leader_election.cc:343] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:34.216593 22053 leader_election.cc:343] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.217044 22053 leader_election.cc:304] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd; no voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.215400 22088 raft_consensus.cc:3060] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.218127 22211 raft_consensus.cc:2749] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:34.212060 22129 leader_election.cc:343] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.209102 22203 tablet_bootstrap.cc:492] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:34.221006 22203 ts_tablet_manager.cc:1403] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.003s
I20260709 13:06:34.221324 22126 leader_election.cc:304] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:34.225106 22210 raft_consensus.cc:2804] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.225548 22210 raft_consensus.cc:493] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.225904 22210 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.228374 22211 raft_consensus.cc:493] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.228924 22211 raft_consensus.cc:515] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.226689 22203 raft_consensus.cc:359] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.230358 22203 raft_consensus.cc:385] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.230664 22203 raft_consensus.cc:740] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.230125 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:34.233227 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.231225 22211 leader_election.cc:290] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.233644 21909 catalog_manager.cc:5697] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 1 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.235215 22205 tablet_bootstrap.cc:492] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.235261 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.235926 22205 ts_tablet_manager.cc:1403] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.009s
W20260709 13:06:34.236793 21978 leader_election.cc:343] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:34.237885 22053 leader_election.cc:343] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:34.238626 22055 leader_election.cc:343] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.239053 22055 leader_election.cc:304] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd; no voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.240084 22211 raft_consensus.cc:2749] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.240063 22205 raft_consensus.cc:359] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.241478 22205 raft_consensus.cc:385] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.241984 22205 raft_consensus.cc:740] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.243255 22204 tablet_bootstrap.cc:492] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.242168 22210 raft_consensus.cc:515] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.243098 22205 consensus_queue.cc:260] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.243800 22204 ts_tablet_manager.cc:1403] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 13:06:34.249820 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.250514 22089 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.231871 22203 consensus_queue.cc:260] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.244760 22088 raft_consensus.cc:2468] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 1.
I20260709 13:06:34.246980 22210 leader_election.cc:290] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.253764 21977 leader_election.cc:304] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.248174 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:34.254715 22209 raft_consensus.cc:2804] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.255446 22209 raft_consensus.cc:697] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
W20260709 13:06:34.255826 22129 leader_election.cc:343] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.256081 22203 ts_tablet_manager.cc:1434] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:06:34.257089 22203 tablet_bootstrap.cc:492] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:34.256762 22209 consensus_queue.cc:237] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.262411 22089 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 1.
I20260709 13:06:34.263566 22203 tablet_bootstrap.cc:654] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.249217 22205 ts_tablet_manager.cc:1434] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:06:34.263698 22126 leader_election.cc:304] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:34.265066 22205 tablet_bootstrap.cc:492] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:34.265159 22239 raft_consensus.cc:2804] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.265870 22239 raft_consensus.cc:697] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:34.266253 22204 raft_consensus.cc:359] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.267002 22204 raft_consensus.cc:385] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.267328 22204 raft_consensus.cc:740] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.268075 22204 consensus_queue.cc:260] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.269270 22210 raft_consensus.cc:493] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.270694 22210 raft_consensus.cc:515] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.272536 22205 tablet_bootstrap.cc:654] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.274408 22210 leader_election.cc:290] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.267345 22239 consensus_queue.cc:237] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.270690 22204 ts_tablet_manager.cc:1434] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:06:34.277547 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.277979 22204 tablet_bootstrap.cc:492] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:34.278440 22013 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 0.
I20260709 13:06:34.281189 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.281418 22129 leader_election.cc:304] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:34.282126 22089 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 0.
I20260709 13:06:34.282909 22210 raft_consensus.cc:2804] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.284385 22210 raft_consensus.cc:493] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.290105 22210 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.309311 22204 tablet_bootstrap.cc:654] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.312188 22224 raft_consensus.cc:493] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.312940 22224 raft_consensus.cc:515] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.316849 22224 leader_election.cc:290] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.317266 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.317266 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.322402 22203 tablet_bootstrap.cc:492] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:34.322952 22203 ts_tablet_manager.cc:1403] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.014s
I20260709 13:06:34.325189 22089 raft_consensus.cc:2468] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
W20260709 13:06:34.325663 21978 leader_election.cc:343] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.325978 22203 raft_consensus.cc:359] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.326692 22203 raft_consensus.cc:385] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.326980 22203 raft_consensus.cc:740] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.327739 21977 leader_election.cc:304] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.328697 22209 raft_consensus.cc:2804] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.329337 22209 raft_consensus.cc:493] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.331139 22209 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.338974 22209 raft_consensus.cc:515] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.339278 22210 raft_consensus.cc:515] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.341253 22209 leader_election.cc:290] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.341987 22203 consensus_queue.cc:260] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.343454 22211 raft_consensus.cc:493] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.344024 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:34.344132 22211 raft_consensus.cc:515] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
W20260709 13:06:34.345628 21978 leader_election.cc:343] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.346042 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.346632 22089 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.346789 22211 leader_election.cc:290] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.348040 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4d361936bd4ac2af2584343cfd2856" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.348910 22162 raft_consensus.cc:2393] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fe3252687494580be00bcbfc0ab70dd in current term 1: Already voted for candidate ddf63d49bd8c464989bbcd752e01c57d in this term.
I20260709 13:06:34.349211 22205 tablet_bootstrap.cc:492] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.349287 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4d361936bd4ac2af2584343cfd2856" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.349745 22205 ts_tablet_manager.cc:1403] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.005s
I20260709 13:06:34.351269 22055 leader_election.cc:304] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd; no voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.352684 22211 raft_consensus.cc:3060] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.356809 22210 leader_election.cc:290] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.354110 22205 raft_consensus.cc:359] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.359315 21912 catalog_manager.cc:5697] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 0 to 1, leader changed from <none> to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.360469 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.361689 22088 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.363204 22089 raft_consensus.cc:2468] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 1.
I20260709 13:06:34.365082 22204 tablet_bootstrap.cc:492] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.365779 22204 ts_tablet_manager.cc:1403] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.009s
I20260709 13:06:34.360697 22205 raft_consensus.cc:385] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.369222 22205 raft_consensus.cc:740] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.370003 22205 consensus_queue.cc:260] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.372291 22205 ts_tablet_manager.cc:1434] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:06:34.371852 22204 raft_consensus.cc:359] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.372699 22204 raft_consensus.cc:385] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.376617 22204 raft_consensus.cc:740] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.379733 22211 raft_consensus.cc:2749] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.374444 21977 leader_election.cc:304] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.382742 22209 raft_consensus.cc:2804] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.383227 22209 raft_consensus.cc:697] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:34.384330 22205 tablet_bootstrap.cc:492] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:34.384114 22209 consensus_queue.cc:237] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.387563 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:34.388212 22013 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.388759 21909 catalog_manager.cc:5697] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 1 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.395900 22205 tablet_bootstrap.cc:654] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.398177 22204 consensus_queue.cc:260] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.402060 22203 ts_tablet_manager.cc:1434] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.079s	user 0.015s	sys 0.012s
I20260709 13:06:34.402818 22204 ts_tablet_manager.cc:1434] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 13:06:34.404237 22203 tablet_bootstrap.cc:492] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd: Bootstrap starting.
I20260709 13:06:34.404508 22211 raft_consensus.cc:493] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.405232 22211 raft_consensus.cc:515] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.408244 22211 leader_election.cc:290] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.410435 22013 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 1.
I20260709 13:06:34.411811 22088 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 1.
I20260709 13:06:34.411761 22129 leader_election.cc:304] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:34.413034 22210 raft_consensus.cc:2804] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.413244 22204 tablet_bootstrap.cc:492] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:34.413080 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.413671 22210 raft_consensus.cc:697] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:34.414718 22014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.414534 22210 consensus_queue.cc:237] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.415381 22014 raft_consensus.cc:2468] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 0.
W20260709 13:06:34.416952 22053 leader_election.cc:343] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.419504 22055 leader_election.cc:304] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.421332 22211 raft_consensus.cc:2804] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.421974 22211 raft_consensus.cc:493] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.422324 22211 raft_consensus.cc:3060] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.422502 21910 catalog_manager.cc:5697] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 1 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.431725 22211 raft_consensus.cc:515] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.438648 22203 tablet_bootstrap.cc:654] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.438584 22211 leader_election.cc:290] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.440378 22204 tablet_bootstrap.cc:654] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.441288 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:34.444312 21909 catalog_manager.cc:5697] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 0 to 1, leader changed from <none> to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.442528 22205 tablet_bootstrap.cc:492] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.446522 22205 ts_tablet_manager.cc:1403] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.004s
I20260709 13:06:34.441267 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256"
W20260709 13:06:34.448514 22053 leader_election.cc:343] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:34.445609 22013 raft_consensus.cc:3060] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.457525 22205 raft_consensus.cc:359] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.469215 22205 raft_consensus.cc:385] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.468677 22203 tablet_bootstrap.cc:492] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd: No bootstrap required, opened a new log
I20260709 13:06:34.469641 22205 raft_consensus.cc:740] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.470069 22203 ts_tablet_manager.cc:1403] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.010s
I20260709 13:06:34.470803 22204 tablet_bootstrap.cc:492] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.471274 22204 ts_tablet_manager.cc:1403] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.058s	user 0.027s	sys 0.004s
I20260709 13:06:34.470611 22205 consensus_queue.cc:260] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.473098 22203 raft_consensus.cc:359] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.473904 22203 raft_consensus.cc:385] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.473755 22204 raft_consensus.cc:359] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.474264 22203 raft_consensus.cc:740] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.474539 22204 raft_consensus.cc:385] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.475077 22204 raft_consensus.cc:740] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.475221 22203 consensus_queue.cc:260] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.475750 22204 consensus_queue.cc:260] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.477681 22204 ts_tablet_manager.cc:1434] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:06:34.478619 22204 tablet_bootstrap.cc:492] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:34.481563 22013 raft_consensus.cc:2468] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 1.
I20260709 13:06:34.483424 22055 leader_election.cc:304] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.484788 22204 tablet_bootstrap.cc:654] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.484900 22211 raft_consensus.cc:2804] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.485476 22211 raft_consensus.cc:697] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 LEADER]: Becoming Leader. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:34.486354 22211 consensus_queue.cc:237] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.488090 22203 ts_tablet_manager.cc:1434] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:34.473151 22205 ts_tablet_manager.cc:1434] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
I20260709 13:06:34.491462 22204 tablet_bootstrap.cc:492] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.492369 22204 ts_tablet_manager.cc:1403] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:06:34.493271 22205 tablet_bootstrap.cc:492] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:34.495971 22204 raft_consensus.cc:359] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.496718 22204 raft_consensus.cc:385] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.497032 22204 raft_consensus.cc:740] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.497716 22204 consensus_queue.cc:260] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.498777 22205 tablet_bootstrap.cc:654] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.500039 22204 ts_tablet_manager.cc:1434] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:34.500988 22204 tablet_bootstrap.cc:492] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: Bootstrap starting.
I20260709 13:06:34.505791 22205 tablet_bootstrap.cc:492] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.506349 22205 ts_tablet_manager.cc:1403] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:06:34.505709 21910 catalog_manager.cc:5697] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130). New cstate: current_term: 1 leader_uuid: "8fe3252687494580be00bcbfc0ab70dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.506973 22204 tablet_bootstrap.cc:654] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.511068 22205 raft_consensus.cc:359] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.511626 22205 raft_consensus.cc:385] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.511911 22205 raft_consensus.cc:740] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.512549 22205 consensus_queue.cc:260] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.514858 22205 ts_tablet_manager.cc:1434] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:34.516044 22205 tablet_bootstrap.cc:492] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:34.526058 22204 tablet_bootstrap.cc:492] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: No bootstrap required, opened a new log
I20260709 13:06:34.526492 22204 ts_tablet_manager.cc:1403] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.011s
I20260709 13:06:34.526981 22205 tablet_bootstrap.cc:654] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.528643 22204 raft_consensus.cc:359] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.529376 22204 raft_consensus.cc:385] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.529634 22204 raft_consensus.cc:740] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.530380 22204 consensus_queue.cc:260] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.532048 22205 tablet_bootstrap.cc:492] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.532116 22204 ts_tablet_manager.cc:1434] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:34.532496 22205 ts_tablet_manager.cc:1403] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:06:34.534667 22205 raft_consensus.cc:359] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.535336 22205 raft_consensus.cc:385] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.535604 22205 raft_consensus.cc:740] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.536249 22205 consensus_queue.cc:260] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.538041 22205 ts_tablet_manager.cc:1434] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:34.538856 22205 tablet_bootstrap.cc:492] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256: Bootstrap starting.
I20260709 13:06:34.543787 22205 tablet_bootstrap.cc:654] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.548393 22205 tablet_bootstrap.cc:492] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256: No bootstrap required, opened a new log
I20260709 13:06:34.548777 22205 ts_tablet_manager.cc:1403] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:06:34.551128 22205 raft_consensus.cc:359] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.551605 22205 raft_consensus.cc:385] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.551869 22205 raft_consensus.cc:740] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.552419 22205 consensus_queue.cc:260] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.553742 22210 raft_consensus.cc:493] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.554224 22205 ts_tablet_manager.cc:1434] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:34.554183 22210 raft_consensus.cc:515] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.556402 22210 leader_election.cc:290] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.557147 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.557509 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.558118 22088 raft_consensus.cc:2393] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78b9651034f4e7abe3c73472158b256 in current term 1: Already voted for candidate ddf63d49bd8c464989bbcd752e01c57d in this term.
I20260709 13:06:34.559082 22126 leader_election.cc:304] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78b9651034f4e7abe3c73472158b256; no voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:34.559732 22210 raft_consensus.cc:3060] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.564881 22210 raft_consensus.cc:2749] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.587996 22209 raft_consensus.cc:493] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.588629 22209 raft_consensus.cc:515] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.590543 22209 leader_election.cc:290] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.591344 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.591650 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.592018 22088 raft_consensus.cc:2468] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
I20260709 13:06:34.592365 22162 raft_consensus.cc:2468] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
I20260709 13:06:34.593128 21977 leader_election.cc:304] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:34.593981 22209 raft_consensus.cc:2804] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.594345 22209 raft_consensus.cc:493] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.594631 22209 raft_consensus.cc:3060] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.595439 22224 raft_consensus.cc:493] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.595925 22224 raft_consensus.cc:515] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.598587 22224 leader_election.cc:290] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.599520 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.599710 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.600262 22162 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
I20260709 13:06:34.600212 22088 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
I20260709 13:06:34.601591 21977 leader_election.cc:304] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:34.602391 22209 raft_consensus.cc:515] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.603015 22224 raft_consensus.cc:2804] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.603415 22224 raft_consensus.cc:493] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.603890 22224 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.604971 22209 leader_election.cc:290] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.605336 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.605595 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:34.605918 22088 raft_consensus.cc:3060] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.606169 22162 raft_consensus.cc:3060] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.611310 22224 raft_consensus.cc:515] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.612489 22162 raft_consensus.cc:2468] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 1.
I20260709 13:06:34.613210 22210 raft_consensus.cc:493] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.613351 22088 raft_consensus.cc:2468] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 1.
I20260709 13:06:34.613751 22210 raft_consensus.cc:515] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.614614 22224 leader_election.cc:290] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:34.615444 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:34.615844 22210 leader_election.cc:290] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.616096 22163 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.616631 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.615478 22239 raft_consensus.cc:493] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.617291 22013 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 0.
I20260709 13:06:34.617664 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.617475 22239 raft_consensus.cc:515] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.618274 22089 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 0.
I20260709 13:06:34.618678 22129 leader_election.cc:304] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:34.619738 22239 leader_election.cc:290] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993)
I20260709 13:06:34.620304 22239 raft_consensus.cc:2804] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.620674 22239 raft_consensus.cc:493] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.615918 21977 leader_election.cc:304] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:34.614869 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.620999 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.621670 22088 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.622068 22013 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 0.
I20260709 13:06:34.622525 22224 raft_consensus.cc:493] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.622977 22224 raft_consensus.cc:515] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.623479 22163 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 1.
I20260709 13:06:34.624691 22129 leader_election.cc:304] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:34.620999 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.625830 22089 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 0.
I20260709 13:06:34.626132 22209 raft_consensus.cc:2804] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.626446 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.627118 22087 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 0.
I20260709 13:06:34.627463 22209 raft_consensus.cc:697] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:34.621034 22239 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.628341 21977 leader_election.cc:304] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:34.625663 22210 raft_consensus.cc:2804] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.629285 22210 raft_consensus.cc:493] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.629457 22233 raft_consensus.cc:2804] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.629667 22210 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.629894 22233 raft_consensus.cc:493] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.630319 22233 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.630306 22088 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 1.
I20260709 13:06:34.624732 21978 leader_election.cc:304] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:34.631338 22224 leader_election.cc:290] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.628496 22209 consensus_queue.cc:237] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.635663 22239 raft_consensus.cc:515] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.638074 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256" is_pre_election: true
I20260709 13:06:34.638581 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:34.638978 22224 raft_consensus.cc:2804] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.639202 22013 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.641140 22210 raft_consensus.cc:515] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.642166 22239 leader_election.cc:290] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.641515 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.642879 22088 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.643114 22163 raft_consensus.cc:2393] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf63d49bd8c464989bbcd752e01c57d in current term 1: Already voted for candidate e78b9651034f4e7abe3c73472158b256 in this term.
I20260709 13:06:34.645690 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.646340 22087 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.647181 22013 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 1.
I20260709 13:06:34.648516 22129 leader_election.cc:304] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:34.649217 22233 raft_consensus.cc:515] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.649786 22239 raft_consensus.cc:493] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.650170 22224 raft_consensus.cc:697] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:34.650632 22239 raft_consensus.cc:515] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.651051 22224 consensus_queue.cc:237] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.653537 22239 leader_election.cc:290] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.653523 21909 catalog_manager.cc:5697] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 1 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.654670 22239 raft_consensus.cc:2804] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.655521 22239 raft_consensus.cc:697] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:34.656795 22239 consensus_queue.cc:237] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.658442 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.659847 22088 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 1.
I20260709 13:06:34.665105 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:34.666242 22163 raft_consensus.cc:2393] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf63d49bd8c464989bbcd752e01c57d in current term 1: Already voted for candidate e78b9651034f4e7abe3c73472158b256 in this term.
I20260709 13:06:34.670017 22210 leader_election.cc:290] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993)
I20260709 13:06:34.671193 22014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:34.672014 22014 raft_consensus.cc:2393] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e78b9651034f4e7abe3c73472158b256 in current term 1: Already voted for candidate ddf63d49bd8c464989bbcd752e01c57d in this term.
I20260709 13:06:34.669212 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.673997 22013 raft_consensus.cc:2393] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78b9651034f4e7abe3c73472158b256 in current term 1: Already voted for candidate 8fe3252687494580be00bcbfc0ab70dd in this term.
I20260709 13:06:34.674196 22260 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:34.676234 22233 leader_election.cc:290] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Requested vote from peers e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.676446 22129 leader_election.cc:304] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78b9651034f4e7abe3c73472158b256; no voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:34.678238 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:34.677542 22210 raft_consensus.cc:3060] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.681341 21977 leader_election.cc:304] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d; no voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256
I20260709 13:06:34.684998 22233 raft_consensus.cc:2749] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.673816 22087 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 1.
I20260709 13:06:34.687995 21911 catalog_manager.cc:5697] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 0 to 1, leader changed from <none> to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.694305 22126 leader_election.cc:304] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:34.695712 22262 raft_consensus.cc:2804] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.696310 22262 raft_consensus.cc:697] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:34.697655 22210 raft_consensus.cc:2749] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.697353 22262 consensus_queue.cc:237] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:34.701367 22239 raft_consensus.cc:493] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.701916 22239 raft_consensus.cc:515] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:34.702716 22224 consensus_queue.cc:1048] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.705154 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d" is_pre_election: true
I20260709 13:06:34.709146 21909 catalog_manager.cc:5697] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 1 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.711365 22239 leader_election.cc:290] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:34.712916 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fe3252687494580be00bcbfc0ab70dd" is_pre_election: true
I20260709 13:06:34.713936 22087 raft_consensus.cc:2393] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78b9651034f4e7abe3c73472158b256 in current term 1: Already voted for candidate ddf63d49bd8c464989bbcd752e01c57d in this term.
I20260709 13:06:34.717381 22126 leader_election.cc:304] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78b9651034f4e7abe3c73472158b256; no voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:34.722071 22210 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.746037 22013 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.748706 22209 consensus_queue.cc:1048] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.743371 22210 raft_consensus.cc:2749] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.752619 21909 catalog_manager.cc:5697] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 0 to 1, leader changed from <none> to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.755820 22210 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.762084 22272 consensus_queue.cc:1048] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:34.770311 22209 consensus_queue.cc:1048] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.805399 22224 consensus_queue.cc:1048] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.817873 22271 consensus_queue.cc:1048] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:34.847043 22262 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.858182 22260 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.927920 22211 consensus_queue.cc:1048] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.939198 22211 consensus_queue.cc:1048] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:35.019261 22162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
mode: GRACEFUL
new_leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:43546
I20260709 13:06:35.019966 22162 raft_consensus.cc:606] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Received request to transfer leadership to TS ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:35.026660 22162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
mode: GRACEFUL
new_leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:43546
I20260709 13:06:35.027285 22162 raft_consensus.cc:606] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Received request to transfer leadership to TS ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:35.044801 22162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
mode: GRACEFUL
new_leader_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:43546
I20260709 13:06:35.045575 22162 raft_consensus.cc:606] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Received request to transfer leadership to TS 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:35.051808 22162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
mode: GRACEFUL
new_leader_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:43546
I20260709 13:06:35.052338 22162 raft_consensus.cc:606] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Received request to transfer leadership to TS 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:35.067380 22013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:52940
I20260709 13:06:35.068011 22013 raft_consensus.cc:606] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Received request to transfer leadership to TS 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:35.073896 22013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:52940
I20260709 13:06:35.074581 22013 raft_consensus.cc:606] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Received request to transfer leadership to TS 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:35.089120 22087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
mode: GRACEFUL
new_leader_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:06:35.089700 22087 raft_consensus.cc:606] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 LEADER]: Received request to transfer leadership to TS e78b9651034f4e7abe3c73472158b256
I20260709 13:06:35.100193 22260 consensus_queue.cc:1048] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.107800 22239 raft_consensus.cc:993] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256: : Instructing follower ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:35.108366 22210 raft_consensus.cc:1081] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Signalling peer ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:35.110203 22014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:52934
I20260709 13:06:35.111393 22014 raft_consensus.cc:493] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.111810 22014 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.117805 22239 consensus_queue.cc:1048] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.120394 22014 raft_consensus.cc:515] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:35.125734 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:35.126390 22162 raft_consensus.cc:3055] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.126727 22162 raft_consensus.cc:740] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:35.127570 22162 consensus_queue.cc:260] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:35.128500 22162 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:35.129436 22239 consensus_queue.cc:1175] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8fe3252687494580be00bcbfc0ab70dd" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:06:35.130599 22014 leader_election.cc:290] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 2 election: Requested vote from peers e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:35.132055 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:35.132679 22087 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.134856 22162 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 2.
I20260709 13:06:35.135839 21978 leader_election.cc:304] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:35.136557 22271 raft_consensus.cc:2804] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.137038 22271 raft_consensus.cc:697] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:35.137843 22271 consensus_queue.cc:237] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:35.138852 22087 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 2.
I20260709 13:06:35.143136 22260 raft_consensus.cc:993] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: : Instructing follower ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:35.143635 22260 raft_consensus.cc:1081] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Signalling peer ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:35.145309 22014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:52934
I20260709 13:06:35.145967 22014 raft_consensus.cc:493] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.146389 22014 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.148155 21910 catalog_manager.cc:5697] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 1 to 2, leader changed from e78b9651034f4e7abe3c73472158b256 (127.20.227.131) to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 2 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.154516 22014 raft_consensus.cc:515] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.156960 22014 leader_election.cc:290] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 2 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:35.158232 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:35.158547 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:35.158838 22087 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.159126 22162 raft_consensus.cc:3055] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.159508 22162 raft_consensus.cc:740] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:35.160307 22162 consensus_queue.cc:260] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.161268 22162 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.163914 22087 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 2.
I20260709 13:06:35.165179 21977 leader_election.cc:304] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:35.165894 22271 raft_consensus.cc:2804] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.165974 22162 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 2.
I20260709 13:06:35.166335 22271 raft_consensus.cc:697] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:35.167191 22271 consensus_queue.cc:237] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.174343 22239 consensus_queue.cc:1048] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.173964 21910 catalog_manager.cc:5697] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 1 to 2, leader changed from e78b9651034f4e7abe3c73472158b256 (127.20.227.131) to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 2 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.182174 22262 raft_consensus.cc:993] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256: : Instructing follower 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.182662 22239 raft_consensus.cc:1081] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Signalling peer 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.185482 22089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:49980
I20260709 13:06:35.187271 22089 raft_consensus.cc:493] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.187749 22089 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.187549 22210 consensus_queue.cc:1048] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.194661 22089 raft_consensus.cc:515] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.200629 22089 leader_election.cc:290] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:35.201193 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:35.201802 22013 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.202793 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:35.203408 22162 raft_consensus.cc:3055] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.203729 22162 raft_consensus.cc:740] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:35.205005 22162 consensus_queue.cc:260] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.206640 22162 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.209287 22013 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.214423 22233 consensus_queue.cc:1048] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:35.214637 22055 leader_election.cc:304] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:35.214427 22162 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.215514 22282 raft_consensus.cc:2804] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.215996 22282 raft_consensus.cc:697] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Leader. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:35.216809 22282 consensus_queue.cc:237] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.224828 21910 catalog_manager.cc:5697] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd reported cstate change: term changed from 1 to 2, leader changed from e78b9651034f4e7abe3c73472158b256 (127.20.227.131) to 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130). New cstate: current_term: 2 leader_uuid: "8fe3252687494580be00bcbfc0ab70dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.235239 22271 consensus_queue.cc:1048] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.235432 22224 consensus_queue.cc:1048] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.237787 22224 consensus_queue.cc:1048] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.256543 22271 raft_consensus.cc:993] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.257267 22224 raft_consensus.cc:1081] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Signalling peer 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.259131 22087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:49972
I20260709 13:06:35.259797 22087 raft_consensus.cc:493] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.260188 22087 raft_consensus.cc:3060] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.267520 22087 raft_consensus.cc:515] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.270574 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:35.270886 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a46b0ea4644ee98eecf71dad46b225" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:35.271193 22013 raft_consensus.cc:3055] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.271490 22162 raft_consensus.cc:3060] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.271528 22013 raft_consensus.cc:740] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:35.272373 22013 consensus_queue.cc:260] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.273368 22013 raft_consensus.cc:3060] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.275679 22087 leader_election.cc:290] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:35.278268 22162 raft_consensus.cc:2468] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.279212 22013 raft_consensus.cc:2468] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.279294 22053 leader_election.cc:304] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:35.280049 22282 raft_consensus.cc:2804] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.280570 22282 raft_consensus.cc:697] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Leader. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:35.281304 22282 consensus_queue.cc:237] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.288250 21910 catalog_manager.cc:5697] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd reported cstate change: term changed from 1 to 2, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130). New cstate: current_term: 2 leader_uuid: "8fe3252687494580be00bcbfc0ab70dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.297299 22262 raft_consensus.cc:993] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256: : Instructing follower 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.297765 22262 raft_consensus.cc:1081] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Signalling peer 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.299388 22087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:49980
I20260709 13:06:35.299904 22087 raft_consensus.cc:493] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.300266 22087 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.304942 22087 raft_consensus.cc:515] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.306741 22087 leader_election.cc:290] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:35.307754 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:35.307829 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:35.308542 22162 raft_consensus.cc:3055] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.308437 22013 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.309015 22162 raft_consensus.cc:740] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:35.309827 22162 consensus_queue.cc:260] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.310791 22162 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.314132 22013 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.315444 22055 leader_election.cc:304] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:35.316012 22162 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.316242 22282 raft_consensus.cc:2804] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.316756 22282 raft_consensus.cc:697] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Leader. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:35.317845 22282 consensus_queue.cc:237] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.324343 21910 catalog_manager.cc:5697] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd reported cstate change: term changed from 1 to 2, leader changed from e78b9651034f4e7abe3c73472158b256 (127.20.227.131) to 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130). New cstate: current_term: 2 leader_uuid: "8fe3252687494580be00bcbfc0ab70dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.347506 22224 raft_consensus.cc:993] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.347996 22233 raft_consensus.cc:1081] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Signalling peer 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:35.349912 22087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:49972
I20260709 13:06:35.350500 22087 raft_consensus.cc:493] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.350891 22087 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.355782 22087 raft_consensus.cc:515] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.357496 22087 leader_election.cc:290] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:35.358642 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:35.358644 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:35.359499 22162 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.359494 22013 raft_consensus.cc:3055] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.360055 22013 raft_consensus.cc:740] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:35.360930 22013 consensus_queue.cc:260] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.362170 22013 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.366979 22162 raft_consensus.cc:2468] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.368647 22053 leader_election.cc:304] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:35.369532 22282 raft_consensus.cc:2804] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.370266 22282 raft_consensus.cc:697] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Leader. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:35.370287 22013 raft_consensus.cc:2468] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:35.371165 22282 consensus_queue.cc:237] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.379336 21910 catalog_manager.cc:5697] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd reported cstate change: term changed from 1 to 2, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130). New cstate: current_term: 2 leader_uuid: "8fe3252687494580be00bcbfc0ab70dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.392167 22247 raft_consensus.cc:993] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd: : Instructing follower e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:35.392771 22247 raft_consensus.cc:1081] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 LEADER]: Signalling peer e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:35.394469 22162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:43540
I20260709 13:06:35.394984 22162 raft_consensus.cc:493] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.395287 22162 raft_consensus.cc:3060] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.399891 22162 raft_consensus.cc:515] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.401616 22162 leader_election.cc:290] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 2 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:35.402637 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:35.402824 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6a798acb9f4be3a184f81b6d62edb5" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:35.403256 22013 raft_consensus.cc:3060] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.403405 22087 raft_consensus.cc:3055] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.403767 22087 raft_consensus.cc:740] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:35.404454 22087 consensus_queue.cc:260] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.405483 22087 raft_consensus.cc:3060] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.408989 22013 raft_consensus.cc:2468] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 2.
I20260709 13:06:35.410147 22129 leader_election.cc:304] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:35.410866 22262 raft_consensus.cc:2804] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.411270 22262 raft_consensus.cc:697] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 2 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:35.411320 22087 raft_consensus.cc:2468] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 2.
I20260709 13:06:35.412139 22262 consensus_queue.cc:237] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:35.420120 21910 catalog_manager.cc:5697] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 1 to 2, leader changed from 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130) to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.589488 22162 raft_consensus.cc:1275] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.590793 22233 consensus_queue.cc:1048] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.601634 22087 raft_consensus.cc:1275] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.603041 22209 consensus_queue.cc:1048] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.719297 22087 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.720793 22209 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:35.729792 22162 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.732843 22233 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.743969 22013 raft_consensus.cc:1275] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.745342 22247 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.755754 22162 raft_consensus.cc:1275] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.758340 22282 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.772861 22162 raft_consensus.cc:1275] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.774309 22247 consensus_queue.cc:1048] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.782763 22013 raft_consensus.cc:1275] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.787184 22247 consensus_queue.cc:1048] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.787524 22162 raft_consensus.cc:1275] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.788929 22296 consensus_queue.cc:1048] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.801883 22013 raft_consensus.cc:1275] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.803535 22247 consensus_queue.cc:1048] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.879328 22013 raft_consensus.cc:1275] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.880694 22262 consensus_queue.cc:1048] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.889495 22087 raft_consensus.cc:1275] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.891281 22262 consensus_queue.cc:1048] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:35.898885 22162 raft_consensus.cc:1275] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.900079 22282 consensus_queue.cc:1048] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.909411 22013 raft_consensus.cc:1275] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.910755 22247 consensus_queue.cc:1048] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.128753 21390 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:06:38.129487 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:38.150547 22013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:40712
I20260709 13:06:38.151346 22013 raft_consensus.cc:606] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Received request to transfer leadership to TS e78b9651034f4e7abe3c73472158b256
I20260709 13:06:38.154313 22013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:40712
I20260709 13:06:38.154860 22013 raft_consensus.cc:606] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Received request to transfer leadership to TS e78b9651034f4e7abe3c73472158b256
I20260709 13:06:38.156144 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:38.156582 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:38.223778 22271 raft_consensus.cc:993] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:38.224285 22271 raft_consensus.cc:1081] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Signalling peer e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:38.225999 22162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:43544
I20260709 13:06:38.226661 22162 raft_consensus.cc:493] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.226905 22162 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.231675 22162 raft_consensus.cc:515] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:38.233263 22162 leader_election.cc:290] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 3 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:38.234079 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:38.234323 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:38.234670 22013 raft_consensus.cc:3055] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.234967 22013 raft_consensus.cc:740] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:38.235003 22087 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.235659 22013 consensus_queue.cc:260] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:38.236521 22013 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.240420 22087 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 3.
I20260709 13:06:38.240499 22013 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 3.
I20260709 13:06:38.241855 22126 leader_election.cc:304] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:38.242621 22300 raft_consensus.cc:2804] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.244060 22300 raft_consensus.cc:697] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:38.245047 22300 consensus_queue.cc:237] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:38.252981 21910 catalog_manager.cc:5697] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 2 to 3, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.274621 22303 raft_consensus.cc:993] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:38.275125 22271 raft_consensus.cc:1081] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Signalling peer e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:38.276659 22162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:43544
I20260709 13:06:38.277310 22162 raft_consensus.cc:493] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.277635 22162 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.282097 22162 raft_consensus.cc:515] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:38.283730 22162 leader_election.cc:290] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 2 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:38.284941 22013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:38.284968 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:38.285650 22013 raft_consensus.cc:3055] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:38.285763 22087 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.286007 22013 raft_consensus.cc:740] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:38.286751 22013 consensus_queue.cc:260] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:38.287619 22013 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.291127 22087 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 2.
I20260709 13:06:38.291977 22013 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 2.
I20260709 13:06:38.292390 22126 leader_election.cc:304] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:38.293381 22300 raft_consensus.cc:2804] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:38.293735 22300 raft_consensus.cc:697] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:38.294485 22300 consensus_queue.cc:237] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:38.301332 21910 catalog_manager.cc:5697] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 1 to 2, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.682330 22087 raft_consensus.cc:1275] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.683892 22300 consensus_queue.cc:1048] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.694574 22013 raft_consensus.cc:1275] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:38.696149 22315 consensus_queue.cc:1048] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:38.802819 22013 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.804044 22300 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:38.812970 22087 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:38.815726 22306 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.157490 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:39.171607 22162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
mode: GRACEFUL
new_leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:43546
I20260709 13:06:39.172118 22162 raft_consensus.cc:606] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 LEADER]: Received request to transfer leadership to TS ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:39.183993 22162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
mode: GRACEFUL
new_leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:43546
I20260709 13:06:39.184638 22162 raft_consensus.cc:606] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 LEADER]: Received request to transfer leadership to TS ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:39.190500 22087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
mode: GRACEFUL
new_leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:06:39.191049 22087 raft_consensus.cc:606] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Received request to transfer leadership to TS ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:39.197201 22087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
mode: GRACEFUL
new_leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:06:39.197715 22087 raft_consensus.cc:606] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Received request to transfer leadership to TS ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:39.203298 22087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
mode: GRACEFUL
new_leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:06:39.203827 22087 raft_consensus.cc:606] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Received request to transfer leadership to TS ddf63d49bd8c464989bbcd752e01c57d
I20260709 13:06:39.265816 22306 raft_consensus.cc:993] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256: : Instructing follower ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.266386 22306 raft_consensus.cc:1081] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 LEADER]: Signalling peer ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.268494 22300 raft_consensus.cc:993] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: : Instructing follower ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.268373 22014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:52934
I20260709 13:06:39.269040 22300 raft_consensus.cc:1081] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 LEADER]: Signalling peer ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.269162 22014 raft_consensus.cc:493] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.269613 22014 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.270818 22013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:52934
I20260709 13:06:39.271433 22013 raft_consensus.cc:493] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.271735 22322 raft_consensus.cc:993] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd: : Instructing follower ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.271868 22013 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.272205 22318 raft_consensus.cc:1081] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Signalling peer ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.274039 22012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:52918
I20260709 13:06:39.274677 22012 raft_consensus.cc:493] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.275068 22012 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.277665 22014 raft_consensus.cc:515] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.278184 22318 raft_consensus.cc:993] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd: : Instructing follower ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.278401 22013 raft_consensus.cc:515] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.278812 22318 raft_consensus.cc:1081] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Signalling peer ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.280251 22013 leader_election.cc:290] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 4 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:39.280900 22011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:52918
I20260709 13:06:39.281313 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:39.281543 22087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:39.281580 22011 raft_consensus.cc:493] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.281890 22162 raft_consensus.cc:3055] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.282141 22011 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.282249 22162 raft_consensus.cc:740] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:39.282872 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:39.283408 22089 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.283139 22162 consensus_queue.cc:260] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.284518 22162 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.282069 22087 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.289492 22011 raft_consensus.cc:515] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.290961 22162 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 4.
I20260709 13:06:39.291427 22011 leader_election.cc:290] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:39.292825 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:39.292528 22088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:39.294190 22088 raft_consensus.cc:3055] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.294030 22012 raft_consensus.cc:515] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.294546 22088 raft_consensus.cc:740] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:39.295370 22088 consensus_queue.cc:260] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.295912 22087 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.297842 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:39.297425 22012 leader_election.cc:290] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:39.298506 22161 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.297971 22089 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 4.
I20260709 13:06:39.296586 22088 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.299154 21977 leader_election.cc:304] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:39.300043 22271 raft_consensus.cc:2804] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.301311 22086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a06a759f74fe98ed1beb8f2560864" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:39.301964 22086 raft_consensus.cc:3055] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.302314 22086 raft_consensus.cc:740] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:39.303184 22086 consensus_queue.cc:260] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.304554 22086 raft_consensus.cc:3060] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.293460 22163 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.306265 22161 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.307144 21977 leader_election.cc:304] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:39.307515 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2170b37fa9774b89b1f29478993964e4" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:39.307863 21978 leader_election.cc:304] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:39.308099 22161 raft_consensus.cc:3055] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.309686 22161 raft_consensus.cc:740] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:39.310673 22161 consensus_queue.cc:260] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.311964 22161 raft_consensus.cc:3060] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.315615 22014 leader_election.cc:290] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:39.317620 22088 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.317883 22163 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.320652 22161 raft_consensus.cc:2468] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.322574 22324 raft_consensus.cc:2804] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:39.323068 22323 raft_consensus.cc:2804] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.322552 21977 leader_election.cc:304] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, ddf63d49bd8c464989bbcd752e01c57d; no voters: 
I20260709 13:06:39.323511 22324 raft_consensus.cc:697] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:39.325692 22324 consensus_queue.cc:237] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.324395 22271 raft_consensus.cc:697] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:39.328327 22271 consensus_queue.cc:237] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.329012 22323 raft_consensus.cc:697] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:39.330132 22086 raft_consensus.cc:2468] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.331167 22323 consensus_queue.cc:237] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.332957 22325 raft_consensus.cc:2804] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.333595 22325 raft_consensus.cc:697] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:39.334609 22325 consensus_queue.cc:237] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.341873 21910 catalog_manager.cc:5697] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 2 to 3, leader changed from e78b9651034f4e7abe3c73472158b256 (127.20.227.131) to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 3 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.360797 21910 catalog_manager.cc:5697] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 3 to 4, leader changed from e78b9651034f4e7abe3c73472158b256 (127.20.227.131) to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 4 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.362362 21910 catalog_manager.cc:5697] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 2 to 3, leader changed from 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130) to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 3 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.363698 21910 catalog_manager.cc:5697] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 2 to 3, leader changed from 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130) to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 3 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.733640 22161 raft_consensus.cc:1275] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:39.735154 22325 consensus_queue.cc:1048] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.743570 22322 raft_consensus.cc:993] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd: : Instructing follower ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.744166 22322 raft_consensus.cc:1081] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Signalling peer ddf63d49bd8c464989bbcd752e01c57d to start an election
I20260709 13:06:39.746331 22014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
 from {username='slave'} at 127.0.0.1:52918
I20260709 13:06:39.746896 22014 raft_consensus.cc:493] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.747260 22086 raft_consensus.cc:1275] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:39.747298 22014 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.748944 22271 consensus_queue.cc:1048] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.756172 22014 raft_consensus.cc:515] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.759055 22014 leader_election.cc:290] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Requested vote from peers 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:39.759466 22086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:39.760068 22086 raft_consensus.cc:3055] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.759892 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f595b5aea11942d9acd7f3c25092a159" candidate_uuid: "ddf63d49bd8c464989bbcd752e01c57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:39.760537 22086 raft_consensus.cc:740] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:39.762512 22161 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.762620 22086 consensus_queue.cc:260] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.765084 22086 raft_consensus.cc:3060] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.769706 22161 raft_consensus.cc:2468] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.770900 21978 leader_election.cc:304] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf63d49bd8c464989bbcd752e01c57d, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:39.772318 22323 raft_consensus.cc:2804] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.772179 22086 raft_consensus.cc:2468] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf63d49bd8c464989bbcd752e01c57d in term 3.
I20260709 13:06:39.773330 22323 raft_consensus.cc:697] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Becoming Leader. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:39.774205 22323 consensus_queue.cc:237] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:39.774978 22088 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 4 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:39.776434 22271 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:39.783370 21911 catalog_manager.cc:5697] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d reported cstate change: term changed from 2 to 3, leader changed from 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130) to ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129). New cstate: current_term: 3 leader_uuid: "ddf63d49bd8c464989bbcd752e01c57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.785634 22161 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 4 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:39.787591 22271 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:39.868494 22161 raft_consensus.cc:1275] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:39.870029 22323 consensus_queue.cc:1048] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.877978 22088 raft_consensus.cc:1275] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:39.879510 22325 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.880018 22163 raft_consensus.cc:1275] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:39.880923 22086 raft_consensus.cc:1275] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:39.883041 22271 consensus_queue.cc:1048] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:39.881469 22323 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:40.181504 22089 raft_consensus.cc:1275] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:40.183395 22342 consensus_queue.cc:1048] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:40.196456 22161 raft_consensus.cc:1275] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Refusing update from remote peer ddf63d49bd8c464989bbcd752e01c57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:40.198947 22342 consensus_queue.cc:1048] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:42.212507 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:42.221819 22014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64938268c48b4e84a6c001608630df49"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:40712
I20260709 13:06:42.222497 22014 raft_consensus.cc:606] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Received request to transfer leadership to TS 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:42.225680 22014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:40712
I20260709 13:06:42.226249 22014 raft_consensus.cc:606] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 LEADER]: Received request to transfer leadership to TS e78b9651034f4e7abe3c73472158b256
I20260709 13:06:42.229007 22014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:40712
I20260709 13:06:42.229674 22014 raft_consensus.cc:606] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Received request to transfer leadership to TS e78b9651034f4e7abe3c73472158b256
I20260709 13:06:42.232496 22014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b"
dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
mode: GRACEFUL
new_leader_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:40712
I20260709 13:06:42.233217 22014 raft_consensus.cc:606] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Received request to transfer leadership to TS 8fe3252687494580be00bcbfc0ab70dd
I20260709 13:06:42.234282 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:42.234756 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:42.243081 22349 raft_consensus.cc:993] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:42.243752 22349 raft_consensus.cc:1081] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 LEADER]: Signalling peer e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:42.245482 22161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:43544
I20260709 13:06:42.245991 22161 raft_consensus.cc:493] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.246320 22161 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.253363 22161 raft_consensus.cc:515] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.255527 22161 leader_election.cc:290] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 5 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:42.256500 22011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:42.257253 22011 raft_consensus.cc:3055] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:42.257210 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99af18886b6f47f9b177ed22a51e4eca" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:42.257720 22011 raft_consensus.cc:740] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:42.257910 22089 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.258662 22011 consensus_queue.cc:260] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.260082 22011 raft_consensus.cc:3060] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.266019 22089 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 5.
I20260709 13:06:42.267619 22126 leader_election.cc:304] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:42.267959 22011 raft_consensus.cc:2468] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 5.
I20260709 13:06:42.268692 22348 raft_consensus.cc:2804] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:42.269701 22348 raft_consensus.cc:697] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 5 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:42.270651 22348 consensus_queue.cc:237] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.275758 22271 raft_consensus.cc:993] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:42.276199 22349 raft_consensus.cc:1081] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Signalling peer e78b9651034f4e7abe3c73472158b256 to start an election
I20260709 13:06:42.277802 22161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc"
dest_uuid: "e78b9651034f4e7abe3c73472158b256"
 from {username='slave'} at 127.0.0.1:43544
I20260709 13:06:42.278290 22161 raft_consensus.cc:493] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.278693 22161 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.278342 21909 catalog_manager.cc:5697] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 4 to 5, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 5 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.283919 22161 raft_consensus.cc:515] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.286334 22161 leader_election.cc:290] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 4 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225)
I20260709 13:06:42.287307 22011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:42.287465 22089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8e106e08204a2a94286e024ffe2ecc" candidate_uuid: "e78b9651034f4e7abe3c73472158b256" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
I20260709 13:06:42.288039 22011 raft_consensus.cc:3055] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.288131 22089 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.288306 22011 raft_consensus.cc:740] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:42.289510 22011 consensus_queue.cc:260] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.290839 22011 raft_consensus.cc:3060] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.295776 22089 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 4.
I20260709 13:06:42.297569 22126 leader_election.cc:304] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:42.298314 22011 raft_consensus.cc:2468] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78b9651034f4e7abe3c73472158b256 in term 4.
I20260709 13:06:42.298632 22348 raft_consensus.cc:2804] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.299124 22348 raft_consensus.cc:697] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 4 LEADER]: Becoming Leader. State: Replica: e78b9651034f4e7abe3c73472158b256, State: Running, Role: LEADER
I20260709 13:06:42.300117 22348 consensus_queue.cc:237] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.307439 21909 catalog_manager.cc:5697] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 reported cstate change: term changed from 3 to 4, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to e78b9651034f4e7abe3c73472158b256 (127.20.227.131). New cstate: current_term: 4 leader_uuid: "e78b9651034f4e7abe3c73472158b256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.515347 22271 raft_consensus.cc:993] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:42.515872 22349 raft_consensus.cc:1081] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Signalling peer 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:42.517555 22089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:49972
I20260709 13:06:42.518056 22089 raft_consensus.cc:493] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.518386 22089 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.523061 22089 raft_consensus.cc:515] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:42.524853 22089 leader_election.cc:290] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 3 election: Requested vote from peers e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125), ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993)
I20260709 13:06:42.525900 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:42.526024 22011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb104d4e77048ec9ea542701e5e359b" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:42.526461 22163 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.526597 22011 raft_consensus.cc:3055] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.527056 22011 raft_consensus.cc:740] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:42.527859 22011 consensus_queue.cc:260] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:42.528914 22011 raft_consensus.cc:3060] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.533033 22163 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 3.
I20260709 13:06:42.534291 22053 leader_election.cc:304] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:42.534745 22011 raft_consensus.cc:2468] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 3.
I20260709 13:06:42.535111 22322 raft_consensus.cc:2804] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.536387 22322 raft_consensus.cc:697] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 3 LEADER]: Becoming Leader. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:42.537211 22322 consensus_queue.cc:237] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } }
I20260709 13:06:42.543829 21909 catalog_manager.cc:5697] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd reported cstate change: term changed from 2 to 3, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130). New cstate: current_term: 3 leader_uuid: "8fe3252687494580be00bcbfc0ab70dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.695696 22349 raft_consensus.cc:993] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d: : Instructing follower 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:42.696280 22349 raft_consensus.cc:1081] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Signalling peer 8fe3252687494580be00bcbfc0ab70dd to start an election
I20260709 13:06:42.697805 22089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64938268c48b4e84a6c001608630df49"
dest_uuid: "8fe3252687494580be00bcbfc0ab70dd"
 from {username='slave'} at 127.0.0.1:49972
I20260709 13:06:42.698459 22089 raft_consensus.cc:493] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.698776 22089 raft_consensus.cc:3060] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.703522 22089 raft_consensus.cc:515] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.705344 22089 leader_election.cc:290] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Requested vote from peers ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993), e78b9651034f4e7abe3c73472158b256 (127.20.227.131:39125)
I20260709 13:06:42.706154 22011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf63d49bd8c464989bbcd752e01c57d"
I20260709 13:06:42.706511 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64938268c48b4e84a6c001608630df49" candidate_uuid: "8fe3252687494580be00bcbfc0ab70dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e78b9651034f4e7abe3c73472158b256"
I20260709 13:06:42.706828 22011 raft_consensus.cc:3055] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.707058 22163 raft_consensus.cc:3060] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.707177 22011 raft_consensus.cc:740] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf63d49bd8c464989bbcd752e01c57d, State: Running, Role: LEADER
I20260709 13:06:42.707944 22011 consensus_queue.cc:260] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.709156 22011 raft_consensus.cc:3060] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.712433 22163 raft_consensus.cc:2468] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:42.713636 22053 leader_election.cc:304] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe3252687494580be00bcbfc0ab70dd, e78b9651034f4e7abe3c73472158b256; no voters: 
I20260709 13:06:42.714404 22322 raft_consensus.cc:2804] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.714552 22011 raft_consensus.cc:2468] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe3252687494580be00bcbfc0ab70dd in term 2.
I20260709 13:06:42.714923 22322 raft_consensus.cc:697] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Becoming Leader. State: Replica: 8fe3252687494580be00bcbfc0ab70dd, State: Running, Role: LEADER
I20260709 13:06:42.715879 22322 consensus_queue.cc:237] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } }
I20260709 13:06:42.723664 21909 catalog_manager.cc:5697] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd reported cstate change: term changed from 1 to 2, leader changed from ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129) to 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130). New cstate: current_term: 2 leader_uuid: "8fe3252687494580be00bcbfc0ab70dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.774433 22011 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 5 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:42.775725 22348 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.778510 22089 raft_consensus.cc:1275] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 5 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:42.780050 22348 consensus_queue.cc:1048] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.790016 22086 raft_consensus.cc:1275] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 4 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:42.799336 22348 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe3252687494580be00bcbfc0ab70dd" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:42.814150 22014 raft_consensus.cc:1275] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 4 FOLLOWER]: Refusing update from remote peer e78b9651034f4e7abe3c73472158b256: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:42.816200 22348 consensus_queue.cc:1048] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:43.046962 22014 raft_consensus.cc:1275] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:43.048457 22322 consensus_queue.cc:1048] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf63d49bd8c464989bbcd752e01c57d" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 44993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:43.059906 22163 raft_consensus.cc:1275] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:43.061762 22369 consensus_queue.cc:1048] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:43.235641 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:43.241900 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
I20260709 13:06:43.252902 22163 raft_consensus.cc:1275] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Refusing update from remote peer 8fe3252687494580be00bcbfc0ab70dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.255864 22369 consensus_queue.cc:1048] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78b9651034f4e7abe3c73472158b256" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:43.269831 22055 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:06:43.273391 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:06:43.274535 22055 consensus_peers.cc:597] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd -> Peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Couldn't send request to peer ddf63d49bd8c464989bbcd752e01c57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.275596 21390 tablet_replica.cc:333] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.276492 21390 raft_consensus.cc:2243] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.277042 21390 raft_consensus.cc:2272] T 99af18886b6f47f9b177ed22a51e4eca P ddf63d49bd8c464989bbcd752e01c57d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.282287 21390 tablet_replica.cc:333] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.283130 21390 raft_consensus.cc:2243] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.283655 21390 raft_consensus.cc:2272] T fcb104d4e77048ec9ea542701e5e359b P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.286590 21390 tablet_replica.cc:333] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.287099 21390 raft_consensus.cc:2243] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.287789 21390 raft_consensus.cc:2272] T 2e5a06a759f74fe98ed1beb8f2560864 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.289666 21390 tablet_replica.cc:333] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.290153 21390 raft_consensus.cc:2243] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.290541 21390 raft_consensus.cc:2272] T dd6a798acb9f4be3a184f81b6d62edb5 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.292269 21390 tablet_replica.cc:333] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.292739 21390 raft_consensus.cc:2243] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.293147 21390 raft_consensus.cc:2272] T 64938268c48b4e84a6c001608630df49 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.294739 21390 tablet_replica.cc:333] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.295188 21390 raft_consensus.cc:2243] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.295836 21390 raft_consensus.cc:2272] T 2170b37fa9774b89b1f29478993964e4 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.297633 21390 tablet_replica.cc:333] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.298079 21390 raft_consensus.cc:2243] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.298413 21390 raft_consensus.cc:2272] T ab8e106e08204a2a94286e024ffe2ecc P ddf63d49bd8c464989bbcd752e01c57d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.300706 21390 tablet_replica.cc:333] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.301275 21390 raft_consensus.cc:2243] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.301947 21390 raft_consensus.cc:2272] T f595b5aea11942d9acd7f3c25092a159 P ddf63d49bd8c464989bbcd752e01c57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.303524 21390 tablet_replica.cc:333] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.303934 21390 raft_consensus.cc:2243] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.304324 21390 raft_consensus.cc:2272] T e6a46b0ea4644ee98eecf71dad46b225 P ddf63d49bd8c464989bbcd752e01c57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.306025 21390 tablet_replica.cc:333] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d: stopping tablet replica
I20260709 13:06:43.306479 21390 raft_consensus.cc:2243] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.307415 21390 raft_consensus.cc:2272] T 5d4d361936bd4ac2af2584343cfd2856 P ddf63d49bd8c464989bbcd752e01c57d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:43.321322 22129 consensus_peers.cc:597] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 -> Peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Couldn't send request to peer ddf63d49bd8c464989bbcd752e01c57d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.340518 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
W20260709 13:06:43.351257 22129 consensus_peers.cc:597] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 -> Peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Couldn't send request to peer ddf63d49bd8c464989bbcd752e01c57d. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:44993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.363636 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
W20260709 13:06:43.379076 22126 consensus_peers.cc:597] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 -> Peer 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225): Couldn't send request to peer 8fe3252687494580be00bcbfc0ab70dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.397130 22055 consensus_peers.cc:597] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd -> Peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Couldn't send request to peer ddf63d49bd8c464989bbcd752e01c57d. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:44993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.399495 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:43.400399 21390 tablet_replica.cc:333] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.401399 21390 raft_consensus.cc:2243] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.401974 21390 raft_consensus.cc:2272] T f595b5aea11942d9acd7f3c25092a159 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:43.403529 22129 consensus_peers.cc:597] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 -> Peer ddf63d49bd8c464989bbcd752e01c57d (127.20.227.129:44993): Couldn't send request to peer ddf63d49bd8c464989bbcd752e01c57d. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:44993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.404436 21390 tablet_replica.cc:333] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.405053 21390 raft_consensus.cc:2243] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.405614 21390 raft_consensus.cc:2272] T 5d4d361936bd4ac2af2584343cfd2856 P 8fe3252687494580be00bcbfc0ab70dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.407379 21390 tablet_replica.cc:333] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.407855 21390 raft_consensus.cc:2243] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.408712 21390 raft_consensus.cc:2272] T e6a46b0ea4644ee98eecf71dad46b225 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.410576 21390 tablet_replica.cc:333] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.411134 21390 raft_consensus.cc:2243] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.411599 21390 raft_consensus.cc:2272] T 2e5a06a759f74fe98ed1beb8f2560864 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.413743 21390 tablet_replica.cc:333] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.414276 21390 raft_consensus.cc:2243] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.414840 21390 raft_consensus.cc:2272] T dd6a798acb9f4be3a184f81b6d62edb5 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.416591 21390 tablet_replica.cc:333] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.417171 21390 raft_consensus.cc:2243] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.417898 21390 raft_consensus.cc:2272] T fcb104d4e77048ec9ea542701e5e359b P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.420246 21390 tablet_replica.cc:333] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.420738 21390 raft_consensus.cc:2243] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.421233 21390 raft_consensus.cc:2272] T 99af18886b6f47f9b177ed22a51e4eca P 8fe3252687494580be00bcbfc0ab70dd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.423426 21390 tablet_replica.cc:333] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.423952 21390 raft_consensus.cc:2243] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.424377 21390 raft_consensus.cc:2272] T 2170b37fa9774b89b1f29478993964e4 P 8fe3252687494580be00bcbfc0ab70dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.426119 21390 tablet_replica.cc:333] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.426607 21390 raft_consensus.cc:2243] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.427026 21390 raft_consensus.cc:2272] T ab8e106e08204a2a94286e024ffe2ecc P 8fe3252687494580be00bcbfc0ab70dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.429203 21390 tablet_replica.cc:333] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd: stopping tablet replica
I20260709 13:06:43.429837 21390 raft_consensus.cc:2243] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.430564 21390 raft_consensus.cc:2272] T 64938268c48b4e84a6c001608630df49 P 8fe3252687494580be00bcbfc0ab70dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.452550 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
I20260709 13:06:43.471796 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
W20260709 13:06:43.484711 22126 consensus_peers.cc:597] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 -> Peer 8fe3252687494580be00bcbfc0ab70dd (127.20.227.130:43225): Couldn't send request to peer 8fe3252687494580be00bcbfc0ab70dd. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:43225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.498528 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:43.499182 21390 tablet_replica.cc:333] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.499840 21390 raft_consensus.cc:2243] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.500403 21390 raft_consensus.cc:2272] T 2e5a06a759f74fe98ed1beb8f2560864 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.502429 21390 tablet_replica.cc:333] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.502990 21390 raft_consensus.cc:2243] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.503720 21390 raft_consensus.cc:2272] T dd6a798acb9f4be3a184f81b6d62edb5 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.505543 21390 tablet_replica.cc:333] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.506058 21390 raft_consensus.cc:2243] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.506489 21390 raft_consensus.cc:2272] T f595b5aea11942d9acd7f3c25092a159 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.508045 21390 tablet_replica.cc:333] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.508611 21390 raft_consensus.cc:2243] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.509171 21390 raft_consensus.cc:2272] T fcb104d4e77048ec9ea542701e5e359b P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.512068 21390 tablet_replica.cc:333] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.512552 21390 raft_consensus.cc:2243] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.512993 21390 raft_consensus.cc:2272] T 64938268c48b4e84a6c001608630df49 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.514988 21390 tablet_replica.cc:333] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.515458 21390 raft_consensus.cc:2243] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.516134 21390 raft_consensus.cc:2272] T ab8e106e08204a2a94286e024ffe2ecc P e78b9651034f4e7abe3c73472158b256 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.518224 21390 tablet_replica.cc:333] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.518792 21390 raft_consensus.cc:2243] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.519171 21390 raft_consensus.cc:2272] T 2170b37fa9774b89b1f29478993964e4 P e78b9651034f4e7abe3c73472158b256 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.520825 21390 tablet_replica.cc:333] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.521365 21390 raft_consensus.cc:2243] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.522001 21390 raft_consensus.cc:2272] T 99af18886b6f47f9b177ed22a51e4eca P e78b9651034f4e7abe3c73472158b256 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.524093 21390 tablet_replica.cc:333] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.524605 21390 raft_consensus.cc:2243] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.525079 21390 raft_consensus.cc:2272] T e6a46b0ea4644ee98eecf71dad46b225 P e78b9651034f4e7abe3c73472158b256 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.526666 21390 tablet_replica.cc:333] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256: stopping tablet replica
I20260709 13:06:43.527127 21390 raft_consensus.cc:2243] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:43.527518 21390 raft_consensus.cc:2272] T 5d4d361936bd4ac2af2584343cfd2856 P e78b9651034f4e7abe3c73472158b256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.556429 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
I20260709 13:06:43.574558 21390 master.cc:562] Master@127.20.227.190:35623 shutting down...
I20260709 13:06:43.598168 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:43.598836 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:43.599236 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8bef6a49689a437a8e0acaa611d627ab: stopping tablet replica
I20260709 13:06:43.621076 21390 master.cc:584] Master@127.20.227.190:35623 shutdown complete.
8fe3252687494580be00bcbfc0ab70dd  4
ddf63d49bd8c464989bbcd752e01c57d  5
e78b9651034f4e7abe3c73472158b256  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10786 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:06:43.666378 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:45599
I20260709 13:06:43.667589 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:43.673935 22379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:43.674046 22378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:43.675450 22381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:43.676745 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:43.678110 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:43.678413 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:43.678547 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602403678535 us; error 0 us; skew 500 ppm
I20260709 13:06:43.679044 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:43.682305 21390 webserver.cc:533] Webserver started at http://127.20.227.190:43083/ using document root <none> and password file <none>
I20260709 13:06:43.682811 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:43.683027 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:43.683548 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:43.684839 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "b97e77c8afed466a990720a609bf1968"
format_stamp: "Formatted at 2026-07-09 13:06:43 on dist-test-slave-078m"
I20260709 13:06:43.689832 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:43.694547 22386 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:43.695416 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:43.695737 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "b97e77c8afed466a990720a609bf1968"
format_stamp: "Formatted at 2026-07-09 13:06:43 on dist-test-slave-078m"
I20260709 13:06:43.696049 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:43.707755 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:43.709084 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:43.758910 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:45599
I20260709 13:06:43.759104 22437 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:45599 every 8 connection(s)
I20260709 13:06:43.763064 22438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.774267 22438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Bootstrap starting.
I20260709 13:06:43.779183 22438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.783946 22438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: No bootstrap required, opened a new log
I20260709 13:06:43.786239 22438 raft_consensus.cc:359] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97e77c8afed466a990720a609bf1968" member_type: VOTER }
I20260709 13:06:43.786646 22438 raft_consensus.cc:385] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.786932 22438 raft_consensus.cc:740] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97e77c8afed466a990720a609bf1968, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.787537 22438 consensus_queue.cc:260] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97e77c8afed466a990720a609bf1968" member_type: VOTER }
I20260709 13:06:43.788017 22438 raft_consensus.cc:399] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:43.788228 22438 raft_consensus.cc:493] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:43.788522 22438 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:43.792822 22438 raft_consensus.cc:515] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97e77c8afed466a990720a609bf1968" member_type: VOTER }
I20260709 13:06:43.793423 22438 leader_election.cc:304] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b97e77c8afed466a990720a609bf1968; no voters: 
I20260709 13:06:43.794683 22438 leader_election.cc:290] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:43.795140 22441 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:43.796504 22441 raft_consensus.cc:697] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 1 LEADER]: Becoming Leader. State: Replica: b97e77c8afed466a990720a609bf1968, State: Running, Role: LEADER
I20260709 13:06:43.797348 22441 consensus_queue.cc:237] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97e77c8afed466a990720a609bf1968" member_type: VOTER }
I20260709 13:06:43.797771 22438 sys_catalog.cc:565] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:43.804191 22443 sys_catalog.cc:455] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b97e77c8afed466a990720a609bf1968. Latest consensus state: current_term: 1 leader_uuid: "b97e77c8afed466a990720a609bf1968" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97e77c8afed466a990720a609bf1968" member_type: VOTER } }
I20260709 13:06:43.804749 22443 sys_catalog.cc:458] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:43.805053 22442 sys_catalog.cc:455] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b97e77c8afed466a990720a609bf1968" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97e77c8afed466a990720a609bf1968" member_type: VOTER } }
I20260709 13:06:43.805593 22442 sys_catalog.cc:458] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:43.811463 22450 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:43.816462 22450 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:43.817567 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:43.826423 22450 catalog_manager.cc:1383] Generated new cluster ID: 32df32820b5447b49973b1e32f7789e5
I20260709 13:06:43.826750 22450 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:43.853941 22450 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:43.855400 22450 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:43.870782 22450 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Generated new TSK 0
I20260709 13:06:43.871562 22450 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:43.884749 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:43.891592 22459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:43.892952 22460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:43.894515 22462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:43.894649 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:43.895697 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:43.895947 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:43.896114 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602403896097 us; error 0 us; skew 500 ppm
I20260709 13:06:43.896682 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:43.899890 21390 webserver.cc:533] Webserver started at http://127.20.227.129:37561/ using document root <none> and password file <none>
I20260709 13:06:43.900398 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:43.900658 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:43.901007 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:43.902231 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "6ca917eaada84bf38a5daae9f8ffa066"
format_stamp: "Formatted at 2026-07-09 13:06:43 on dist-test-slave-078m"
I20260709 13:06:43.907091 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:06:43.910784 22467 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:43.912101 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:06:43.912616 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "6ca917eaada84bf38a5daae9f8ffa066"
format_stamp: "Formatted at 2026-07-09 13:06:43 on dist-test-slave-078m"
I20260709 13:06:43.912966 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:43.945719 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:43.947073 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:43.948618 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:43.951082 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:43.951310 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:43.951572 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:43.951771 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:43.995735 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:38445
I20260709 13:06:43.995831 22529 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:38445 every 8 connection(s)
I20260709 13:06:44.001178 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:44.009444 22535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:44.010202 22534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:44.014119 22537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:44.015216 21390 server_base.cc:1061] running on GCE node
I20260709 13:06:44.016451 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:44.016705 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:44.016924 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602404016903 us; error 0 us; skew 500 ppm
I20260709 13:06:44.017608 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:44.020057 22530 heartbeater.cc:344] Connected to a master server at 127.20.227.190:45599
I20260709 13:06:44.020567 22530 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:44.021234 21390 webserver.cc:533] Webserver started at http://127.20.227.130:44375/ using document root <none> and password file <none>
I20260709 13:06:44.021684 22530 heartbeater.cc:507] Master 127.20.227.190:45599 requested a full tablet report, sending...
I20260709 13:06:44.021785 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:44.022193 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:44.022574 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:44.024089 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "691cccbd0258483ebe19e1581674cc94"
format_stamp: "Formatted at 2026-07-09 13:06:44 on dist-test-slave-078m"
I20260709 13:06:44.024521 22403 ts_manager.cc:194] Registered new tserver with Master: 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:06:44.026432 22403 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37524
I20260709 13:06:44.029645 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:44.033671 22542 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:44.034616 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:06:44.034948 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "691cccbd0258483ebe19e1581674cc94"
format_stamp: "Formatted at 2026-07-09 13:06:44 on dist-test-slave-078m"
I20260709 13:06:44.035259 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:44.073415 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:44.074832 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:44.077008 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:44.079989 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:44.080300 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:44.080575 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:44.080770 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:44.128269 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:41465
I20260709 13:06:44.128360 22604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:41465 every 8 connection(s)
I20260709 13:06:44.133285 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:44.142509 22608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:44.143644 22609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:44.147188 21390 server_base.cc:1061] running on GCE node
W20260709 13:06:44.147658 22611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:44.148379 22605 heartbeater.cc:344] Connected to a master server at 127.20.227.190:45599
I20260709 13:06:44.148736 22605 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:44.148790 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:44.149178 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:44.149353 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602404149338 us; error 0 us; skew 500 ppm
I20260709 13:06:44.149750 22605 heartbeater.cc:507] Master 127.20.227.190:45599 requested a full tablet report, sending...
I20260709 13:06:44.150099 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:44.152164 22403 ts_manager.cc:194] Registered new tserver with Master: 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:44.153307 21390 webserver.cc:533] Webserver started at http://127.20.227.131:35735/ using document root <none> and password file <none>
I20260709 13:06:44.153954 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:44.154083 22403 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37530
I20260709 13:06:44.154196 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:44.154628 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:44.155979 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
format_stamp: "Formatted at 2026-07-09 13:06:44 on dist-test-slave-078m"
I20260709 13:06:44.161080 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 13:06:44.164813 22616 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:44.165843 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:44.166131 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
format_stamp: "Formatted at 2026-07-09 13:06:44 on dist-test-slave-078m"
I20260709 13:06:44.166493 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:44.181836 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:44.183043 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:44.184497 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:44.186811 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:44.187006 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:44.187186 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:44.187312 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:44.231717 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:35857
I20260709 13:06:44.231838 22678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:35857 every 8 connection(s)
I20260709 13:06:44.249290 22679 heartbeater.cc:344] Connected to a master server at 127.20.227.190:45599
I20260709 13:06:44.249758 22679 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:44.250607 22679 heartbeater.cc:507] Master 127.20.227.190:45599 requested a full tablet report, sending...
I20260709 13:06:44.253131 22403 ts_manager.cc:194] Registered new tserver with Master: 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:44.253322 21390 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018172218s
I20260709 13:06:44.254632 22403 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37546
I20260709 13:06:44.283423 22403 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37562:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:44.289754 22403 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:44.512950 22493 tablet_service.cc:1511] Processing CreateTablet for tablet 0a60725e5550479db8d1e52b48126750 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:44.513839 22491 tablet_service.cc:1511] Processing CreateTablet for tablet ea7bfa694a734e68806da48189a7e004 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:44.514070 22644 tablet_service.cc:1511] Processing CreateTablet for tablet 5314aa61dd7f4a7f9b148f71ea5055c4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:44.514988 22495 tablet_service.cc:1511] Processing CreateTablet for tablet 5314aa61dd7f4a7f9b148f71ea5055c4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:44.515570 22644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5314aa61dd7f4a7f9b148f71ea5055c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.516390 22638 tablet_service.cc:1511] Processing CreateTablet for tablet 8852a51dd9a84948bed8ee87ae7a9f21 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:44.518096 22638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8852a51dd9a84948bed8ee87ae7a9f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.518033 22639 tablet_service.cc:1511] Processing CreateTablet for tablet f0e2410740c9458db983018bbe19dcbf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:44.519868 22639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e2410740c9458db983018bbe19dcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.522027 22490 tablet_service.cc:1511] Processing CreateTablet for tablet f0e2410740c9458db983018bbe19dcbf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:44.522121 22640 tablet_service.cc:1511] Processing CreateTablet for tablet ea7bfa694a734e68806da48189a7e004 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:44.524362 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 8852a51dd9a84948bed8ee87ae7a9f21 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:44.524569 22641 tablet_service.cc:1511] Processing CreateTablet for tablet a14caf28740540799ba1c6db058346a1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:44.526650 22488 tablet_service.cc:1511] Processing CreateTablet for tablet 78833bb30a8347f19e5f2696aacc31e1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:44.526932 22642 tablet_service.cc:1511] Processing CreateTablet for tablet 0a60725e5550479db8d1e52b48126750 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:44.516570 22492 tablet_service.cc:1511] Processing CreateTablet for tablet a14caf28740540799ba1c6db058346a1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:44.529178 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 0498259251e24450b91d38bfc4b83dbf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:44.529738 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a60725e5550479db8d1e52b48126750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.530431 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7bfa694a734e68806da48189a7e004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.531050 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8852a51dd9a84948bed8ee87ae7a9f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.531694 22488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78833bb30a8347f19e5f2696aacc31e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.531492 22643 tablet_service.cc:1511] Processing CreateTablet for tablet 0498259251e24450b91d38bfc4b83dbf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:44.532788 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e2410740c9458db983018bbe19dcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.533453 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0498259251e24450b91d38bfc4b83dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.537511 22487 tablet_service.cc:1511] Processing CreateTablet for tablet acc845449beb4f859e55185200f34bd2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:44.538295 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a60725e5550479db8d1e52b48126750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.537552 22495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5314aa61dd7f4a7f9b148f71ea5055c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.539685 22643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0498259251e24450b91d38bfc4b83dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.541250 22641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14caf28740540799ba1c6db058346a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.542604 22640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7bfa694a734e68806da48189a7e004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.543053 22487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc845449beb4f859e55185200f34bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.544112 22492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14caf28740540799ba1c6db058346a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.549609 22486 tablet_service.cc:1511] Processing CreateTablet for tablet 3eac3c624e2c43fc9505fe5c344151d0 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:44.551054 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eac3c624e2c43fc9505fe5c344151d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.574637 22637 tablet_service.cc:1511] Processing CreateTablet for tablet 78833bb30a8347f19e5f2696aacc31e1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:44.576260 22637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78833bb30a8347f19e5f2696aacc31e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.578510 22636 tablet_service.cc:1511] Processing CreateTablet for tablet acc845449beb4f859e55185200f34bd2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:44.579901 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc845449beb4f859e55185200f34bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.590482 22635 tablet_service.cc:1511] Processing CreateTablet for tablet 3eac3c624e2c43fc9505fe5c344151d0 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:44.592022 22635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eac3c624e2c43fc9505fe5c344151d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.612130 22641 tablet_service.cc:1511] Processing CreateTablet for tablet be7264d3053b44989c5504d296ea482b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:44.613574 22641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be7264d3053b44989c5504d296ea482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.618120 22642 tablet_service.cc:1511] Processing CreateTablet for tablet 799bdeb956cf4c76aa244c0f5bbc89c2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:44.619531 22635 tablet_service.cc:1511] Processing CreateTablet for tablet 401fe414b8f443bebfed8254895d71c3 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:44.620023 22488 tablet_service.cc:1511] Processing CreateTablet for tablet be7264d3053b44989c5504d296ea482b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:44.621510 22488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be7264d3053b44989c5504d296ea482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.623529 22639 tablet_service.cc:1511] Processing CreateTablet for tablet 33d734b2b43a40138a8a0ee22b30d9ba (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:44.626963 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 799bdeb956cf4c76aa244c0f5bbc89c2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:44.635108 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bdeb956cf4c76aa244c0f5bbc89c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.620095 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bdeb956cf4c76aa244c0f5bbc89c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.644009 22694 tablet_bootstrap.cc:492] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:44.651616 22640 tablet_service.cc:1511] Processing CreateTablet for tablet 31de2edeb38841bfa9edd362c910f0f7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:44.657191 22639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d734b2b43a40138a8a0ee22b30d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.660032 22492 tablet_service.cc:1511] Processing CreateTablet for tablet 401fe414b8f443bebfed8254895d71c3 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:44.674582 22635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401fe414b8f443bebfed8254895d71c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.681231 22640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31de2edeb38841bfa9edd362c910f0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.691215 22643 tablet_service.cc:1511] Processing CreateTablet for tablet 34b4979f789f48d0807b87e7a48b9a78 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:44.692682 22643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b4979f789f48d0807b87e7a48b9a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.704794 22694 tablet_bootstrap.cc:654] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.705962 22644 tablet_service.cc:1511] Processing CreateTablet for tablet 6f42f0567ae14f62b39e69ed29a409cf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:44.706821 22636 tablet_service.cc:1511] Processing CreateTablet for tablet 7452859c008745c19509f4d5d908e8f1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:44.707350 22644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f42f0567ae14f62b39e69ed29a409cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.708106 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7452859c008745c19509f4d5d908e8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.708979 22492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401fe414b8f443bebfed8254895d71c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.710078 22493 tablet_service.cc:1511] Processing CreateTablet for tablet 33d734b2b43a40138a8a0ee22b30d9ba (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:44.712736 22695 tablet_bootstrap.cc:492] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:44.713165 22491 tablet_service.cc:1511] Processing CreateTablet for tablet 34b4979f789f48d0807b87e7a48b9a78 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:44.714589 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b4979f789f48d0807b87e7a48b9a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.718115 22490 tablet_service.cc:1511] Processing CreateTablet for tablet 31de2edeb38841bfa9edd362c910f0f7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:44.719537 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31de2edeb38841bfa9edd362c910f0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.663813 22641 tablet_service.cc:1511] Processing CreateTablet for tablet 39009bfe483947928e10122b4bb55ca6 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:44.729540 22641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39009bfe483947928e10122b4bb55ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.736045 22637 tablet_service.cc:1511] Processing CreateTablet for tablet ec33ad69c4af4d379aff74ce15c85af7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:44.741730 22570 tablet_service.cc:1511] Processing CreateTablet for tablet 5314aa61dd7f4a7f9b148f71ea5055c4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:44.745703 22565 tablet_service.cc:1511] Processing CreateTablet for tablet f0e2410740c9458db983018bbe19dcbf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:44.745927 22486 tablet_service.cc:1511] Processing CreateTablet for tablet 6f42f0567ae14f62b39e69ed29a409cf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:44.746099 22569 tablet_service.cc:1511] Processing CreateTablet for tablet 0498259251e24450b91d38bfc4b83dbf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:44.747148 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f42f0567ae14f62b39e69ed29a409cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.748589 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 0a60725e5550479db8d1e52b48126750 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:44.749269 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 39009bfe483947928e10122b4bb55ca6 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:44.752019 22566 tablet_service.cc:1511] Processing CreateTablet for tablet ea7bfa694a734e68806da48189a7e004 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:44.743237 22570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5314aa61dd7f4a7f9b148f71ea5055c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.758553 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a60725e5550479db8d1e52b48126750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.760926 22565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e2410740c9458db983018bbe19dcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.761487 22695 tablet_bootstrap.cc:654] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.744609 22567 tablet_service.cc:1511] Processing CreateTablet for tablet a14caf28740540799ba1c6db058346a1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:44.763434 22566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7bfa694a734e68806da48189a7e004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.765913 22494 tablet_service.cc:1511] Processing CreateTablet for tablet ee0a982f0606460f93cc934c9319409d (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:44.768234 22637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec33ad69c4af4d379aff74ce15c85af7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.770591 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0498259251e24450b91d38bfc4b83dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.782874 22639 tablet_service.cc:1511] Processing CreateTablet for tablet ee0a982f0606460f93cc934c9319409d (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:44.784222 22639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0a982f0606460f93cc934c9319409d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.785836 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 8852a51dd9a84948bed8ee87ae7a9f21 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:44.787359 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8852a51dd9a84948bed8ee87ae7a9f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.787590 22488 tablet_service.cc:1511] Processing CreateTablet for tablet ec33ad69c4af4d379aff74ce15c85af7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:44.771950 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d734b2b43a40138a8a0ee22b30d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.779592 22487 tablet_service.cc:1511] Processing CreateTablet for tablet 7452859c008745c19509f4d5d908e8f1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:44.797874 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 78833bb30a8347f19e5f2696aacc31e1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:44.798317 22561 tablet_service.cc:1511] Processing CreateTablet for tablet 3eac3c624e2c43fc9505fe5c344151d0 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:44.798463 22562 tablet_service.cc:1511] Processing CreateTablet for tablet acc845449beb4f859e55185200f34bd2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:44.794224 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14caf28740540799ba1c6db058346a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:44.812094 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:44.813194 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc845449beb4f859e55185200f34bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.816038 22561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eac3c624e2c43fc9505fe5c344151d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.816970 22488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec33ad69c4af4d379aff74ce15c85af7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.818198 22487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7452859c008745c19509f4d5d908e8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.821167 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0a982f0606460f93cc934c9319409d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.822455 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78833bb30a8347f19e5f2696aacc31e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.823740 22495 tablet_service.cc:1511] Processing CreateTablet for tablet d3feac7af5754b40a9c951d0a8e31413 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:44.825167 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39009bfe483947928e10122b4bb55ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.842245 22636 tablet_service.cc:1511] Processing CreateTablet for tablet 40f71093a3d7477c93130a982d6233f9 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:44.842453 22635 tablet_service.cc:1511] Processing CreateTablet for tablet 1f196f572a5c44a1adb647d7ebc64463 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:44.843829 22635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f196f572a5c44a1adb647d7ebc64463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.844242 22492 tablet_service.cc:1511] Processing CreateTablet for tablet 40f71093a3d7477c93130a982d6233f9 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:44.836833 22638 tablet_service.cc:1511] Processing CreateTablet for tablet d3feac7af5754b40a9c951d0a8e31413 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:44.839257 22642 tablet_service.cc:1511] Processing CreateTablet for tablet 384f494818f741d1bb257daeaab933f2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:44.826581 22491 tablet_service.cc:1511] Processing CreateTablet for tablet 384f494818f741d1bb257daeaab933f2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:44.878921 22694 tablet_bootstrap.cc:492] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:44.900926 22644 tablet_service.cc:1511] Processing CreateTablet for tablet d23ea829d43140beb6a88079029d865b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:44.901306 22694 ts_tablet_manager.cc:1403] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.257s	user 0.017s	sys 0.012s
I20260709 13:06:44.850215 22495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3feac7af5754b40a9c951d0a8e31413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.874646 22695 tablet_bootstrap.cc:492] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:44.887105 22486 tablet_service.cc:1511] Processing CreateTablet for tablet 1f196f572a5c44a1adb647d7ebc64463 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:44.871116 22643 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5719028ca945b2b6c1a1f140b05146 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:44.861306 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f71093a3d7477c93130a982d6233f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.904979 22638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3feac7af5754b40a9c951d0a8e31413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.905741 22643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5719028ca945b2b6c1a1f140b05146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.909288 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384f494818f741d1bb257daeaab933f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.911700 22644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23ea829d43140beb6a88079029d865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.903069 22490 tablet_service.cc:1511] Processing CreateTablet for tablet 603e708bc6b346ea93c1fb612030a16f (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:44.887970 22489 tablet_service.cc:1511] Processing CreateTablet for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:44.889799 22569 tablet_service.cc:1511] Processing CreateTablet for tablet 31de2edeb38841bfa9edd362c910f0f7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:44.913350 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384f494818f741d1bb257daeaab933f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.913700 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31de2edeb38841bfa9edd362c910f0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.915292 22492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f71093a3d7477c93130a982d6233f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.890273 22640 tablet_service.cc:1511] Processing CreateTablet for tablet 603e708bc6b346ea93c1fb612030a16f (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:44.916436 22640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603e708bc6b346ea93c1fb612030a16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.918510 22570 tablet_service.cc:1511] Processing CreateTablet for tablet 401fe414b8f443bebfed8254895d71c3 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:44.925729 22570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401fe414b8f443bebfed8254895d71c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.864197 22641 tablet_service.cc:1511] Processing CreateTablet for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:44.893388 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5719028ca945b2b6c1a1f140b05146 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:44.921281 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f196f572a5c44a1adb647d7ebc64463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.921653 22695 ts_tablet_manager.cc:1403] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.209s	user 0.008s	sys 0.009s
I20260709 13:06:44.944831 22695 raft_consensus.cc:359] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:44.949904 22695 raft_consensus.cc:385] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.950244 22695 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.951160 22695 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:44.927407 22694 raft_consensus.cc:359] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:44.897428 22568 tablet_service.cc:1511] Processing CreateTablet for tablet be7264d3053b44989c5504d296ea482b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:44.936977 22641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.900972 22565 tablet_service.cc:1511] Processing CreateTablet for tablet 799bdeb956cf4c76aa244c0f5bbc89c2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:44.941785 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5719028ca945b2b6c1a1f140b05146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.953508 22694 raft_consensus.cc:385] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.966663 22565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bdeb956cf4c76aa244c0f5bbc89c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.966741 22698 tablet_bootstrap.cc:492] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:44.946017 22487 tablet_service.cc:1511] Processing CreateTablet for tablet d23ea829d43140beb6a88079029d865b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:44.970615 22562 tablet_service.cc:1511] Processing CreateTablet for tablet 34b4979f789f48d0807b87e7a48b9a78 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:44.970893 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 7452859c008745c19509f4d5d908e8f1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:44.971652 22566 tablet_service.cc:1511] Processing CreateTablet for tablet 33d734b2b43a40138a8a0ee22b30d9ba (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:44.972402 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.973471 22493 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9ab72464841aca55186beb0dbeb53 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:44.977226 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be7264d3053b44989c5504d296ea482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.967846 22694 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.984400 22530 heartbeater.cc:499] Master 127.20.227.190:45599 was elected leader, sending a full tablet report...
I20260709 13:06:44.986588 22639 tablet_service.cc:1511] Processing CreateTablet for tablet e294969b50aa438bb288b913f169f06e (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:45.003324 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b4979f789f48d0807b87e7a48b9a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.988763 22635 tablet_service.cc:1511] Processing CreateTablet for tablet 549907a9ef52413ab776c58c50b74e5d (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:45.004838 22637 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9ab72464841aca55186beb0dbeb53 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:45.005018 22694 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:45.003942 22487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23ea829d43140beb6a88079029d865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.003700 22639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e294969b50aa438bb288b913f169f06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:44.995568 22636 tablet_service.cc:1511] Processing CreateTablet for tablet ca60e389358849e7bf461e472007a7f7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:45.028846 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7452859c008745c19509f4d5d908e8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.037909 22488 tablet_service.cc:1511] Processing CreateTablet for tablet e294969b50aa438bb288b913f169f06e (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:44.984438 22561 tablet_service.cc:1511] Processing CreateTablet for tablet 39009bfe483947928e10122b4bb55ca6 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:45.041536 22695 ts_tablet_manager.cc:1434] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.099s	user 0.002s	sys 0.006s
I20260709 13:06:45.041756 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 6f42f0567ae14f62b39e69ed29a409cf (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:45.042670 22695 tablet_bootstrap.cc:492] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:45.047839 22643 tablet_service.cc:1511] Processing CreateTablet for tablet d36d7ae701b84ad59f37ee479b4bd84f (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:45.048173 22486 tablet_service.cc:1511] Processing CreateTablet for tablet 549907a9ef52413ab776c58c50b74e5d (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:45.049446 22643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36d7ae701b84ad59f37ee479b4bd84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.051898 22491 tablet_service.cc:1511] Processing CreateTablet for tablet ca60e389358849e7bf461e472007a7f7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:45.052407 22639 tablet_service.cc:1511] Processing CreateTablet for tablet a9239c6f95c54166b454ada0dd9c1b9b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:45.053550 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca60e389358849e7bf461e472007a7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.003683 22569 tablet_service.cc:1511] Processing CreateTablet for tablet ec33ad69c4af4d379aff74ce15c85af7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:45.061993 22565 tablet_service.cc:1511] Processing CreateTablet for tablet 384f494818f741d1bb257daeaab933f2 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:45.062301 22567 tablet_service.cc:1511] Processing CreateTablet for tablet ee0a982f0606460f93cc934c9319409d (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:45.032009 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603e708bc6b346ea93c1fb612030a16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.067881 22637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9ab72464841aca55186beb0dbeb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.068219 22679 heartbeater.cc:499] Master 127.20.227.190:45599 was elected leader, sending a full tablet report...
I20260709 13:06:45.075361 22635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549907a9ef52413ab776c58c50b74e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.064054 22570 tablet_service.cc:1511] Processing CreateTablet for tablet d3feac7af5754b40a9c951d0a8e31413 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:45.095685 22492 tablet_service.cc:1511] Processing CreateTablet for tablet d36d7ae701b84ad59f37ee479b4bd84f (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:45.105291 22698 tablet_bootstrap.cc:654] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.106252 22694 ts_tablet_manager.cc:1434] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.204s	user 0.006s	sys 0.006s
I20260709 13:06:45.107553 22694 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:45.108572 22639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9239c6f95c54166b454ada0dd9c1b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.108980 22565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384f494818f741d1bb257daeaab933f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.110013 22561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39009bfe483947928e10122b4bb55ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.105180 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549907a9ef52413ab776c58c50b74e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.113211 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca60e389358849e7bf461e472007a7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.113057 22644 tablet_service.cc:1511] Processing CreateTablet for tablet 9693f1d9b0aa4659842e296e4ccab6fb (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:45.114771 22644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9693f1d9b0aa4659842e296e4ccab6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.115249 22495 tablet_service.cc:1511] Processing CreateTablet for tablet a9239c6f95c54166b454ada0dd9c1b9b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:45.117591 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f42f0567ae14f62b39e69ed29a409cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.119041 22640 tablet_service.cc:1511] Processing CreateTablet for tablet 5b79bbacdb324d378e564aba36fc4014 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:45.120520 22640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b79bbacdb324d378e564aba36fc4014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.121191 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec33ad69c4af4d379aff74ce15c85af7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.124778 22642 tablet_service.cc:1511] Processing CreateTablet for tablet acc46eb991824d25bde40d1001e04798 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:45.127862 22566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d734b2b43a40138a8a0ee22b30d9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.099996 22638 tablet_service.cc:1511] Processing CreateTablet for tablet 096694b658e343f384dc3c1f4e4c5dac (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:45.131700 22643 tablet_service.cc:1511] Processing CreateTablet for tablet b09d79da74a54c84ab38db5f54cacc35 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:45.133518 22488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e294969b50aa438bb288b913f169f06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.135492 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9ab72464841aca55186beb0dbeb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.120746 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 9693f1d9b0aa4659842e296e4ccab6fb (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:45.141207 22495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9239c6f95c54166b454ada0dd9c1b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.145506 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0a982f0606460f93cc934c9319409d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.145148 22641 tablet_service.cc:1511] Processing CreateTablet for tablet 0328fc7e60424283b5d1ea734bd5136a (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:45.148077 22695 tablet_bootstrap.cc:654] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.147855 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9693f1d9b0aa4659842e296e4ccab6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.153713 22492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36d7ae701b84ad59f37ee479b4bd84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.157053 22605 heartbeater.cc:499] Master 127.20.227.190:45599 was elected leader, sending a full tablet report...
I20260709 13:06:45.156355 22636 tablet_service.cc:1511] Processing CreateTablet for tablet 6530ceb18c814f10ad99777fb17a2ea1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:45.149750 22570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3feac7af5754b40a9c951d0a8e31413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.181339 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6530ceb18c814f10ad99777fb17a2ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.182253 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc46eb991824d25bde40d1001e04798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.182948 22641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0328fc7e60424283b5d1ea734bd5136a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.185546 22698 tablet_bootstrap.cc:492] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:45.186075 22698 ts_tablet_manager.cc:1403] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.220s	user 0.009s	sys 0.005s
I20260709 13:06:45.192019 22698 raft_consensus.cc:359] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:45.192816 22698 raft_consensus.cc:385] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.193161 22698 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.194051 22698 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:45.204847 22694 tablet_bootstrap.cc:654] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.205102 22643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b09d79da74a54c84ab38db5f54cacc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.205811 22638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096694b658e343f384dc3c1f4e4c5dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.207731 22635 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:45.211633 22637 tablet_service.cc:1511] Processing CreateTablet for tablet ddaffb6b139e4723bd2535c363e228ff (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:45.217308 22563 tablet_service.cc:1511] Processing CreateTablet for tablet 40f71093a3d7477c93130a982d6233f9 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:45.219710 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f71093a3d7477c93130a982d6233f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.245718 22698 ts_tablet_manager.cc:1434] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.006s
W20260709 13:06:45.232223 22389 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 112431us
I20260709 13:06:45.246932 22698 tablet_bootstrap.cc:492] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:45.232439 22635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:45.227790 22387 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 103000us
I20260709 13:06:45.267400 22700 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.267988 22700 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:45.271037 22700 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:06:45.288592 22567 tablet_service.cc:1511] Processing CreateTablet for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:45.252887 22636 tablet_service.cc:1511] Processing CreateTablet for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:45.291721 22637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddaffb6b139e4723bd2535c363e228ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.290251 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.309497 22695 tablet_bootstrap.cc:492] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:45.310060 22695 ts_tablet_manager.cc:1403] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.268s	user 0.010s	sys 0.019s
I20260709 13:06:45.325879 22699 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.326517 22699 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:45.330266 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.331598 22695 raft_consensus.cc:359] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:45.332507 22695 raft_consensus.cc:385] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.332917 22695 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.339967 22492 tablet_service.cc:1511] Processing CreateTablet for tablet 5b79bbacdb324d378e564aba36fc4014 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:45.312539 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 096694b658e343f384dc3c1f4e4c5dac (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:45.344233 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096694b658e343f384dc3c1f4e4c5dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.307747 22565 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5719028ca945b2b6c1a1f140b05146 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:45.333609 22694 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:45.340373 22493 tablet_service.cc:1511] Processing CreateTablet for tablet acc46eb991824d25bde40d1001e04798 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:45.363760 22694 ts_tablet_manager.cc:1403] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.256s	user 0.017s	sys 0.027s
I20260709 13:06:45.387583 22566 tablet_service.cc:1511] Processing CreateTablet for tablet d23ea829d43140beb6a88079029d865b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:45.389976 22703 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.390580 22703 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:45.407366 22639 tablet_service.cc:1511] Processing CreateTablet for tablet 90227a385eee486dbc981f55629940e4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:45.397625 22699 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:45.401846 22492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b79bbacdb324d378e564aba36fc4014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.363898 22695 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:45.402922 22565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5719028ca945b2b6c1a1f140b05146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.397356 22703 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:06:45.417301 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:45.423064 22580 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:45.418903 22641 tablet_service.cc:1511] Processing CreateTablet for tablet 66564b8595294cedb0956a6878879f95 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:45.411005 22561 tablet_service.cc:1511] Processing CreateTablet for tablet 603e708bc6b346ea93c1fb612030a16f (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:45.421725 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc46eb991824d25bde40d1001e04798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.384677 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 1f196f572a5c44a1adb647d7ebc64463 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:45.408823 22639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90227a385eee486dbc981f55629940e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.426164 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:45.429606 22486 tablet_service.cc:1511] Processing CreateTablet for tablet ddaffb6b139e4723bd2535c363e228ff (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:45.431632 22642 tablet_service.cc:1511] Processing CreateTablet for tablet 77ec411c33594ae08408279ef5c44410 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:45.408789 22694 raft_consensus.cc:359] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:45.437677 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 0328fc7e60424283b5d1ea734bd5136a (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:45.438990 22487 tablet_service.cc:1511] Processing CreateTablet for tablet 6530ceb18c814f10ad99777fb17a2ea1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:45.442401 22698 tablet_bootstrap.cc:654] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:45.444725 22569 tablet_service.cc:1511] Processing CreateTablet for tablet e294969b50aa438bb288b913f169f06e (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:45.445246 22566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23ea829d43140beb6a88079029d865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.442425 22570 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9ab72464841aca55186beb0dbeb53 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:45.447837 22699 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.454846 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:45.463716 22700 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:45.487221 22700 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.487645 22700 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.465586 22641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66564b8595294cedb0956a6878879f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.468079 22640 tablet_service.cc:1511] Processing CreateTablet for tablet 80dc0c7d4f9341eeb7472424613de2ce (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:45.475060 22694 raft_consensus.cc:385] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:45.493369 22694 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:45.494163 22694 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:45.492969 22699 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:45.508841 22488 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:45.502501 22561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603e708bc6b346ea93c1fb612030a16f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:45.519325 22619 leader_election.cc:343] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.520043 22643 tablet_service.cc:1511] Processing CreateTablet for tablet b881738a5b7f4910b375833c1cd61083 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:45.523264 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 096694b658e343f384dc3c1f4e4c5dac (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:45.524616 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096694b658e343f384dc3c1f4e4c5dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.525430 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ec411c33594ae08408279ef5c44410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.528105 22570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9ab72464841aca55186beb0dbeb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.529923 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e294969b50aa438bb288b913f169f06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.532408 22699 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:45.534701 22562 tablet_service.cc:1511] Processing CreateTablet for tablet 549907a9ef52413ab776c58c50b74e5d (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:45.535967 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549907a9ef52413ab776c58c50b74e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.516593 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0328fc7e60424283b5d1ea734bd5136a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.540052 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddaffb6b139e4723bd2535c363e228ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.540990 22490 tablet_service.cc:1511] Processing CreateTablet for tablet b09d79da74a54c84ab38db5f54cacc35 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:45.542286 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b09d79da74a54c84ab38db5f54cacc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.547770 22491 tablet_service.cc:1511] Processing CreateTablet for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:45.552330 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:45.549058 22695 ts_tablet_manager.cc:1434] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.239s	user 0.008s	sys 0.003s
I20260709 13:06:45.557303 22488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:45.557560 22545 leader_election.cc:343] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:45.557930 22695 tablet_bootstrap.cc:492] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:45.559934 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f196f572a5c44a1adb647d7ebc64463. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:45.885851 22387 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 89716.9us
I20260709 13:06:46.563866 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 31) took 1710 ms. Trace:
I20260709 13:06:46.564400 22562 rpcz_store.cc:276] 0709 13:06:44.853363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.533609 (+680246us) service_pool.cc:224] Handling call
0709 13:06:45.535525 (+  1916us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.535617 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.556366 (+1020749us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.563260 (+  6894us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.563785 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.567430 22562 tablet_service.cc:1511] Processing CreateTablet for tablet ca60e389358849e7bf461e472007a7f7 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:46.568843 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca60e389358849e7bf461e472007a7f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:46.576774 22468 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.010s	sys 0.014s
W20260709 13:06:46.577193 22468 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.013s	sys 0.014s
W20260709 13:06:46.584103 22698 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.019s	sys 0.012s
I20260709 13:06:46.584125 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 32) took 1730 ms. Trace:
W20260709 13:06:46.584640 22698 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.020s	sys 0.012s
I20260709 13:06:46.584621 22562 rpcz_store.cc:276] 0709 13:06:44.853676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.566328 (+1712652us) service_pool.cc:224] Handling call
0709 13:06:46.568315 (+  1987us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.568417 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.577393 (+  8976us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.583725 (+  6332us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.584078 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.586966 22562 tablet_service.cc:1511] Processing CreateTablet for tablet d36d7ae701b84ad59f37ee479b4bd84f (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:46.587615 22698 tablet_bootstrap.cc:492] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:46.588090 22698 ts_tablet_manager.cc:1403] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 1.341s	user 0.032s	sys 0.021s
I20260709 13:06:46.588212 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36d7ae701b84ad59f37ee479b4bd84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.591662 22698 raft_consensus.cc:359] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.592412 22698 raft_consensus.cc:385] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.592729 22698 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.593523 22698 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:46.594112 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800064960 after lost signal to thread 21393
I20260709 13:06:46.595742 22698 ts_tablet_manager.cc:1434] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:46.596768 22698 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:46.604382 22568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 10) took 1818 ms. Trace:
I20260709 13:06:46.604763 22568 rpcz_store.cc:276] 0709 13:06:44.786129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.896433 (+110304us) service_pool.cc:224] Handling call
0709 13:06:44.968512 (+ 72079us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:44.973000 (+  4488us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.232650 (+259650us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:45.358287 (+125637us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.604063 (+1245776us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b58000fa298. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d71a2 00007fec2c118bb9 00007fec2b249d88 00007fec2b310973 00007fec2b30c70f 00007fec2b30cecd 00007fec2b2bb400 00007fec24740af4 00007fec24740a82
0709 13:06:46.604329 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8377216}
I20260709 13:06:46.606604 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 33) took 1752 ms. Trace:
I20260709 13:06:46.607451 22698 tablet_bootstrap.cc:654] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.606989 22562 rpcz_store.cc:276] 0709 13:06:44.853973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.585962 (+1731989us) service_pool.cc:224] Handling call
0709 13:06:46.587747 (+  1785us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.587855 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.598555 (+ 10700us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.606033 (+  7478us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.606545 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.607551 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 5b79bbacdb324d378e564aba36fc4014 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:46.609081 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b79bbacdb324d378e564aba36fc4014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.609158 22562 tablet_service.cc:1511] Processing CreateTablet for tablet a9239c6f95c54166b454ada0dd9c1b9b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:46.612118 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9239c6f95c54166b454ada0dd9c1b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.613569 22698 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:46.614071 22698 ts_tablet_manager.cc:1403] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:06:46.617133 22698 raft_consensus.cc:359] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.617913 22698 raft_consensus.cc:385] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.618199 22698 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.618841 22698 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:46.619315 22644 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.207s	user 0.019s	sys 0.000s
I20260709 13:06:46.621428 22698 ts_tablet_manager.cc:1434] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:46.622489 22698 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:46.631124 22698 tablet_bootstrap.cc:654] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.633188 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 34) took 1779 ms. Trace:
I20260709 13:06:46.633642 22562 rpcz_store.cc:276] 0709 13:06:44.854275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.608142 (+1753867us) service_pool.cc:224] Handling call
0709 13:06:46.610037 (+  1895us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.610133 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.621049 (+ 10916us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.632568 (+ 11519us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.633116 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.636106 22562 tablet_service.cc:1511] Processing CreateTablet for tablet acc46eb991824d25bde40d1001e04798 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:46.637156 22698 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:46.637463 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc46eb991824d25bde40d1001e04798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.637809 22698 ts_tablet_manager.cc:1403] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:06:46.641089 22698 raft_consensus.cc:359] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.641929 22698 raft_consensus.cc:385] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:46.642113 22617 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.020s	sys 0.016s
W20260709 13:06:46.642570 22617 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.020s	sys 0.016s
I20260709 13:06:46.642361 22698 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.643594 22698 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.646600 22698 ts_tablet_manager.cc:1434] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:46.647730 22698 tablet_bootstrap.cc:492] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
W20260709 13:06:46.649396 22494 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.179s	user 0.011s	sys 0.008s
I20260709 13:06:46.651909 22494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 36) took 1955 ms. Trace:
I20260709 13:06:46.652311 22494 rpcz_store.cc:276] 0709 13:06:44.696248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.307933 (+611685us) service_pool.cc:224] Handling call
0709 13:06:45.343717 (+ 35784us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.343816 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.470334 (+126518us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.649938 (+1179604us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.651841 (+  1903us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.654476 22639 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.128s	user 0.010s	sys 0.007s
I20260709 13:06:46.654511 22698 tablet_bootstrap.cc:654] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.655284 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 38) took 1799 ms. Trace:
I20260709 13:06:46.655738 22562 rpcz_store.cc:276] 0709 13:06:44.855414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.635047 (+1779633us) service_pool.cc:224] Handling call
0709 13:06:46.636963 (+  1916us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.637057 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.647381 (+ 10324us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.654673 (+  7292us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.655215 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.657992 22562 tablet_service.cc:1511] Processing CreateTablet for tablet 9693f1d9b0aa4659842e296e4ccab6fb (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:46.659552 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9693f1d9b0aa4659842e296e4ccab6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.662074 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 90227a385eee486dbc981f55629940e4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:46.667311 22698 tablet_bootstrap.cc:492] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:46.667634 22487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6530ceb18c814f10ad99777fb17a2ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.667913 22698 ts_tablet_manager.cc:1403] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:06:46.671602 22698 raft_consensus.cc:359] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.672881 22698 raft_consensus.cc:385] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.673240 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90227a385eee486dbc981f55629940e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.673581 22698 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.674722 22698 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.677346 22698 ts_tablet_manager.cc:1434] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:06:46.678215 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 35) took 1823 ms. Trace:
I20260709 13:06:46.678928 22698 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:46.678568 22562 rpcz_store.cc:276] 0709 13:06:44.854555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.656854 (+1802299us) service_pool.cc:224] Handling call
0709 13:06:46.658968 (+  2114us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.659099 (+   131us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.669853 (+ 10754us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.677714 (+  7861us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.678153 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.680807 22562 tablet_service.cc:1511] Processing CreateTablet for tablet b09d79da74a54c84ab38db5f54cacc35 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:46.682508 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b09d79da74a54c84ab38db5f54cacc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.683858 22568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 37) took 1828 ms. Trace:
I20260709 13:06:46.684314 22568 rpcz_store.cc:276] 0709 13:06:44.855136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.606550 (+1751414us) service_pool.cc:224] Handling call
0709 13:06:46.608577 (+  2027us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.608671 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.655872 (+ 47201us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.683279 (+ 27407us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.683782 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.686491 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 6530ceb18c814f10ad99777fb17a2ea1 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:46.687456 22698 tablet_bootstrap.cc:654] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.687989 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6530ceb18c814f10ad99777fb17a2ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.693328 22694 ts_tablet_manager.cc:1434] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 1.314s	user 0.019s	sys 0.017s
W20260709 13:06:46.693755 22694 ts_tablet_manager.cc:1467] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet startup took 1315ms
W20260709 13:06:46.694096 22694 ts_tablet_manager.cc:1469] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Trace:
0709 13:06:44.511149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.525772 (+ 14623us) service_pool.cc:224] Handling call
0709 13:06:44.527781 (+  2009us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:44.527884 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:44.581198 (+ 53314us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:44.601878 (+ 20680us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:44.602390 (+   512us) inbound_call.cc:177] Queueing success response
0709 13:06:45.107152 (+504762us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:45.379689 (+272537us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:45.393500 (+ 13811us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:45.394165 (+   665us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":22807,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"tablet-open.queue_time_us":504858,"thread_start_us":22420,"threads_started":1}
I20260709 13:06:46.700722 22698 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:46.701411 22698 ts_tablet_manager.cc:1403] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:06:46.701596 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 39) took 1845 ms. Trace:
I20260709 13:06:46.701999 22562 rpcz_store.cc:276] 0709 13:06:44.855724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.679813 (+1824089us) service_pool.cc:224] Handling call
0709 13:06:46.681844 (+  2031us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.681944 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.692278 (+ 10334us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.701047 (+  8769us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.701533 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.704131 22562 tablet_service.cc:1511] Processing CreateTablet for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:46.705459 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.705363 22698 raft_consensus.cc:359] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.706434 22698 raft_consensus.cc:385] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.706828 22698 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.707695 22698 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:46.708900 22565 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.148s	user 0.000s	sys 0.014s
I20260709 13:06:46.710671 22698 ts_tablet_manager.cc:1434] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:06:46.711977 22698 tablet_bootstrap.cc:492] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:46.717746 22640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dc0c7d4f9341eeb7472424613de2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.719066 22698 tablet_bootstrap.cc:654] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.722431 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 41) took 1866 ms. Trace:
I20260709 13:06:46.723009 22562 rpcz_store.cc:276] 0709 13:06:44.856280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.703197 (+1846917us) service_pool.cc:224] Handling call
0709 13:06:46.704973 (+  1776us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.705073 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.714424 (+  9351us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.721847 (+  7423us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.722344 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.725656 22562 tablet_service.cc:1511] Processing CreateTablet for tablet 0328fc7e60424283b5d1ea734bd5136a (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:46.727465 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0328fc7e60424283b5d1ea734bd5136a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.735744 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.737591 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:46.739300 22468 leader_election.cc:343] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.740288 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:46.742103 22468 leader_election.cc:343] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.743999 22489 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 42) took 2017 ms. Trace:
W20260709 13:06:46.746065 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:46.751370 22638 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 36) took 1926 ms. Trace:
I20260709 13:06:46.752105 22638 rpcz_store.cc:276] 0709 13:06:44.824988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.099084 (+274096us) service_pool.cc:224] Handling call
0709 13:06:45.129428 (+ 30344us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.129565 (+   137us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.307882 (+178317us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:45.480345 (+172463us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.751266 (+1270921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.709928 22565 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 26) took 1878 ms. Trace:
I20260709 13:06:46.766208 22638 tablet_service.cc:1511] Processing CreateTablet for tablet 5c413dbaae364e3a919a92c57b6216ba (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:46.732755 22569 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 30) took 1899 ms. Trace:
I20260709 13:06:46.744462 22489 rpcz_store.cc:276] 0709 13:06:44.726663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.436572 (+709909us) service_pool.cc:224] Handling call
0709 13:06:45.495718 (+ 59146us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.498343 (+  2625us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.693082 (+1194739us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.743456 (+ 50374us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.743939 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.773214 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 42) took 1916 ms. Trace:
I20260709 13:06:46.773605 22562 rpcz_store.cc:276] 0709 13:06:44.856548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.724319 (+1867771us) service_pool.cc:224] Handling call
0709 13:06:46.726806 (+  2487us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.726946 (+   140us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.762588 (+ 35642us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.772686 (+ 10098us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.773155 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.773334 22570 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.218s	user 0.053s	sys 0.078s
I20260709 13:06:46.774894 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 77ec411c33594ae08408279ef5c44410 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:46.775259 22562 tablet_service.cc:1511] Processing CreateTablet for tablet ddaffb6b139e4723bd2535c363e228ff (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:46.776291 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddaffb6b139e4723bd2535c363e228ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.776167 22570 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 29) took 1943 ms. Trace:
I20260709 13:06:46.776294 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ec411c33594ae08408279ef5c44410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.777243 22570 rpcz_store.cc:276] 0709 13:06:44.832613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.441374 (+608761us) service_pool.cc:224] Handling call
0709 13:06:45.527636 (+ 86262us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.527746 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.554781 (+ 27035us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.775025 (+1220244us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.776047 (+  1022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.805441 22570 tablet_service.cc:1511] Processing CreateTablet for tablet 90227a385eee486dbc981f55629940e4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:46.806833 22570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90227a385eee486dbc981f55629940e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:46.808039 22563 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.401s	user 0.013s	sys 0.004s
I20260709 13:06:46.771924 22569 rpcz_store.cc:276] 0709 13:06:44.852955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.443598 (+590643us) service_pool.cc:224] Handling call
0709 13:06:45.529429 (+ 85831us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.529558 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.700677 (+1171119us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.732226 (+ 31549us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.732699 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.732460 22495 tablet_service.cc:1511] Processing CreateTablet for tablet 66564b8595294cedb0956a6878879f95 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:46.811177 22569 tablet_service.cc:1511] Processing CreateTablet for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:46.778120 22698 tablet_bootstrap.cc:492] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:46.812403 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:46.813202 22698 ts_tablet_manager.cc:1403] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.030s
I20260709 13:06:46.813542 22489 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 47) took 1936 ms. Trace:
W20260709 13:06:46.814078 22468 leader_election.cc:343] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.813967 22489 rpcz_store.cc:276] 0709 13:06:44.877334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.773810 (+1896476us) service_pool.cc:224] Handling call
0709 13:06:46.775833 (+  2023us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.775927 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.786363 (+ 10436us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.812942 (+ 26579us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.813462 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.814745 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:06:46.815256 22492 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.317s	user 0.028s	sys 0.012s
I20260709 13:06:46.816306 22492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 37) took 2119 ms. Trace:
I20260709 13:06:46.817299 22489 tablet_service.cc:1511] Processing CreateTablet for tablet b881738a5b7f4910b375833c1cd61083 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:46.770961 22565 rpcz_store.cc:276] 0709 13:06:44.831763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.306742 (+474979us) service_pool.cc:224] Handling call
0709 13:06:45.364483 (+ 57741us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.370982 (+  6499us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.560642 (+189660us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.709397 (+1148755us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.709873 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.811165 22703 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.822594 22566 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.251s	user 0.015s	sys 0.011s
I20260709 13:06:46.822794 22703 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.823905 22494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 45) took 2050 ms. Trace:
I20260709 13:06:46.825284 22699 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:46.826150 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:46.828570 22636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 44) took 1973 ms. Trace:
W20260709 13:06:46.801494 22700 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.313s	user 0.015s	sys 0.004s
I20260709 13:06:46.830088 22643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b881738a5b7f4910b375833c1cd61083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.829779 22700 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:46.830389 22635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 41) took 1978 ms. Trace:
I20260709 13:06:46.830760 22635 rpcz_store.cc:276] 0709 13:06:44.851995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.206748 (+354753us) service_pool.cc:224] Handling call
0709 13:06:45.208583 (+  1835us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.208676 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.416986 (+208310us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:45.522481 (+105495us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.830327 (+1307846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.832059 22700 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:06:46.832221 22653 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:46.816676 22698 raft_consensus.cc:359] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.832924 22703 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:46.809170 22563 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 23) took 1978 ms. Trace:
I20260709 13:06:46.833528 22698 raft_consensus.cc:385] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:46.834070 22698 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:46.829177 22636 rpcz_store.cc:276] 0709 13:06:44.854822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.251157 (+396335us) service_pool.cc:224] Handling call
0709 13:06:45.302712 (+ 51555us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.317817 (+ 15105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.428233 (+110416us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:45.532750 (+104517us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.828503 (+1295753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.816664 22492 rpcz_store.cc:276] 0709 13:06:44.696720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.338940 (+642220us) service_pool.cc:224] Handling call
0709 13:06:45.362100 (+ 23160us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.369054 (+  6954us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.479858 (+110804us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.815797 (+1335939us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.816251 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.853411 22641 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 46) took 1950 ms. Trace:
I20260709 13:06:46.853868 22641 rpcz_store.cc:276] 0709 13:06:44.902619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.417652 (+515033us) service_pool.cc:224] Handling call
0709 13:06:45.465089 (+ 47437us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.465202 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.591312 (+1126110us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.599010 (+  7698us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.853342 (+254332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.854876 22492 tablet_service.cc:1511] Processing CreateTablet for tablet 80dc0c7d4f9341eeb7472424613de2ce (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:46.857270 22644 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 35) took 2117 ms. Trace:
I20260709 13:06:46.857695 22644 rpcz_store.cc:276] 0709 13:06:44.739657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.061977 (+322320us) service_pool.cc:224] Handling call
0709 13:06:45.114285 (+ 52308us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.114404 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.401482 (+287078us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.619862 (+1218380us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.857203 (+237341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.859700 22644 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7684e99fff4bc297f8fbf170e45ddb (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:46.861608 22639 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 45) took 1963 ms. Trace:
I20260709 13:06:46.862084 22564 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 24) took 2030 ms. Trace:
I20260709 13:06:46.862004 22639 rpcz_store.cc:276] 0709 13:06:44.897776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.405146 (+507370us) service_pool.cc:224] Handling call
0709 13:06:45.408347 (+  3201us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.408450 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.526612 (+118162us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.655133 (+1128521us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.861544 (+206411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.862723 22564 rpcz_store.cc:276] 0709 13:06:44.831208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.221265 (+390057us) service_pool.cc:224] Handling call
0709 13:06:45.521508 (+300243us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b58000fa298. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6eee 0000000000375939 00007fec2b24a1e0 00007fec2b32f84c 00007fec2b30cac3 00007fec2b2bb400 00007fec24740af4 00007fec24740a82 00007fec247409b1
0709 13:06:45.558518 (+ 37010us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.559479 (+   961us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.762812 (+1203333us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.861507 (+ 98695us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.862023 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10973568}
I20260709 13:06:46.864035 22639 tablet_service.cc:1511] Processing CreateTablet for tablet 88d0b8c255a14106a3b00b5476896b2c (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:46.824286 22494 rpcz_store.cc:276] 0709 13:06:44.773598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.661072 (+1887474us) service_pool.cc:224] Handling call
0709 13:06:46.662986 (+  1914us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.663121 (+   135us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.699872 (+ 36751us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.823408 (+123536us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.823840 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.834487 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:46.852423 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:46.833791 22563 rpcz_store.cc:276] 0709 13:06:44.830905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.171090 (+340185us) service_pool.cc:224] Handling call
0709 13:06:45.218373 (+ 47283us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.219281 (+   908us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.406990 (+187709us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.808567 (+1401577us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.809105 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.856387 22641 tablet_service.cc:1511] Processing CreateTablet for tablet f6c34f1ef8704ce29f9df924d306bc42 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:46.866523 22494 tablet_service.cc:1511] Processing CreateTablet for tablet 5c413dbaae364e3a919a92c57b6216ba (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:46.874034 22568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 40) took 2018 ms. Trace:
W20260709 13:06:46.870252 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800192d80 after lost signal to thread 22437
I20260709 13:06:46.864831 22564 tablet_service.cc:1511] Processing CreateTablet for tablet 66564b8595294cedb0956a6878879f95 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:46.875581 22490 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 39) took 2150 ms. Trace:
I20260709 13:06:46.838052 22487 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 40) took 2112 ms. Trace:
I20260709 13:06:46.878482 22644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7684e99fff4bc297f8fbf170e45ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.842106 22698 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.878683 22490 rpcz_store.cc:276] 0709 13:06:44.725677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.423512 (+697835us) service_pool.cc:224] Handling call
0709 13:06:45.541811 (+118299us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.541929 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.846714 (+1304785us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.873758 (+ 27044us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.875518 (+  1760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.843538 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:46.881181 22641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c34f1ef8704ce29f9df924d306bc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.881243 22579 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.878350 22487 rpcz_store.cc:276] 0709 13:06:44.726025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.438049 (+712024us) service_pool.cc:224] Handling call
0709 13:06:45.522741 (+ 84692us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5800003698. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b32f831 00007fec2b30cac3 00007fec2b2bb400 00007fec24740af4 00007fec24740a82 00007fec247409b1
0709 13:06:45.522872 (+   131us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.522966 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.751655 (+1228689us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.837523 (+ 85868us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.837992 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42123520}
I20260709 13:06:46.844326 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.873606 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:46.844846 22566 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 28) took 2012 ms. Trace:
W20260709 13:06:46.845434 22493 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.284s	user 0.015s	sys 0.000s
I20260709 13:06:46.883212 22487 tablet_service.cc:1511] Processing CreateTablet for tablet 360d81cdb43c4dd69ba77b3db56e94e4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:46.845623 22695 tablet_bootstrap.cc:654] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:46.883972 22639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d0b8c255a14106a3b00b5476896b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.883488 22566 rpcz_store.cc:276] 0709 13:06:44.832325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.386489 (+554164us) service_pool.cc:224] Handling call
0709 13:06:45.388583 (+  2094us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.388701 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.571711 (+183010us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.823122 (+1251411us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.844788 (+ 21666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.885106 22493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 38) took 2173 ms. Trace:
I20260709 13:06:46.885632 22566 tablet_service.cc:1511] Processing CreateTablet for tablet 80dc0c7d4f9341eeb7472424613de2ce (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:46.874475 22568 rpcz_store.cc:276] 0709 13:06:44.856006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.685395 (+1829389us) service_pool.cc:224] Handling call
0709 13:06:46.687447 (+  2052us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.687561 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.831367 (+143806us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.873477 (+ 42110us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.873967 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.846251 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 43) took 1989 ms. Trace:
I20260709 13:06:46.847199 22635 tablet_service.cc:1511] Processing CreateTablet for tablet 360d81cdb43c4dd69ba77b3db56e94e4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:46.837086 22636 tablet_service.cc:1511] Processing CreateTablet for tablet a4afa4eec9774883a53b37419c20bbf4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:46.887033 22562 rpcz_store.cc:276] 0709 13:06:44.856819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.774468 (+1917649us) service_pool.cc:224] Handling call
0709 13:06:46.775894 (+  1426us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.775964 (+    70us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.796835 (+ 20871us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.808839 (+ 12004us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.846192 (+ 37353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.851788 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:46.850384 22642 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 47) took 1946 ms. Trace:
W20260709 13:06:46.876130 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800152a20 after lost signal to thread 22529
I20260709 13:06:46.865629 22694 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
W20260709 13:06:46.888702 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800155180 after lost signal to thread 22530
I20260709 13:06:46.888146 22642 rpcz_store.cc:276] 0709 13:06:44.903718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.430683 (+526965us) service_pool.cc:224] Handling call
0709 13:06:45.524874 (+ 94191us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d72b8 00007fec231d71db 00007fec2c118bb9 00007fec2b249d88 00007fec2b30cb80 00007fec2b2bb400 00007fec24740af4 00007fec24740a82 00007fec247409b1 00007fec2474092c
0709 13:06:45.524927 (+    53us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.525057 (+   130us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.566694 (+ 41637us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:45.583676 (+ 16982us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.850318 (+1266642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3367808}
I20260709 13:06:46.888841 22562 tablet_service.cc:1511] Processing CreateTablet for tablet a4afa4eec9774883a53b37419c20bbf4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:46.890947 22642 tablet_service.cc:1511] Processing CreateTablet for tablet b9c028af0e9e408792f2900ec24e194b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:46.890544 22568 tablet_service.cc:1511] Processing CreateTablet for tablet 5c413dbaae364e3a919a92c57b6216ba (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:46.868335 22654 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:46.885958 22563 tablet_service.cc:1511] Processing CreateTablet for tablet b881738a5b7f4910b375833c1cd61083 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:46.877611 22567 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 36) took 2022 ms. Trace:
I20260709 13:06:46.841325 22495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66564b8595294cedb0956a6878879f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.900375 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b881738a5b7f4910b375833c1cd61083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.880611 22698 ts_tablet_manager.cc:1434] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.067s	user 0.002s	sys 0.005s
I20260709 13:06:46.901741 22698 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:46.901783 22487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d81cdb43c4dd69ba77b3db56e94e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.865752 22486 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 43) took 2138 ms. Trace:
I20260709 13:06:46.905233 22486 rpcz_store.cc:276] 0709 13:06:44.726941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.416339 (+689398us) service_pool.cc:224] Handling call
0709 13:06:45.539533 (+123194us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800003698. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d71a2 00007fec2c118bb9 00007fec2b249d88 00007fec2b30cb80 00007fec2b2bb400 00007fec24740af4 00007fec24740a82 00007fec247409b1 00007fec2474092c
0709 13:06:45.539602 (+    69us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.539707 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.835625 (+1295918us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.865261 (+ 29636us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.865695 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34982144}
I20260709 13:06:46.887759 22635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d81cdb43c4dd69ba77b3db56e94e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:46.867775 22619 leader_election.cc:343] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.843012 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:46.908102 22580 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:46.885502 22493 rpcz_store.cc:276] 0709 13:06:44.725089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.339514 (+614425us) service_pool.cc:224] Handling call
0709 13:06:45.377862 (+ 38348us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.380738 (+  2876us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:45.561127 (+180389us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.883760 (+1322633us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.885043 (+  1283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631488}
I20260709 13:06:46.910660 22493 tablet_service.cc:1511] Processing CreateTablet for tablet f6c34f1ef8704ce29f9df924d306bc42 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:46.912325 22493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c34f1ef8704ce29f9df924d306bc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.911474 22567 rpcz_store.cc:276] 0709 13:06:44.854833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.522269 (+667436us) service_pool.cc:224] Handling call
0709 13:06:45.524137 (+  1868us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.524228 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.825607 (+1301379us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.877068 (+ 51461us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.877545 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.913885 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c028af0e9e408792f2900ec24e194b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.915041 22567 tablet_service.cc:1511] Processing CreateTablet for tablet 360d81cdb43c4dd69ba77b3db56e94e4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:46.883014 22490 tablet_service.cc:1511] Processing CreateTablet for tablet a4afa4eec9774883a53b37419c20bbf4 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:46.920068 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4afa4eec9774883a53b37419c20bbf4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:46.922134 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080020ef20 after lost signal to thread 22604
W20260709 13:06:46.922484 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800211060 after lost signal to thread 22605
W20260709 13:06:46.928975 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 77416.7us
I20260709 13:06:46.929992 22543 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:46.955101 22561 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 27) took 2120 ms. Trace:
I20260709 13:06:46.869980 22488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 41) took 2143 ms. Trace:
W20260709 13:06:46.972204 22545 leader_election.cc:343] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:46.967844 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4afa4eec9774883a53b37419c20bbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.968000 22566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dc0c7d4f9341eeb7472424613de2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.969635 22492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dc0c7d4f9341eeb7472424613de2ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:46.979039 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080014fec0 after lost signal to thread 22678
I20260709 13:06:46.867648 22565 tablet_service.cc:1511] Processing CreateTablet for tablet 77ec411c33594ae08408279ef5c44410 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:46.993309 22695 tablet_bootstrap.cc:492] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:46.994045 22695 ts_tablet_manager.cc:1403] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 1.436s	user 0.026s	sys 0.041s
I20260709 13:06:46.994251 22638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c413dbaae364e3a919a92c57b6216ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.997329 22568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c413dbaae364e3a919a92c57b6216ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:46.997481 22486 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7684e99fff4bc297f8fbf170e45ddb (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:46.993224 22727 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.999212 22726 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:46.999778 22726 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.000149 22726 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:46.998759 22727 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:46.979868 22637 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 43) took 2124 ms. Trace:
I20260709 13:06:47.004426 22637 rpcz_store.cc:276] 0709 13:06:44.853869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.210339 (+356470us) service_pool.cc:224] Handling call
0709 13:06:45.212590 (+  2251us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.212702 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.781497 (+1568795us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.790134 (+  8637us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.978183 (+188049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.006705 22637 tablet_service.cc:1511] Processing CreateTablet for tablet 813ede727198414390a20d5845e75e07 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:47.008152 22637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813ede727198414390a20d5845e75e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.009119 22494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c413dbaae364e3a919a92c57b6216ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.014485 22694 tablet_bootstrap.cc:654] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.017701 22727 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.020193 22579 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:46.963037 22561 rpcz_store.cc:276] 0709 13:06:44.832044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.353297 (+521253us) service_pool.cc:224] Handling call
0709 13:06:45.473166 (+119869us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.481745 (+  8579us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.841011 (+1359266us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.848475 (+  7464us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.952132 (+103657us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.987326 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4260 after lost signal to thread 22679
I20260709 13:06:46.988188 22640 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 49) took 1988 ms. Trace:
I20260709 13:06:47.026716 22703 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.037400 22561 tablet_service.cc:1511] Processing CreateTablet for tablet f6c34f1ef8704ce29f9df924d306bc42 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:46.989961 22643 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 48) took 1993 ms. Trace:
I20260709 13:06:47.041117 22643 rpcz_store.cc:276] 0709 13:06:44.996226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.498509 (+502283us) service_pool.cc:224] Handling call
0709 13:06:46.829434 (+1330925us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.829557 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.871849 (+ 42292us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.963528 (+ 91679us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.988610 (+ 25082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.043726 22643 tablet_service.cc:1511] Processing CreateTablet for tablet 1abd591408b04d32a9049743f1e89547 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:47.029183 22727 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.047534 22486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7684e99fff4bc297f8fbf170e45ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.049065 22565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ec411c33594ae08408279ef5c44410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.056770 22570 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 45) took 2158 ms. Trace:
I20260709 13:06:46.974058 22488 rpcz_store.cc:276] 0709 13:06:44.726351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.507897 (+781546us) service_pool.cc:224] Handling call
0709 13:06:45.509786 (+  1889us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.509898 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.753725 (+1243827us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.864889 (+111164us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.869912 (+  5023us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3059}
I20260709 13:06:47.028946 22640 rpcz_store.cc:276] 0709 13:06:44.998303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.466878 (+468575us) service_pool.cc:224] Handling call
0709 13:06:45.569617 (+102739us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.716973 (+1147356us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d7785 00007fec2b30c298 00007fec2b30cc7d 00007fec2b2bb400 00007fec24740af4 00007fec24740a82 00007fec247409b1 00007fec2474092c 00007fec2473fbe2 00007fec2463648c
0709 13:06:46.717313 (+   340us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.779443 (+ 62130us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.845741 (+ 66298us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.986745 (+141004us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7987456}
I20260709 13:06:47.061105 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:47.048727 22491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 44) took 2318 ms. Trace:
I20260709 13:06:47.071488 22700 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.069470 22491 rpcz_store.cc:276] 0709 13:06:44.727244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.546753 (+819509us) service_pool.cc:224] Handling call
0709 13:06:45.548650 (+  1897us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:45.548745 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.856152 (+1307407us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.990354 (+134202us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.045611 (+ 55257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.074134 22488 tablet_service.cc:1511] Processing CreateTablet for tablet 88d0b8c255a14106a3b00b5476896b2c (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:47.077126 22703 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.077909 22703 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.080112 22703 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.066730 22570 rpcz_store.cc:276] 0709 13:06:44.897584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.804051 (+1906467us) service_pool.cc:224] Handling call
0709 13:06:46.806327 (+  2276us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.806433 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.867033 (+ 60600us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:46.990154 (+123121us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.055465 (+ 65311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.082620 22570 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7684e99fff4bc297f8fbf170e45ddb (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:47.087080 22703 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.087721 22703 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.090054 22703 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.101845 22489 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 48) took 2201 ms. Trace:
I20260709 13:06:47.105014 22489 rpcz_store.cc:276] 0709 13:06:44.900134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.816200 (+1916066us) service_pool.cc:224] Handling call
0709 13:06:46.818244 (+  2044us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.818345 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.036344 (+217999us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.101048 (+ 64704us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.101775 (+   727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.110556 22491 tablet_service.cc:1511] Processing CreateTablet for tablet b9c028af0e9e408792f2900ec24e194b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:47.113693 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c028af0e9e408792f2900ec24e194b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.068687 22643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abd591408b04d32a9049743f1e89547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.034471 22695 raft_consensus.cc:359] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.125818 22695 raft_consensus.cc:385] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.126408 22695 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.066814 22727 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:47.051647 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 161368us
I20260709 13:06:47.153432 22488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d0b8c255a14106a3b00b5476896b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.149067 22563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b881738a5b7f4910b375833c1cd61083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.169644 22727 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.170849 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.158023 22489 tablet_service.cc:1511] Processing CreateTablet for tablet 1abd591408b04d32a9049743f1e89547 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:47.180284 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.172811 22638 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 50) took 2138 ms. Trace:
I20260709 13:06:47.181234 22638 rpcz_store.cc:276] 0709 13:06:45.035312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.765110 (+1729798us) service_pool.cc:224] Handling call
0709 13:06:46.969319 (+204209us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.977028 (+  7709us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.112334 (+135306us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.172286 (+ 59952us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.172746 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.177929 22564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66564b8595294cedb0956a6878879f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.189545 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:47.201426 22570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7684e99fff4bc297f8fbf170e45ddb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:47.197096 22545 leader_election.cc:343] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.149461 22695 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.202620 22505 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:47.203737 22695 ts_tablet_manager.cc:1434] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.209s	user 0.009s	sys 0.000s
I20260709 13:06:47.210839 22494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 50) took 2216 ms. Trace:
I20260709 13:06:47.192147 22700 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:47.226665 22403 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 2) took 2143 ms. Trace:
I20260709 13:06:47.225764 22489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abd591408b04d32a9049743f1e89547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.206120 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.215034 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.231804 22503 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:47.227064 22403 rpcz_store.cc:276] 0709 13:06:45.082922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.083537 (+   615us) service_pool.cc:224] Handling call
0709 13:06:47.226614 (+2143077us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124245,"reported_tablets":28}
I20260709 13:06:47.219285 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 2) took 2054 ms. Trace:
I20260709 13:06:47.205054 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:06:47.238078 22545 leader_election.cc:343] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.238829 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:47.239789 22729 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.239866 22728 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.240331 22729 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.240403 22728 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.240757 22729 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.240847 22728 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.241185 22695 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:47.242661 22566 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 49) took 2246 ms. Trace:
I20260709 13:06:47.243342 22566 rpcz_store.cc:276] 0709 13:06:44.996581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.884633 (+1888052us) service_pool.cc:224] Handling call
0709 13:06:46.886625 (+  1992us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.886732 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.228991 (+342259us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.241604 (+ 12613us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.242534 (+   930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.245261 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:47.245805 22490 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 51) took 2213 ms. Trace:
I20260709 13:06:47.245937 22579 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:47.220607 22567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d81cdb43c4dd69ba77b3db56e94e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.221300 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:47.246205 22490 rpcz_store.cc:276] 0709 13:06:45.033937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.881759 (+1847822us) service_pool.cc:224] Handling call
0709 13:06:46.919447 (+ 37688us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.919582 (+   135us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.197171 (+277589us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.245312 (+ 48141us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.245750 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.248193 22490 tablet_service.cc:1511] Processing CreateTablet for tablet 813ede727198414390a20d5845e75e07 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:47.250471 22561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c34f1ef8704ce29f9df924d306bc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.251380 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:06:47.252944 22699 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.253373 22699 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.253755 22699 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.253820 22400 rpcz_store.cc:276] 0709 13:06:45.164658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.164826 (+   168us) service_pool.cc:224] Handling call
0709 13:06:47.219068 (+2054242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33024,"reported_tablets":13}
I20260709 13:06:47.256944 22495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 46) took 2468 ms. Trace:
I20260709 13:06:47.211280 22494 rpcz_store.cc:276] 0709 13:06:44.994345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.865505 (+1871160us) service_pool.cc:224] Handling call
0709 13:06:46.874582 (+  9077us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.874703 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.183469 (+308766us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.205645 (+ 22176us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.210771 (+  5126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883008}
I20260709 13:06:47.228950 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:47.260548 22726 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.257901 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4afa4eec9774883a53b37419c20bbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.263208 22726 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.263924 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:47.264950 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:47.265654 22545 leader_election.cc:343] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.221472 22492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 49) took 2261 ms. Trace:
I20260709 13:06:47.266847 22495 rpcz_store.cc:276] 0709 13:06:44.788973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.731477 (+1942504us) service_pool.cc:224] Handling call
0709 13:06:46.809999 (+ 78522us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.810108 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:46.995186 (+185078us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.256295 (+261109us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.256837 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10884}
I20260709 13:06:47.266372 22492 rpcz_store.cc:276] 0709 13:06:44.960514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.853301 (+1892787us) service_pool.cc:224] Handling call
0709 13:06:46.855972 (+  2671us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.856286 (+   314us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.094120 (+237834us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.210162 (+116042us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.221407 (+ 11245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.259332 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 2) took 2168 ms. Trace:
I20260709 13:06:47.272513 22402 rpcz_store.cc:276] 0709 13:06:45.090887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.091079 (+   192us) service_pool.cc:224] Handling call
0709 13:06:47.259071 (+2167992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":368355,"reported_tablets":20}
I20260709 13:06:47.286273 22644 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 54) took 1790 ms. Trace:
I20260709 13:06:47.286767 22700 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:47.286834 22644 rpcz_store.cc:276] 0709 13:06:45.501088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.858752 (+1357664us) service_pool.cc:224] Handling call
0709 13:06:46.860530 (+  1778us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.860633 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.107506 (+246873us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.285763 (+178257us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.286205 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.293998 22490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813ede727198414390a20d5845e75e07. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:47.280097 22543 leader_election.cc:343] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:47.297916 22543 leader_election.cc:343] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.298444 22543 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:47.299741 22543 leader_election.cc:343] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:47.300725 22543 leader_election.cc:343] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.302752 22694 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:47.305042 22726 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.305668 22635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 52) took 2203 ms. Trace:
I20260709 13:06:47.319468 22635 rpcz_store.cc:276] 0709 13:06:45.102523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.846130 (+1743607us) service_pool.cc:224] Handling call
0709 13:06:46.887279 (+ 41149us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.887383 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.135181 (+247798us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.304821 (+169640us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.305602 (+   781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.319981 22562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 51) took 2262 ms. Trace:
I20260709 13:06:47.320667 22562 rpcz_store.cc:276] 0709 13:06:45.057635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.887985 (+1830350us) service_pool.cc:224] Handling call
0709 13:06:46.889756 (+  1771us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.889843 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.302046 (+412203us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.319391 (+ 17345us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.319923 (+   532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.307204 22565 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 47) took 2403 ms. Trace:
I20260709 13:06:47.306452 22729 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.322631 22562 tablet_service.cc:1511] Processing CreateTablet for tablet b9c028af0e9e408792f2900ec24e194b (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:47.323144 22729 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.323959 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c028af0e9e408792f2900ec24e194b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.325780 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:47.326555 22503 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.309966 22641 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 53) took 1896 ms. Trace:
I20260709 13:06:47.267181 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:47.310254 22699 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.306409 22566 tablet_service.cc:1511] Processing CreateTablet for tablet 1abd591408b04d32a9049743f1e89547 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:47.318907 22543 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:47.345765 22726 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.346531 22695 tablet_bootstrap.cc:654] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:47.346781 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46081.9us
I20260709 13:06:47.329370 22493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 53) took 2228 ms. Trace:
I20260709 13:06:47.348891 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:47.349017 22493 rpcz_store.cc:276] 0709 13:06:45.101222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.909351 (+1808129us) service_pool.cc:224] Handling call
0709 13:06:46.911715 (+  2364us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.911821 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.229433 (+317612us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.292484 (+ 63051us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.327394 (+ 34910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.327312 22565 rpcz_store.cc:276] 0709 13:06:44.904130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.866678 (+1962548us) service_pool.cc:224] Handling call
0709 13:06:46.997720 (+131042us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.997823 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.192981 (+195158us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.306713 (+113732us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.307144 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.352885 22565 tablet_service.cc:1511] Processing CreateTablet for tablet 88d0b8c255a14106a3b00b5476896b2c (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:47.353228 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:47.353914 22579 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.336992 22569 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 44) took 2448 ms. Trace:
I20260709 13:06:47.353258 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:06:47.358254 22543 leader_election.cc:343] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:47.359288 22468 leader_election.cc:343] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.321478 22636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45752 (request call id 51) took 2219 ms. Trace:
I20260709 13:06:47.341078 22694 ts_tablet_manager.cc:1403] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.476s	user 0.031s	sys 0.017s
I20260709 13:06:47.359895 22636 rpcz_store.cc:276] 0709 13:06:45.101625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.835108 (+1733483us) service_pool.cc:224] Handling call
0709 13:06:46.887673 (+ 52565us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.887765 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.096490 (+208725us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.320836 (+224346us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.321389 (+   553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.345116 22566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abd591408b04d32a9049743f1e89547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.365881 22565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d0b8c255a14106a3b00b5476896b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.367997 22487 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 52) took 2292 ms. Trace:
I20260709 13:06:47.329864 22653 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.369009 22488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 58) took 1830 ms. Trace:
I20260709 13:06:47.369390 22488 rpcz_store.cc:276] 0709 13:06:45.538538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.073120 (+1534582us) service_pool.cc:224] Handling call
0709 13:06:47.075024 (+  1904us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:47.075121 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.215239 (+140118us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.351727 (+136488us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.368945 (+ 17218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.370230 22698 tablet_bootstrap.cc:654] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.368589 22487 rpcz_store.cc:276] 0709 13:06:45.075301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.882271 (+1806970us) service_pool.cc:224] Handling call
0709 13:06:46.884100 (+  1829us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.884206 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.217541 (+333335us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.358159 (+140618us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.367930 (+  9771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.343607 22562 tablet_service.cc:1511] Processing CreateTablet for tablet 813ede727198414390a20d5845e75e07 (DEFAULT_TABLE table=test-workload [id=2646b0dde47f4fce81117d088ff28920]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:47.361757 22563 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 48) took 2366 ms. Trace:
I20260709 13:06:47.336704 22503 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:47.364114 22694 raft_consensus.cc:359] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.364822 22579 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:47.377828 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:06:47.377974 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:06:47.379362 22726 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.379889 22726 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:47.353348 22699 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.373359 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813ede727198414390a20d5845e75e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.328835 22641 rpcz_store.cc:276] 0709 13:06:45.413416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.855098 (+1441682us) service_pool.cc:224] Handling call
0709 13:06:46.874192 (+ 19094us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.874299 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.193563 (+319264us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.309401 (+115838us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.309893 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.380793 22726 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.389294 22699 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.394791 22699 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:47.360378 22728 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.386207 22694 raft_consensus.cc:385] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.405267 22653 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:47.388805 22402 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.407045 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:47.407701 22503 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.404116 22699 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.407821 22543 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:47.409117 22729 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.409576 22729 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:47.380676 22568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 50) took 2381 ms. Trace:
I20260709 13:06:47.357134 22569 rpcz_store.cc:276] 0709 13:06:44.888898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.809952 (+1921054us) service_pool.cc:224] Handling call
0709 13:06:46.842747 (+ 32795us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.843916 (+  1169us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.108005 (+264089us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.323685 (+215680us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.328471 (+  4786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7552}
I20260709 13:06:47.411793 22728 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.410343 22729 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.390554 22564 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 46) took 2487 ms. Trace:
I20260709 13:06:47.401044 22694 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.392450 22486 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 54) took 2067 ms. Trace:
I20260709 13:06:47.424396 22486 rpcz_store.cc:276] 0709 13:06:45.325115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.966663 (+1641548us) service_pool.cc:224] Handling call
0709 13:06:46.998610 (+ 31947us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.998728 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.311832 (+313104us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.391948 (+ 80116us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.392393 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.424641 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:06:47.438969 22543 leader_election.cc:343] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.421959 22564 rpcz_store.cc:276] 0709 13:06:44.903612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.863872 (+1960260us) service_pool.cc:224] Handling call
0709 13:06:46.875886 (+ 12014us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.876215 (+   329us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.315701 (+439486us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.390038 (+ 74337us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.390481 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.381279 22563 rpcz_store.cc:276] 0709 13:06:44.995460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.868768 (+1873308us) service_pool.cc:224] Handling call
0709 13:06:46.894840 (+ 26072us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.894967 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.303669 (+408702us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.361197 (+ 57528us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.361691 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.442519 22570 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 54) took 2117 ms. Trace:
I20260709 13:06:47.442987 22570 rpcz_store.cc:276] 0709 13:06:45.324813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.081626 (+1756813us) service_pool.cc:224] Handling call
0709 13:06:47.083483 (+  1857us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:47.083696 (+   213us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.307785 (+224089us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.441951 (+134166us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.442457 (+   506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.445631 22561 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 53) took 2122 ms. Trace:
I20260709 13:06:47.446089 22561 rpcz_store.cc:276] 0709 13:06:45.323597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.036363 (+1712766us) service_pool.cc:224] Handling call
0709 13:06:47.053887 (+ 17524us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:47.056803 (+  2916us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.295612 (+238809us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.445021 (+149409us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.445554 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.447764 22694 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.412173 22568 rpcz_store.cc:276] 0709 13:06:44.999612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.887331 (+1887719us) service_pool.cc:224] Handling call
0709 13:06:46.892689 (+  5358us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.892807 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.335681 (+442874us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.380172 (+ 44491us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.380616 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.461745 22694 ts_tablet_manager.cc:1434] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.101s	user 0.004s	sys 0.004s
I20260709 13:06:47.462316 22695 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:47.462334 22491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 57) took 1924 ms. Trace:
I20260709 13:06:47.464660 22491 rpcz_store.cc:276] 0709 13:06:45.538231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.109455 (+1571224us) service_pool.cc:224] Handling call
0709 13:06:47.113130 (+  3675us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:47.113270 (+   140us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.336121 (+222851us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.449564 (+113443us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.462272 (+ 12708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.466719 22695 ts_tablet_manager.cc:1403] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.226s	user 0.017s	sys 0.007s
I20260709 13:06:47.467602 22567 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41926 (request call id 52) took 2365 ms. Trace:
I20260709 13:06:47.468008 22567 rpcz_store.cc:276] 0709 13:06:45.101777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.914068 (+1812291us) service_pool.cc:224] Handling call
0709 13:06:46.916017 (+  1949us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:46.916170 (+   153us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.304599 (+388429us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.450975 (+146376us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.467535 (+ 16560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.469867 22694 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:47.470402 22698 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:47.470746 22503 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:47.469887 22695 raft_consensus.cc:359] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.471342 22695 raft_consensus.cc:385] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.470952 22698 ts_tablet_manager.cc:1403] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.569s	user 0.029s	sys 0.002s
I20260709 13:06:47.471654 22695 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.472201 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:06:47.472442 22695 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.474406 22698 raft_consensus.cc:359] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.474983 22695 ts_tablet_manager.cc:1434] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:47.475143 22698 raft_consensus.cc:385] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.475505 22698 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.476148 22695 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
W20260709 13:06:47.453411 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 74576.3us
I20260709 13:06:47.477535 22489 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 55) took 1940 ms. Trace:
I20260709 13:06:47.477933 22489 rpcz_store.cc:276] 0709 13:06:45.537346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.116017 (+1578671us) service_pool.cc:224] Handling call
0709 13:06:47.191816 (+ 75799us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:47.205175 (+ 13359us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.362886 (+157711us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.476994 (+114108us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.477475 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.478603 22726 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.476209 22698 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.482081 22698 ts_tablet_manager.cc:1434] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:47.480301 22726 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:47.482672 22694 tablet_bootstrap.cc:654] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.483181 22698 tablet_bootstrap.cc:492] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:47.483299 22726 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.491094 22403 catalog_manager.cc:5697] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.495344 22698 tablet_bootstrap.cc:654] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.499524 22490 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59516 (request call id 56) took 1961 ms. Trace:
I20260709 13:06:47.499963 22490 rpcz_store.cc:276] 0709 13:06:45.537916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.247231 (+1709315us) service_pool.cc:224] Handling call
0709 13:06:47.293493 (+ 46262us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:06:47.293601 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:06:47.436100 (+142499us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:47.498584 (+ 62484us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:47.499447 (+   863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.507254 22698 tablet_bootstrap.cc:492] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:47.507463 22694 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:47.507798 22698 ts_tablet_manager.cc:1403] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 13:06:47.508147 22694 ts_tablet_manager.cc:1403] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:06:47.513028 22695 tablet_bootstrap.cc:654] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.515048 22698 raft_consensus.cc:359] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.515946 22698 raft_consensus.cc:385] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.516286 22698 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.525103 22698 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.527822 22698 ts_tablet_manager.cc:1434] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:06:47.524624 22694 raft_consensus.cc:359] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.528965 22694 raft_consensus.cc:385] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.529361 22694 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.530332 22698 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:47.535408 22695 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:47.536015 22695 ts_tablet_manager.cc:1403] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.008s
I20260709 13:06:47.539080 22698 tablet_bootstrap.cc:654] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.539484 22695 raft_consensus.cc:359] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.540284 22695 raft_consensus.cc:385] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.540594 22695 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.548774 22695 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.541312 22694 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.551494 22694 ts_tablet_manager.cc:1434] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 13:06:47.552788 22694 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:47.553822 22698 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:47.554382 22698 ts_tablet_manager.cc:1403] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:06:47.559849 22694 tablet_bootstrap.cc:654] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.562902 22695 ts_tablet_manager.cc:1434] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 13:06:47.564078 22695 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:47.572031 22695 tablet_bootstrap.cc:654] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.578711 22400 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.583016 22695 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:47.585728 22694 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:47.586365 22694 ts_tablet_manager.cc:1403] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.007s
I20260709 13:06:47.586884 22695 ts_tablet_manager.cc:1403] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:06:47.557520 22698 raft_consensus.cc:359] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.587517 22698 raft_consensus.cc:385] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.587865 22698 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.588699 22698 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.591295 22698 ts_tablet_manager.cc:1434] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:06:47.591358 22694 raft_consensus.cc:359] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.592197 22694 raft_consensus.cc:385] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.592510 22694 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.593355 22694 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.596609 22695 raft_consensus.cc:359] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.597473 22695 raft_consensus.cc:385] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.597805 22695 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.600243 22694 ts_tablet_manager.cc:1434] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:06:47.601469 22694 tablet_bootstrap.cc:492] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:47.605305 22695 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.611543 22695 ts_tablet_manager.cc:1434] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:06:47.612730 22695 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:47.619648 22700 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.620220 22700 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.622406 22700 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:47.623102 22695 tablet_bootstrap.cc:654] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.624194 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.624884 22503 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:47.625417 22694 tablet_bootstrap.cc:654] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.626163 22698 tablet_bootstrap.cc:492] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:47.628034 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:47.628715 22579 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:47.626118 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:47.631048 22700 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.631573 22700 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.631999 22700 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.634315 22698 tablet_bootstrap.cc:654] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.644030 22700 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.653772 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:47.654372 22694 tablet_bootstrap.cc:492] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:47.654440 22503 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.654976 22694 ts_tablet_manager.cc:1403] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.012s
I20260709 13:06:47.657192 22726 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.657809 22726 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.657948 22400 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.659893 22726 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.660002 22400 catalog_manager.cc:5697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.661289 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:47.661993 22694 raft_consensus.cc:359] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.662791 22694 raft_consensus.cc:385] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:47.662966 22543 leader_election.cc:343] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.663142 22694 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.664060 22503 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:47.664395 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.663977 22694 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.667309 22695 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:47.667104 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:47.670486 22695 ts_tablet_manager.cc:1403] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.007s
I20260709 13:06:47.670712 22579 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:47.671240 22545 leader_election.cc:343] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.671758 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:47.673614 22726 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.677953 22694 ts_tablet_manager.cc:1434] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 13:06:47.679059 22694 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:47.681578 22698 tablet_bootstrap.cc:492] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:47.681509 22695 raft_consensus.cc:359] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.689868 22695 raft_consensus.cc:385] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.690078 22698 ts_tablet_manager.cc:1403] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.006s
I20260709 13:06:47.690253 22695 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.691290 22695 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.693778 22695 ts_tablet_manager.cc:1434] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:06:47.686146 22694 tablet_bootstrap.cc:654] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.694944 22579 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:47.668020 22700 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:47.696286 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:47.700059 22730 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.702467 22695 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:47.697741 22698 raft_consensus.cc:359] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.711037 22698 raft_consensus.cc:385] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.711874 22698 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.713174 22698 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.715529 22730 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:47.716604 22730 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.717578 22695 tablet_bootstrap.cc:654] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.721638 22698 ts_tablet_manager.cc:1434] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:06:47.723663 22694 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:47.724282 22698 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:47.724205 22694 ts_tablet_manager.cc:1403] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.001s
I20260709 13:06:47.727455 22694 raft_consensus.cc:359] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.728324 22694 raft_consensus.cc:385] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.728736 22694 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.734192 22700 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:47.740200 22694 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.744719 22695 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:47.745319 22695 ts_tablet_manager.cc:1403] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.002s
I20260709 13:06:47.749265 22698 tablet_bootstrap.cc:654] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:47.752840 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:47.756330 22694 ts_tablet_manager.cc:1434] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:06:47.757601 22694 tablet_bootstrap.cc:492] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:47.751233 22400 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.748319 22695 raft_consensus.cc:359] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.765574 22695 raft_consensus.cc:385] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.766052 22695 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.767274 22695 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.768736 22726 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.769289 22726 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.773664 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.774730 22726 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.775859 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:47.777626 22545 leader_election.cc:343] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.779307 22695 ts_tablet_manager.cc:1434] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
W20260709 13:06:47.781309 22543 leader_election.cc:343] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:47.781929 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:47.784497 22726 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:47.787441 22698 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:47.797318 22698 ts_tablet_manager.cc:1403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.004s
I20260709 13:06:47.789703 22695 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:47.790901 22694 tablet_bootstrap.cc:654] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:47.796039 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.805745 22699 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.806272 22699 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.800280 22698 raft_consensus.cc:359] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.807564 22698 raft_consensus.cc:385] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.807925 22698 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.809926 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:47.810807 22579 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:47.812650 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:47.814129 22735 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.814908 22735 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.815356 22735 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.838369 22699 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.838937 22699 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.839025 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:47.839692 22653 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:47.839442 22699 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.841008 22694 tablet_bootstrap.cc:492] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:47.841379 22503 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.841524 22694 ts_tablet_manager.cc:1403] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.000s
I20260709 13:06:47.844429 22694 raft_consensus.cc:359] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.844777 22735 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.845263 22694 raft_consensus.cc:385] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.845741 22694 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.847632 22698 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.848084 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:47.848881 22579 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.850639 22735 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.850924 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:47.851567 22653 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.851967 22698 ts_tablet_manager.cc:1434] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.016s
I20260709 13:06:47.846716 22694 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.855139 22694 ts_tablet_manager.cc:1434] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:06:47.857738 22694 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:47.864009 22726 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:47.855960 22579 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:47.856524 22735 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.875053 22735 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.875965 22726 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.877521 22735 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.878175 22735 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:47.880985 22699 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.885231 22694 tablet_bootstrap.cc:654] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.888317 22726 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:47.890920 22695 tablet_bootstrap.cc:654] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.892385 22653 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:47.897869 22698 tablet_bootstrap.cc:492] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:47.906934 22694 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:47.907490 22694 ts_tablet_manager.cc:1403] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.005s
I20260709 13:06:47.909250 22653 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.910434 22694 raft_consensus.cc:359] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.911479 22694 raft_consensus.cc:385] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.911814 22694 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.912570 22694 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.914806 22694 ts_tablet_manager.cc:1434] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:47.915831 22694 tablet_bootstrap.cc:492] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:47.927304 22730 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.939054 22730 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:47.945529 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75145.6us
I20260709 13:06:47.947320 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.955291 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:47.958107 22754 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.958715 22754 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.951377 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:47.963182 22652 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:47.963518 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:47.964331 22579 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 1: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:06:47.973588 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:47.975497 22754 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:47.976765 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:47.961449 22730 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:47.978259 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:47.978937 22579 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:47.980252 22698 tablet_bootstrap.cc:654] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.981688 22617 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:47.983283 22730 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:47.983788 22730 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.984153 22730 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.984879 22764 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.985440 22764 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:47.985994 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:47.986898 22754 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.987573 22502 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:47.988083 22764 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:47.988585 22694 tablet_bootstrap.cc:654] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.993175 22729 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:47.997852 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:47.998077 22695 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:47.999444 22695 ts_tablet_manager.cc:1403] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.210s	user 0.019s	sys 0.019s
I20260709 13:06:48.000927 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.002422 22764 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.002251 22695 raft_consensus.cc:359] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.002271 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.003532 22764 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:48.004838 22762 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.003050 22695 raft_consensus.cc:385] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.005242 22762 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.005345 22695 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.006341 22762 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.007026 22764 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.008021 22695 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.013855 22695 ts_tablet_manager.cc:1434] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:06:48.015283 22695 tablet_bootstrap.cc:492] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:48.022509 22754 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.031520 22698 tablet_bootstrap.cc:492] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:48.032085 22698 ts_tablet_manager.cc:1403] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.134s	user 0.023s	sys 0.020s
I20260709 13:06:48.035091 22698 raft_consensus.cc:359] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.035195 22762 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.035820 22698 raft_consensus.cc:385] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.036109 22698 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.036836 22698 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.040150 22762 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:48.041079 22468 leader_election.cc:343] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.042649 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:48.043793 22762 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.050460 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.051535 22580 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:48.069329 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.074787 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:48.077278 22654 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.077456 22730 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.080407 22730 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.082464 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:48.083280 22503 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.076848 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.083504 22653 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:48.097314 22698 ts_tablet_manager.cc:1434] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.004s
I20260709 13:06:48.098459 22698 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:48.088474 22762 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:06:48.101202 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:48.101877 22580 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:48.109611 22543 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.111140 22727 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.111637 22727 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.111974 22729 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.113796 22727 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.114396 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:48.116418 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.119113 22694 tablet_bootstrap.cc:492] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.119633 22694 ts_tablet_manager.cc:1403] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.204s	user 0.032s	sys 0.035s
W20260709 13:06:48.121503 22545 leader_election.cc:343] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.121510 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.122982 22503 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:48.123811 22699 raft_consensus.cc:2764] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:06:48.124295 22543 leader_election.cc:343] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.124768 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.125716 22729 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.126042 22727 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.125804 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.126230 22729 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.127259 22695 tablet_bootstrap.cc:654] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.127455 22730 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.128263 22730 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:48.128839 22729 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:48.130465 22468 leader_election.cc:343] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.130719 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.132661 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:48.133165 22545 leader_election.cc:343] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.133378 22694 raft_consensus.cc:359] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.134106 22694 raft_consensus.cc:385] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.134413 22694 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
W20260709 13:06:48.134564 22543 leader_election.cc:343] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.135012 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.129560 22730 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.135865 22400 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.139339 22694 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.140903 22729 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.147572 22694 ts_tablet_manager.cc:1434] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:06:48.148720 22694 tablet_bootstrap.cc:492] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.149210 22654 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:48.125761 22580 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:48.270365 22698 tablet_bootstrap.cc:654] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.273278 22729 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.285742 22729 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.193356 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:48.191485 22695 tablet_bootstrap.cc:492] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:48.209102 22700 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.094s
I20260709 13:06:48.289986 22764 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.304850 22764 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:48.306041 22764 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.306964 22730 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.307464 22730 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.196100 22754 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.313095 22754 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.288856 22729 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:48.290325 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 97131.7us
I20260709 13:06:48.295274 22694 tablet_bootstrap.cc:654] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.302731 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.292995 22695 ts_tablet_manager.cc:1403] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.278s	user 0.022s	sys 0.002s
I20260709 13:06:48.323071 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.323778 22503 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:48.325227 22619 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.324627 22403 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.325299 22762 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.326241 22545 leader_election.cc:343] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.326409 22762 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.329047 22762 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.329656 22730 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.330152 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.331023 22730 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:48.332901 22730 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.333396 22730 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.333776 22730 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.342728 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.331028 22579 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:48.342172 22694 tablet_bootstrap.cc:492] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.344177 22694 ts_tablet_manager.cc:1403] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.016s
I20260709 13:06:48.344606 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.346314 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.346978 22578 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:48.347419 22694 raft_consensus.cc:359] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.348132 22694 raft_consensus.cc:385] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.348413 22694 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
W20260709 13:06:48.349346 22543 leader_election.cc:343] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.349789 22543 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.351727 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.352507 22754 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.352629 22729 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.359237 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.361321 22694 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.363817 22694 ts_tablet_manager.cc:1434] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 13:06:48.364807 22694 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.364914 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.366714 22784 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.362185 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.349942 22695 raft_consensus.cc:359] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.371773 22695 raft_consensus.cc:385] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.372301 22694 tablet_bootstrap.cc:654] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.373242 22764 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.373723 22764 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.374114 22764 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.385316 22695 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.390492 22402 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.395380 22695 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.399175 22730 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.400537 22654 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:48.404224 22698 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:48.404747 22698 ts_tablet_manager.cc:1403] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.306s	user 0.039s	sys 0.060s
I20260709 13:06:48.406019 22695 ts_tablet_manager.cc:1434] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:06:48.406993 22695 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:48.407577 22694 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.408006 22694 ts_tablet_manager.cc:1403] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.012s
I20260709 13:06:48.408538 22698 raft_consensus.cc:359] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.409267 22698 raft_consensus.cc:385] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.409571 22698 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.410248 22698 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.410943 22694 raft_consensus.cc:359] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.411588 22694 raft_consensus.cc:385] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.411856 22694 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.412530 22694 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.412942 22764 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.414849 22694 ts_tablet_manager.cc:1434] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:48.415787 22694 tablet_bootstrap.cc:492] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.415899 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:48.416477 22580 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.422247 22698 ts_tablet_manager.cc:1434] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:48.422322 22694 tablet_bootstrap.cc:654] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.429895 22580 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:48.431064 22762 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:48.432719 22698 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:48.441332 22764 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.433965 22694 tablet_bootstrap.cc:492] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.442328 22694 ts_tablet_manager.cc:1403] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:06:48.445438 22694 raft_consensus.cc:359] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.446274 22694 raft_consensus.cc:385] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.446604 22694 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.434430 22730 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.435173 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:48.436990 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:48.447748 22503 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 1: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:06:48.448315 22578 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 1: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:06:48.449950 22698 tablet_bootstrap.cc:654] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.450330 22617 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.451181 22730 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.453940 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.447721 22694 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.457156 22764 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.457743 22764 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:48.458129 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:48.458904 22653 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:48.458590 22764 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.466424 22694 ts_tablet_manager.cc:1434] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:06:48.469456 22694 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.440040 22695 tablet_bootstrap.cc:654] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.469527 22653 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.491154 22694 tablet_bootstrap.cc:654] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.505262 22730 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.508450 22730 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.518839 22764 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:48.522296 22789 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:06:48.528582 22730 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.529731 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:48.531980 22619 leader_election.cc:343] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.532469 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.534027 22754 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.534523 22754 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:48.534956 22617 leader_election.cc:343] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.535393 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.537092 22779 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.539093 22695 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:48.539497 22695 ts_tablet_manager.cc:1403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.010s
I20260709 13:06:48.536578 22754 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.541126 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:48.542779 22617 leader_election.cc:343] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.542918 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:48.544631 22619 leader_election.cc:343] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.545132 22619 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.546785 22694 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.546917 22754 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.547346 22694 ts_tablet_manager.cc:1403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.000s
I20260709 13:06:48.551107 22695 raft_consensus.cc:359] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.551823 22694 raft_consensus.cc:359] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.552587 22694 raft_consensus.cc:385] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.552925 22694 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.553669 22694 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.551875 22695 raft_consensus.cc:385] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.555321 22695 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.556098 22695 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.556779 22402 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.558564 22695 ts_tablet_manager.cc:1434] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:06:48.559659 22695 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:48.564543 22779 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.566279 22694 ts_tablet_manager.cc:1434] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:06:48.567534 22694 tablet_bootstrap.cc:492] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.579138 22694 tablet_bootstrap.cc:654] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.585670 22695 tablet_bootstrap.cc:654] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.587813 22698 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:48.588508 22698 ts_tablet_manager.cc:1403] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.043s
I20260709 13:06:48.592133 22698 raft_consensus.cc:359] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.592836 22698 raft_consensus.cc:385] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.600787 22698 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.593111 22694 tablet_bootstrap.cc:492] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.596434 22695 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:48.602468 22695 ts_tablet_manager.cc:1403] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.003s
I20260709 13:06:48.601873 22694 ts_tablet_manager.cc:1403] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:06:48.605140 22698 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.606956 22694 raft_consensus.cc:359] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.607801 22694 raft_consensus.cc:385] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.608112 22694 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.608923 22694 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.610154 22698 ts_tablet_manager.cc:1434] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.007s
I20260709 13:06:48.611418 22694 ts_tablet_manager.cc:1434] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:48.612581 22698 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:48.613487 22695 raft_consensus.cc:359] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.614279 22695 raft_consensus.cc:385] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.614589 22695 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.615578 22695 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.618355 22695 ts_tablet_manager.cc:1434] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:48.619630 22694 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.629803 22695 tablet_bootstrap.cc:492] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:48.640349 22698 tablet_bootstrap.cc:654] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.645656 22779 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.651592 22694 tablet_bootstrap.cc:654] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.657235 22695 tablet_bootstrap.cc:654] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.669987 22698 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:48.670506 22698 ts_tablet_manager.cc:1403] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.004s
I20260709 13:06:48.673416 22698 raft_consensus.cc:359] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.674175 22698 raft_consensus.cc:385] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.674456 22698 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.675140 22698 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.678727 22695 tablet_bootstrap.cc:492] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:48.679203 22695 ts_tablet_manager.cc:1403] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.011s
I20260709 13:06:48.682435 22694 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.683079 22694 ts_tablet_manager.cc:1403] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.003s
I20260709 13:06:48.685781 22698 ts_tablet_manager.cc:1434] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:06:48.686002 22694 raft_consensus.cc:359] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.686870 22694 raft_consensus.cc:385] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.686815 22695 raft_consensus.cc:359] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:48.687319 22694 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.687625 22695 raft_consensus.cc:385] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.687923 22695 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.688212 22694 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.686837 22698 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:48.690557 22694 ts_tablet_manager.cc:1434] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:06:48.691612 22694 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.697714 22694 tablet_bootstrap.cc:654] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.688815 22695 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:06:48.704418 22695 ts_tablet_manager.cc:1434] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:06:48.705420 22695 tablet_bootstrap.cc:492] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:48.708114 22698 tablet_bootstrap.cc:654] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.708798 22779 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.709304 22779 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.711555 22779 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.713454 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.715560 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:48.718073 22619 leader_election.cc:343] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:48.718902 22617 leader_election.cc:343] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.719306 22617 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.720026 22779 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.720525 22694 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.721231 22694 ts_tablet_manager.cc:1403] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.003s
I20260709 13:06:48.724836 22726 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.725521 22726 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.729450 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.730300 22726 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.730705 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.732160 22695 tablet_bootstrap.cc:654] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:48.732105 22543 leader_election.cc:343] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:48.733040 22545 leader_election.cc:343] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.733151 22694 raft_consensus.cc:359] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.733587 22545 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:48.734165 22694 raft_consensus.cc:385] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.734560 22694 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.735291 22735 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.735482 22694 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.735899 22735 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.738415 22694 ts_tablet_manager.cc:1434] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:06:48.739527 22694 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.742781 22698 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:48.743285 22698 ts_tablet_manager.cc:1403] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.027s
I20260709 13:06:48.745119 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.745806 22653 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:48.746048 22698 raft_consensus.cc:359] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.746640 22735 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.747036 22694 tablet_bootstrap.cc:654] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.748173 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.748543 22695 tablet_bootstrap.cc:492] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:48.749064 22695 ts_tablet_manager.cc:1403] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.044s	user 0.004s	sys 0.010s
I20260709 13:06:48.749857 22735 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.751015 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.752473 22580 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:48.752401 22735 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.753459 22735 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.752336 22726 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:48.746773 22698 raft_consensus.cc:385] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.763494 22698 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.764418 22698 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.765579 22694 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.766054 22694 ts_tablet_manager.cc:1403] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
I20260709 13:06:48.767027 22698 ts_tablet_manager.cc:1434] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:06:48.763098 22735 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.761057 22699 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.769443 22699 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.771672 22699 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:48.763082 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:48.772703 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.768970 22698 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:48.752336 22695 raft_consensus.cc:359] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.772750 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.774133 22653 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
W20260709 13:06:48.774217 22468 leader_election.cc:343] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.775470 22735 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.775740 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:48.781085 22698 tablet_bootstrap.cc:654] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.781404 22699 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.781805 22699 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.782171 22699 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.782858 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:48.783447 22653 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.785678 22764 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.786175 22764 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.788354 22764 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.789407 22699 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.790477 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.791132 22654 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:48.791563 22699 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.776132 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:48.792164 22580 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.768529 22694 raft_consensus.cc:359] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.790982 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.792784 22694 raft_consensus.cc:385] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.792990 22578 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:48.793115 22694 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.794103 22694 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.796208 22694 ts_tablet_manager.cc:1434] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:06:48.797370 22694 tablet_bootstrap.cc:492] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.802037 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:48.803020 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.804131 22699 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.804495 22699 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.804821 22699 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:48.805487 22468 leader_election.cc:343] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.806706 22653 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:48.776232 22695 raft_consensus.cc:385] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.807790 22726 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.808314 22726 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.810391 22726 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.811448 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:48.811872 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.812098 22654 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:48.813344 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:06:48.814126 22545 leader_election.cc:343] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.814987 22726 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.815379 22726 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.815757 22726 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.816053 22698 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:48.816716 22698 ts_tablet_manager.cc:1403] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.017s
I20260709 13:06:48.817123 22694 tablet_bootstrap.cc:654] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.807801 22695 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.820072 22698 raft_consensus.cc:359] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.820988 22698 raft_consensus.cc:385] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.821381 22698 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.821204 22695 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.815514 22699 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.822357 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.823649 22699 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:48.824103 22580 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:48.825608 22764 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.825660 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:48.826165 22735 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:48.826334 22579 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.826184 22764 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:48.827400 22764 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.831631 22503 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.835286 22695 ts_tablet_manager.cc:1434] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.086s	user 0.001s	sys 0.005s
W20260709 13:06:48.835566 22468 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.836280 22695 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:48.843550 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:48.844185 22654 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.844559 22698 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.848932 22579 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:48.850140 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.850997 22698 ts_tablet_manager.cc:1434] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:06:48.851090 22699 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:48.851819 22699 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:48.852300 22698 tablet_bootstrap.cc:492] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:48.852703 22699 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.854041 22694 tablet_bootstrap.cc:492] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:48.854492 22694 ts_tablet_manager.cc:1403] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:06:48.859417 22779 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.860039 22779 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.859303 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:48.865774 22779 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:48.866539 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:48.867197 22502 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:48.868531 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:48.869357 22779 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:48.869731 22779 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.873118 22779 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.870993 22653 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:48.879527 22694 raft_consensus.cc:359] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.886053 22694 raft_consensus.cc:385] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:48.886498 22694 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:48.887447 22694 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:48.891136 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:48.904244 22694 ts_tablet_manager.cc:1434] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 13:06:48.906997 22694 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:48.891824 22579 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:48.895934 22728 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.937369 22729 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.007426 22729 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.011385 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:49.013262 22545 leader_election.cc:343] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:48.885196 22726 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.037461 22694 tablet_bootstrap.cc:654] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.944067 22654 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:49.014331 22728 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.044461 22653 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:49.046484 22728 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.047410 22762 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:49.047868 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:49.035734 22729 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.053653 22698 tablet_bootstrap.cc:654] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:49.057582 22545 leader_election.cc:343] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.060962 22695 tablet_bootstrap.cc:654] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:48.952013 22401 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.075520 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:49.076483 22735 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.077013 22735 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:49.081372 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:49.081507 22735 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:49.082830 22545 leader_election.cc:343] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.079018 22779 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.091188 22698 tablet_bootstrap.cc:492] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:49.091833 22698 ts_tablet_manager.cc:1403] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.006s
I20260709 13:06:49.096479 22779 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:49.097430 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:49.098095 22503 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.108322 22726 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.111208 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:49.113294 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:49.120509 22698 raft_consensus.cc:359] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.121186 22698 raft_consensus.cc:385] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.121460 22698 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.122792 22698 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.117375 22654 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:49.125277 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:49.125911 22653 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.125953 22698 ts_tablet_manager.cc:1434] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:06:49.127012 22698 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:49.133746 22729 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.134339 22729 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.136236 22653 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:49.137414 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:49.138866 22545 leader_election.cc:343] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.136590 22729 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:49.147428 22543 leader_election.cc:343] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.151171 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.152038 22726 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.153479 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.156672 22694 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:49.157162 22694 ts_tablet_manager.cc:1403] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.250s	user 0.019s	sys 0.004s
I20260709 13:06:49.162782 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:49.165331 22762 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.165802 22579 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.161521 22503 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:49.160924 22726 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.202576 22779 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.203215 22779 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.197705 22726 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.209072 22726 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.213382 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:49.214576 22754 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.218211 22779 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:49.219421 22698 tablet_bootstrap.cc:654] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.224987 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:49.225903 22578 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:49.227373 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:49.229547 22694 raft_consensus.cc:359] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.232803 22694 raft_consensus.cc:385] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.231041 22579 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:49.231678 22779 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.234966 22695 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:49.234037 22694 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.235893 22695 ts_tablet_manager.cc:1403] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.400s	user 0.027s	sys 0.014s
W20260709 13:06:49.209807 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56444.9us
I20260709 13:06:49.238809 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.239491 22695 raft_consensus.cc:359] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.240006 22813 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.240206 22695 raft_consensus.cc:385] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.240578 22695 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.241214 22813 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:49.236337 22694 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.242975 22695 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.240723 22726 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.235915 22754 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:49.245167 22754 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.245919 22726 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.245652 22813 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.236598 22779 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.249572 22779 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.251039 22695 ts_tablet_manager.cc:1434] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:49.252203 22695 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:49.262197 22694 ts_tablet_manager.cc:1434] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.105s	user 0.019s	sys 0.000s
I20260709 13:06:49.265712 22694 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:49.279004 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:49.279662 22654 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:49.281227 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:49.281839 22651 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.281749 22762 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.283684 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:49.284948 22619 leader_election.cc:343] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.288195 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:49.288815 22503 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.290727 22543 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.294188 22813 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.294608 22813 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.294958 22813 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.298952 22762 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.330011 22651 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:49.330403 22503 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:49.332373 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:49.333892 22729 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.334412 22729 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:49.335242 22729 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.341809 22694 tablet_bootstrap.cc:654] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.345830 22779 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.349036 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:49.349349 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:49.349901 22579 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:49.350592 22619 leader_election.cc:343] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.357062 22779 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:49.357183 22579 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:49.363744 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.357954 22401 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.367571 22827 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.372570 22762 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:49.372900 22827 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:49.373780 22827 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.373651 22401 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:06:49.370033 22698 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:49.377389 22698 ts_tablet_manager.cc:1403] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.251s	user 0.018s	sys 0.012s
I20260709 13:06:49.372020 22695 tablet_bootstrap.cc:654] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.378068 22813 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.385162 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:49.391113 22545 leader_election.cc:343] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.384802 22813 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.388748 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:49.399158 22651 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.402611 22698 raft_consensus.cc:359] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.403741 22698 raft_consensus.cc:385] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.404166 22698 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.406042 22698 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.413874 22698 ts_tablet_manager.cc:1434] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:06:49.414937 22698 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:49.430060 22698 tablet_bootstrap.cc:654] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.432457 22651 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:49.434270 22543 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.434037 22403 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.435564 22813 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.436134 22813 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:49.437058 22813 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.444537 22695 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:49.445909 22695 ts_tablet_manager.cc:1403] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.194s	user 0.016s	sys 0.022s
I20260709 13:06:49.453603 22764 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.455864 22695 raft_consensus.cc:359] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.459633 22695 raft_consensus.cc:385] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.461388 22695 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.463577 22694 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:49.464661 22694 ts_tablet_manager.cc:1403] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.202s	user 0.012s	sys 0.016s
I20260709 13:06:49.465375 22695 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.465492 22402 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.463577 22698 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:49.467804 22694 raft_consensus.cc:359] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.470130 22694 raft_consensus.cc:385] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.470310 22698 ts_tablet_manager.cc:1403] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.000s
I20260709 13:06:49.470588 22694 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.470782 22402 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.471565 22694 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.474413 22698 raft_consensus.cc:359] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.479828 22698 raft_consensus.cc:385] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.480811 22698 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.476013 22695 ts_tablet_manager.cc:1434] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:06:49.482640 22695 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:49.482702 22698 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.479455 22694 ts_tablet_manager.cc:1434] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:06:49.486963 22694 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:49.487814 22698 ts_tablet_manager.cc:1434] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:06:49.489035 22698 tablet_bootstrap.cc:492] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:49.503937 22403 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.505577 22403 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.517160 22695 tablet_bootstrap.cc:654] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.518239 22698 tablet_bootstrap.cc:654] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.520164 22694 tablet_bootstrap.cc:654] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.534693 22764 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.544544 22813 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.545203 22813 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.549687 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:49.550014 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:49.550627 22653 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:49.552462 22813 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.553166 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:49.554785 22813 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.555199 22813 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:49.555265 22545 leader_election.cc:343] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.555568 22813 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.570879 22813 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.574754 22813 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:49.576102 22468 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.576252 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:49.578418 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:06:49.578900 22545 leader_election.cc:343] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.581490 22698 tablet_bootstrap.cc:492] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:49.582049 22698 ts_tablet_manager.cc:1403] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.007s
I20260709 13:06:49.579015 22653 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.583181 22694 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:49.583709 22694 ts_tablet_manager.cc:1403] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.012s
I20260709 13:06:49.584062 22827 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.584744 22827 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.586731 22694 raft_consensus.cc:359] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.587579 22694 raft_consensus.cc:385] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.587913 22694 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.588201 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:49.588698 22694 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:49.589704 22619 leader_election.cc:343] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.586665 22698 raft_consensus.cc:359] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.590337 22698 raft_consensus.cc:385] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.590622 22698 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.591300 22698 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.593338 22694 ts_tablet_manager.cc:1434] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:49.594313 22694 tablet_bootstrap.cc:492] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:49.595031 22827 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:49.595613 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:49.596254 22579 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:49.597954 22617 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.599227 22827 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.599704 22827 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.600152 22827 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.599592 22698 ts_tablet_manager.cc:1434] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 13:06:49.601603 22698 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:49.607240 22695 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:49.607885 22695 ts_tablet_manager.cc:1403] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.125s	user 0.027s	sys 0.026s
I20260709 13:06:49.610453 22694 tablet_bootstrap.cc:654] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.610524 22695 raft_consensus.cc:359] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.611294 22695 raft_consensus.cc:385] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.611552 22695 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.612146 22695 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.620146 22698 tablet_bootstrap.cc:654] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.625484 22653 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:49.626870 22695 ts_tablet_manager.cc:1434] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:06:49.627882 22695 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:49.629200 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.630859 22813 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.631593 22813 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:49.632772 22813 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.652168 22695 tablet_bootstrap.cc:654] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.652688 22698 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:49.654889 22698 ts_tablet_manager.cc:1403] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.053s	user 0.004s	sys 0.012s
I20260709 13:06:49.652696 22694 tablet_bootstrap.cc:492] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:49.657536 22694 ts_tablet_manager.cc:1403] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.016s
I20260709 13:06:49.657351 22827 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.658156 22698 raft_consensus.cc:359] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.658900 22698 raft_consensus.cc:385] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.659180 22698 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.660005 22698 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.661590 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:49.662294 22503 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.660367 22694 raft_consensus.cc:359] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.663039 22698 ts_tablet_manager.cc:1434] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:06:49.663264 22694 raft_consensus.cc:385] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.663534 22694 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.664054 22698 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:49.664211 22694 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.672004 22694 ts_tablet_manager.cc:1434] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:49.673267 22779 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.674793 22694 tablet_bootstrap.cc:492] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:49.674645 22779 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.678575 22779 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:49.679750 22729 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.680266 22729 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.682642 22729 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.682919 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:49.684478 22619 leader_election.cc:343] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.685367 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:49.685371 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:49.686053 22579 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
W20260709 13:06:49.686820 22543 leader_election.cc:343] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.687170 22617 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.687774 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:49.688683 22779 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:49.689216 22545 leader_election.cc:343] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.689679 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.690567 22729 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.690464 22401 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.689235 22779 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.693106 22779 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.697002 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:49.697698 22579 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.697906 22698 tablet_bootstrap.cc:654] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.696512 22827 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:49.707587 22779 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.708616 22694 tablet_bootstrap.cc:654] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.709824 22695 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:49.710812 22695 ts_tablet_manager.cc:1403] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.011s
I20260709 13:06:49.718923 22503 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:49.721784 22695 raft_consensus.cc:359] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.722740 22698 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:49.730456 22695 raft_consensus.cc:385] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.730705 22698 ts_tablet_manager.cc:1403] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.020s
I20260709 13:06:49.730873 22695 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.725550 22779 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:49.726575 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:49.732232 22694 tablet_bootstrap.cc:492] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:49.732702 22694 ts_tablet_manager.cc:1403] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.003s
I20260709 13:06:49.732124 22695 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:49.733574 22619 leader_election.cc:343] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.735116 22695 ts_tablet_manager.cc:1434] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:06:49.736104 22695 tablet_bootstrap.cc:492] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:49.726845 22579 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:49.727051 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:49.733867 22698 raft_consensus.cc:359] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.736689 22580 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.737469 22698 raft_consensus.cc:385] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.736714 22694 raft_consensus.cc:359] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.737782 22698 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.737869 22694 raft_consensus.cc:385] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.738256 22694 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.738479 22698 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.739125 22694 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.741856 22694 ts_tablet_manager.cc:1434] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:49.744486 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:49.745658 22827 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.746131 22827 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:49.746326 22694 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:49.746980 22827 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.751508 22754 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.755282 22580 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:49.756619 22617 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.758778 22754 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:49.759316 22754 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:49.759238 22729 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.760462 22754 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.767267 22698 ts_tablet_manager.cc:1434] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:06:49.768582 22698 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:49.773734 22695 tablet_bootstrap.cc:654] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.776732 22694 tablet_bootstrap.cc:654] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.789021 22698 tablet_bootstrap.cc:654] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.788782 22402 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.800647 22729 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:06:49.825109 22729 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.828022 22694 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:49.830704 22694 ts_tablet_manager.cc:1403] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.011s
I20260709 13:06:49.833467 22694 raft_consensus.cc:359] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.834226 22694 raft_consensus.cc:385] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.834479 22694 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.835053 22694 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.836350 22729 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:49.835855 22695 tablet_bootstrap.cc:492] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:49.837489 22694 ts_tablet_manager.cc:1434] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:49.846844 22695 ts_tablet_manager.cc:1403] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.017s
I20260709 13:06:49.848408 22694 tablet_bootstrap.cc:492] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:49.854382 22695 raft_consensus.cc:359] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.855142 22695 raft_consensus.cc:385] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.855427 22695 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.856050 22695 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.866029 22779 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.877585 22764 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.877980 22502 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.878197 22764 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.894160 22764 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.896000 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:49.898043 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:49.900059 22729 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:06:49.915391 22694 tablet_bootstrap.cc:654] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.915810 22402 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.900470 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:49.901728 22504 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.912889 22695 ts_tablet_manager.cc:1434] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.010s
I20260709 13:06:49.927924 22729 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.928403 22695 tablet_bootstrap.cc:492] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:49.928680 22729 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.933959 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:49.936167 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:49.941098 22543 leader_election.cc:343] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.942094 22695 tablet_bootstrap.cc:654] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:49.944134 22545 leader_election.cc:343] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:49.947853 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:49.947685 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:49.898882 22698 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:49.953015 22698 ts_tablet_manager.cc:1403] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.185s	user 0.019s	sys 0.018s
I20260709 13:06:49.961997 22698 raft_consensus.cc:359] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.962721 22698 raft_consensus.cc:385] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.963012 22698 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.952322 22729 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:49.964221 22694 tablet_bootstrap.cc:492] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:49.965358 22694 ts_tablet_manager.cc:1403] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.117s	user 0.023s	sys 0.031s
I20260709 13:06:49.957011 22813 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.971927 22501 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.980218 22698 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:49.979475 22764 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.983645 22698 ts_tablet_manager.cc:1434] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:06:49.986168 22698 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:49.986864 22813 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:49.991089 22779 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.009220 22695 tablet_bootstrap.cc:492] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:50.009943 22695 ts_tablet_manager.cc:1403] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.006s
I20260709 13:06:50.014858 22779 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.015841 22694 raft_consensus.cc:359] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.016570 22694 raft_consensus.cc:385] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.016844 22694 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.017575 22694 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.019775 22694 ts_tablet_manager.cc:1434] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.054s	user 0.002s	sys 0.002s
I20260709 13:06:50.028626 22694 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.034067 22698 tablet_bootstrap.cc:654] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.046854 22860 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.033864 22695 raft_consensus.cc:359] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.051836 22695 raft_consensus.cc:385] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.053890 22695 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.050266 22860 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.045161 22779 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.055469 22779 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.058254 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:50.058434 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:50.059696 22543 leader_election.cc:343] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.059998 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.060261 22860 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.060685 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:50.062059 22545 leader_election.cc:343] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:50.061739 22617 leader_election.cc:343] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.062511 22545 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:50.063767 22619 leader_election.cc:343] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.063926 22695 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.064181 22779 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.064216 22619 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.064940 22860 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.041639 22694 tablet_bootstrap.cc:654] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.068269 22779 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.072240 22698 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.072790 22698 ts_tablet_manager.cc:1403] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.000s
I20260709 13:06:50.078487 22698 raft_consensus.cc:359] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.079361 22698 raft_consensus.cc:385] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.079663 22698 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.083235 22698 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.085909 22694 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.086481 22694 ts_tablet_manager.cc:1403] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.006s
I20260709 13:06:50.089324 22694 raft_consensus.cc:359] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.090082 22694 raft_consensus.cc:385] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.090382 22694 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.091075 22694 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.093684 22754 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.094766 22698 ts_tablet_manager.cc:1434] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:06:50.094374 22754 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.095902 22698 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:50.097214 22860 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.097460 22754 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.097723 22860 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.098272 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.098634 22695 ts_tablet_manager.cc:1434] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260709 13:06:50.099646 22695 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
W20260709 13:06:50.099910 22619 leader_election.cc:343] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.105484 22860 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.108342 22694 ts_tablet_manager.cc:1434] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:06:50.107939 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.110986 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:50.113768 22543 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.116690 22694 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.116976 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.118417 22860 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:50.119853 22617 leader_election.cc:343] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.120725 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.121977 22871 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.125360 22813 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.125953 22813 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.128151 22813 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.129158 22695 tablet_bootstrap.cc:654] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.129944 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:50.131103 22698 tablet_bootstrap.cc:654] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.133741 22580 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.134590 22694 tablet_bootstrap.cc:654] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.138139 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.141100 22545 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.142014 22729 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.147532 22698 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.148059 22871 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.149262 22871 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.153995 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:50.156533 22619 leader_election.cc:343] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.159072 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:50.160748 22617 leader_election.cc:343] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.161257 22694 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.161311 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.161899 22694 ts_tablet_manager.cc:1403] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.003s
I20260709 13:06:50.162339 22779 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.148254 22698 ts_tablet_manager.cc:1403] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.001s
I20260709 13:06:50.163053 22871 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.166177 22694 raft_consensus.cc:359] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.166962 22694 raft_consensus.cc:385] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.167270 22694 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.167949 22694 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.169023 22698 raft_consensus.cc:359] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.175179 22698 raft_consensus.cc:385] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.175666 22698 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.176491 22698 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.169543 22694 ts_tablet_manager.cc:1434] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:50.182418 22694 tablet_bootstrap.cc:492] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.183204 22860 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:50.186997 22695 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:50.187613 22695 ts_tablet_manager.cc:1403] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.031s
I20260709 13:06:50.188817 22694 tablet_bootstrap.cc:654] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.192246 22695 raft_consensus.cc:359] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.193284 22695 raft_consensus.cc:385] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.193487 22698 ts_tablet_manager.cc:1434] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:06:50.193655 22695 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.194679 22698 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:50.194593 22695 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.253129 22501 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.245373 22871 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.256950 22504 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.257565 22871 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.263664 22871 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.264375 22871 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.265198 22871 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.265589 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.268677 22871 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.268790 22754 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.272303 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:50.272432 22619 leader_election.cc:343] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:50.275607 22619 leader_election.cc:343] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.246313 22695 ts_tablet_manager.cc:1434] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:06:50.281410 22694 tablet_bootstrap.cc:492] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.282989 22695 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:50.283835 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.284997 22694 ts_tablet_manager.cc:1403] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.006s
I20260709 13:06:50.284967 22698 tablet_bootstrap.cc:654] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.285818 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:50.289441 22617 leader_election.cc:343] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.290033 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.290132 22694 raft_consensus.cc:359] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.290865 22694 raft_consensus.cc:385] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.291159 22694 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.269410 22871 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.298687 22754 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.292112 22694 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.308485 22694 ts_tablet_manager.cc:1434] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.007s
I20260709 13:06:50.314507 22754 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.320067 22813 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:06:50.317662 22617 leader_election.cc:343] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.322014 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.324600 22871 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.336274 22694 tablet_bootstrap.cc:492] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.348834 22698 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.354514 22754 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.355772 22578 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.379091 22698 ts_tablet_manager.cc:1403] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.185s	user 0.014s	sys 0.005s
I20260709 13:06:50.391356 22698 raft_consensus.cc:359] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.392144 22698 raft_consensus.cc:385] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.392470 22698 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.402825 22813 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.401582 22698 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.403402 22813 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.404840 22695 tablet_bootstrap.cc:654] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.408795 22813 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.409147 22694 tablet_bootstrap.cc:654] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.409363 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:50.413409 22543 leader_election.cc:343] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.422567 22779 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.423310 22698 ts_tablet_manager.cc:1434] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.005s
I20260709 13:06:50.423610 22779 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.430775 22779 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.434736 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.435827 22577 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:50.435719 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.438434 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:06:50.444355 22545 leader_election.cc:343] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.444960 22545 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.446817 22813 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.447495 22779 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.447996 22779 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.448149 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.448421 22779 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:50.461153 22619 leader_election.cc:343] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.477859 22698 tablet_bootstrap.cc:492] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
W20260709 13:06:50.486447 22882 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:50.515017 22813 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.515641 22813 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.516027 22779 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.546185 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.547590 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:50.549427 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:50.538991 22813 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:50.553186 22619 leader_election.cc:343] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:50.554764 22545 leader_election.cc:343] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.555454 22754 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.555989 22754 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.558255 22754 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.558837 22779 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.571846 22698 tablet_bootstrap.cc:654] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.588675 22888 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.594659 22888 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.597323 22888 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.599052 22695 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:50.599522 22695 ts_tablet_manager.cc:1403] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.317s	user 0.031s	sys 0.019s
I20260709 13:06:50.606590 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.607838 22577 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:50.608946 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:50.609393 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:50.611078 22545 leader_election.cc:343] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.609627 22579 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:50.620545 22543 leader_election.cc:343] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.637540 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.638644 22891 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.639159 22891 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:50.639180 22619 leader_election.cc:343] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.642288 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:50.643488 22579 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:50.645082 22891 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.633854 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.638689 22695 raft_consensus.cc:359] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.646536 22695 raft_consensus.cc:385] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.646853 22695 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.646739 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.647603 22695 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:50.648353 22619 leader_election.cc:343] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:50.648392 22543 leader_election.cc:343] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.656920 22543 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.657757 22694 tablet_bootstrap.cc:492] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.653627 22617 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.657963 22729 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.658219 22694 ts_tablet_manager.cc:1403] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.322s	user 0.010s	sys 0.011s
I20260709 13:06:50.659497 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.661428 22695 ts_tablet_manager.cc:1434] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.003s
I20260709 13:06:50.661306 22694 raft_consensus.cc:359] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.662145 22694 raft_consensus.cc:385] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.662567 22695 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:50.662503 22694 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.663435 22694 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.665262 22827 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.665656 22827 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.665990 22827 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.666570 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.667279 22579 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:50.668481 22891 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.669230 22891 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:50.670224 22891 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.674072 22694 ts_tablet_manager.cc:1434] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:06:50.679812 22694 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.676321 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.680783 22779 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.676214 22827 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.681223 22779 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.678462 22698 tablet_bootstrap.cc:492] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.681629 22779 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.674525 22890 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.682602 22698 ts_tablet_manager.cc:1403] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.221s	user 0.013s	sys 0.011s
I20260709 13:06:50.684922 22695 tablet_bootstrap.cc:654] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.689357 22762 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.689989 22762 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.691892 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:50.692334 22762 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:50.694178 22619 leader_election.cc:343] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.694253 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:50.695007 22652 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:50.695595 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.696215 22468 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:06:50.697295 22468 leader_election.cc:343] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.698182 22762 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.698626 22762 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.699153 22762 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.698386 22827 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.700567 22698 raft_consensus.cc:359] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.696756 22403 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.702235 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:50.703035 22579 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.705101 22779 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.707363 22779 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:50.708727 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:50.709599 22577 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.715281 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:50.716967 22619 leader_election.cc:343] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.719051 22695 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:50.719622 22695 ts_tablet_manager.cc:1403] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.011s
I20260709 13:06:50.721737 22762 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.723331 22695 raft_consensus.cc:359] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.724252 22695 raft_consensus.cc:385] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.724599 22695 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.725348 22695 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.726643 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:50.727573 22695 ts_tablet_manager.cc:1434] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:06:50.728591 22695 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:50.701716 22698 raft_consensus.cc:385] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:50.730859 22468 leader_election.cc:343] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.731868 22579 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:50.733210 22868 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.733712 22868 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.730894 22698 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.730346 22577 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:50.735123 22698 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.736178 22868 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.737975 22617 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.736575 22694 tablet_bootstrap.cc:654] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.738739 22695 tablet_bootstrap.cc:654] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.739146 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.739976 22827 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.740758 22891 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.741250 22891 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:50.742084 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:50.742357 22891 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.746966 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:50.747577 22652 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.752249 22827 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:50.755781 22827 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.759162 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:50.761701 22577 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:50.760380 22698 ts_tablet_manager.cc:1434] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 13:06:50.766014 22762 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.770943 22698 tablet_bootstrap.cc:492] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:50.779935 22694 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.779855 22468 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:50.780746 22694 ts_tablet_manager.cc:1403] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.005s
I20260709 13:06:50.782599 22699 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.787570 22652 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:50.791659 22468 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:50.792552 22868 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.793105 22868 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:50.793974 22868 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.798098 22698 tablet_bootstrap.cc:654] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.809235 22695 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:50.809707 22695 ts_tablet_manager.cc:1403] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.081s	user 0.033s	sys 0.018s
I20260709 13:06:50.811462 22694 raft_consensus.cc:359] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.812440 22694 raft_consensus.cc:385] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.812789 22694 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.813699 22694 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.813879 22698 tablet_bootstrap.cc:492] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.813838 22695 raft_consensus.cc:359] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.814591 22698 ts_tablet_manager.cc:1403] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.006s
I20260709 13:06:50.814652 22695 raft_consensus.cc:385] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.814991 22695 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.815804 22694 ts_tablet_manager.cc:1434] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:06:50.815696 22695 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.810324 22699 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.816918 22694 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.817351 22698 raft_consensus.cc:359] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.818544 22695 ts_tablet_manager.cc:1434] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:50.819630 22695 tablet_bootstrap.cc:492] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:50.818003 22698 raft_consensus.cc:385] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.823271 22698 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.824033 22698 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.826027 22698 ts_tablet_manager.cc:1434] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:50.827404 22698 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:50.828130 22694 tablet_bootstrap.cc:654] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.833252 22698 tablet_bootstrap.cc:654] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.845172 22695 tablet_bootstrap.cc:654] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.845711 22698 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.846225 22698 ts_tablet_manager.cc:1403] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 13:06:50.849210 22698 raft_consensus.cc:359] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.850545 22698 raft_consensus.cc:385] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.850914 22698 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.851754 22698 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.855917 22698 ts_tablet_manager.cc:1434] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:06:50.856690 22694 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.857368 22698 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:50.857389 22694 ts_tablet_manager.cc:1403] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.003s
I20260709 13:06:50.876715 22694 raft_consensus.cc:359] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.877418 22694 raft_consensus.cc:385] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.877693 22694 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.878334 22694 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.883781 22695 tablet_bootstrap.cc:492] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:50.884322 22695 ts_tablet_manager.cc:1403] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.024s
I20260709 13:06:50.887274 22695 raft_consensus.cc:359] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.887817 22698 tablet_bootstrap.cc:654] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.887995 22695 raft_consensus.cc:385] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.888262 22695 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.889271 22695 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.892824 22695 ts_tablet_manager.cc:1434] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:06:50.893972 22695 tablet_bootstrap.cc:492] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:50.895480 22694 ts_tablet_manager.cc:1434] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:06:50.896593 22694 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.900151 22695 tablet_bootstrap.cc:654] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.905074 22694 tablet_bootstrap.cc:654] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.896317 22401 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.922403 22695 tablet_bootstrap.cc:492] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:50.922801 22695 ts_tablet_manager.cc:1403] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.009s
I20260709 13:06:50.925323 22695 raft_consensus.cc:359] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.925875 22695 raft_consensus.cc:385] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.926052 22695 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.926662 22695 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.928218 22695 ts_tablet_manager.cc:1434] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:06:50.929247 22695 tablet_bootstrap.cc:492] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:50.929738 22402 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.931627 22402 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.933266 22860 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.933769 22860 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.935746 22695 tablet_bootstrap.cc:654] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.936008 22860 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:50.937435 22698 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.937829 22694 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.938016 22698 ts_tablet_manager.cc:1403] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.003s
I20260709 13:06:50.938278 22694 ts_tablet_manager.cc:1403] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 13:06:50.939389 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:50.940878 22543 leader_election.cc:343] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.940937 22694 raft_consensus.cc:359] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.941298 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:50.941690 22694 raft_consensus.cc:385] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.941430 22698 raft_consensus.cc:359] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.942001 22694 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.942194 22698 raft_consensus.cc:385] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.942550 22698 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.942693 22694 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:50.943213 22545 leader_election.cc:343] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.943281 22698 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.945765 22694 ts_tablet_manager.cc:1434] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:06:50.945947 22698 ts_tablet_manager.cc:1434] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:50.943830 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:50.946784 22694 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:50.947265 22892 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.952960 22694 tablet_bootstrap.cc:654] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.963781 22698 tablet_bootstrap.cc:492] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:50.972214 22698 tablet_bootstrap.cc:654] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.986555 22694 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:50.987442 22694 ts_tablet_manager.cc:1403] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.001s
I20260709 13:06:50.990921 22694 raft_consensus.cc:359] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.991619 22694 raft_consensus.cc:385] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.991665 22698 tablet_bootstrap.cc:492] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:50.991910 22694 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.992342 22698 ts_tablet_manager.cc:1403] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.006s
I20260709 13:06:50.992731 22694 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:50.995095 22694 ts_tablet_manager.cc:1434] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:50.996335 22694 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:51.000810 22762 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.001559 22762 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.003774 22762 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.005666 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.006678 22577 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:50.996116 22698 raft_consensus.cc:359] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.011929 22698 raft_consensus.cc:385] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.012813 22698 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.015055 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.017372 22694 tablet_bootstrap.cc:654] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.018956 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:51.020112 22762 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.023126 22698 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.033524 22698 ts_tablet_manager.cc:1434] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 13:06:51.035372 22762 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.039294 22698 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:51.047503 22698 tablet_bootstrap.cc:654] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.049214 22695 tablet_bootstrap.cc:492] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:51.049844 22695 ts_tablet_manager.cc:1403] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.121s	user 0.028s	sys 0.019s
I20260709 13:06:51.053259 22891 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.056144 22694 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:51.055931 22891 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.056720 22694 ts_tablet_manager.cc:1403] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.007s
W20260709 13:06:51.056895 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:51.060262 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.060390 22694 raft_consensus.cc:359] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.061066 22694 raft_consensus.cc:385] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.061319 22827 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.061758 22619 leader_election.cc:343] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.061086 22695 raft_consensus.cc:359] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.061878 22762 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.062254 22695 raft_consensus.cc:385] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.061954 22827 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.062589 22695 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.062438 22762 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.061381 22694 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.063953 22695 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.067255 22827 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.068169 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.069243 22695 ts_tablet_manager.cc:1434] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:06:51.069182 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.069944 22652 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:51.070634 22695 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:51.071882 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:51.065840 22694 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.067178 22762 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.073342 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.074265 22580 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:51.074697 22762 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.074891 22694 ts_tablet_manager.cc:1434] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:51.075130 22762 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.079586 22698 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:51.080160 22698 ts_tablet_manager.cc:1403] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 13:06:51.079640 22762 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.077617 22694 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:51.078187 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:51.079113 22617 leader_election.cc:343] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.083896 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.080197 22891 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.084661 22577 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
W20260709 13:06:51.086299 22619 leader_election.cc:343] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.086791 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.087915 22891 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.088225 22694 tablet_bootstrap.cc:654] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.084946 22698 raft_consensus.cc:359] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.090169 22698 raft_consensus.cc:385] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.090544 22698 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.090090 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.095309 22891 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.100256 22695 tablet_bootstrap.cc:654] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.104573 22698 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.095811 22891 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.107304 22698 ts_tablet_manager.cc:1434] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 13:06:51.107470 22891 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.114182 22754 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.114924 22754 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.117025 22779 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.117537 22779 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.135387 22698 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:51.205636 22779 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.203418 22868 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.209254 22868 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.210765 22754 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.211802 22868 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:51.214313 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 60392us
I20260709 13:06:51.228883 22860 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.229506 22860 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:51.229897 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110472us
I20260709 13:06:51.239423 22860 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.240914 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.244329 22503 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:51.245198 22827 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.245738 22827 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.246294 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.247594 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.247941 22827 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:06:51.247637 22543 leader_election.cc:343] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.248344 22579 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:51.251542 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:06:51.252341 22892 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.252729 22892 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.240901 22762 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.255501 22695 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:51.261030 22695 ts_tablet_manager.cc:1403] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.191s	user 0.026s	sys 0.005s
I20260709 13:06:51.264950 22762 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.265278 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.257076 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.266120 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.253538 22892 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.269228 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.260974 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.271925 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:51.272089 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:51.272765 22617 leader_election.cc:343] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.266683 22918 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.273177 22922 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.272253 22919 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.273669 22922 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.277237 22922 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:51.277467 22619 leader_election.cc:343] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.277935 22694 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:51.277935 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.278533 22694 ts_tablet_manager.cc:1403] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.201s	user 0.014s	sys 0.010s
I20260709 13:06:51.279445 22919 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.273572 22918 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:51.274487 22617 leader_election.cc:343] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.281291 22779 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:51.277261 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:51.280573 22892 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.293382 22860 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.294431 22579 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:06:51.294210 22860 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.295853 22892 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.297351 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:51.283886 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:51.299532 22543 leader_election.cc:343] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.283238 22694 raft_consensus.cc:359] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.300688 22694 raft_consensus.cc:385] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:51.285871 22619 leader_election.cc:343] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.301529 22694 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.303601 22694 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.287438 22698 tablet_bootstrap.cc:654] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.288288 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:51.291205 22695 raft_consensus.cc:359] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.306222 22695 raft_consensus.cc:385] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.306694 22695 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.276180 22891 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.313583 22891 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.287145 22577 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.316322 22695 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.314640 22652 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.304284 22860 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.324519 22694 ts_tablet_manager.cc:1434] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:06:51.310616 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.326310 22695 ts_tablet_manager.cc:1434] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:06:51.328083 22695 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:51.304224 22619 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.336774 22694 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:51.337409 22918 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.320276 22504 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:51.325294 22860 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.342525 22860 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.345264 22918 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:51.345947 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66711.9us
I20260709 13:06:51.349874 22860 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.352077 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.352684 22922 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.357316 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:51.360107 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:06:51.360167 22543 leader_election.cc:343] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.360795 22579 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:51.358657 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69387.7us
W20260709 13:06:51.357928 22468 leader_election.cc:343] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.370456 22918 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:51.376070 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.376924 22578 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:51.377017 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.377449 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:51.354738 22926 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 13:06:51.379105 22619 leader_election.cc:343] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.382273 22504 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:51.382915 22619 leader_election.cc:343] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:51.383723 22619 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.384147 22695 tablet_bootstrap.cc:654] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.387434 22698 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:51.387868 22698 ts_tablet_manager.cc:1403] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.253s	user 0.021s	sys 0.022s
W20260709 13:06:51.396603 22543 leader_election.cc:343] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.397233 22652 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:51.402258 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.401310 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.409791 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:51.414551 22922 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.415057 22499 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.415500 22762 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.415869 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.416304 22762 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.417040 22779 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.420159 22779 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.420264 22762 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.420532 22779 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.425220 22925 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.427258 22925 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:51.423179 22545 leader_election.cc:343] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.432626 22545 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.436009 22892 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.431886 22925 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.438572 22891 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:51.438862 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:51.430702 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:51.439220 22504 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:51.444733 22921 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:51.443490 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.445094 22577 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:51.449776 22576 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.456918 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.457697 22653 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:51.458055 22579 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
W20260709 13:06:51.446650 22545 leader_election.cc:343] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.459568 22545 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:51.461277 22543 leader_election.cc:343] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.460851 22779 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.463551 22860 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.450927 22926 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.468453 22779 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.472252 22698 raft_consensus.cc:359] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.475013 22698 raft_consensus.cc:385] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.474525 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:51.474027 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.475975 22762 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.478173 22921 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.478674 22695 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:51.478789 22921 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:51.475340 22698 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.479156 22695 ts_tablet_manager.cc:1403] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.018s
I20260709 13:06:51.479831 22698 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.483819 22762 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:06:51.494413 22929 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:06:51.494971 22762 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.477284 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:51.500789 22699 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.510571 22698 ts_tablet_manager.cc:1434] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.122s	user 0.007s	sys 0.002s
I20260709 13:06:51.484798 22921 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.513425 22698 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:51.513360 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:51.511994 22695 raft_consensus.cc:359] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.514657 22695 raft_consensus.cc:385] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.515024 22695 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.515925 22695 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.511484 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:51.522508 22578 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.512246 22699 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:51.499356 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53723.3us
I20260709 13:06:51.530366 22695 ts_tablet_manager.cc:1434] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:06:51.528398 22699 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:51.541082 22619 leader_election.cc:343] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.542898 22695 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:51.547785 22694 tablet_bootstrap.cc:654] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.551620 22499 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:51.557413 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:06:51.581979 22927 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.582516 22927 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:51.583734 22925 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.590167 22925 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.593423 22619 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:51.624568 22937 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.625190 22937 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:51.627871 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48694.5us
I20260709 13:06:51.583444 22927 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.757738 22698 tablet_bootstrap.cc:654] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.629149 22937 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.626865 22925 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.629304 22779 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.658485 22576 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:51.774086 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.778373 22653 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:51.773151 22921 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.775094 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:51.779906 22652 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:51.779522 22921 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.782537 22921 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.786183 22403 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.637799 22578 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:51.789921 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.790890 22576 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:51.795334 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:51.810062 22938 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.810642 22938 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.811059 22938 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.643463 22699 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.818228 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:51.813063 22779 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:51.819720 22925 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.820106 22925 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.820470 22925 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.820144 22779 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.835831 22699 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.838194 22695 tablet_bootstrap.cc:654] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.839006 22617 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:51.840689 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:51.843526 22694 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:51.843981 22694 ts_tablet_manager.cc:1403] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.508s	user 0.011s	sys 0.013s
I20260709 13:06:51.841074 22827 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.846334 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:51.846796 22827 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.847118 22651 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.847291 22827 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.846395 22921 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.850255 22921 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:51.851192 22921 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.853641 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.872143 22827 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:51.878849 22619 leader_election.cc:343] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.879400 22695 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:51.879876 22695 ts_tablet_manager.cc:1403] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.349s	user 0.014s	sys 0.003s
I20260709 13:06:51.881958 22651 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:51.885075 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:51.886096 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:51.886816 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:51.887444 22577 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.883080 22827 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:51.891371 22937 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:51.891902 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 339713us
I20260709 13:06:51.892130 22937 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:51.893294 22937 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.875291 22938 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.891443 22695 raft_consensus.cc:359] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.896194 22695 raft_consensus.cc:385] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.896512 22695 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.896534 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.897341 22695 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.898501 22694 raft_consensus.cc:359] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.901665 22694 raft_consensus.cc:385] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.902045 22694 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.914646 22925 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.932951 22938 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.934937 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:51.939613 22925 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:51.941448 22694 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.942675 22695 ts_tablet_manager.cc:1434] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:06:51.944636 22695 tablet_bootstrap.cc:492] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:51.949728 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:51.950475 22651 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.952419 22694 ts_tablet_manager.cc:1434] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.108s	user 0.010s	sys 0.003s
I20260709 13:06:51.952356 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:51.953130 22652 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.961452 22694 tablet_bootstrap.cc:492] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:51.962594 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:06:51.955533 22619 leader_election.cc:343] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:51.964013 22468 leader_election.cc:343] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:51.965374 22468 consensus_peers.cc:597] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:51.965844 22468 leader_election.cc:343] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.968204 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:06:51.972637 22468 leader_election.cc:343] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.973592 22577 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:51.975013 22652 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:51.975152 22617 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:51.975975 22468 leader_election.cc:343] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.976888 22779 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.978536 22779 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:51.979727 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:51.979463 22779 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.982935 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:51.984050 22925 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.984567 22925 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:51.985441 22925 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:51.994870 22762 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.010990 22762 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.997056 22651 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:52.057058 22695 tablet_bootstrap.cc:654] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.058858 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:52.060117 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:52.061374 22698 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:52.061870 22698 ts_tablet_manager.cc:1403] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.549s	user 0.026s	sys 0.051s
I20260709 13:06:52.062563 22762 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.063067 22762 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:52.063446 22694 tablet_bootstrap.cc:654] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.063917 22762 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.064370 22698 raft_consensus.cc:359] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.065122 22698 raft_consensus.cc:385] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.065448 22698 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.066190 22698 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.091729 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:52.098232 22545 leader_election.cc:343] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.098752 22545 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:52.100015 22860 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:52.105062 22545 leader_election.cc:343] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.109423 22698 ts_tablet_manager.cc:1434] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.012s
I20260709 13:06:52.110524 22698 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:52.111917 22921 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.120994 22698 tablet_bootstrap.cc:654] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.125952 22694 tablet_bootstrap.cc:492] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:52.130648 22694 ts_tablet_manager.cc:1403] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.169s	user 0.004s	sys 0.017s
I20260709 13:06:52.132200 22401 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.126161 22695 tablet_bootstrap.cc:492] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
W20260709 13:06:52.135989 22619 consensus_peers.cc:597] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:52.136507 22695 ts_tablet_manager.cc:1403] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.013s
I20260709 13:06:52.136940 22919 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.137465 22919 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.139663 22919 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:52.139554 22695 raft_consensus.cc:359] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.140398 22695 raft_consensus.cc:385] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.140749 22695 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.141464 22695 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.143882 22695 ts_tablet_manager.cc:1434] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:52.145294 22695 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
W20260709 13:06:52.132543 22545 leader_election.cc:343] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.147864 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:52.148571 22575 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:52.150007 22402 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.152673 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:52.153971 22695 tablet_bootstrap.cc:654] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.156904 22919 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.157080 22698 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:52.157387 22919 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.157768 22919 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.157795 22698 ts_tablet_manager.cc:1403] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 13:06:52.161198 22698 raft_consensus.cc:359] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.162420 22698 raft_consensus.cc:385] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.162720 22698 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.164824 22698 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.167250 22698 ts_tablet_manager.cc:1434] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:06:52.168335 22698 tablet_bootstrap.cc:492] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:52.176836 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:52.175239 22699 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.180719 22619 leader_election.cc:343] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.181571 22699 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.167963 22919 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.185065 22699 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:52.188457 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:52.189620 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:52.190268 22651 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:52.197559 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:52.198455 22699 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.199074 22699 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.199548 22699 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:52.198557 22468 leader_election.cc:343] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.213814 22919 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:52.214570 22699 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.215713 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:52.216352 22577 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.217025 22699 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:52.211170 22698 tablet_bootstrap.cc:654] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.221313 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:52.227124 22694 raft_consensus.cc:359] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.239449 22694 raft_consensus.cc:385] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.239794 22694 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.240512 22694 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.230243 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:06:52.241546 22468 leader_election.cc:343] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.241950 22654 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.233824 22401 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.246291 22401 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.248204 22401 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:52.254953 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:52.234608 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:52.257162 22619 leader_election.cc:343] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.261643 22694 ts_tablet_manager.cc:1434] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.000s
I20260709 13:06:52.270107 22695 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:52.270807 22695 ts_tablet_manager.cc:1403] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.126s	user 0.035s	sys 0.029s
I20260709 13:06:52.273123 22577 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:52.274392 22695 raft_consensus.cc:359] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.275128 22695 raft_consensus.cc:385] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.275403 22695 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.276122 22695 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.274571 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:52.277259 22919 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.277758 22919 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:52.278141 22695 ts_tablet_manager.cc:1434] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:52.279158 22695 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:52.278628 22919 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.285987 22403 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.287915 22654 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:52.288712 22403 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.297111 22694 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:52.304308 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:52.309051 22699 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.309589 22699 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:52.310367 22699 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.313760 22779 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.315585 22779 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.323184 22922 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:52.331000 22402 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.340031 22779 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:52.341246 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:52.342216 22543 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:52.343344 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:52.343787 22619 leader_election.cc:343] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.344208 22575 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:52.350121 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:52.352666 22922 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.353363 22922 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.354521 22922 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.358826 22695 tablet_bootstrap.cc:654] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.360535 22779 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:06:52.375988 22698 tablet_bootstrap.cc:492] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:52.376559 22698 ts_tablet_manager.cc:1403] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.208s	user 0.027s	sys 0.061s
I20260709 13:06:52.377887 22401 catalog_manager.cc:5697] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.379801 22698 raft_consensus.cc:359] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.380295 22698 raft_consensus.cc:385] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.380453 22698 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.381184 22698 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:52.383598 22619 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:52.385692 22694 tablet_bootstrap.cc:654] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.394441 22698 ts_tablet_manager.cc:1434] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:06:52.413585 22927 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.413373 22922 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.432785 22698 tablet_bootstrap.cc:492] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:52.449815 22927 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.450621 22927 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.441301 22762 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.455628 22969 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:52.455377 22762 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.459844 22499 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.460821 22503 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:52.470999 22967 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:06:52.456573 22699 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:06:52.481078 22892 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.481667 22892 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.482715 22927 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:52.483999 22892 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:52.490818 22403 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.498862 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:52.499596 22922 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:52.494082 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:52.506099 22762 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:52.507267 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:52.508543 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:52.509215 22575 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.509327 22652 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 1: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:06:52.516482 22573 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.527740 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:52.595355 22694 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:52.595983 22694 ts_tablet_manager.cc:1403] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.299s	user 0.021s	sys 0.012s
W20260709 13:06:52.615298 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 82827us
I20260709 13:06:52.616384 22695 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:52.617250 22695 ts_tablet_manager.cc:1403] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.338s	user 0.006s	sys 0.019s
I20260709 13:06:52.584626 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:52.614931 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:52.588290 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:52.615069 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90278.3us
I20260709 13:06:52.632484 22694 raft_consensus.cc:359] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.635193 22694 raft_consensus.cc:385] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.635560 22694 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.637432 22694 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.640782 22937 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:06:52.641991 22619 leader_election.cc:343] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.655596 22575 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:52.662400 22694 ts_tablet_manager.cc:1434] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.002s
I20260709 13:06:52.660924 22754 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:06:52.661078 22695 raft_consensus.cc:359] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.670373 22695 raft_consensus.cc:385] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.670554 22694 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:52.670713 22695 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.671494 22695 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.686173 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:52.694718 22573 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.699405 22827 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.700083 22698 tablet_bootstrap.cc:654] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.701228 22762 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.707019 22468 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:52.685725 22919 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.710995 22919 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.718267 22695 ts_tablet_manager.cc:1434] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.008s
I20260709 13:06:52.660833 22973 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 13:06:52.700150 22827 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:52.729288 22699 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:52.742610 22545 consensus_peers.cc:597] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:52.740160 22919 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:52.755545 22695 tablet_bootstrap.cc:492] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:52.750023 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:52.789505 22694 tablet_bootstrap.cc:654] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.796181 22698 tablet_bootstrap.cc:492] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:52.796787 22698 ts_tablet_manager.cc:1403] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.392s	user 0.012s	sys 0.041s
I20260709 13:06:52.797482 22543 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:52.765956 22827 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.803402 22698 raft_consensus.cc:359] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.804354 22698 raft_consensus.cc:385] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.804695 22698 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.805387 22698 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.806542 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:52.843415 22981 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.891932 22698 ts_tablet_manager.cc:1434] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.010s
W20260709 13:06:52.897821 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 151899us
I20260709 13:06:52.899634 22698 tablet_bootstrap.cc:492] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:52.915534 22892 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:52.947564 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 209857us
I20260709 13:06:52.952282 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:52.953109 22573 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:52.941414 22981 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:06:52.950603 22970 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:52.952184 22998 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:06:52.969401 22991 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.972510 22991 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.982465 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:52.983364 22579 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:52.978884 22991 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:52.983546 22997 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.984083 22997 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:52.990028 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:52.990892 22973 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.991644 22973 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.991983 22973 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.993882 22698 tablet_bootstrap.cc:654] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.990731 22970 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:06:53.007184 22619 leader_election.cc:343] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.009469 22695 tablet_bootstrap.cc:654] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:53.019363 22468 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:53.011247 22997 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.044350 22694 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:53.044816 22694 ts_tablet_manager.cc:1403] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.375s	user 0.022s	sys 0.029s
I20260709 13:06:53.053289 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:53.070751 22500 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.043184 22699 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
W20260709 13:06:53.074805 22617 leader_election.cc:343] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.065933 22997 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.083177 22606 tablet.cc:2406] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:53.083076 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:53.087334 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:53.098279 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:53.094077 22973 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:53.106710 22619 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:53.107529 22619 leader_election.cc:343] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.108029 22619 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:53.086297 22997 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.123368 22695 tablet_bootstrap.cc:492] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:53.124383 22695 ts_tablet_manager.cc:1403] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.380s	user 0.033s	sys 0.013s
I20260709 13:06:53.128466 22975 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.130519 22694 raft_consensus.cc:359] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.131276 22694 raft_consensus.cc:385] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.131544 22694 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.134711 22694 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.140491 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:53.143853 22694 ts_tablet_manager.cc:1434] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:06:53.145742 22997 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:06:53.140787 23000 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:06:53.141069 23001 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.001s
W20260709 13:06:53.152135 23004 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.104s	user 0.000s	sys 0.005s
I20260709 13:06:53.152112 22694 tablet_bootstrap.cc:492] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:53.160363 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:53.161115 22576 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:53.163026 22617 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:53.165239 22992 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.165701 22992 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.166054 22992 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.171692 22695 raft_consensus.cc:359] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.172446 22695 raft_consensus.cc:385] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.172932 22695 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.176048 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:53.183841 22619 leader_election.cc:343] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:53.185912 22619 leader_election.cc:343] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.192104 22402 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.199465 22695 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.207203 22994 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.208468 22994 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.212260 22695 ts_tablet_manager.cc:1434] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:06:53.224798 22920 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.229368 22498 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.235124 22698 tablet_bootstrap.cc:492] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:53.236431 22981 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.237275 22981 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.237867 22698 ts_tablet_manager.cc:1403] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.339s	user 0.026s	sys 0.009s
I20260709 13:06:53.248323 22994 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:53.251142 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:53.251444 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:53.254873 22695 tablet_bootstrap.cc:492] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:53.255131 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:53.251453 22981 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:53.253051 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:53.257440 22652 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:53.258515 22973 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.258739 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:53.262468 22981 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.266233 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:53.267915 22545 leader_election.cc:343] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.271184 22698 raft_consensus.cc:359] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.265578 22981 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.278867 22698 raft_consensus.cc:385] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.280265 22698 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.281126 22698 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.282848 22698 ts_tablet_manager.cc:1434] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.003s
I20260709 13:06:53.283645 22698 tablet_bootstrap.cc:492] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:53.280380 22981 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:53.285604 23009 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:06:53.288379 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:53.289438 22577 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.319811 22698 tablet_bootstrap.cc:654] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.297266 22981 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.322451 22694 tablet_bootstrap.cc:654] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.322752 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:53.323210 22992 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.327905 22992 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.330608 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:53.331441 22545 leader_election.cc:343] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.336410 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:53.332166 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:53.332547 22754 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.325349 22577 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:53.337889 22649 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:53.343518 22619 leader_election.cc:343] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.347870 22982 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.345867 22572 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.360663 22695 tablet_bootstrap.cc:654] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.338289 22981 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:53.370376 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:53.379652 22992 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.380209 22992 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:53.381228 22649 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:53.381312 22992 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.382496 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:53.384505 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:53.383525 22981 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.385289 22981 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:53.391974 22981 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.400146 22698 tablet_bootstrap.cc:492] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:53.400617 22698 ts_tablet_manager.cc:1403] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.019s
I20260709 13:06:53.407483 22695 tablet_bootstrap.cc:492] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:53.407958 22695 ts_tablet_manager.cc:1403] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.163s	user 0.012s	sys 0.005s
I20260709 13:06:53.423552 22572 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:53.424759 22617 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:53.425654 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:53.426620 22975 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.428967 22695 raft_consensus.cc:359] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.429726 22975 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:53.430068 22695 raft_consensus.cc:385] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.430362 22695 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.430610 22975 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.431012 22695 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.435477 22694 tablet_bootstrap.cc:492] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:53.436147 22694 ts_tablet_manager.cc:1403] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.284s	user 0.022s	sys 0.004s
I20260709 13:06:53.440330 22695 ts_tablet_manager.cc:1434] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.032s	user 0.014s	sys 0.001s
I20260709 13:06:53.440250 22694 raft_consensus.cc:359] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.441299 22694 raft_consensus.cc:385] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.441592 22695 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:53.441680 22694 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.441948 22698 raft_consensus.cc:359] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.442852 22698 raft_consensus.cc:385] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.443248 22698 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.444144 22698 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.446561 22694 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.448819 22698 ts_tablet_manager.cc:1434] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.006s
I20260709 13:06:53.449677 22694 ts_tablet_manager.cc:1434] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:06:53.450021 22698 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:53.451138 22694 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:53.457559 22695 tablet_bootstrap.cc:654] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.458699 22698 tablet_bootstrap.cc:654] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.473111 22698 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:53.473873 22698 ts_tablet_manager.cc:1403] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 13:06:53.481452 22698 raft_consensus.cc:359] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.482210 22698 raft_consensus.cc:385] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.482903 22698 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.484598 22698 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.488968 22698 ts_tablet_manager.cc:1434] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:06:53.493104 22698 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:53.494975 22695 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:53.495568 22695 ts_tablet_manager.cc:1403] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.005s
I20260709 13:06:53.502876 22695 raft_consensus.cc:359] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.499933 22694 tablet_bootstrap.cc:654] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.504364 22695 raft_consensus.cc:385] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.508486 22695 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.509691 22695 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.512518 22695 ts_tablet_manager.cc:1434] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:06:53.514012 22695 tablet_bootstrap.cc:492] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:53.526355 22694 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:53.527315 22694 ts_tablet_manager.cc:1403] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.005s
I20260709 13:06:53.530918 22698 tablet_bootstrap.cc:654] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.530524 22694 raft_consensus.cc:359] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.533000 22694 raft_consensus.cc:385] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.534629 22694 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.535665 22694 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.534049 22695 tablet_bootstrap.cc:654] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.541306 22694 ts_tablet_manager.cc:1434] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:06:53.542596 22694 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:53.557382 22694 tablet_bootstrap.cc:654] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.554665 22401 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.578583 22698 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:53.579074 22698 ts_tablet_manager.cc:1403] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.004s
I20260709 13:06:53.580274 22572 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.557472 22695 tablet_bootstrap.cc:492] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:53.581264 22695 ts_tablet_manager.cc:1403] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.005s
I20260709 13:06:53.581089 22403 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.581975 22698 raft_consensus.cc:359] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.582716 22698 raft_consensus.cc:385] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.583001 22698 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.583670 22698 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.583915 22695 raft_consensus.cc:359] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.584638 22695 raft_consensus.cc:385] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.584954 22695 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.584792 22403 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.586141 22698 ts_tablet_manager.cc:1434] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:53.593206 22698 tablet_bootstrap.cc:492] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:53.593132 22695 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.595363 22695 ts_tablet_manager.cc:1434] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:06:53.590660 22694 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:53.597291 22694 ts_tablet_manager.cc:1403] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.008s
I20260709 13:06:53.601301 22695 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:53.602167 22694 raft_consensus.cc:359] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.613508 22694 raft_consensus.cc:385] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.613879 22694 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.615219 22694 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.616601 22981 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.617166 22981 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.619921 22698 tablet_bootstrap.cc:654] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.648644 22981 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:53.650104 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:53.652045 22543 leader_election.cc:343] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.653983 22694 ts_tablet_manager.cc:1434] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.027s
I20260709 13:06:53.656306 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:53.663403 22982 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.664582 22694 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
W20260709 13:06:53.665450 22545 leader_election.cc:343] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.665781 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:53.664076 22982 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.669673 22945 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.674069 22982 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:53.678524 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:53.678308 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:53.680961 22572 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:53.686554 22695 tablet_bootstrap.cc:654] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.689625 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:53.690770 22993 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.692304 22694 tablet_bootstrap.cc:654] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.699045 22993 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.702042 22698 tablet_bootstrap.cc:492] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:53.702683 22698 ts_tablet_manager.cc:1403] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.110s	user 0.019s	sys 0.019s
I20260709 13:06:53.714313 22997 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.714548 22945 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.714875 22997 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.714979 22945 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.717056 22945 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:53.720214 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:53.712661 22698 raft_consensus.cc:359] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.720921 22698 raft_consensus.cc:385] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.721197 22698 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.721544 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:53.721817 22698 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.722977 22997 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.723368 22698 ts_tablet_manager.cc:1434] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
W20260709 13:06:53.726200 22619 leader_election.cc:343] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.727293 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:53.727648 22698 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:53.729522 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:53.730350 22577 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:53.730320 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:53.733294 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:53.734685 22997 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.735097 22997 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.735440 22997 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.736910 22981 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.744045 22694 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:53.744659 22694 ts_tablet_manager.cc:1403] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.013s
I20260709 13:06:53.744660 22498 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.745445 22992 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.746379 22992 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.752954 22695 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:53.753654 22695 ts_tablet_manager.cc:1403] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.004s
I20260709 13:06:53.754048 22992 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.753942 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:53.755858 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:53.756304 22619 leader_election.cc:343] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:53.758296 22617 leader_election.cc:343] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.758814 22617 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:53.758057 22694 raft_consensus.cc:359] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.759716 22694 raft_consensus.cc:385] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.760012 22694 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.763027 22694 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.762871 22992 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.773054 22695 raft_consensus.cc:359] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.773785 22695 raft_consensus.cc:385] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.774037 22695 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.774325 22975 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.774690 22695 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.774835 22975 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.780831 22694 ts_tablet_manager.cc:1434] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.003s
I20260709 13:06:53.781929 22694 tablet_bootstrap.cc:492] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:53.783910 22698 tablet_bootstrap.cc:654] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.785423 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:53.786079 22502 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:53.788941 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:53.792126 22695 ts_tablet_manager.cc:1434] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:06:53.794328 22973 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.796912 22973 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.797319 22973 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.797430 22754 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.787537 22975 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.801421 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:53.802597 22572 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:53.802855 22695 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:53.803524 22997 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.810662 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:53.808450 22973 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.813819 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:53.813038 22694 tablet_bootstrap.cc:654] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:53.821498 22619 leader_election.cc:343] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.820917 22577 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:53.822610 22619 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:53.807375 22997 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.827768 22754 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:53.838510 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:53.839217 22502 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.838394 22973 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:53.857916 22577 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:53.858399 22981 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.859203 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:53.860052 22754 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.860363 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:53.861338 22574 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.860635 22754 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:53.864420 22698 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:53.871961 22698 ts_tablet_manager.cc:1403] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.007s
I20260709 13:06:53.870594 22695 tablet_bootstrap.cc:654] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.875948 22754 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.880254 22698 raft_consensus.cc:359] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.883172 22698 raft_consensus.cc:385] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.883492 22698 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.884187 22698 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.889181 22698 ts_tablet_manager.cc:1434] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
W20260709 13:06:53.896790 22545 consensus_peers.cc:597] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:53.904240 22698 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:53.926371 22502 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:53.930895 22574 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:53.936498 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:53.941478 22694 tablet_bootstrap.cc:492] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:53.942101 22694 ts_tablet_manager.cc:1403] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.009s
I20260709 13:06:53.944556 22576 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.949193 22994 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.949954 22994 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.953260 22975 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.953868 22975 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:53.958174 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:53.961074 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:53.966523 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:53.974642 22694 raft_consensus.cc:359] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.975618 22694 raft_consensus.cc:385] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.975980 22694 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.974227 22993 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.967862 22992 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:06:53.977873 22403 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.954815 22975 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.955338 22994 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:53.993407 22694 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:53.992844 22502 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.008627 22698 tablet_bootstrap.cc:654] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.036602 22694 ts_tablet_manager.cc:1434] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.002s
I20260709 13:06:54.038921 22695 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:54.039770 22695 ts_tablet_manager.cc:1403] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.237s	user 0.037s	sys 0.029s
I20260709 13:06:54.049889 22694 tablet_bootstrap.cc:492] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:54.049777 22975 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.074334 22698 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:54.074851 22698 ts_tablet_manager.cc:1403] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.171s	user 0.015s	sys 0.009s
I20260709 13:06:54.101631 22922 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.102169 22922 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.104344 22922 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:54.106432 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:54.108526 22619 leader_election.cc:343] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.064985 22975 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.100147 22695 raft_consensus.cc:359] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.112139 22695 raft_consensus.cc:385] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.112649 22695 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.114897 22698 raft_consensus.cc:359] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.115752 22698 raft_consensus.cc:385] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.115689 22695 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.116115 22698 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.119395 22698 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.115188 22981 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.138597 22981 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.144062 22698 ts_tablet_manager.cc:1434] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.004s
I20260709 13:06:54.152367 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:54.239140 22945 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.148588 22403 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.249723 22698 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:54.149952 22695 ts_tablet_manager.cc:1434] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.000s
I20260709 13:06:54.213841 22994 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.249575 22975 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:54.188484 23053 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.145013 22981 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:54.163926 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:54.260641 22695 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:54.258996 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:54.250124 22945 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.258890 22994 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:54.299307 22617 leader_election.cc:343] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.305502 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:54.264303 23053 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.315275 22694 tablet_bootstrap.cc:654] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.317253 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:54.325058 22543 leader_election.cc:343] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:54.327931 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49294.6us
I20260709 13:06:54.310140 22992 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:54.340412 22617 leader_election.cc:343] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.392122 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:54.392844 22503 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
W20260709 13:06:54.398098 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 72102.3us
W20260709 13:06:54.410817 22545 leader_election.cc:343] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.411280 22545 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:54.411564 22619 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:54.429775 22945 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:54.435336 23046 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:54.437724 23054 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:06:54.437803 22994 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:54.440328 22698 tablet_bootstrap.cc:654] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.446687 22997 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.429847 23053 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:54.467110 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:54.474577 22695 tablet_bootstrap.cc:654] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.461351 22997 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.482018 22997 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:54.487186 22545 leader_election.cc:343] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:54.551621 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54468.2us
I20260709 13:06:54.536381 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:54.557987 22649 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:54.567359 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:54.570240 22694 tablet_bootstrap.cc:492] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:54.570786 22694 ts_tablet_manager.cc:1403] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.523s	user 0.026s	sys 0.044s
W20260709 13:06:54.584030 22619 consensus_peers.cc:597] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:54.584681 22975 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:54.590314 22698 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:54.590922 22698 ts_tablet_manager.cc:1403] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.345s	user 0.017s	sys 0.031s
I20260709 13:06:54.586105 23064 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.595754 23064 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.596124 23064 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:54.598928 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46599.5us
I20260709 13:06:54.609568 22698 raft_consensus.cc:359] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.610343 22698 raft_consensus.cc:385] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.610644 22698 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.612528 22698 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.617056 22997 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.616176 22694 raft_consensus.cc:359] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.621116 22694 raft_consensus.cc:385] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.621459 22694 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.626251 22694 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.628122 22694 ts_tablet_manager.cc:1434] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:06:54.629784 22997 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:54.632519 23064 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.630173 22694 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:54.643711 23064 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:54.661139 22698 ts_tablet_manager.cc:1434] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:06:54.667021 22695 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:54.667673 22695 ts_tablet_manager.cc:1403] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.407s	user 0.013s	sys 0.006s
I20260709 13:06:54.675958 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:54.675668 22695 raft_consensus.cc:359] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.676827 22695 raft_consensus.cc:385] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:54.677917 22545 leader_election.cc:343] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.681788 22695 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.682909 22695 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.689739 22649 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.691454 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:54.694666 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:54.695365 22576 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:54.706873 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:54.707763 22496 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.715212 22698 tablet_bootstrap.cc:492] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:54.715628 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:54.720534 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:06:54.720799 22543 leader_election.cc:343] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.723677 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:54.726377 22694 tablet_bootstrap.cc:654] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.728472 23064 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:54.729771 22653 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.755209 22504 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.757742 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:54.761548 22695 ts_tablet_manager.cc:1434] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.093s	user 0.003s	sys 0.010s
I20260709 13:06:54.763373 22698 tablet_bootstrap.cc:654] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:54.765218 22545 leader_election.cc:343] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.766455 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:54.768530 22648 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:54.779109 23048 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:54.798221 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:54.798861 22577 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.804838 22695 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:54.803082 23067 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:06:54.820580 22695 tablet_bootstrap.cc:654] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.824154 22653 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:54.810632 22496 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
W20260709 13:06:54.833794 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:54.835789 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:54.838449 22619 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:54.830773 23066 raft_consensus.cc:2764] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:06:54.836853 23052 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.852175 22694 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:54.852676 22694 ts_tablet_manager.cc:1403] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.045s
I20260709 13:06:54.841207 23048 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.863580 23052 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:06:54.917191 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46588.2us
I20260709 13:06:54.916504 23048 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:54.934216 23052 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.938233 22577 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:54.957616 22694 raft_consensus.cc:359] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.958376 22694 raft_consensus.cc:385] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.958632 22694 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.959184 22695 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:54.959326 22694 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:54.959810 22695 ts_tablet_manager.cc:1403] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.004s
I20260709 13:06:54.985803 22694 ts_tablet_manager.cc:1434] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.004s
I20260709 13:06:54.988291 22694 tablet_bootstrap.cc:492] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:54.992525 23048 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.041749 22698 tablet_bootstrap.cc:492] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:55.042785 22698 ts_tablet_manager.cc:1403] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.328s	user 0.029s	sys 0.052s
I20260709 13:06:55.051994 22695 raft_consensus.cc:359] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.053082 22695 raft_consensus.cc:385] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.053574 22695 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.054271 22695 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.065548 22695 ts_tablet_manager.cc:1434] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.100s	user 0.004s	sys 0.002s
I20260709 13:06:55.075501 22694 tablet_bootstrap.cc:654] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.076766 22698 raft_consensus.cc:359] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.077690 22698 raft_consensus.cc:385] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.077991 22698 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.079007 22698 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.081739 22695 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:55.089501 22698 ts_tablet_manager.cc:1434] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:06:55.090392 22695 tablet_bootstrap.cc:654] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.090606 22698 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:55.096707 22403 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.127944 22698 tablet_bootstrap.cc:654] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.133224 22694 tablet_bootstrap.cc:492] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:55.134238 23063 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.134768 23063 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.141062 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:55.141796 22649 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:55.143079 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:55.143883 22982 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.144235 22982 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.144562 22982 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.144691 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:55.145358 22573 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 0.
I20260709 13:06:55.137152 23063 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.133750 22694 ts_tablet_manager.cc:1403] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.011s
I20260709 13:06:55.150219 22694 raft_consensus.cc:359] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.150926 22694 raft_consensus.cc:385] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.151242 22694 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.151854 22982 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.152210 22694 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.154618 22694 ts_tablet_manager.cc:1434] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:55.154961 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:55.155705 22694 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:55.155619 22573 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.166028 22573 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:55.167930 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:55.168752 23063 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:55.169270 23063 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:06:55.169929 22694 tablet_bootstrap.cc:654] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.170126 23063 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.172597 22695 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:55.173115 22695 ts_tablet_manager.cc:1403] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.006s
I20260709 13:06:55.182644 22695 raft_consensus.cc:359] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.183360 22695 raft_consensus.cc:385] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.183630 22695 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.183948 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:55.185384 22649 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.186048 22401 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.189182 22982 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.192297 22695 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.195111 22695 ts_tablet_manager.cc:1434] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:06:55.196156 22695 tablet_bootstrap.cc:492] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:55.197139 22698 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:55.200815 22698 ts_tablet_manager.cc:1403] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.004s
I20260709 13:06:55.203960 22698 raft_consensus.cc:359] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.206596 22698 raft_consensus.cc:385] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.206981 22698 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.207273 22695 tablet_bootstrap.cc:654] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.207886 22698 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.200091 22649 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:06:55.206249 22694 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:55.210726 22694 ts_tablet_manager.cc:1403] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.008s
I20260709 13:06:55.214986 22694 raft_consensus.cc:359] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.215785 22694 raft_consensus.cc:385] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.216076 22694 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.218142 22698 ts_tablet_manager.cc:1434] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:55.219270 22698 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:55.223434 22403 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.225160 22694 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.227965 22694 ts_tablet_manager.cc:1434] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:06:55.229211 22694 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:55.231528 22698 tablet_bootstrap.cc:654] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.239697 22694 tablet_bootstrap.cc:654] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.240692 22695 tablet_bootstrap.cc:492] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:55.241343 22945 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.241869 22945 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.244005 22945 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.244644 22698 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:55.245173 22698 ts_tablet_manager.cc:1403] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 13:06:55.245550 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:55.248946 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:55.249713 22649 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
W20260709 13:06:55.248939 22545 leader_election.cc:343] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.251526 22543 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:55.252664 22945 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.253079 22945 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.257357 22945 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.263967 22695 ts_tablet_manager.cc:1403] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 13:06:55.247982 22698 raft_consensus.cc:359] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.267516 22698 raft_consensus.cc:385] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.267866 22698 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.268530 22698 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.270784 22698 ts_tablet_manager.cc:1434] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:06:55.272178 22698 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:55.275923 22695 raft_consensus.cc:359] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.276602 22695 raft_consensus.cc:385] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.276911 22695 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.277422 22694 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:55.277941 22694 ts_tablet_manager.cc:1403] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.006s
I20260709 13:06:55.277542 22695 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.282481 22695 ts_tablet_manager.cc:1434] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:06:55.283519 22695 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:55.289273 22698 tablet_bootstrap.cc:654] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.290969 22945 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.280542 22694 raft_consensus.cc:359] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.293936 22694 raft_consensus.cc:385] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.294261 22694 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.294965 22694 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.299722 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:55.301103 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:55.301766 22649 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:55.302289 22545 leader_election.cc:343] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.319015 22649 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:55.320313 22543 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:55.321228 23052 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:55.321772 23052 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:55.325690 23052 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.329399 22945 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.330907 22698 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:55.331393 22698 ts_tablet_manager.cc:1403] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.026s
I20260709 13:06:55.332307 22695 tablet_bootstrap.cc:654] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.334004 22698 raft_consensus.cc:359] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.334724 22698 raft_consensus.cc:385] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.334995 22698 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.329511 23069 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.335690 23069 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.335855 22698 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.337579 23064 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.338037 23064 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.341177 23064 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.341635 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:55.342720 23069 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:55.343413 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:55.343873 22545 leader_election.cc:343] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.344422 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:55.344743 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:55.344820 22619 leader_election.cc:343] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.345324 22573 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:55.346788 22617 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:55.347793 23069 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.348163 23069 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.348505 23069 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.355639 22698 ts_tablet_manager.cc:1434] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:06:55.357218 22698 tablet_bootstrap.cc:492] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:55.361485 23069 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.364095 22698 tablet_bootstrap.cc:654] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.364305 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:55.365818 22619 leader_election.cc:343] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.366776 22694 ts_tablet_manager.cc:1434] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 13:06:55.368389 22694 tablet_bootstrap.cc:492] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
W20260709 13:06:55.369462 22543 leader_election.cc:343] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.369910 22543 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:55.370941 23050 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.371905 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:55.372574 22573 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.379878 23069 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:55.381834 22403 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.386795 22573 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:55.388556 22617 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:55.394958 23069 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:55.395928 23069 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:55.397379 23069 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.421059 22694 tablet_bootstrap.cc:654] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.427590 22695 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:55.428143 22695 ts_tablet_manager.cc:1403] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.145s	user 0.008s	sys 0.003s
I20260709 13:06:55.432932 22695 raft_consensus.cc:359] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.433737 22695 raft_consensus.cc:385] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.434031 22695 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.434723 22695 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.437023 22695 ts_tablet_manager.cc:1434] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:06:55.441035 22695 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:55.458190 22694 tablet_bootstrap.cc:492] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:55.460464 22694 ts_tablet_manager.cc:1403] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.007s
I20260709 13:06:55.463572 22694 raft_consensus.cc:359] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.464313 22694 raft_consensus.cc:385] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.464843 22695 tablet_bootstrap.cc:654] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.465543 23048 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.464578 22694 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.471745 22694 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.473030 23052 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.473611 23052 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.475800 22695 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:55.476364 22695 ts_tablet_manager.cc:1403] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:06:55.476749 23052 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.478950 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:55.479084 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:55.480490 22545 leader_election.cc:343] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:55.481109 22543 leader_election.cc:343] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.481684 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:55.482434 22694 ts_tablet_manager.cc:1434] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
I20260709 13:06:55.483239 23052 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.483584 22694 tablet_bootstrap.cc:492] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:55.496843 23064 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.502663 22694 tablet_bootstrap.cc:654] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.479172 22695 raft_consensus.cc:359] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.506574 22695 raft_consensus.cc:385] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.506937 22695 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.507637 22695 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.510977 22695 ts_tablet_manager.cc:1434] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.005s
I20260709 13:06:55.513945 22496 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.515273 22695 tablet_bootstrap.cc:492] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:55.542819 22694 tablet_bootstrap.cc:492] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:55.535338 22698 tablet_bootstrap.cc:492] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:55.543854 22698 ts_tablet_manager.cc:1403] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.187s	user 0.062s	sys 0.071s
I20260709 13:06:55.529143 22997 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:06:55.541205 23073 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.546032 23073 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.543341 22982 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.547809 22695 tablet_bootstrap.cc:654] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.543316 22694 ts_tablet_manager.cc:1403] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.000s
I20260709 13:06:55.525722 22400 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.538096 23063 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.550961 22698 raft_consensus.cc:359] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.539374 23064 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:06:55.547537 22982 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.553372 22698 raft_consensus.cc:385] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.557327 23063 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.560925 22698 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.562721 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:55.563922 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:55.550742 22997 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.565056 22997 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.567584 22982 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.569985 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:55.571321 22997 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:55.571947 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:06:55.573170 22619 leader_election.cc:343] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.563551 22698 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.573470 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:55.577450 22577 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:55.579645 22468 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:55.581933 23056 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.582823 22698 ts_tablet_manager.cc:1434] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:06:55.585067 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:55.584179 22496 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:55.564607 23073 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:55.581336 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:55.589748 22580 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:55.596524 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:55.612556 23063 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:55.613359 23048 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.613775 23048 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.614122 23048 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.615674 22694 raft_consensus.cc:359] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.616411 22694 raft_consensus.cc:385] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.616691 22694 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.627238 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:55.620344 22694 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.628034 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:55.628811 22698 tablet_bootstrap.cc:492] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:55.613359 22973 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.630367 22973 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.630756 22973 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.643770 23066 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:55.645596 22496 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.646502 23066 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:55.658612 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81446.9us
W20260709 13:06:55.742791 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 94480us
I20260709 13:06:55.743820 22468 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:55.751649 22694 ts_tablet_manager.cc:1434] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.203s	user 0.014s	sys 0.038s
I20260709 13:06:55.753093 22694 tablet_bootstrap.cc:492] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:55.753861 22997 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.757612 22997 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:55.760711 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82651.6us
I20260709 13:06:55.810207 22698 tablet_bootstrap.cc:654] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.763902 23048 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.827714 22695 tablet_bootstrap.cc:492] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:55.828174 22695 ts_tablet_manager.cc:1403] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.316s	user 0.024s	sys 0.028s
I20260709 13:06:55.832367 22997 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:55.841693 22694 tablet_bootstrap.cc:654] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.841704 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:55.842815 22577 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:55.861552 22498 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:55.897219 22545 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:55.879755 23073 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.882867 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:55.887945 22973 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.889923 22695 raft_consensus.cc:359] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.893541 23048 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:06:55.897085 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:55.878520 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:55.898312 22695 raft_consensus.cc:385] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.898694 22695 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.899636 22695 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.868110 23056 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:55.933734 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:55.934013 22619 leader_election.cc:343] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.928432 23114 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.941779 22695 ts_tablet_manager.cc:1434] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.000s
I20260709 13:06:55.917150 23073 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:55.957530 22695 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:55.967600 22973 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:55.968071 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:55.942905 23114 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.940284 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:55.973031 23114 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.979092 22573 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.979808 22497 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.999425 22698 tablet_bootstrap.cc:492] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:55.999984 22698 ts_tablet_manager.cc:1403] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.371s	user 0.019s	sys 0.013s
I20260709 13:06:56.056931 23073 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:56.068499 22698 raft_consensus.cc:359] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.070766 22698 raft_consensus.cc:385] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.071151 22698 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.071872 22698 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.074291 22698 ts_tablet_manager.cc:1434] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:06:56.092355 22694 tablet_bootstrap.cc:492] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:56.093284 22694 ts_tablet_manager.cc:1403] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.341s	user 0.015s	sys 0.028s
I20260709 13:06:56.096010 22694 raft_consensus.cc:359] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.096692 22694 raft_consensus.cc:385] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.097751 22694 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.101125 22694 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.111106 22982 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:06:56.114079 22982 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.120070 22497 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:56.122736 22695 tablet_bootstrap.cc:654] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.124413 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:56.129837 22572 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.143873 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:56.144970 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.157935 23114 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.164885 22982 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:56.165756 22698 tablet_bootstrap.cc:492] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:56.169253 22694 ts_tablet_manager.cc:1434] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.002s
I20260709 13:06:56.173918 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:56.174115 22573 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:56.176960 22572 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:56.180598 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.195467 22694 tablet_bootstrap.cc:492] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
W20260709 13:06:56.199147 22617 leader_election.cc:343] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.202154 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:56.203630 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:56.203044 23126 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:56.208032 23114 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:56.213853 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:56.218665 22579 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.212939 23114 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.221319 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:56.228812 22695 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:56.229413 22695 ts_tablet_manager.cc:1403] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.272s	user 0.018s	sys 0.014s
I20260709 13:06:56.205601 23135 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.234016 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:56.228837 22468 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:56.234495 22695 raft_consensus.cc:359] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.235251 22695 raft_consensus.cc:385] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.235559 22695 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.236606 22698 tablet_bootstrap.cc:654] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.236256 22695 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.238890 23120 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:56.241325 22619 leader_election.cc:343] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:56.245321 22619 leader_election.cc:343] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.245864 22619 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:56.247975 23126 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.246419 23135 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:56.249060 23135 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.221731 23114 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:56.251350 23114 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.254907 22579 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:56.258387 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:56.263088 23128 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.270306 23128 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:56.278189 22695 ts_tablet_manager.cc:1434] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:06:56.271543 23128 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.279211 23052 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:06:56.289595 22619 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:56.294353 22982 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.295102 22982 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.298207 22694 tablet_bootstrap.cc:654] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.299052 22982 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:56.301348 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.304904 22695 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
W20260709 13:06:56.305943 22619 leader_election.cc:343] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.330972 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:56.331792 22650 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:06:56.341449 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:56.347777 22982 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.361474 22499 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.402621 22982 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.413003 23048 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.413601 23048 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.423391 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:56.418239 23048 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:06:56.428337 22619 leader_election.cc:343] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.430784 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.434265 22576 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:56.437702 22698 tablet_bootstrap.cc:492] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:56.437484 23048 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.444099 22698 ts_tablet_manager.cc:1403] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.279s	user 0.015s	sys 0.005s
I20260709 13:06:56.446879 22694 tablet_bootstrap.cc:492] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:56.446878 22698 raft_consensus.cc:359] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.447669 22698 raft_consensus.cc:385] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.447695 22694 ts_tablet_manager.cc:1403] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.253s	user 0.021s	sys 0.005s
I20260709 13:06:56.448122 22698 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.449406 22698 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.450495 23048 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.461859 23048 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:56.464725 22694 raft_consensus.cc:359] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.464599 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:56.465549 22694 raft_consensus.cc:385] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:56.468147 22619 leader_election.cc:343] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.465845 22694 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.469884 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.470322 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:56.472298 22617 leader_election.cc:343] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.476377 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:56.478297 22698 ts_tablet_manager.cc:1434] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:06:56.481916 22400 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.486967 22694 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.483980 22400 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.487026 23114 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.475668 23073 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.494782 23073 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.495239 23073 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.498812 22698 tablet_bootstrap.cc:492] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:56.502418 22400 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.502470 22694 ts_tablet_manager.cc:1434] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:06:56.519939 22695 tablet_bootstrap.cc:654] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.534233 23073 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.546746 22694 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:56.557191 23073 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:56.559474 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:56.563700 22694 tablet_bootstrap.cc:654] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:56.564270 22619 leader_election.cc:343] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.568727 22698 tablet_bootstrap.cc:654] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.570434 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:56.572502 22576 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.593708 22695 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:56.595227 22695 ts_tablet_manager.cc:1403] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.309s	user 0.007s	sys 0.021s
I20260709 13:06:56.621826 22695 raft_consensus.cc:359] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.622534 22695 raft_consensus.cc:385] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.622808 22695 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.630625 22695 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.638608 22576 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:56.638731 22694 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:56.639395 22694 ts_tablet_manager.cc:1403] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.006s
I20260709 13:06:56.639948 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:56.640784 23073 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.641005 22695 ts_tablet_manager.cc:1434] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:06:56.641327 23073 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:56.642055 22695 tablet_bootstrap.cc:492] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:56.642164 23073 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.648249 22694 raft_consensus.cc:359] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.649291 22694 raft_consensus.cc:385] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.649668 22694 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.660912 22694 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.663105 22698 tablet_bootstrap.cc:492] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:56.663554 22694 ts_tablet_manager.cc:1434] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:06:56.663682 22698 ts_tablet_manager.cc:1403] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.029s
I20260709 13:06:56.666429 22695 tablet_bootstrap.cc:654] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.667814 22698 raft_consensus.cc:359] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.668582 22698 raft_consensus.cc:385] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.668951 22698 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.669647 22698 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.663964 22503 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.672290 22945 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.673470 22698 ts_tablet_manager.cc:1434] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:06:56.673630 22945 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.674605 22698 tablet_bootstrap.cc:492] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:56.684381 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:56.684965 22945 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:56.685127 22651 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:56.685420 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:56.686486 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:56.686705 22698 tablet_bootstrap.cc:654] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:56.687251 22545 leader_election.cc:343] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.690338 22945 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.692000 22945 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.692456 22945 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.664673 22694 tablet_bootstrap.cc:492] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:56.702986 23114 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:56.703506 23073 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:56.733378 22945 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.734166 22694 tablet_bootstrap.cc:654] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.729624 23128 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.738584 22698 tablet_bootstrap.cc:492] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:56.739126 22698 ts_tablet_manager.cc:1403] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.013s
I20260709 13:06:56.742568 23128 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.748551 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.750523 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:56.751937 22617 leader_election.cc:343] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.753576 23128 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:06:56.753747 22619 leader_election.cc:343] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.754184 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:56.755056 23114 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.760246 22695 tablet_bootstrap.cc:492] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:56.760782 22695 ts_tablet_manager.cc:1403] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.019s
I20260709 13:06:56.761148 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:56.764923 22545 leader_election.cc:343] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.765741 22695 raft_consensus.cc:359] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.766683 22695 raft_consensus.cc:385] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.766973 22695 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.767614 22695 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.772091 23117 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.772739 22945 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:56.772612 23117 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.773703 22695 ts_tablet_manager.cc:1434] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:56.774645 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:56.775293 22651 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.778039 23114 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:56.778640 23117 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:56.785144 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.789242 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:56.799435 22500 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.802183 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:56.802989 22695 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:56.802037 22698 raft_consensus.cc:359] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.805125 22698 raft_consensus.cc:385] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.805550 22698 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.811461 22698 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.817186 22945 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.817718 22945 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.818989 22698 ts_tablet_manager.cc:1434] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.002s
I20260709 13:06:56.820945 22698 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:56.821022 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:56.824734 22545 leader_election.cc:343] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.826553 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:56.827508 22652 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:56.828980 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:56.815364 22400 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.833204 23121 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.836505 22694 tablet_bootstrap.cc:492] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:56.837059 22694 ts_tablet_manager.cc:1403] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.173s	user 0.022s	sys 0.002s
I20260709 13:06:56.836534 23121 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.833431 22945 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:56.843111 23121 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.848605 23117 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.841470 22651 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:56.853837 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:56.855682 23129 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.856194 23129 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:56.857031 23129 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:56.867496 22619 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:56.868254 22694 raft_consensus.cc:359] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.870471 22694 raft_consensus.cc:385] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.870787 22694 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.871506 22694 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.873343 23128 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.873873 23128 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.877625 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:56.879688 22619 leader_election.cc:343] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.882386 23128 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:56.891256 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:56.891147 23121 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.891520 22694 ts_tablet_manager.cc:1434] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:06:56.895907 23048 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:56.907352 22694 tablet_bootstrap.cc:492] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:56.918184 22698 tablet_bootstrap.cc:654] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:56.942852 22617 leader_election.cc:343] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.943337 22617 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:56.933449 22695 tablet_bootstrap.cc:654] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.955683 23052 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.959050 23052 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:56.949568 22400 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.966470 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:56.966681 23052 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:06:56.967909 22545 leader_election.cc:343] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.969133 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:56.970016 22650 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:56.973291 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:56.974028 22652 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.975973 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:06:56.947338 23128 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.984921 23052 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.985420 23052 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.985769 23052 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.973522 23121 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:56.973366 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:56.998723 22545 leader_election.cc:343] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.948069 23135 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:06:57.013083 22652 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:57.014334 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.016042 22694 tablet_bootstrap.cc:654] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.025701 22945 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.025804 23052 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.036546 23052 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.037175 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:57.038681 22545 leader_election.cc:343] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.040050 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:57.040680 22652 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.049957 22652 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:57.051731 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:06:57.056726 22449 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:57.054930 22945 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:57.062036 22698 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:57.062563 22698 ts_tablet_manager.cc:1403] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.004s
I20260709 13:06:57.060717 22945 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.063078 23052 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.060977 23167 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.066263 23167 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:57.063568 23052 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:57.076450 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.080814 23167 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.082903 22698 raft_consensus.cc:359] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.083686 22698 raft_consensus.cc:385] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.083987 22698 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.085695 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:57.082938 23052 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.088557 22698 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:57.091957 22543 leader_election.cc:343] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.095165 22698 ts_tablet_manager.cc:1434] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:06:57.093055 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:57.126752 22698 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
W20260709 13:06:57.132004 22545 leader_election.cc:343] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.132953 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.091037 23052 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.140125 23129 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.140713 23052 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.143056 23052 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.146083 22698 tablet_bootstrap.cc:654] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.148761 22694 tablet_bootstrap.cc:492] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:57.149259 22694 ts_tablet_manager.cc:1403] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.243s	user 0.009s	sys 0.012s
I20260709 13:06:57.149319 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:57.152050 22694 raft_consensus.cc:359] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.152474 22401 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.152747 22694 raft_consensus.cc:385] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.154326 22694 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.153098 23048 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.154975 22694 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:57.158727 22545 leader_election.cc:343] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.160030 22694 ts_tablet_manager.cc:1434] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:06:57.161671 22694 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:57.168242 22695 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.168772 22695 ts_tablet_manager.cc:1403] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.366s	user 0.014s	sys 0.007s
I20260709 13:06:57.171630 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:57.171681 22695 raft_consensus.cc:359] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.173965 22695 raft_consensus.cc:385] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.174250 22695 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.174875 22694 tablet_bootstrap.cc:654] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.174921 22695 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.178529 22695 ts_tablet_manager.cc:1434] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:57.179443 22695 tablet_bootstrap.cc:492] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
W20260709 13:06:57.181375 22543 leader_election.cc:343] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.181825 22543 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.183037 23052 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.192569 22698 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:57.193079 22698 ts_tablet_manager.cc:1403] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.001s
I20260709 13:06:57.197278 22694 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:57.197567 22698 raft_consensus.cc:359] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.199879 22698 raft_consensus.cc:385] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.200207 22698 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.200824 22698 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.204128 22698 ts_tablet_manager.cc:1434] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:57.205148 22698 tablet_bootstrap.cc:492] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Bootstrap starting.
I20260709 13:06:57.198931 22695 tablet_bootstrap.cc:654] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.209095 22694 ts_tablet_manager.cc:1403] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.008s
I20260709 13:06:57.217248 22694 raft_consensus.cc:359] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.218029 22694 raft_consensus.cc:385] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.218317 22694 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.218966 22694 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.220160 22698 tablet_bootstrap.cc:654] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.221860 22694 ts_tablet_manager.cc:1434] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:57.229287 22403 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.236519 22694 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Bootstrap starting.
I20260709 13:06:57.238855 22695 tablet_bootstrap.cc:492] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.239336 22695 ts_tablet_manager.cc:1403] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.004s
I20260709 13:06:57.243171 22695 raft_consensus.cc:359] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.243896 22695 raft_consensus.cc:385] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.244175 22695 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.244819 22695 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.261046 22695 ts_tablet_manager.cc:1434] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:06:57.264771 22695 tablet_bootstrap.cc:492] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.274201 22694 tablet_bootstrap.cc:654] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.276479 22695 tablet_bootstrap.cc:654] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.279386 22698 tablet_bootstrap.cc:492] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: No bootstrap required, opened a new log
I20260709 13:06:57.289317 22698 ts_tablet_manager.cc:1403] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.003s
I20260709 13:06:57.293254 22698 raft_consensus.cc:359] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.293972 22698 raft_consensus.cc:385] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.294232 22698 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.295550 22698 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.297658 22698 ts_tablet_manager.cc:1434] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:57.300773 23052 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.308712 22694 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: No bootstrap required, opened a new log
I20260709 13:06:57.309295 22694 ts_tablet_manager.cc:1403] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.004s
I20260709 13:06:57.312697 23052 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.313340 23052 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.316560 23052 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.318053 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:57.318742 22652 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:57.318087 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:57.320384 23119 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.320907 23119 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:57.321156 22545 leader_election.cc:343] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.325169 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:57.327054 23119 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.323817 22694 raft_consensus.cc:359] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.328444 22694 raft_consensus.cc:385] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.328732 22694 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.328887 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:57.329488 22694 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.331638 22694 ts_tablet_manager.cc:1434] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:06:57.331511 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:57.332638 23119 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.334432 22543 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.335491 23167 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.335909 23167 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.336277 23167 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:57.353513 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.362129 23073 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.362805 23073 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.367492 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:57.368165 22499 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:57.369541 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:57.370544 23137 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.370972 23137 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.371294 23137 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.371948 22695 tablet_bootstrap.cc:492] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.372453 22695 ts_tablet_manager.cc:1403] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.108s	user 0.037s	sys 0.008s
I20260709 13:06:57.359853 23167 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.370075 23073 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:57.377517 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:57.377643 22695 raft_consensus.cc:359] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.378391 22695 raft_consensus.cc:385] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.378705 22695 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.379462 22695 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:06:57.381146 22545 leader_election.cc:343] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.382881 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:57.383584 22576 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:57.386318 22695 ts_tablet_manager.cc:1434] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:06:57.387387 22695 tablet_bootstrap.cc:492] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.391079 23137 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.394678 22499 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.395030 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:06:57.395676 22496 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.398223 22695 tablet_bootstrap.cc:654] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.409031 22496 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:57.414397 22695 tablet_bootstrap.cc:492] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.414927 22695 ts_tablet_manager.cc:1403] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 13:06:57.418675 22695 raft_consensus.cc:359] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.419339 22695 raft_consensus.cc:385] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.419588 22695 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.420279 22695 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.422284 23167 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.423921 22695 ts_tablet_manager.cc:1434] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:57.425024 22695 tablet_bootstrap.cc:492] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.428881 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:06:57.429736 23179 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.430768 22695 tablet_bootstrap.cc:654] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.431223 23179 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:57.432224 23179 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.449280 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:57.449934 22652 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.453058 22695 tablet_bootstrap.cc:492] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.453552 22695 ts_tablet_manager.cc:1403] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 13:06:57.456285 22695 raft_consensus.cc:359] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.457000 22695 raft_consensus.cc:385] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.457283 22695 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.458082 22695 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.460155 22652 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:57.460207 22695 ts_tablet_manager.cc:1434] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:57.461831 22695 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.464112 22543 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.466231 23167 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.466840 23167 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:57.467808 23167 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.470746 23121 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.471704 23137 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:57.474190 23121 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.474697 23121 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.477586 23121 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.484368 22695 tablet_bootstrap.cc:654] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.488792 22496 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.489022 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:57.494506 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:06:57.497164 22545 leader_election.cc:343] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.505010 23167 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.505920 22652 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 0.
I20260709 13:06:57.508554 23119 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.510113 23119 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.514405 23119 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.517192 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:57.522989 22403 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.544955 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:57.545732 22578 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.556768 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.557878 23167 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.558280 23167 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.558609 23167 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.575795 23119 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.576344 23119 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.579281 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:57.579901 23119 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.589859 23167 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.592038 23167 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.601326 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:57.604220 22545 leader_election.cc:343] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.622372 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:06:57.623010 22649 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.626493 23129 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.631083 22649 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:06:57.646014 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.646873 23167 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.647341 23167 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:06:57.648201 23167 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.653879 22578 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:57.671664 22695 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.672189 22695 ts_tablet_manager.cc:1403] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.211s	user 0.041s	sys 0.048s
I20260709 13:06:57.674741 22695 raft_consensus.cc:359] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.675671 22695 raft_consensus.cc:385] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.675983 22695 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.676735 22695 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.686084 22695 ts_tablet_manager.cc:1434] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:06:57.686316 22499 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.688338 22401 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.695807 23129 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.703143 22496 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.703536 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:57.706562 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:57.698411 22695 tablet_bootstrap.cc:492] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.719129 22695 tablet_bootstrap.cc:654] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.727864 23114 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.728582 23114 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.731372 23114 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:57.733734 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:06:57.735896 22619 leader_election.cc:343] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.741477 23178 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.742003 23178 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.744112 23178 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:57.745338 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:06:57.749140 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:57.749888 22576 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:57.759253 22400 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:57.760166 22619 leader_election.cc:343] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:57.764479 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44425.7us
I20260709 13:06:57.774631 23117 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.775697 22695 tablet_bootstrap.cc:492] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.775321 23117 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.776400 22695 ts_tablet_manager.cc:1403] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.022s
I20260709 13:06:57.778582 23117 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:57.781193 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:57.781179 22695 raft_consensus.cc:359] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.782142 22695 raft_consensus.cc:385] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.782446 22695 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.783110 22695 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.784106 22617 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.784780 23178 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.785746 23178 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.786190 23178 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.788386 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:57.789161 22576 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 0.
I20260709 13:06:57.791795 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.791931 23117 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:57.792270 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:57.793257 23137 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.793764 23137 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.794198 23137 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.794430 22695 ts_tablet_manager.cc:1434] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:06:57.796847 22695 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.802296 23198 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.802561 22500 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.804147 23178 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.808184 23178 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:57.812397 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:57.815083 22695 tablet_bootstrap.cc:654] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.808743 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:57.817907 22619 leader_election.cc:343] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.824826 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:57.825611 22572 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.816298 23137 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.833616 22695 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.838383 22695 ts_tablet_manager.cc:1403] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.000s
I20260709 13:06:57.838608 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:57.839329 22652 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:06:57.846269 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:57.847152 23117 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.858718 22572 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:57.860298 23137 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:06:57.858760 23117 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.861016 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:06:57.862483 22619 leader_election.cc:343] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.864843 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:06:57.865597 22573 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.865278 22695 raft_consensus.cc:359] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.867015 22617 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.873072 23178 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.873632 23178 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:57.874516 23178 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.865976 22695 raft_consensus.cc:385] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.883927 22695 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.884617 22695 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.886466 23167 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.886873 22695 ts_tablet_manager.cc:1434] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.000s
I20260709 13:06:57.890312 22573 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:06:57.892704 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:06:57.891621 22695 tablet_bootstrap.cc:492] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.900429 22695 tablet_bootstrap.cc:654] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.901309 23073 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.901855 23073 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:06:57.902732 23073 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.923568 22945 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.941643 22695 tablet_bootstrap.cc:492] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.942211 22695 ts_tablet_manager.cc:1403] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.011s
I20260709 13:06:57.944703 22695 raft_consensus.cc:359] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.945433 22695 raft_consensus.cc:385] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.945695 22695 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.946336 22695 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.947829 22695 ts_tablet_manager.cc:1434] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:06:57.955022 22695 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Bootstrap starting.
I20260709 13:06:57.954327 22400 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.963366 22695 tablet_bootstrap.cc:654] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.972913 23073 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.980203 22695 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: No bootstrap required, opened a new log
I20260709 13:06:57.980756 22695 ts_tablet_manager.cc:1403] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.008s
I20260709 13:06:57.983759 22695 raft_consensus.cc:359] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.984436 22695 raft_consensus.cc:385] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.984691 22695 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.985611 22695 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:57.988689 22695 ts_tablet_manager.cc:1434] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:58.014590 23073 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.017799 22400 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.111258 22500 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.124440 22945 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.142475 23129 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.212915 23117 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.213416 23117 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:06:58.215421 23117 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:06:58.216595 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:06:58.216574 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:06:58.217841 22572 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 1: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:06:58.218847 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:06:58.219720 23117 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.226271 23117 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:58.278275 23114 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.295562 23137 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.442293 22500 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.451232 23137 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.468488 23134 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.698320 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:58.736038 23218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:58.737212 23219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:58.742719 21390 server_base.cc:1061] running on GCE node
W20260709 13:06:58.744899 23221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:58.746464 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:58.747597 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:58.747911 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602418747890 us; error 0 us; skew 500 ppm
I20260709 13:06:58.748733 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:58.779181 21390 webserver.cc:533] Webserver started at http://127.20.227.132:41029/ using document root <none> and password file <none>
I20260709 13:06:58.780021 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:58.780285 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:58.780695 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:58.782011 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-3-root/instance:
uuid: "fa2f181263f446a6962b649f9348c15f"
format_stamp: "Formatted at 2026-07-09 13:06:58 on dist-test-slave-078m"
I20260709 13:06:58.787660 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:06:58.799441 23226 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:58.804302 21390 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.000s	sys 0.010s
I20260709 13:06:58.804776 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-3-root
uuid: "fa2f181263f446a6962b649f9348c15f"
format_stamp: "Formatted at 2026-07-09 13:06:58 on dist-test-slave-078m"
I20260709 13:06:58.805227 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:58.840049 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:58.842237 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:58.850683 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:58.854589 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:58.854984 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:06:58.855358 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:58.855618 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:58.981741 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.132:42571
I20260709 13:06:58.982230 23288 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.132:42571 every 8 connection(s)
I20260709 13:06:59.111055 21390 auto_leader_rebalancer-test.cc:384] add a tserver: fa2f181263f446a6962b649f9348c15f
I20260709 13:06:59.176208 23289 heartbeater.cc:344] Connected to a master server at 127.20.227.190:45599
I20260709 13:06:59.176712 23289 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:59.177649 23289 heartbeater.cc:507] Master 127.20.227.190:45599 requested a full tablet report, sending...
I20260709 13:06:59.182101 22401 ts_manager.cc:194] Registered new tserver with Master: fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:06:59.184267 22401 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44600
I20260709 13:07:00.188616 23289 heartbeater.cc:499] Master 127.20.227.190:45599 was elected leader, sending a full tablet report...
I20260709 13:07:00.628793 22572 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:00.641203 22652 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:00.642972 23312 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.650240 22504 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:00.652015 23312 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:00.672356 23302 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.678498 22652 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.753309 22401 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.755839 22504 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:07:00.777647 22544 consensus_peers.cc:597] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39009bfe483947928e10122b4bb55ca6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:00.782789 22652 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:00.850129 22503 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:00.852021 23307 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.853010 22572 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:00.855409 23307 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:00.869437 23307 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:07:00.873380 22618 consensus_peers.cc:597] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 549907a9ef52413ab776c58c50b74e5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:00.880398 22572 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.881711 22503 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.899993 22652 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:00.904120 22400 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:07:00.927402 22618 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9239c6f95c54166b454ada0dd9c1b9b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:00.927470 22572 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:00.929188 23296 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.932704 22503 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:00.935618 23305 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:00.943208 23296 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.944972 22576 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.949352 22503 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:00.963563 22401 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.017103 22503 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.028519 22572 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:01.029135 22652 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:01.030838 23300 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.032620 23300 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:01.051048 22469 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90227a385eee486dbc981f55629940e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.061828 23300 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:01.078701 22572 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:01.085175 22401 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.091029 22652 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:01.126739 23337 ts_tablet_manager.cc:933] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:01.181923 23337 tablet_copy_client.cc:323] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:01.217243 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet 39009bfe483947928e10122b4bb55ca6 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:01.217947 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet 39009bfe483947928e10122b4bb55ca6 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-39009bfe483947928e10122b4bb55ca6
I20260709 13:07:01.227911 22590 tablet_copy_source_session.cc:215] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:01.232326 23337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39009bfe483947928e10122b4bb55ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:01.255615 23337 tablet_copy_client.cc:806] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:01.256382 23337 tablet_copy_client.cc:670] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:01.260639 23337 tablet_copy_client.cc:538] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:01.271047 23337 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:01.303664 23337 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.304991 23337 tablet_bootstrap.cc:492] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:01.305769 23337 ts_tablet_manager.cc:1403] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.021s
I20260709 13:07:01.309497 23337 raft_consensus.cc:359] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.310503 23337 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:01.311311 23337 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.321022 23337 ts_tablet_manager.cc:1434] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.011s
I20260709 13:07:01.326359 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-39009bfe483947928e10122b4bb55ca6 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:01.326963 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-39009bfe483947928e10122b4bb55ca6 on tablet 39009bfe483947928e10122b4bb55ca6 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:01.416769 23337 ts_tablet_manager.cc:933] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:01.449250 23337 tablet_copy_client.cc:323] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:01.468325 23345 ts_tablet_manager.cc:933] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:01.478528 22664 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 549907a9ef52413ab776c58c50b74e5d from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:01.479307 22664 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 549907a9ef52413ab776c58c50b74e5d from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-549907a9ef52413ab776c58c50b74e5d
I20260709 13:07:01.480901 23345 tablet_copy_client.cc:323] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:01.483505 22663 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet a9239c6f95c54166b454ada0dd9c1b9b from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:01.484125 22663 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet a9239c6f95c54166b454ada0dd9c1b9b from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-a9239c6f95c54166b454ada0dd9c1b9b
I20260709 13:07:01.487388 22664 tablet_copy_source_session.cc:215] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:01.491266 23337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549907a9ef52413ab776c58c50b74e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:01.506611 22663 tablet_copy_source_session.cc:215] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:01.510962 23337 tablet_copy_client.cc:806] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:01.511727 23337 tablet_copy_client.cc:670] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:01.516686 23337 tablet_copy_client.cc:538] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:01.527593 23337 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:01.555318 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9239c6f95c54166b454ada0dd9c1b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:01.568606 23348 ts_tablet_manager.cc:933] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:01.578293 23348 tablet_copy_client.cc:323] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:01.590535 23337 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.594017 23337 tablet_bootstrap.cc:492] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:01.595124 23337 ts_tablet_manager.cc:1403] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.007s
I20260709 13:07:01.598971 23337 raft_consensus.cc:359] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.599938 23337 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:01.603211 23337 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.614295 23337 ts_tablet_manager.cc:1434] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:07:01.624537 22663 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-549907a9ef52413ab776c58c50b74e5d received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:01.625043 22663 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-549907a9ef52413ab776c58c50b74e5d on tablet 549907a9ef52413ab776c58c50b74e5d with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:01.639910 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet 90227a385eee486dbc981f55629940e4 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:01.640851 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet 90227a385eee486dbc981f55629940e4 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-90227a385eee486dbc981f55629940e4
I20260709 13:07:01.642140 23345 tablet_copy_client.cc:806] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:01.642927 23345 tablet_copy_client.cc:670] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:01.645864 23264 raft_consensus.cc:1217] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:01.659891 23345 tablet_copy_client.cc:538] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:01.665310 22515 tablet_copy_source_session.cc:215] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:01.684490 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90227a385eee486dbc981f55629940e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:01.685523 23345 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:01.777766 23345 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.779032 23345 tablet_bootstrap.cc:492] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:01.780234 23345 ts_tablet_manager.cc:1403] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.095s	user 0.022s	sys 0.037s
I20260709 13:07:01.783531 23345 raft_consensus.cc:359] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.784538 23345 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:01.785409 23345 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.787994 23345 ts_tablet_manager.cc:1434] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:07:01.790227 22663 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-a9239c6f95c54166b454ada0dd9c1b9b received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:01.790679 22663 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-a9239c6f95c54166b454ada0dd9c1b9b on tablet a9239c6f95c54166b454ada0dd9c1b9b with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:01.813113 23348 tablet_copy_client.cc:806] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:01.817631 23348 tablet_copy_client.cc:670] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:01.821765 23348 tablet_copy_client.cc:538] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:01.832152 23348 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:01.859318 23348 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.861726 23348 tablet_bootstrap.cc:492] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:01.862413 23348 ts_tablet_manager.cc:1403] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260709 13:07:01.865079 23348 raft_consensus.cc:359] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.865859 23348 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:01.866395 23348 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:01.868893 23348 ts_tablet_manager.cc:1434] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:01.871178 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-90227a385eee486dbc981f55629940e4 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:01.871685 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-90227a385eee486dbc981f55629940e4 on tablet 90227a385eee486dbc981f55629940e4 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:01.943491 23264 raft_consensus.cc:1217] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:02.036463 23264 raft_consensus.cc:1217] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:02.047761 23264 raft_consensus.cc:1217] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:02.148983 23312 raft_consensus.cc:1064] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:02.151906 23312 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:02.172670 22649 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.174593 23302 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.178453 23264 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.181164 22504 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.182171 23302 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.188655 23312 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:02.226869 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 47173.2us
I20260709 13:07:02.362012 23357 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.521044 22649 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.546519 23306 raft_consensus.cc:1064] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:02.568921 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 46880.2us
I20260709 13:07:02.586292 23306 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:02.597190 22400 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.617796 23264 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.631701 23369 raft_consensus.cc:1064] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:02.633487 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48394.7us
I20260709 13:07:02.637508 23369 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:02.655972 22498 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.702822 22579 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.709143 23263 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.717554 23263 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.717917 23296 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.718837 23366 raft_consensus.cc:1064] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:02.723753 23354 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:02.723776 23366 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:02.757149 23371 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:02.802443 22496 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.803454 22651 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.814798 23353 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:02.820415 23264 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.834333 22576 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.889721 22578 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.894886 23368 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:07:02.898609 23134 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:07:02.907507 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48407us
I20260709 13:07:02.913962 23377 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:02.921602 22504 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:02.911547 23368 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:07:02.950157 23300 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.955013 22651 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:02.961040 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 81905.3us
I20260709 13:07:02.962016 22578 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.969831 23262 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.970475 23382 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:02.982362 23296 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:02.996037 22579 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.014104 23296 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.023689 23263 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.030470 23262 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.028194 22401 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.049638 22504 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.065855 22572 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:03.072530 22499 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:03.066246 22400 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.081821 22503 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.071344 22578 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.095916 23263 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.098532 22651 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.098567 23262 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.099517 23300 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:03.102079 23362 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.103330 22401 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 2 to 3, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.107359 23377 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.110602 22503 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.114290 23300 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:03.117372 23363 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.127140 23312 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.112020 23262 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.128679 22650 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:03.134357 23264 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.137109 22652 raft_consensus.cc:2955] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.138603 22572 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.140352 23261 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.143288 23385 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.159415 23382 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:03.163658 23385 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.169541 22503 raft_consensus.cc:2955] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.237151 22579 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.248191 22400 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 3 to 4, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.257580 22652 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:03.276332 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80557.3us
I20260709 13:07:03.278471 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39009bfe483947928e10122b4bb55ca6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:03.278162 22401 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 1 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.295900 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 549907a9ef52413ab776c58c50b74e5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:03.298065 23261 raft_consensus.cc:2955] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.309191 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90227a385eee486dbc981f55629940e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:03.324659 22496 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.326483 23385 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:03.328009 23263 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:03.335062 23385 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:03.340011 23134 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.341838 22496 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.355059 22402 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 3 to 4, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.359047 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet 39009bfe483947928e10122b4bb55ca6 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:03.372972 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet 90227a385eee486dbc981f55629940e4 with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41926
I20260709 13:07:03.397768 23261 raft_consensus.cc:2955] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.407297 23396 tablet_replica.cc:333] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:07:03.411579 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9239c6f95c54166b454ada0dd9c1b9b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:03.417876 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet 549907a9ef52413ab776c58c50b74e5d with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:03.419286 22402 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 3 to 4, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 1 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:03.435459 23396 raft_consensus.cc:2243] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.437278 23397 tablet_replica.cc:333] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:07:03.425269 23395 tablet_replica.cc:333] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:07:03.442175 23395 raft_consensus.cc:2243] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.442893 23395 raft_consensus.cc:2272] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.444028 23397 raft_consensus.cc:2243] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.444948 23397 raft_consensus.cc:2272] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.445835 23396 raft_consensus.cc:2272] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.449117 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet a9239c6f95c54166b454ada0dd9c1b9b with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41926
I20260709 13:07:03.455236 23397 ts_tablet_manager.cc:1916] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:03.456215 23396 ts_tablet_manager.cc:1916] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:03.456528 23395 ts_tablet_manager.cc:1916] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:03.475899 23396 ts_tablet_manager.cc:1929] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:03.476487 23397 ts_tablet_manager.cc:1929] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:03.476614 23396 log.cc:1199] T 90227a385eee486dbc981f55629940e4 P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/90227a385eee486dbc981f55629940e4
I20260709 13:07:03.477154 23397 log.cc:1199] T 549907a9ef52413ab776c58c50b74e5d P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/549907a9ef52413ab776c58c50b74e5d
I20260709 13:07:03.478940 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet 90227a385eee486dbc981f55629940e4 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:03.479423 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet 549907a9ef52413ab776c58c50b74e5d (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:03.481055 23396 tablet_replica.cc:333] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:07:03.482216 23396 raft_consensus.cc:2243] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.483057 23396 raft_consensus.cc:2272] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.486770 23396 ts_tablet_manager.cc:1916] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:03.500345 23395 ts_tablet_manager.cc:1929] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:03.501009 23395 log.cc:1199] T 39009bfe483947928e10122b4bb55ca6 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/39009bfe483947928e10122b4bb55ca6
I20260709 13:07:03.504773 23396 ts_tablet_manager.cc:1929] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:03.505762 23396 log.cc:1199] T a9239c6f95c54166b454ada0dd9c1b9b P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/a9239c6f95c54166b454ada0dd9c1b9b
I20260709 13:07:03.506227 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet 39009bfe483947928e10122b4bb55ca6 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:03.507767 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet a9239c6f95c54166b454ada0dd9c1b9b (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:05.016537 23399 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.017241 23399 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.019541 23399 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.020732 23403 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.023386 23403 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.038484 23403 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.052659 23403 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.053301 23403 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.054111 23399 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.054912 23399 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.055876 23403 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.058205 23399 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.059706 23401 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.059862 23399 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.060261 23401 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.060528 23399 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.062556 23401 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.062788 23399 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.065230 23399 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.065537 23400 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.066432 23400 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.066860 23399 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.068337 23402 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.069067 23405 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.068853 23402 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.069540 23405 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.070974 23402 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.064540 23398 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.072855 23398 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.075662 23400 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.076233 23398 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.072314 23399 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.071486 23405 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.078284 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 400) took 1202 ms. Trace:
I20260709 13:07:05.078730 22579 rpcz_store.cc:276] 0709 13:07:03.876011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.921438 (+ 45427us) service_pool.cc:224] Handling call
0709 13:07:05.065912 (+1144474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.066130 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.066165 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.066218 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:05.066262 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.078082 (+ 11820us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.078204 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.091316 23398 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.091938 23398 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.094959 23398 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.105707 23399 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.106498 23399 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:05.109004 23404 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.109576 23404 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.111917 23404 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.113019 23402 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.113610 23402 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.116417 23401 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.117311 23401 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.117872 23406 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.119858 23406 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.115703 23402 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.121479 23403 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.123147 23403 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.125200 23403 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.119387 23401 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.108721 23399 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.124632 23406 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.132108 23406 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.133034 23405 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.132825 23406 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.133627 23405 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.135383 23406 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.135855 23405 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.136008 23406 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.136446 23405 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.137173 23402 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.137020 23406 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.138540 23401 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.139063 23401 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.137768 23402 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.146345 23402 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.137044 23405 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.150328 23405 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.142741 23401 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.158565 23401 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.159155 23401 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.161715 23401 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.169376 23406 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.172950 23399 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.175665 23408 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.176337 23399 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.176438 23408 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.178432 23399 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.178462 23408 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.182611 23406 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.183650 23403 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.184566 23403 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.186681 23403 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.183646 23406 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.194121 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.200249 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.191622 23402 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.201030 23402 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.203050 23399 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.203761 23399 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.207041 23399 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.209357 23403 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.210256 23403 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.194303 23408 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.212378 23408 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.214989 23408 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.218693 23406 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.218629 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.220182 23403 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.221480 23414 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.221841 23402 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.222262 23414 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.247867 23409 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.254321 23415 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.255160 23407 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.247042 23411 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.255261 23415 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.249657 23409 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.259423 23399 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.260700 23405 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.255910 23407 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.268115 23405 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.261229 23406 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.270586 23406 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.258473 23411 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.261430 23409 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.263082 23413 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.264715 23415 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.262003 23408 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.262835 23399 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.270639 23405 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.260957 23402 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.266098 23401 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.260253 23410 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.274863 23412 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.264957 23416 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.280773 23403 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.314364 23408 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.315982 23415 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.316409 23407 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.314216 23420 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.317780 23411 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.263171 23414 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.314291 23406 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.281505 23409 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.341305 23422 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.319416 23404 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.341898 23418 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.346733 23403 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.333843 23405 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.353533 23418 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.358136 23414 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.358525 23399 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.327666 23401 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.322494 23402 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.359779 23411 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.353080 23406 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.342533 23415 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.368412 23415 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.342023 23410 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.352559 23409 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.343700 23416 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.365873 23404 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.343559 23412 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.351745 23420 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.382495 23403 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.383445 23408 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.384140 23420 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.374871 22579 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:05.384994 23399 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.358745 23414 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.369097 23418 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.364945 23405 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.393308 23410 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.393733 23401 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.385604 23399 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.394845 23405 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.396656 23399 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.369141 23411 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.398649 23404 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.290091 23413 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.370194 23406 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.410501 23410 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.411900 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.413580 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.421855 22499 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:05.413861 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.422322 23423 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.360456 23422 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.424599 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.413970 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.425518 22504 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:05.425472 22503 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:05.426916 23419 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.427201 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.428841 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.429527 22503 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:05.430681 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.431295 22504 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:05.421695 23420 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.427595 23419 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.432169 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.425315 23398 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.432937 23407 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.435236 23398 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.435593 23407 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.434253 22500 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:05.437476 23407 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.423094 23423 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.438589 23420 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.433699 23410 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.467726 23419 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.468775 23406 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:05.467726 23420 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.474283 23398 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.476744 23410 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.478897 23409 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.480738 23402 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.480283 23423 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.484231 23422 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.485697 23411 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.487300 23414 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.487418 23416 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.491688 23413 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.491773 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:05.495301 23261 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.498443 23412 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:05.499919 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:05.500733 23263 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.506579 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:05.507759 22469 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:05.511610 23134 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.512616 23134 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.510761 23422 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:05.520212 23417 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.524590 23134 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.520285 23422 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.525974 23422 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.520941 23417 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.514185 23412 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:05.532998 23419 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.533906 23419 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:05.541386 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.543282 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.546322 23424 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.546487 23411 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.536643 23419 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:05.533111 23412 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.539856 23407 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.546954 23424 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.547070 23411 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.546360 23420 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.548512 23415 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.551018 23412 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.555424 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.556471 23420 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.558322 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.561188 23428 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.561875 23424 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.562557 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.565105 23414 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.565199 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.565415 23426 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.566818 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.553789 23419 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.563623 23415 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.567916 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.570067 22577 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.556051 23407 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.567037 23421 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.576320 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.570443 23418 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.578962 22572 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.572775 23411 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.575711 23424 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.565059 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.575635 23410 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.580168 22580 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.579963 23419 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.595920 23418 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.600234 23419 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.600419 23418 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.600893 22576 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.579972 23421 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.602412 23371 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.602464 23424 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.602964 23371 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.604238 23421 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.601016 22573 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.604749 23371 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.604816 23424 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.608170 23371 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.608840 23371 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.609354 23415 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.589938 23426 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.606839 23382 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.593329 23417 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.611764 23382 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.613972 23427 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.613816 23422 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.583488 23414 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.617558 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.618258 23420 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.618180 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.625288 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.633160 22650 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.630360 23430 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.630939 23434 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.614838 22571 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.633512 23409 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.625267 23427 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.633567 22574 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.612654 23371 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.631135 23417 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.638104 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.637785 23409 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.640903 23420 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.641111 23417 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.641748 23420 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.643256 23417 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.644793 23414 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.645136 23409 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.645768 23407 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.644590 23420 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:05.577100 23428 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.646622 22651 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.612118 23410 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.652494 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.653306 23382 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.653998 23422 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:05.654379 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.659204 23429 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.659431 23427 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.664337 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.665346 23410 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.665452 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.659782 23429 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.668329 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.668545 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.671312 22578 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.669750 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.658432 23417 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.672566 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.673509 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.669029 23382 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.675514 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.676316 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.676231 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.677630 22577 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.662274 23426 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.680307 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.677166 23410 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.682502 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.683075 22578 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 1.
I20260709 13:07:05.684279 23428 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.684206 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.672544 23427 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.686911 23427 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.687265 23412 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:05.687618 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.688987 23427 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.677419 23417 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.690294 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.690850 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.691394 23417 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.690872 22573 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.693634 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.694016 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.694221 22652 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.649718 23434 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.692813 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.634073 23430 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.685268 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.698689 23134 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.697624 23410 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.699201 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.699812 23134 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.691828 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.695058 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:05.702033 23263 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.679684 22650 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.701299 22651 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.679909 23382 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.705089 23134 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.704212 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.705597 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.706210 22579 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.697017 23427 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.699507 22574 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.709259 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:05.710763 23398 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:05.710950 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:05.712049 23417 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.712294 23410 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:05.709554 22580 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.712695 23417 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.710757 23430 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.717222 23398 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:05.722018 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.721366 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.717471 23431 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.720650 23398 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.722957 22652 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.725320 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.737649 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.738857 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.739918 23134 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.742072 22651 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.742664 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.743271 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.745059 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.745759 22500 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:05.739518 22579 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.748301 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.749217 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.741071 23296 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.718643 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:05.749399 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.746438 23134 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.760527 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.723879 23429 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:05.726306 22544 consensus_peers.cc:597] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f42f0567ae14f62b39e69ed29a409cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:05.721655 23427 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:05.794919 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.752700 23412 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:05.794257 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.756526 23437 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.759800 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.828996 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.722941 23435 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:05.759334 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:05.829216 23437 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:05.830049 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 103941us
I20260709 13:07:05.795789 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.723299 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.744750 23371 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:05.724413 23431 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.750118 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:05.792200 23296 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.847015 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.758899 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.757997 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.864302 23371 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.869583 22580 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.794516 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.758533 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.854702 23382 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.858354 23435 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:05.972738 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:05.905827 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 114329us
I20260709 13:07:05.944049 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.943097 23134 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.991413 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.992702 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.945276 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.993523 22651 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.995862 23296 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.938748 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.997753 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.998407 22653 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.945818 23439 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.010779 23439 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.011076 23431 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.916738 23263 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:05.967784 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:05.937530 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:05.955868 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.019577 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.019713 23427 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.955706 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.031431 22580 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.036187 22503 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.036451 23371 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.037263 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.038056 22574 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.038277 22578 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.015867 22571 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.929574 23398 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:06.039363 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.040186 22577 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.041193 23398 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.033120 23434 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:05.912626 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:05.896642 22650 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:05.896936 22575 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.041913 23437 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.046864 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.052706 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.143936 22580 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.043133 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.145150 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.049089 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.145366 22572 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.048728 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:06.148300 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08001139e0 after lost signal to thread 21393
I20260709 13:07:06.056489 23435 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.036216 23261 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:05.912518 23429 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.145404 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.142830 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:06.057965 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.152529 22578 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.150490 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:06.154135 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.153331 23429 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.154536 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.154903 23412 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:06.150595 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08001b83e0 after lost signal to thread 22437
I20260709 13:07:06.157028 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.157912 22496 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:06.155640 23412 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:06.159093 23443 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:06.159832 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.160236 23443 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.161072 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.160822 23412 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:06.162151 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.162803 22496 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:06.163646 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.164065 22574 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
W20260709 13:07:06.164510 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb9c0 after lost signal to thread 22529
I20260709 13:07:06.164569 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:06.165819 22675 debug-util.cc:398] Leaking SignalData structure 0x7b080029d9a0 after lost signal to thread 22604
I20260709 13:07:06.165737 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:06.166903 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfb60 after lost signal to thread 22678
W20260709 13:07:06.167213 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfb40 after lost signal to thread 22679
W20260709 13:07:06.168247 22675 debug-util.cc:398] Leaking SignalData structure 0x7b0800261d20 after lost signal to thread 23288
I20260709 13:07:06.169126 23429 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.172817 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.158248 23417 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.176369 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.162474 23443 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.180483 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.184659 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.187700 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:06.189363 23444 ts_tablet_manager.cc:933] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.190174 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.193499 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.192195 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.199878 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.200196 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.200798 22647 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.201088 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.201220 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.201776 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.202384 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.202453 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.203492 23401 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.204028 23401 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.204105 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.204500 23401 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.207120 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.203485 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.208995 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.209230 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.209750 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.209949 22653 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.210886 23422 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.211138 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.211355 23422 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.211858 23422 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.211901 22654 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.213114 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:06.215548 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 477323us
I20260709 13:07:06.223021 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.226229 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.227152 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.225697 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.229435 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.230492 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.221483 23401 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.227386 22619 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.209064 23412 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.232999 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.233553 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.233109 23412 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.234525 23432 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.235008 23432 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:06.235399 23432 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.235654 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.238960 23442 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.234189 23412 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.220609 23422 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.257869 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:06.258978 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49150.2us
I20260709 13:07:06.263775 23432 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.234191 22575 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:06.266242 23422 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.266949 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:06.269002 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:06.270038 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:06.270219 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.272091 22575 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.273133 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.278622 23371 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:06.279709 23371 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.280036 23371 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.280407 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.281064 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.281831 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.283107 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.283615 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.283917 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.284826 22503 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.285058 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.283177 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.285709 23371 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:06.286320 22504 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:06.286891 23371 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.287345 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.288630 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.289330 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.290665 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.288447 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.292894 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.295128 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.301766 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.303932 22619 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.304193 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.304556 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.304833 23443 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.305406 23443 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:06.305940 23443 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.306995 22653 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:06.309652 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.311124 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.311708 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.312180 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.312386 22505 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:06.313697 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.314611 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.315054 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.315781 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.316898 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.317399 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.319000 22499 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.318869 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.320444 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.316304 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.322587 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.317536 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.313666 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.324577 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.327649 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:06.328960 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.330287 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.330590 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.331881 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.332230 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.333433 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.334671 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.335843 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.336009 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.336737 23401 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.335843 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.337548 22497 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.338251 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.339155 23432 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.312737 22504 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:06.340960 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.336191 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.342375 23444 tablet_copy_client.cc:323] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:06.343538 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.346726 23412 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.348064 22575 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:07:06.349570 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet 6f42f0567ae14f62b39e69ed29a409cf from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:06.350436 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet 6f42f0567ae14f62b39e69ed29a409cf from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-6f42f0567ae14f62b39e69ed29a409cf
I20260709 13:07:06.351002 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.351406 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.352756 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.354424 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.355429 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.356109 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.358105 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.358676 22590 tablet_copy_source_session.cc:215] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:06.358237 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:06.360599 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.310214 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:06.371356 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61206.5us
W20260709 13:07:06.373793 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 112572us
I20260709 13:07:06.375150 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.375234 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f42f0567ae14f62b39e69ed29a409cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:06.375227 23417 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.376725 23417 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:06.377218 23417 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.378293 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.380465 23449 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.381018 23449 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.381482 23449 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.377290 23422 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.386143 23422 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.386626 23422 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.387262 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.388973 23443 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.389554 23412 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.390031 23401 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.390139 22653 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.390733 23401 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.391136 23401 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.397535 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.402128 23448 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.402581 23448 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.402944 23448 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.405189 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.407088 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.410068 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:06.410642 23448 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.410782 23417 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.411347 23442 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:06.411922 23442 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:07:06.413532 23437 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.412838 23442 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:06.414100 22468 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.416947 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.417464 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:06.418469 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.420082 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:06.421368 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55344us
I20260709 13:07:06.421522 22498 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.422049 23422 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.424809 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:06.425145 22498 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.425261 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.423034 23449 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.424167 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:06.428139 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.412851 23448 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.429737 22545 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:06.429797 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 62741.1us
I20260709 13:07:06.431100 23448 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.432821 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.426520 23371 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.445636 23371 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.446621 23371 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.448086 23371 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.448179 22577 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.448662 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.450258 23449 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.450402 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.451496 23401 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:06.451875 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.453424 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.453117 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.444511 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.445649 23417 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.457324 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.458664 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:06.458886 22500 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.433570 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.413182 23443 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:06.431533 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.460906 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.461187 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.458549 23440 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.462085 23429 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.462132 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:06.430267 23435 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.471529 23429 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.472080 23429 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.472491 23440 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.472787 23422 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.473014 23440 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.471570 23435 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.473951 23435 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.468166 22468 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.464105 23448 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.466882 22545 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.476107 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.478276 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.463966 23451 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.478627 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.471596 23452 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.480995 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.480368 23449 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.481447 23438 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.481129 23451 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.482378 23447 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.474040 23440 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.477341 23448 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.478385 23422 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.482524 23452 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.486450 23444 tablet_copy_client.cc:806] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:06.533916 23444 tablet_copy_client.cc:670] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:06.485558 23449 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.534808 23449 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.541730 23382 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:06.543208 23382 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.543637 23382 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.483842 23450 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.485848 23412 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.485050 23401 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:06.487761 23428 consensus_queue.cc:1175] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:07:06.487709 23440 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.518536 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.494764 23422 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.544950 23444 tablet_copy_client.cc:538] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:06.558693 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.486953 23447 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.499442 22402 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 2 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:06.556131 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 72131.9us
I20260709 13:07:06.550350 23452 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.486444 23451 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.552002 23412 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.552803 23450 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.583418 22468 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.556707 23422 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:06.597363 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 120225us
I20260709 13:07:06.598291 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.563061 23447 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.561599 23432 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.582957 23417 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:06.613214 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 150263us
I20260709 13:07:06.556748 23434 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:06.592273 23412 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.592409 23450 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:06.634346 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51023.6us
I20260709 13:07:06.635777 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.636945 23461 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.637557 23461 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.638111 23461 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:06.645339 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47310.5us
W20260709 13:07:06.654157 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 91440.6us
I20260709 13:07:06.655210 22617 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.656374 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.641238 23401 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.643859 23456 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.609319 23382 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.658470 23427 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.659431 23401 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.688779 22617 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.682631 23456 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.686996 23401 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.685117 23464 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.700819 23464 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.700968 23461 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.701275 23464 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.700133 23456 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.698752 23438 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.704033 23382 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.687500 23465 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:06.733409 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92958.2us
W20260709 13:07:06.737529 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48832us
I20260709 13:07:06.738691 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.717831 23429 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.760691 23461 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.756129 23465 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.764230 23435 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.803278 23432 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.803815 23432 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.787786 23429 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.811228 23261 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:06.811440 23432 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.813129 23432 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.803436 23449 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.816491 23454 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:06.777551 23451 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.829527 22502 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.829890 22501 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:06.832080 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.836974 23456 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.839398 23456 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:06.842260 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 95360.2us
I20260709 13:07:06.843582 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.845141 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.835605 23448 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.841332 23464 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.850456 22497 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.857060 22501 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:06.862536 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 127559us
I20260709 13:07:06.862999 23459 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.863512 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.864348 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.864224 23459 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:06.846546 23471 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.865536 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.867281 22500 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.868402 22617 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.871991 23472 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.874418 23469 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.874747 23472 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.874804 23469 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.875187 23472 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.872756 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.877614 22617 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.881434 22617 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.851649 23371 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:06.850934 23443 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:06.882814 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.884083 23465 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.881184 23437 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.878867 23459 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.875794 23469 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.874068 23470 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.893144 23371 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.893784 23443 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.897420 23443 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.898000 23412 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.898718 23443 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.900004 22499 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.900173 22580 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:06.891475 23468 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.879861 23473 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:06.900439 23443 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.894057 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.909761 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.894224 23427 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.912016 23442 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:06.912904 23473 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.922029 23450 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.895898 23401 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.896657 23371 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.924221 23448 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.900766 23468 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.892560 23464 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.925434 23449 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.878047 23477 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.928429 23427 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.928833 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:06.929517 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 281235us
I20260709 13:07:06.895294 23469 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.943352 23474 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:06.895594 23470 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.953583 22504 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.939668 23454 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:06.955341 23466 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:07:06.957017 22617 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.932797 23473 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:06.894397 23422 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:06.961426 23440 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.952817 23444 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:06.963663 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.961495 22497 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.945631 23435 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.949170 23468 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.954156 23477 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.947069 23382 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:06.956305 23451 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:06.958856 23454 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:06.981196 22617 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.980593 23438 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.958068 23470 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.971547 23437 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:06.976187 23371 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:06.987993 22505 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.987727 23473 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:06.988722 23466 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:06.993746 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:06.986760 23454 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.979799 23477 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.003479 22545 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:07.021479 22617 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:06.997854 23466 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.002084 23435 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.007654 23451 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.029858 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.030635 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.033743 22573 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:06.996356 23456 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:07:06.997766 23447 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.012269 23437 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:07:07.020430 23474 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.042085 23451 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.053748 23451 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.054000 23466 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.026098 23473 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.025723 23371 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.027129 23434 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.056413 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:07.042872 23438 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:07.059199 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.020303 23463 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:07.025549 23435 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:07.067555 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 438357us
I20260709 13:07:07.060348 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.078948 23458 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:07.079598 23458 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.082020 23458 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.083844 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.074698 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.086968 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.101624 22502 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.076474 23450 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.108692 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.109455 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.056874 23412 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.083796 23401 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.078274 23440 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.083285 23464 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.066846 23434 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.083402 23435 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.122104 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:07.124626 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49999.6us
I20260709 13:07:07.034060 23471 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:07:07.124069 23464 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.130215 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.124332 23422 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.122788 23440 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.127986 23463 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.142269 23468 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.133773 23464 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.119884 23438 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:07:07.138962 23477 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:07.152061 23452 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.006s
I20260709 13:07:07.146518 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.165035 23455 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:07.151073 23434 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.177347 22497 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.178221 23435 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.181234 23435 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.182441 23468 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.182828 23447 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.180269 23454 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.194561 23434 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.187041 23455 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.175935 23452 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.239104 23477 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.242123 23458 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.242619 23458 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:07.243547 23458 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:07.245456 23465 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.245911 23465 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.250548 22503 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.257143 23471 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.257555 23471 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.258375 23471 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.191146 23440 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.214574 23451 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.273999 23466 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.274333 23454 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.284626 23452 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.287508 23440 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.265636 23458 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.246801 23465 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.301739 23465 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.320456 22653 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:07.331080 23481 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:07.282510 23472 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.350600 23455 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.322311 23470 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.369457 22504 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:07.363112 23464 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:07.399639 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 469918us
W20260709 13:07:07.401707 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 265653us
W20260709 13:07:07.402880 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 336771us
I20260709 13:07:07.405040 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:07.408902 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:07.441484 22504 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.442287 22617 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:07.407431 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.445688 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.446022 22572 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.448578 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:07.452396 23437 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:07.453202 23437 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.454118 23459 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.456058 23437 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:07.403767 23451 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.474328 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:07.474025 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 347393us
I20260709 13:07:07.475319 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.445760 23454 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.473733 22574 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.450749 23452 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.481894 22543 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.483606 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.449827 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:07.458559 23477 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.487273 22503 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:07.474216 23469 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.513s	user 0.016s	sys 0.025s
I20260709 13:07:07.492264 23493 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.489482 23443 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:07:07.493324 23432 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.494138 23371 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:07.497536 23471 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.497879 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:07.498935 22579 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.485924 23452 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.508198 23427 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:07.509719 22580 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.510257 23448 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:07.510196 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 60434.3us
I20260709 13:07:07.513931 23464 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.477731 23459 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.478474 23454 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.531363 23371 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.537966 23371 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.538771 23474 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.539148 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:07.538972 23371 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.531847 23432 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.490406 23477 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.540242 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:07.530876 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49024.9us
I20260709 13:07:07.544442 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:07.547096 22503 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.504544 23465 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:07.526587 23429 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.540072 22571 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.540723 23454 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.533344 23452 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.529656 23472 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.551308 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.554775 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.515275 23382 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:07.558699 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.550343 23422 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.559888 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.560120 23422 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.560500 23422 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.561043 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.562904 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.564257 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.565573 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.567077 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.543100 23432 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.569217 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.570013 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.571441 22580 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.543100 23371 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.573367 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.548128 23469 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.536043 23448 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.579972 22543 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.581043 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 23) took 1083 ms. Trace:
I20260709 13:07:07.581285 23489 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.539187 23474 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.547577 23477 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.545675 23447 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.548775 23468 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.549065 23470 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.585690 22543 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.581445 22402 rpcz_store.cc:276] 0709 13:07:06.491147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.491386 (+   239us) service_pool.cc:224] Handling call
0709 13:07:07.574040 (+1082654us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:06.665810 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:06.666537 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:06.666579 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:07:06.666605 (+    26us) tablet.cc:662] Decoding operations
0709 13:07:06.667016 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:06.667102 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:06.667149 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:06.667375 (+   226us) tablet.cc:701] Row locks acquired
0709 13:07:06.667394 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:07:06.667603 (+   209us) write_op.cc:270] Start()
0709 13:07:06.667738 (+   135us) write_op.cc:276] Timestamp: P: 1783602426667520 usec, L: 0
0709 13:07:06.667769 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:07:06.668561 (+   792us) log.cc:844] Serialized 538 byte log entry
0709 13:07:07.113559 (+444998us) op_driver.cc:464] REPLICATION: finished
0709 13:07:07.551883 (+438324us) write_op.cc:301] APPLY: starting
0709 13:07:07.556594 (+  4711us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:07.559732 (+  3138us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:07.559869 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:07.560093 (+   224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:07.560245 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:07.560287 (+    42us) write_op.cc:312] APPLY: finished
0709 13:07:07.560480 (+   193us) log.cc:844] Serialized 22 byte log entry
0709 13:07:07.560642 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:07.560722 (+    80us) write_op.cc:454] Released schema lock
0709 13:07:07.560758 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:07.561120 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:07.561150 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3670,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":419063,"apply.run_cpu_time_us":1756,"apply.run_wall_time_us":14888,"num_ops":1,"prepare.queue_time_us":101271,"prepare.run_cpu_time_us":51005,"prepare.run_wall_time_us":89493,"raft.queue_time_us":343179,"raft.run_cpu_time_us":18906,"raft.run_wall_time_us":294309,"replication_time_us":445592,"thread_start_us":796110,"threads_started":4,"wal-append.queue_time_us":99691}]]}
I20260709 13:07:07.596362 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.598740 22543 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.599020 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:07:07.594751 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0039787779999187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:07:07.600596 22543 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.595788 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.596323 23475 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:07.596925 22645 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:07.587751 22649 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.610039 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.601729 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.602674 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.543251 23427 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:07:07.606563 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.611600 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.606065 22504 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.607883 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.608180 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.583341 23410 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.584059 23448 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.621662 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.583762 23469 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.597677 23468 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:07.626621 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.613502 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.613584 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.614151 23459 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.614542 23432 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.606740 23451 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.608969 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.624068 22403 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.597908 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.605499 23489 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.631307 23457 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.631233 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.631608 23469 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.632665 23474 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.630239 23475 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:07.630057 23468 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.633749 23422 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.634281 22651 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.637867 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.640079 22652 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.630716 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.629932 23459 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.734064 23422 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.733714 23459 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.734935 23459 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:07.737324 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 99545.5us
I20260709 13:07:07.738443 23422 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.698770 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.699841 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.696838 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:07.699333 23471 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:07.662616 23483 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.633596 23476 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.664305 22654 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.696957 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.718544 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.718760 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.717062 23437 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:07:07.783175 23454 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.699335 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.784533 22497 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:07.784839 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85611.1us
I20260709 13:07:07.785480 23454 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:07.679167 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70883.7us
I20260709 13:07:07.683112 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:07.786017 23417 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.786686 23417 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.787127 23475 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:07:07.731880 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101331us
I20260709 13:07:07.788471 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.789526 23410 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.789639 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:07.790385 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.792237 23464 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.787168 23417 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.793046 23464 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:07.794680 23417 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:07.795728 23465 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.799235 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.799928 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.801877 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.803037 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.730129 23432 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.742192 23451 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.814491 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.732239 23427 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.601962 23466 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:07:07.665062 22646 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.727638 23481 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.730435 23438 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:07:07.761037 23484 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.769729 23486 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:07:07.770887 23474 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.764315 23485 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.780380 22650 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.843204 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.844489 23485 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:07.845474 23458 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.003s
I20260709 13:07:07.847962 23477 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.815183 23443 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.848918 23475 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.849123 23443 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.849686 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.851251 23443 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:07.738910 23422 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.852476 23422 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.855762 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:07.858444 22647 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.859994 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.782753 22648 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.861759 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.863125 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.719390 23440 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:07.816268 22649 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.864441 23440 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.864760 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.811787 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:07.809103 23434 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.865831 23434 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.866791 23434 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.868115 23434 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.796134 23465 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.821415 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.821324 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:07.874289 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.803938 23483 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.875047 23483 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.831091 22651 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.876048 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:07.831384 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 70238.8us
W20260709 13:07:07.834780 23444 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:07.837257 23481 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:07.839279 23484 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.883258 22503 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.863206 22652 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.864835 23440 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.822351 22500 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.869732 22653 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.747761 22468 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.872766 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:07.825503 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64309.4us
I20260709 13:07:07.889271 23481 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:07.827167 23427 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.891507 23427 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:07.891613 23440 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.892874 23484 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:07.893520 23371 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.893689 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:07.895644 23417 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.896059 23417 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.896344 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.896816 23444 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:07.897127 22500 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:07:07.897606 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 149948us
I20260709 13:07:07.896947 23417 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.898717 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:07.899435 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.882506 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:07.884438 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.902113 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 110249us
I20260709 13:07:07.903982 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.905076 23401 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.905493 23401 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.905865 23401 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.908766 23422 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.909214 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:07.910936 22578 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.911233 23465 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.910907 23422 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.912391 23465 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.905514 23444 tablet_bootstrap.cc:492] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:07.913604 23444 ts_tablet_manager.cc:1403] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.971s	user 0.032s	sys 0.038s
I20260709 13:07:07.904585 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.923014 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.926251 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.849691 23475 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:07.885114 23485 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:07.929921 23451 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.939496 23475 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:07.926940 23422 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.941558 23422 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.941949 23422 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.921873 23484 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.944168 23440 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.929955 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.930152 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.931551 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.922041 23438 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.931849 23489 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.932606 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.929955 23468 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.949532 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:07.950286 23451 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.932798 23448 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.901350 22646 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:07.952302 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:07.931026 23470 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.952813 22498 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.953246 23470 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.953698 23470 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.953963 23468 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.952384 23448 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.957111 22575 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:07:07.883383 23452 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.922132 23417 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.959766 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.956840 23457 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:07.963083 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.946496 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.958391 23454 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.964665 23477 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:07.964289 23422 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.969295 22468 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.970306 23382 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.971144 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.971395 23428 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:07.973091 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:07.989885 23452 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:07.976033 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.991683 23382 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:07.978030 23468 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:07.920365 23444 raft_consensus.cc:359] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:07.982343 22504 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:07.983752 22619 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.992776 23438 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.995903 23474 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.996541 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:07.993991 23472 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.976760 23454 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.997884 23454 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.981501 22543 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:07.989763 23428 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.981808 23469 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.001735 23428 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:08.002039 22648 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.002693 23428 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.004078 23428 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.006335 22468 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.007141 23480 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.007233 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.007695 23480 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.008174 23480 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.008926 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:07.993217 23468 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.015021 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.017477 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:08.037408 23476 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:07.999111 23465 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.989895 23422 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.040742 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.041738 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.043339 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.013394 23447 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.016312 23468 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.041040 23477 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.029789 23401 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:08.045127 23493 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.045835 23498 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.046901 23450 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.017553 22645 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.046512 22543 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.006842 23382 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.067029 23382 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.048437 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:08.052253 23464 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.069268 23470 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.071434 23470 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.073239 22500 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.052896 23447 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:07.994940 23500 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.018141 23451 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.057997 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.057657 23477 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.091172 23477 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.091217 23470 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.093537 22468 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.094671 23470 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.095142 23470 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.095623 23470 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.060977 23498 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.097090 23498 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.063172 22496 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.063815 22498 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.064221 23401 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.058625 23472 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.065997 22503 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.065774 23474 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.081615 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:08.082660 23438 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.077128 23447 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.123696 23477 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.088510 23468 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:08.098747 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52346.4us
I20260709 13:07:08.099254 22468 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.030786 23483 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.121426 23474 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.086073 23450 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:08.125571 23438 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.137297 23438 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:08.126245 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44768.7us
I20260709 13:07:08.117133 23472 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.140641 22500 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.138281 23438 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.129529 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.143122 23450 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.143774 23450 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.143455 23470 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.144414 22468 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.146766 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.126088 23500 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.147902 23500 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.148239 23500 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.134497 23444 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:08.130966 23465 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.151449 23438 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.151775 23452 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.152366 23468 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.131086 23493 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:08.129048 22543 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.150588 22499 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.153079 23450 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.153676 23410 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.133677 23401 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.154450 23450 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.154750 23401 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.155308 23401 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.155459 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.156231 23489 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.156636 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.156957 23489 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.157632 23489 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.157784 22543 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.158877 22543 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.133880 23474 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:08.151053 23448 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.152416 23422 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.149114 23500 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.113715 23464 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.177443 23500 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.177661 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.149962 23472 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.139890 23469 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:07:08.159473 23455 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.165638 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.166468 23474 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.185073 23452 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.185570 23452 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.185807 23474 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.186457 23452 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:08.188091 23477 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.166769 23468 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:08.191150 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.167457 23448 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.192581 23448 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.133087 22650 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.154767 23410 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.200048 23410 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.200910 23410 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.202160 23410 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.169749 23489 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.170135 23451 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.170984 23458 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.173022 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.180487 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.181171 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.182075 23483 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.183746 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.184521 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.184820 23469 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.189896 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:08.196786 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.150221 23447 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.149547 23444 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:08.263621 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 79944.5us
I20260709 13:07:08.264520 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.265189 22651 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:08.268724 22652 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:08.268968 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:08.269618 22649 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:08.269889 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.270881 22652 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:08.272182 22652 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:08.274286 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 311269us
I20260709 13:07:08.266084 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.285933 23472 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.205591 23454 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.176743 23480 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.295328 23480 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.208319 23451 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.205669 23455 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.290616 23489 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.272502 23477 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.267140 23422 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.310792 22649 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.311843 22496 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.206988 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.280963 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.299460 22503 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.300828 22500 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.348340 22653 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
W20260709 13:07:08.360908 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 81688.5us
I20260709 13:07:08.263547 23469 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:08.302699 22499 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.306859 22647 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:08.203970 23401 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.292949 23447 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.305923 23489 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.393469 23438 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.304353 23382 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:08.314248 23422 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.314930 23477 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.319576 23474 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.307521 23455 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.322891 23444 ts_tablet_manager.cc:1434] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.405s	user 0.003s	sys 0.008s
I20260709 13:07:08.289950 23470 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.323616 23458 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.298136 23483 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.303359 23451 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.303159 22543 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.361956 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:08.411409 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49568.7us
I20260709 13:07:08.412422 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.413563 23447 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.413853 22468 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.267194 23498 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:08.414994 23470 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.415457 23470 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.369709 23454 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.326116 22645 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:08.366361 23480 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.329715 22646 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:08.405169 23501 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:08.375285 23500 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:08.414013 23447 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.375013 23493 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:08.327101 22498 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:08.418471 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115409us
I20260709 13:07:08.432963 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.420316 23450 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.403043 23472 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.402063 23382 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.407604 23474 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.428704 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:08.394133 23438 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.420197 23498 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:08.440498 22543 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.439321 22499 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:08.449860 22503 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.436616 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-6f42f0567ae14f62b39e69ed29a409cf received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:08.456768 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-6f42f0567ae14f62b39e69ed29a409cf on tablet 6f42f0567ae14f62b39e69ed29a409cf with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:08.457846 23474 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:08.458374 22648 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:08.458570 22654 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:08.460148 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.435501 23454 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.465863 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:08.473884 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:08.474666 22578 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:08.449656 23429 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.410838 23469 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.420183 23422 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.394030 23489 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.466835 23455 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.472021 23500 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.492120 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:08.503403 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 89606.1us
I20260709 13:07:08.505160 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.507681 22468 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.509928 23457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36342 (request call id 1) took 3118 ms. Trace:
I20260709 13:07:08.490450 22572 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:07:08.481050 23454 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.471474 23477 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.512192 23507 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.522521 23451 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.501128 23493 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.510075 23474 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.509768 23429 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:07:08.536098 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:08.512598 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 72208.5us
I20260709 13:07:08.509965 23500 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.515367 23476 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.474680 23470 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.488848 23401 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:08.527581 23469 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.537412 23489 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.537240 23468 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.556126 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.489624 23447 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.563822 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:08.563412 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.555333 23500 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.549327 23507 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.608032 23468 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.554123 23458 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:08.609279 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45926.9us
I20260709 13:07:08.554493 23476 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.613909 22617 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.565521 23452 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.567327 23483 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.553787 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.606132 23480 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.617249 23448 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.614660 23451 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.613139 23428 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.625624 23458 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.684787 23440 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.684580 23476 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.614400 23417 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.672212 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:08.623469 23494 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:08.559526 23474 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.621023 23493 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:08.622154 23517 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.668180 23438 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:08.678865 23429 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:08.700495 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.701597 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 79632.9us
W20260709 13:07:08.702560 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 146532us
W20260709 13:07:08.696702 23492 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:08.701805 23508 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:08.703065 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 89238us
I20260709 13:07:08.693109 23452 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.700644 23440 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.712322 22468 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.712517 22543 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.718434 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:08.718917 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:08.679304 23454 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.723747 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.726438 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.724972 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.701443 23428 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.704667 23417 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.712807 23507 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.705006 23448 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.733835 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.734815 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.796689 22579 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:08.732571 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.790391 22503 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:08.706925 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 162455us
I20260709 13:07:08.750886 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:07:08.796847 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70513.7us
I20260709 13:07:08.797423 22652 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:08.747529 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.704821 23516 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.817495 22577 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:08.708892 23517 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.736912 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:08.720767 23440 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:08.728457 23509 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:07:08.723022 23401 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.722977 23519 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.723228 23476 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.725584 23508 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:07:08.724699 23521 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.733727 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.714046 23493 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.728619 23382 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:08.799499 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.827087 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.822911 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.733315 23520 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:08.821071 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.836153 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.808036 23450 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.838866 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:07:08.841830 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 123040us
I20260709 13:07:08.865211 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.537593 23457 rpcz_store.cc:276] 0709 13:07:05.371446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.371606 (+   160us) service_pool.cc:224] Handling call
0709 13:07:05.397340 (+ 25734us) log.cc:844] Serialized 513 byte log entry
0709 13:07:05.496063 (+ 98723us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18002c3ce0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec26254b0b 00007fec262d9b63 00007fec26301752 00007fec2b2c1d29
0709 13:07:05.561990 (+ 65927us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5400359420. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26274142 00007fec26254eaa 00007fec2625bd53 00007fec2625bcd9 00007fec2625bc69 00007fec2625bc31 00007fec2625adfd 000000000038f354 000000000038f199 00007fec2320e475
0709 13:07:08.489285 (+2927295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103473,"raft.queue_time_us":96191,"raft.run_cpu_time_us":27302,"raft.run_wall_time_us":135660,"spinlock_wait_cycles":36881920,"thread_start_us":141457,"threads_started":2,"wal-append.queue_time_us":42428,"wal-append.run_cpu_time_us":1563,"wal-append.run_wall_time_us":1001599}
I20260709 13:07:08.820796 23464 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.827808 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.866371 22653 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:08.735236 23458 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.839795 23438 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.883033 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.732147 23480 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.844560 22498 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.885185 22652 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.889647 22649 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.850987 23523 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.730798 23483 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.866865 23520 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.733569 23468 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.730446 23452 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.891170 22573 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
W20260709 13:07:08.902256 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.902262 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.919344 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.903235 22499 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.902190 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.904114 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:08.905493 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:08.879081 23450 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.913446 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.913446 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:08.913552 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 101652us
I20260709 13:07:08.879724 23528 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.848282 23521 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.927556 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.920504 22652 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:08.924495 22653 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.924710 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.883327 23464 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:08.887199 23382 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:08.933423 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.936808 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.940096 22652 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.941843 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.898362 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.929375 22573 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.919229 23401 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.945061 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.902223 23516 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:08.971031 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.893672 23438 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.918176 23520 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.935369 23458 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.973205 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.978679 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.985142 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:08.947235 22652 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.977249 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:09.017608 22617 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:08.985586 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 81621.5us
W20260709 13:07:09.020110 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46957.4us
I20260709 13:07:09.021342 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.014925 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:09.022964 22649 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.024060 22653 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.984090 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.941116 23501 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.035996 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:09.037204 22543 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.039932 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:09.040529 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 120803us
I20260709 13:07:09.044441 22543 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.048007 22649 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:08.893982 23448 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.984193 23428 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:08.976986 23474 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:08.976394 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:08.982894 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.054446 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:09.005831 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:08.981504 23531 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.059469 22653 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:08.976909 23261 raft_consensus.cc:1217] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:08.928753 23457 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.121s
I20260709 13:07:09.034940 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:08.970422 23382 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.926777 23524 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.140s
W20260709 13:07:09.068037 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46839.4us
I20260709 13:07:09.052064 23410 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.069420 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:08.937424 23528 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.053911 23526 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.059775 23519 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.061534 23477 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.083848 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.083734 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:08.983996 23401 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.927459 23517 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:08.983260 23464 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:09.072505 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 136319us
I20260709 13:07:08.933553 23508 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:09.097224 23515 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:07:09.155288 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55486.1us
I20260709 13:07:09.076756 23516 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.107339 22574 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:09.147272 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.123308 23493 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.118083 23410 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:07:09.211509 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.212334 22574 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
W20260709 13:07:09.213507 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 167980us
I20260709 13:07:09.174022 23464 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:09.219624 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.220803 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:09.221256 23530 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.201480 23526 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.222420 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:09.225694 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68733us
I20260709 13:07:09.202761 23428 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.228478 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:09.230520 23422 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.221117 23533 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.232213 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:09.216747 23493 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:09.222476 23489 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.655s	user 0.003s	sys 0.007s
I20260709 13:07:09.214054 23438 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.236234 23422 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.240481 23532 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:07:09.221896 23457 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:09.244884 23542 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.245682 23542 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.248822 23542 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.249933 23457 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.261179 23382 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.273731 22576 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:09.236160 23493 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:09.250039 23438 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:09.095988 23261 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:09.170657 23519 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.233455 23428 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.282582 23382 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.284453 23438 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:09.300388 23438 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:09.290882 23451 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.006s
W20260709 13:07:09.302870 23540 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:09.304559 23382 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:09.300446 23536 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:07:09.233737 23526 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:09.314723 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 82566.4us
I20260709 13:07:09.314898 23518 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:09.315392 23518 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:09.317094 23515 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.317665 23515 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.318713 23515 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.322023 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.315544 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:09.315393 23524 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:09.326661 23477 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.296365 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.330307 22650 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:09.347266 22650 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:09.331707 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.334364 22578 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:09.348528 22577 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:09.351893 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:09.343308 22653 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:09.343245 22654 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:09.313823 23528 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.355912 23450 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.369267 23547 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:09.328047 23524 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:09.357630 23493 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.343783 23382 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.354570 23455 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.391683 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.393426 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.394627 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.370519 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.401021 23527 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.401437 23477 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.401718 23527 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.402388 23477 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.389148 23528 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.405203 23528 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.406993 23541 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.407564 23541 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:09.407827 23528 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.316541 23518 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:09.412559 23518 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.344410 23422 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.414628 23438 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.410727 23541 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:09.411458 23417 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.374475 23532 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.408610 23520 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.401054 22580 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:09.418057 23524 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.408964 23455 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.423731 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.391139 23547 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.433983 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.435494 22468 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.384771 22647 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:09.438081 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:09.431478 23524 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.426430 23527 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.437433 23417 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.426481 23528 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.444895 22572 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:09.442090 23489 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.446404 23489 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.447237 23537 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.433935 23457 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.444639 23528 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.448331 23543 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.447359 23520 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.440029 23541 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.440418 23530 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:09.452507 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.438005 23547 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.439563 23521 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.448553 23489 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.444515 23417 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.442247 23523 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:09.457582 22468 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:09.459657 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 415253us
I20260709 13:07:09.459812 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:09.460641 22543 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.445827 23527 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.463218 22543 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.462219 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:09.466948 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.466508 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.467870 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.457912 23517 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.458046 23530 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.458600 23523 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:09.463809 23483 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.474687 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:09.464848 23520 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:09.466476 23500 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.000s
I20260709 13:07:09.426966 23532 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.476133 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.479707 22650 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:09.480333 23438 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.480679 23455 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.448952 23543 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:09.483098 23543 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:09.484264 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.467298 23489 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:09.484787 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.487416 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.467401 23521 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.484740 23527 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.488771 23537 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.488720 23483 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.502821 23521 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.504281 23483 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.505615 23521 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.473178 23457 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.462015 23501 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:09.472966 23382 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.516202 23417 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.519335 23428 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:09.522127 23476 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.004s
I20260709 13:07:09.526609 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.532560 22573 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:09.533928 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.534879 22573 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:09.535962 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.526728 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.469628 23541 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.478278 23528 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.478453 23523 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.537336 22577 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:09.540874 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.541666 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.542598 23532 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.543995 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:09.545011 23457 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:09.540256 23440 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.004s
I20260709 13:07:09.515060 23520 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:09.529940 23469 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.001s
I20260709 13:07:09.546336 22577 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.536659 22573 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:09.543262 23428 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.549669 23457 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.530944 23521 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.553028 22579 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:09.555179 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.543730 22647 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:09.489142 23500 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.539211 22617 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.590299 23538 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.593745 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.595095 22650 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:09.477932 23480 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.550936 23541 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.570669 22649 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:09.566715 23428 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.587059 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.551854 23530 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.583461 22651 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:09.590987 23538 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:09.597712 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:09.598378 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.600293 22577 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
W20260709 13:07:09.596503 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57427.3us
I20260709 13:07:09.611490 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:09.612437 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:09.557065 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82451.4us
I20260709 13:07:09.598878 22498 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:09.601560 23480 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:09.553812 23440 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.591182 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.566184 23489 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:09.599442 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.615334 23545 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.594436 23469 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:09.620519 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.622848 22579 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.624013 22650 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:09.626192 23455 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:09.626364 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.625419 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:09.626634 23451 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.577806 23521 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.633754 22577 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.647917 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.654227 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:09.648829 22572 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:09.649112 22578 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:09.602018 23501 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.631399 23438 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:09.658226 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:09.659842 23538 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:09.660178 23440 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.632335 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.627478 23533 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:09.630962 23528 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:09.662997 22502 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:09.654404 22645 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:09.669467 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:09.653462 23455 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.671742 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.680469 23533 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:09.691215 22654 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:09.668458 22646 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:09.672101 23440 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:09.672267 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.632561 23480 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.663247 23417 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.673506 23489 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.675623 23538 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.677211 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:09.678965 23429 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.695228 23447 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:07:09.660742 22648 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:09.681427 22545 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.651670 23469 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:09.652593 23524 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.664021 23438 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.705621 23429 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.634366 23520 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.703500 23538 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.686157 23528 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.657178 23451 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.707681 22579 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:09.715533 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.726610 22619 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.688022 22647 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:09.632910 23541 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:09.806027 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.713449 23543 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.150s
I20260709 13:07:09.803826 23532 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.865798 23532 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:09.871495 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 156754us
I20260709 13:07:09.872730 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:09.702194 23428 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.883265 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:09.895345 23429 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.794731 23438 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.797415 23526 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.724753 23476 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.796648 23524 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.906780 23524 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.724898 23469 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.871181 23410 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:09.908023 23410 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:09.910684 23410 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.881608 22403 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 1 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.720118 23417 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:09.759773 23474 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.724874 23382 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:09.934659 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.935125 23500 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.938845 23493 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.871891 23528 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.879598 23544 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.939800 23535 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.251s
I20260709 13:07:09.697597 23537 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.215s
I20260709 13:07:09.880136 23464 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:09.963012 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:09.973641 23450 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.974292 23538 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.978259 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 501) took 1151 ms. Trace:
I20260709 13:07:09.979581 23526 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.868752 23532 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:10.103109 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.986580 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.933393 23521 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:09.933782 23428 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.985873 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:10.057721 23448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.015s	sys 0.038s
I20260709 13:07:09.990120 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:09.992244 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 493) took 1267 ms. Trace:
I20260709 13:07:09.955799 23455 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:09.998405 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.000290 22577 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:10.000420 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.003069 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:10.005359 23517 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.002s
I20260709 13:07:10.020110 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.031088 23533 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.126376 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.046371 23417 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:10.053838 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 181205us
I20260709 13:07:09.985321 23469 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.108493 23500 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:10.048625 23474 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.099946 22651 rpcz_store.cc:276] 0709 13:07:08.834200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.842461 (+  8261us) service_pool.cc:224] Handling call
0709 13:07:09.978023 (+1135562us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54002f8ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:09.978154 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505567488}
I20260709 13:07:10.046855 22580 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:09.990228 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.113557 23521 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:10.114439 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.117400 23428 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.119467 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.065778 23410 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.982614 23438 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.021315 23523 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.180752 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:10.121434 23448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.016s	sys 0.039s
I20260709 13:07:10.197016 22503 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:10.112600 22575 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:10.202818 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.203706 22496 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:10.165484 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.208549 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.210961 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.192216 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.112073 23526 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.130620 22505 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:10.202620 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.228786 23517 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.232410 23517 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.234769 23538 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.228670 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.237269 23538 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.237676 23382 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.238229 23382 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.239388 23538 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.247785 22496 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:10.248911 23417 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.228667 23555 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.203569 23500 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.229943 23532 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.263720 23532 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.266494 23532 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.267396 23469 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.236164 23451 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.240242 23517 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.275748 23474 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.262264 23538 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.276937 23538 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.121908 22646 rpcz_store.cc:276] 0709 13:07:08.725519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.732271 (+  6752us) service_pool.cc:224] Handling call
0709 13:07:08.732609 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.691782 (+959173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.991186 (+299404us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54001c84d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:09.992137 (+   951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125013376}
W20260709 13:07:10.309144 23519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.000s	sys 0.063s
W20260709 13:07:10.309865 23519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.000s	sys 0.063s
W20260709 13:07:10.269366 23547 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.807s	user 0.000s	sys 0.013s
I20260709 13:07:10.317413 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.313961 23523 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.318553 22503 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:10.324208 22574 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:10.278055 23555 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.331568 23438 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.333714 23500 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.335296 23538 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.336563 23526 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.327489 23522 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:10.338093 23522 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.317920 23547 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.343588 23547 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.346269 23555 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.350561 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.357348 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.368606 23428 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.369032 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.341109 23522 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.371213 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.372756 23533 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.373368 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.375718 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.376662 22503 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:10.377326 22571 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:10.378898 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:10.379617 22571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 507) took 1572 ms (client timeout 1924 ms). Trace:
I20260709 13:07:10.381093 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.381137 23410 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:10.386143 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.388017 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.390411 23382 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:10.386585 23545 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.001s
I20260709 13:07:10.393224 23545 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:10.400166 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:10.401310 23545 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:10.401886 23545 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.402384 23545 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.396354 23528 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.432744 23410 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:10.429103 23422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.035s	sys 0.103s
W20260709 13:07:10.380239 22571 rpcz_store.cc:269] 0709 13:07:08.807105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.926628 (+119523us) service_pool.cc:224] Handling call
0709 13:07:10.379365 (+1452737us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001e5fd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:10.379518 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451925376}
I20260709 13:07:10.446331 23382 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.445348 23410 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:10.446637 23422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.035s	sys 0.103s
W20260709 13:07:10.496953 23452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.020s	sys 0.028s
W20260709 13:07:10.543843 23508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.162s	user 0.016s	sys 0.033s
W20260709 13:07:10.544111 23452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.021s	sys 0.029s
W20260709 13:07:10.544270 23508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.016s	sys 0.033s
W20260709 13:07:10.494696 23468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.034s	sys 0.057s
W20260709 13:07:10.544819 23483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.016s	sys 0.020s
I20260709 13:07:10.528680 23545 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:10.545415 23483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.016s	sys 0.020s
I20260709 13:07:10.547449 23545 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.530867 23410 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:10.551493 23527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.000s	sys 0.020s
W20260709 13:07:10.551990 23527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.000s	sys 0.020s
W20260709 13:07:10.531780 23401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.021s	sys 0.044s
W20260709 13:07:10.554080 23401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.021s	sys 0.045s
W20260709 13:07:10.534173 23477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.024s	sys 0.022s
W20260709 13:07:10.555094 23477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.024s	sys 0.023s
W20260709 13:07:10.538707 23515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.008s	sys 0.041s
W20260709 13:07:10.556504 23515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.008s	sys 0.041s
I20260709 13:07:10.521757 23528 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:10.536435 23516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.014s	sys 0.034s
W20260709 13:07:10.558239 23516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.014s	sys 0.034s
W20260709 13:07:10.544919 23468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.034s	sys 0.058s
W20260709 13:07:10.570816 23480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.010s
W20260709 13:07:10.571815 23480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.009s	sys 0.010s
W20260709 13:07:10.575378 23440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.008s	sys 0.021s
W20260709 13:07:10.577538 23440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.008s	sys 0.021s
I20260709 13:07:10.577944 23440 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:10.579082 23530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.002s	sys 0.020s
I20260709 13:07:10.579458 23440 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:10.577044 23501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.007s
W20260709 13:07:10.576263 23541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.027s	sys 0.027s
W20260709 13:07:10.579474 23530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.002s	sys 0.020s
W20260709 13:07:10.580816 23501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.000s	sys 0.007s
W20260709 13:07:10.581465 23541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.028s	sys 0.028s
W20260709 13:07:10.593814 23489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.012s
W20260709 13:07:10.594359 23489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.008s	sys 0.012s
W20260709 13:07:10.595031 23457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.011s
W20260709 13:07:10.595510 23457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.006s	sys 0.011s
W20260709 13:07:10.629436 22469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.009s	sys 0.005s
W20260709 13:07:10.630628 22469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.009s	sys 0.005s
I20260709 13:07:10.633826 22500 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:10.639631 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.005s	sys 0.003s
W20260709 13:07:10.639676 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.000s	sys 0.020s
W20260709 13:07:10.640506 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.001s	sys 0.020s
W20260709 13:07:10.640468 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.005s	sys 0.003s
W20260709 13:07:10.643378 22652 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.178s	user 0.006s	sys 0.019s
W20260709 13:07:10.643908 22652 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.006s	sys 0.019s
W20260709 13:07:10.643796 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 985566us
I20260709 13:07:10.646394 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 513) took 1803 ms. Trace:
W20260709 13:07:10.649223 22620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.009s	sys 0.015s
W20260709 13:07:10.649715 23261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.005s	sys 0.016s
W20260709 13:07:10.650404 23261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.006s	sys 0.018s
I20260709 13:07:10.651059 23457 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.649279 23228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.010s	sys 0.007s
I20260709 13:07:10.652421 23457 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:10.653825 23228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.010s	sys 0.007s
W20260709 13:07:10.640794 22618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.005s	sys 0.010s
I20260709 13:07:10.655740 23410 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.656001 22618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.006s	sys 0.010s
I20260709 13:07:10.656618 23458 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.649760 22620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.009s	sys 0.015s
I20260709 13:07:10.657775 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:10.657908 23458 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.659498 22571 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.656634 23410 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.661813 23458 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.662593 23440 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:10.663034 23464 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.663618 23440 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.664158 23410 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.663936 23464 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:10.666878 23464 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.667843 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.668939 22497 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.666803 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:10.677223 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.679630 23528 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:10.680457 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:10.680766 23528 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.681509 22574 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
W20260709 13:07:10.693589 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 966922us
I20260709 13:07:10.685009 23410 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.707469 22498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.005s
W20260709 13:07:10.708066 22498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.005s
I20260709 13:07:10.708356 23582 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.646988 22652 rpcz_store.cc:276] 0709 13:07:08.842586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.052998 (+210412us) service_pool.cc:224] Handling call
0709 13:07:09.053359 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.053810 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.053851 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.054472 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.459399 (+404927us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:10.644812 (+1185413us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.645507 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.645719 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.645844 (+   125us) raft_consensus.cc:1685] finished
0709 13:07:10.645865 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.646201 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1088085,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":1490,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":6722,"thread_start_us":1583577,"threads_started":2,"wal-append.queue_time_us":668457}
I20260709 13:07:10.662621 23458 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.716914 23569 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.718416 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:10.718575 23569 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.719918 22575 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:10.721223 23570 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.721756 23528 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.722108 22504 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:10.723286 23574 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.724138 23574 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.729250 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:10.728639 23571 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.729444 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:10.730436 23571 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.731171 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:10.731844 22574 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:10.733024 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.008s	sys 0.003s
W20260709 13:07:10.733476 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.008s	sys 0.003s
W20260709 13:07:10.736490 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 1.04148e+06us
I20260709 13:07:10.736745 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:10.738222 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 563) took 1119 ms. Trace:
I20260709 13:07:10.738395 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:10.738849 23574 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.738674 22500 rpcz_store.cc:276] 0709 13:07:09.618743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.622486 (+  3743us) service_pool.cc:224] Handling call
0709 13:07:09.622745 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.634884 (+1012139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.726884 (+ 92000us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540007ce54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:10.738138 (+ 11254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323492736}
I20260709 13:07:10.739609 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.739770 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:10.726743 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:10.740787 23382 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:10.741250 22579 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:10.741052 23545 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:10.741532 23382 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.742651 23549 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:10.744378 23382 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.744971 23582 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.743088 22543 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:10.745644 23428 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.722247 23570 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.747534 23571 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.748188 23410 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.748473 23458 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.734087 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 21) took 2272 ms. Trace:
I20260709 13:07:10.734998 23528 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.756315 23569 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.765746 23440 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.771730 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.772087 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:10.779361 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.768435 23591 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
W20260709 13:07:10.782312 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.783299 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.796666 22496 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:10.784368 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.784845 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.786437 23428 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.788576 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:10.784567 23582 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:10.789242 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 50994.5us
I20260709 13:07:10.776489 23531 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:10.783953 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:10.800426 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.791620 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:10.778946 23457 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.803079 23545 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.805972 22577 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:10.807992 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:10.798941 23570 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.812629 22505 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:10.812899 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.799723 23574 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:10.802241 23569 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.816767 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.817476 23569 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.816167 22572 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:07:10.817871 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75545.4us
I20260709 13:07:10.799101 22571 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
W20260709 13:07:10.815827 22403 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.010s	sys 0.008s
I20260709 13:07:10.825446 22496 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.825636 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.813637 23571 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.827105 22403 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.011s	sys 0.009s
I20260709 13:07:10.830866 22576 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.829757 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:10.814451 23531 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:10.826592 23428 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.837026 22580 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.824344 23440 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.844794 23523 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.830293 23410 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.821826 23528 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.822969 23582 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.827471 22497 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:10.849130 23440 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.849169 22578 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:10.855834 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 112969us
I20260709 13:07:10.862828 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:10.863790 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:10.863569 23523 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.867084 22646 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:10.864832 23428 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:10.869026 23523 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.868824 23428 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:10.870589 23458 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:10.871556 23428 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.863875 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.876683 23569 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.875625 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:10.877316 23569 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.877990 22574 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:10.874105 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:10.882758 22652 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:10.883004 23440 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.875581 23526 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.875670 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:10.884479 22646 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:10.884186 23526 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.789198 23261 rpcz_store.cc:276] 0709 13:07:08.464613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.473749 (+  9136us) service_pool.cc:224] Handling call
0709 13:07:08.933329 (+459580us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6eee 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:08.971451 (+ 38122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.078138 (+106687us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:09.679394 (+601256us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.652208 (+972814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.652352 (+   144us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:10.652555 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.652754 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.706476 (+ 53722us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101843,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":10548,"spinlock_wait_cycles":2719104,"thread_start_us":971150,"threads_started":1,"wal-append.queue_time_us":897918}
I20260709 13:07:10.887643 23526 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.878053 23523 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.888603 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:10.888706 23523 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.889227 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.889330 23543 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:10.890408 23543 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:10.891263 23523 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.877967 23569 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.892201 23528 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.891860 23543 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.854971 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:10.874199 23574 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.893687 23569 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.874053 23571 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.901259 23574 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.908511 23582 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:07:10.893766 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 70645.9us
I20260709 13:07:10.833721 23457 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:10.902990 23571 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.901592 22496 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:10.836673 23382 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.919744 22572 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:10.920032 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:10.922981 22580 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:10.923418 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:10.923593 22576 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:10.862365 23547 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:10.926911 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:10.939136 22578 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:10.941195 23410 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:10.942121 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 51541.2us
I20260709 13:07:10.943434 22543 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:10.962728 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 114711us
I20260709 13:07:10.963713 22646 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:10.934417 23458 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:10.939766 23582 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
W20260709 13:07:10.968240 22469 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be7264d3053b44989c5504d296ea482b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:10.971953 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:10.973026 23382 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.975941 23382 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.976027 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.933693 23574 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:10.983141 22652 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:10.983031 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:10.985684 22545 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:10.989095 23582 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.989182 23480 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:10.989881 23582 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.991369 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:10.992030 22651 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.992274 23582 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:10.996976 23571 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:10.997311 23515 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.997826 23582 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.998986 23582 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.998303 23531 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.984467 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.004452 22651 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:10.982225 23547 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.984747 23410 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.982064 23533 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.997975 23571 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.015808 23524 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:11.017259 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45980.1us
I20260709 13:07:11.018308 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.016412 23524 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.019196 23524 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.019017 23410 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:10.986253 23574 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:11.023517 23410 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:11.021445 23584 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:11.023993 23574 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:11.026460 23593 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.027033 23593 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.027344 22619 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.027529 23593 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.028239 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.028815 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.029050 22646 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.029608 22647 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.029660 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:11.030575 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.031325 22653 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.032239 23458 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.034749 23581 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:11.035555 23581 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:11.036020 23574 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.037083 23581 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.039309 22617 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.039634 23458 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:10.998214 23515 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.041749 23458 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.042913 23515 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.040334 23569 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.044422 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.044813 23569 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.045301 23569 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.045570 22648 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.040505 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.051185 22652 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.015817 23571 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.057096 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.059217 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.062145 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.064230 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.065843 22646 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:11.053745 23581 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.067454 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.069334 23574 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.069890 22652 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.069799 23574 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.061764 22648 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.070050 22578 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.066594 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.075886 22496 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.068776 23582 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.075857 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:11.093608 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47903.6us
I20260709 13:07:11.101642 23582 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.102164 23582 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.102563 23582 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.094364 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.096508 22505 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.071640 23547 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.071360 23574 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.130904 23522 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.131573 23522 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.132995 23520 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.134120 23520 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.109877 22579 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.113631 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.115720 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.117329 22572 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.136145 22579 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.138219 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.139189 23547 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.139503 23410 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.140251 23410 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.140797 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.143299 23457 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.144037 23457 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.128470 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.146828 23457 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.147699 23410 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.117472 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.119269 22571 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:11.119436 23545 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.120237 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:11.120555 22653 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.121099 22575 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.123623 22577 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.124491 22573 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.126571 23571 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.127465 23382 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.135715 23522 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.117671 22574 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.131711 23593 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.179579 22578 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.178934 22617 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.195994 22572 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.196070 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:11.154052 23520 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.205945 22648 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.206223 23428 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.206925 23428 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:11.207158 22647 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.208242 23570 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.208115 23428 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.195976 23547 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.177455 23410 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.212538 23410 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.213261 23515 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:11.213924 23515 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.214912 23410 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.195170 23382 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.215590 23382 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.216006 23515 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.208662 23570 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.216637 23570 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.202678 23574 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.219355 23574 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.227486 23524 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:11.229389 22576 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:11.230063 23382 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.231863 23520 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.232640 23520 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.234723 23570 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.236124 23520 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.253932 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.254221 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.256049 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.256160 22577 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.258426 22651 raft_consensus.cc:2368] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3.
I20260709 13:07:11.236989 23571 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.178800 22646 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.238272 23382 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.238907 23457 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.239194 23533 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:11.242132 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 78285.3us
I20260709 13:07:11.242635 23501 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.242774 23410 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:11.245951 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:11.203248 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62597.1us
I20260709 13:07:11.261819 22579 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.272914 22617 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.273183 22576 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.267558 22573 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.265506 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.275645 22653 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:11.257712 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.276417 22580 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.271951 23501 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.249241 23547 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.274057 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.282625 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.272331 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.280148 23501 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.285454 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.285745 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.286474 22647 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.285519 23574 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.287560 23574 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.287670 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:11.288453 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.288378 22653 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.264446 23569 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.290625 23574 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.292057 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.298099 22578 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.300074 23524 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.280385 22505 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.291849 22502 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.293380 22571 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.310686 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.310657 23581 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.313206 23593 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.313369 23581 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.315845 23581 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.316933 23547 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.289660 23457 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.321388 23457 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.310672 22575 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.322710 23569 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.304840 23382 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.323674 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.324432 22653 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.326381 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.350541 22468 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:11.352308 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.411419 22545 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:11.430279 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 156321us
I20260709 13:07:11.345362 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.346593 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.348083 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.431771 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.329428 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.351862 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.330506 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.434346 22653 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:11.434675 22651 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.435556 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.437291 22573 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:11.437481 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.343387 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.345813 23569 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.438422 22580 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.438690 22652 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.432747 23524 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.432931 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:11.447798 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 97375.8us
I20260709 13:07:11.335681 22648 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.447162 22577 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.312016 23428 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.347388 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.444002 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.445694 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.346045 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.333137 23593 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.333479 23382 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:11.451035 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.454221 22577 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.341709 22646 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:11.451970 22576 raft_consensus.cc:2368] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:11.452529 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.356431 23501 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.457403 22468 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:11.345158 23582 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.330963 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.469110 23531 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.469411 22647 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.470028 23531 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:11.471208 23531 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.474790 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.456267 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.444765 23524 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.475633 22575 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.475744 23524 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.476351 23570 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.447039 23515 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.459124 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.447432 22645 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.479689 23515 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:11.463009 23593 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:11.484011 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.484761 22573 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.485675 22654 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.486013 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.486637 22573 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.487206 22654 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.484011 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.489379 22646 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:11.492347 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.494457 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.495271 22499 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.463050 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.497309 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.497900 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:11.498736 22647 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.497921 22571 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.501574 23593 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.502957 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.451128 23569 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:11.464735 23382 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.452203 22574 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.469611 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:11.456239 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.475147 23574 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.518633 22576 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.457358 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.520298 22577 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.477934 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.462244 22502 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:11.480573 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.480851 23515 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.481366 22580 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.459671 23428 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:11.501348 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:11.506021 22651 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.528944 22573 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:11.527551 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.528765 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.530829 22576 raft_consensus.cc:2368] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:11.530534 23410 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.531977 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.532765 22574 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.532847 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.533787 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.532202 23410 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.534493 22574 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.534741 23533 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.533879 22651 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.536144 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.534189 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.532027 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.537627 22580 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.539196 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.539784 22578 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:11.528551 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.542160 22648 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:11.543160 23428 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.543666 23501 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.544124 22400 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.546422 23574 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.545949 22400 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:11.547381 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 77933.8us
I20260709 13:07:11.547986 22400 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.549055 23582 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.551913 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.552637 23569 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.553164 23582 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.553385 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:11.553797 23582 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.554852 22653 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.546414 22650 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.537092 22577 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.562175 22653 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.553414 22400 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.565780 23501 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:11.566247 23501 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.568338 23501 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.569303 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.569934 22651 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:11.571478 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.568528 22649 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:11.536006 23543 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.559326 23582 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.582306 22576 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.584456 22400 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.589351 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.566847 23574 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.575052 23533 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.567047 22645 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:11.598349 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.597313 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.586736 22400 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.594517 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.607852 22501 raft_consensus.cc:2368] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
W20260709 13:07:11.621851 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73766.8us
I20260709 13:07:11.620522 22577 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:11.626235 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44318.3us
I20260709 13:07:11.629980 22651 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.592151 23570 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.630393 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.594062 23410 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.634796 22543 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.635236 22400 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.613003 23533 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.650354 23457 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.652050 22543 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.600919 23574 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:11.645624 22400 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.656908 23522 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.640255 22648 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.678274 22543 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.694880 22646 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:11.695494 23606 ts_tablet_manager.cc:933] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:11.705312 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.708359 22500 raft_consensus.cc:2368] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:11.710147 22400 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.656787 23545 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.718252 22651 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.688691 23581 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:11.649708 23570 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.677387 23543 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:11.718158 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.708765 23410 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:11.705812 23522 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:11.732906 23574 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:11.741257 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.734359 22575 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:11.734510 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:11.734974 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.736479 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.738368 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:11.747058 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.746045 22577 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.727931 22400 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:11.740033 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55436.4us
I20260709 13:07:11.741911 22579 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.742542 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:11.750962 22573 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.689288 23524 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.753443 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:11.756393 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 102513us
I20260709 13:07:11.737709 23410 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.760397 22400 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.771895 22577 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:11.771771 22400 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.763170 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.777129 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.754508 22646 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.752223 23458 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.738313 23545 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.745858 23581 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.787968 22617 leader_election.cc:400] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:11.782276 22400 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.761332 23410 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.758713 23574 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.798275 22651 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.788432 22617 leader_election.cc:403] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.804163 22543 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.779663 23547 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.779513 23457 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.829854 22650 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:11.807504 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.830437 23533 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:11.832587 23606 tablet_copy_client.cc:323] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:11.832589 23533 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.833431 23533 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.807526 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.839447 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet be7264d3053b44989c5504d296ea482b from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:11.816252 23609 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:07:11.861605 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet be7264d3053b44989c5504d296ea482b from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-be7264d3053b44989c5504d296ea482b
I20260709 13:07:11.861717 23581 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.862704 23614 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:11.863116 23614 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:11.863353 23524 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.840027 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.868417 22579 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:11.842001 23570 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:11.842496 22647 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:11.843878 23593 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.784596 23612 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:07:11.846899 23501 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.847371 22571 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:11.851301 22574 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:11.852488 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45458us
I20260709 13:07:11.881672 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.882804 23515 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:11.883024 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:11.853091 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 68521.8us
I20260709 13:07:11.884343 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.829865 22573 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:11.805122 22654 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:11.806550 23547 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.872078 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.864259 23614 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.871325 23382 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.893915 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.912452 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.918567 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:11.918833 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46845.1us
I20260709 13:07:11.919231 22501 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.919622 23571 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:11.920469 22617 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.918551 23547 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.877395 23612 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:11.877653 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.920790 23571 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.922919 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.921066 23382 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.923635 23382 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.924069 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.878454 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.805465 23543 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.925702 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.926854 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.928104 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.879575 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.922710 23571 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.929399 23571 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.929912 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.931149 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.885090 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.931677 22504 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:07:11.932878 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 47830.1us
I20260709 13:07:11.933872 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.934880 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.935591 22543 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.857553 23440 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.937577 23440 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:11.938092 23440 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.885257 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.941613 22498 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:11.885460 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.807847 23522 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.886811 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.887586 23410 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.873898 23582 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:11.890003 23593 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.890962 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:11.805399 23458 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.893082 23545 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.805742 23574 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:11.884383 23515 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:11.937067 23457 raft_consensus.cc:2764] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:07:11.933905 23524 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.921480 22617 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:11.922142 23612 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:11.953896 22653 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.946693 23501 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:11.921926 23570 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:11.921712 23614 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.956079 22504 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:11.944229 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:11.990469 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106708us
I20260709 13:07:11.918987 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:11.966187 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.991837 22503 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.967382 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:11.968786 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47377.6us
I20260709 13:07:11.970017 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:11.976656 23582 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:11.996665 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77797.8us
I20260709 13:07:11.973965 23545 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.997889 22403 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 142) took 2519 ms. Trace:
I20260709 13:07:11.976456 23570 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:07:11.998749 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 62179.1us
I20260709 13:07:11.999531 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:12.001006 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.010342 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.011111 22515 tablet_copy_source_session.cc:215] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:12.003540 23570 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.997653 22402 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 1 to 2, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 2 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:12.017335 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:12.020429 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77744.8us
I20260709 13:07:12.021921 22545 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:12.001257 22498 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.997213 23582 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.002049 23569 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.007929 22646 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:12.026870 23593 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:12.040186 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44996.1us
I20260709 13:07:11.995765 23533 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.032595 23582 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.035123 23545 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.034628 23524 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.046533 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:12.031636 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 153797us
I20260709 13:07:12.054960 22617 leader_election.cc:400] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:12.055420 22617 leader_election.cc:403] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.044478 23593 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.059458 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.047360 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:12.076632 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:12.077039 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70442.4us
I20260709 13:07:12.080034 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:12.081063 23543 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.081007 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:12.040844 23621 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:12.000447 22403 rpcz_store.cc:276] 0709 13:07:09.481038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.481153 (+   115us) service_pool.cc:224] Handling call
0709 13:07:11.994478 (+2513325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:10.833535 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:10.902397 (+ 68862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:10.902466 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:07:10.902499 (+    33us) tablet.cc:662] Decoding operations
0709 13:07:10.903056 (+   557us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:10.903154 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:10.903204 (+    50us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:10.903561 (+   357us) tablet.cc:701] Row locks acquired
0709 13:07:10.903608 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:07:10.903822 (+   214us) write_op.cc:270] Start()
0709 13:07:10.903967 (+   145us) write_op.cc:276] Timestamp: P: 1783602430903758 usec, L: 0
0709 13:07:10.904007 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:07:10.923714 (+ 19707us) log.cc:844] Serialized 602 byte log entry
0709 13:07:11.038036 (+114322us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b18000bca40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:07:11.329801 (+291765us) op_driver.cc:464] REPLICATION: finished
0709 13:07:11.600664 (+270863us) write_op.cc:301] APPLY: starting
0709 13:07:11.623207 (+ 22543us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:11.641013 (+ 17806us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:11.648419 (+  7406us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:11.745985 (+ 97566us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:11.801764 (+ 55779us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:11.809935 (+  8171us) write_op.cc:312] APPLY: finished
0709 13:07:11.869165 (+ 59230us) log.cc:844] Serialized 22 byte log entry
0709 13:07:11.886065 (+ 16900us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.886169 (+   104us) write_op.cc:454] Released schema lock
0709 13:07:11.886410 (+   241us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:11.886883 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.886913 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42110,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":248217,"apply.run_cpu_time_us":4410,"apply.run_wall_time_us":299105,"num_ops":1,"prepare.queue_time_us":874573,"prepare.run_cpu_time_us":13544,"prepare.run_wall_time_us":171504,"raft.queue_time_us":205654,"raft.run_cpu_time_us":35131,"raft.run_wall_time_us":149200,"replication_time_us":407772,"spinlock_wait_cycles":37273344,"thread_start_us":1230959,"threads_started":4,"wal-append.queue_time_us":65530}]]}
I20260709 13:07:12.093664 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:12.098308 23630 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.098994 23630 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.099505 23630 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.108273 23569 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.110617 23612 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.113976 23428 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.116035 22501 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:12.117592 23617 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:07:12.112165 23440 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:07:12.118579 23623 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:07:12.125569 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.090200 23524 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:12.144801 22543 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.091630 23410 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:12.146768 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92038.8us
I20260709 13:07:12.092599 23458 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:12.175179 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43600.8us
I20260709 13:07:12.176314 22617 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.143195 23593 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.157286 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.144207 23574 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.112607 23382 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.149453 23612 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.148216 23524 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.157730 23545 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:12.192022 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.193058 23629 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:12.193678 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.197564 23570 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.190101 23524 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:12.198328 23619 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:07:12.199388 23593 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.207120 23636 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.210994 22503 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:12.176214 23581 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:07:12.213725 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:12.213094 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.148358 23515 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:07:12.212966 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55792.6us
I20260709 13:07:12.179700 23458 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:07:12.215390 23569 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:07:12.213819 23574 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.220322 22505 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:12.221037 23624 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.173777 23630 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.218240 22619 leader_election.cc:400] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:12.226390 22619 leader_election.cc:403] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.227617 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:12.230544 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53804.2us
I20260709 13:07:12.231926 23614 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:12.232661 23574 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:12.233090 23634 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.233687 23634 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.233960 23382 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.234498 23627 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.234594 23609 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:12.235265 23609 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:12.234725 23634 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.236322 23609 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.238730 23609 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.239641 23631 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.240121 23631 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.240504 23631 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.242146 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.243341 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.190697 23410 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:07:12.232069 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.246912 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.247924 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.232069 22543 leader_election.cc:400] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3.
I20260709 13:07:12.225690 23428 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:12.222131 23533 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.221592 23624 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:12.250626 22543 leader_election.cc:403] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.229998 23569 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.218511 23571 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.250093 23574 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.254132 23382 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:12.265055 23628 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:07:12.264786 22543 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.265445 23638 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3.
I20260709 13:07:12.263809 23625 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.252419 23627 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.263840 23440 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:12.266608 23569 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.263898 23593 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.258831 23547 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.265357 23606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be7264d3053b44989c5504d296ea482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:12.276629 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.275694 23428 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.281507 23621 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:12.287680 23627 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.289700 23569 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.300894 23582 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.281387 23501 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:12.291922 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.293116 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.314083 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.314388 23457 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.314679 23531 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:12.315169 23457 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.315344 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.315614 23457 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.315985 23457 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.279062 23574 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.318040 23574 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.321195 23638 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.321653 23638 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.321995 23638 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.299400 23570 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.312546 23501 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.325484 23501 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.303884 22498 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:12.304945 23571 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.309549 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 130) took 1032 ms. Trace:
I20260709 13:07:12.290369 23547 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.331980 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.285547 23581 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:12.362524 22543 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.295578 23522 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.294528 23593 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.371987 22545 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:12.376835 22543 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.380352 22543 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.381603 22543 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.333143 22400 rpcz_store.cc:276] 0709 13:07:11.276807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.291280 (+ 14473us) service_pool.cc:224] Handling call
0709 13:07:12.309463 (+1018183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:12.072140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:12.081392 (+  9252us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:12.081434 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:07:12.081448 (+    14us) tablet.cc:662] Decoding operations
0709 13:07:12.113916 (+ 32468us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:12.113996 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:12.114028 (+    32us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:12.115278 (+  1250us) tablet.cc:701] Row locks acquired
0709 13:07:12.115298 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:07:12.115461 (+   163us) write_op.cc:270] Start()
0709 13:07:12.115581 (+   120us) write_op.cc:276] Timestamp: P: 1783602432115410 usec, L: 0
0709 13:07:12.115603 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:12.116323 (+   720us) log.cc:844] Serialized 5232 byte log entry
0709 13:07:12.142408 (+ 26085us) op_driver.cc:464] REPLICATION: finished
0709 13:07:12.142838 (+   430us) write_op.cc:301] APPLY: starting
0709 13:07:12.142928 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:12.175592 (+ 32664us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:12.182130 (+  6538us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:12.290189 (+108059us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:12.290440 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:07:12.290491 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:12.292745 (+  2254us) log.cc:844] Serialized 94 byte log entry
0709 13:07:12.298704 (+  5959us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.298889 (+   185us) write_op.cc:454] Released schema lock
0709 13:07:12.298953 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:12.299317 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.299344 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":140,"apply.run_cpu_time_us":5917,"apply.run_wall_time_us":156428,"num_ops":13,"prepare.queue_time_us":141391,"prepare.run_cpu_time_us":5504,"prepare.run_wall_time_us":58576,"replication_time_us":26583,"thread_start_us":68634,"threads_started":1}]]}
W20260709 13:07:12.386758 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 103456us
I20260709 13:07:12.373342 23625 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:12.385280 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 138437us
I20260709 13:07:12.373919 23522 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.392525 22617 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.361078 23410 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:07:12.375267 23630 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.383987 23458 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.383731 23533 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:12.404065 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.383577 23636 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.405063 22617 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.282851 23545 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:12.309191 23624 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.412537 23632 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:12.414857 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.398943 23625 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.408527 23533 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.425686 23645 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:07:12.426261 23533 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.426622 23629 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:12.426831 23644 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:12.424372 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:12.329950 23627 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.427996 22573 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:12.403872 23522 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.425043 23651 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.429266 23651 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.429692 23651 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.425822 22574 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:12.427088 23629 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:12.424711 23649 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.432453 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:12.450124 22573 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:12.444527 23569 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.453279 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:12.454116 22572 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.436548 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:12.456887 22576 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.442070 22571 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:12.442430 23582 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.442693 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:12.452422 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:12.431754 23625 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:12.461596 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 213723us
I20260709 13:07:12.455408 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:12.463598 22580 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.463617 22619 leader_election.cc:400] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:12.461211 22578 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.465155 22619 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.471841 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:12.475572 22619 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.459794 23569 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.466652 23547 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.481287 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 99747.2us
I20260709 13:07:12.482764 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.462368 23649 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:12.486500 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 81110.1us
I20260709 13:07:12.474251 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:12.484642 23630 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.417294 23647 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:07:12.478983 23440 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.458230 23593 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.525075 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.527920 22652 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:07:12.527818 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45146.7us
I20260709 13:07:12.528730 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.533151 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:12.552124 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.529933 22653 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:12.568069 22578 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:12.535354 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 27) took 1746 ms. Trace:
I20260709 13:07:12.527103 22575 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.530967 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.537554 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.575662 22580 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:12.565002 22576 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:12.587131 22649 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 2: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:12.547544 22499 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:12.549705 22401 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 1 to 2, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 2 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:12.552380 23640 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.169s	user 0.003s	sys 0.000s
W20260709 13:07:12.595439 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66784.8us
I20260709 13:07:12.538419 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:12.549021 23570 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.533604 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.610869 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:12.529297 23547 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.535976 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.606905 22572 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:12.604843 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.610050 22543 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.530611 23531 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:07:12.568694 22402 rpcz_store.cc:276] 0709 13:07:10.789396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.789720 (+   324us) service_pool.cc:224] Handling call
0709 13:07:12.535274 (+1745554us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:12.124238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:12.188718 (+ 64480us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:12.188766 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:07:12.188783 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:12.231121 (+ 42338us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:12.234884 (+  3763us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:12.234916 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:12.235122 (+   206us) tablet.cc:701] Row locks acquired
0709 13:07:12.235151 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:07:12.235329 (+   178us) write_op.cc:270] Start()
0709 13:07:12.235447 (+   118us) write_op.cc:276] Timestamp: P: 1783602432235282 usec, L: 0
0709 13:07:12.235470 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:12.236472 (+  1002us) log.cc:844] Serialized 538 byte log entry
0709 13:07:12.238563 (+  2091us) op_driver.cc:464] REPLICATION: finished
0709 13:07:12.282094 (+ 43531us) write_op.cc:301] APPLY: starting
0709 13:07:12.282187 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:12.282296 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:12.309105 (+ 26809us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:12.309386 (+   281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:12.309543 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:12.309590 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:12.378776 (+ 69186us) log.cc:844] Serialized 22 byte log entry
0709 13:07:12.390073 (+ 11297us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.392618 (+  2545us) write_op.cc:454] Released schema lock
0709 13:07:12.402583 (+  9965us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:12.427086 (+ 24503us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.427144 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50267,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":43268,"apply.run_cpu_time_us":3231,"apply.run_wall_time_us":125384,"num_ops":1,"prepare.queue_time_us":75274,"prepare.run_cpu_time_us":3878,"prepare.run_wall_time_us":119867,"replication_time_us":2941,"thread_start_us":15509,"threads_started":1}]]}
I20260709 13:07:12.559500 23533 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.529671 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:12.616604 22617 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.538139 23524 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.597957 23428 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.560395 23457 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.530539 23581 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:07:12.620937 22576 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:12.621358 22619 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.558220 23625 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.541723 23651 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.590842 23458 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:12.562644 23649 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.625154 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:12.626889 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:12.628309 22619 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.654386 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.655325 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:12.656051 22651 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:12.629828 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.517973 23629 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.631672 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:12.662595 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.663193 22645 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.624938 23570 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.664147 23570 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.664516 23570 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.623626 23569 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.666621 22401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 123) took 1219 ms. Trace:
I20260709 13:07:12.632368 23633 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.632853 23662 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:12.633111 23582 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.634605 23524 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.635092 23533 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.637446 23457 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.633144 23440 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:12.638564 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.622677 23522 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.692935 23522 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.609802 23631 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.660017 23428 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.644351 22652 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:12.625696 22654 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:12.646210 23651 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:12.785020 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.647308 23501 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.793336 22646 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:12.786870 23410 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:12.795922 23410 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.797298 23653 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.797963 23653 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.648749 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.646238 23638 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.650758 23625 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.619805 23636 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.625913 23634 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:07:12.660580 23630 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.661335 23629 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.670202 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.681267 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.664532 22575 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:12.786283 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 80345.1us
I20260709 13:07:12.667069 22401 rpcz_store.cc:276] 0709 13:07:11.447049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.447477 (+   428us) service_pool.cc:224] Handling call
0709 13:07:12.666554 (+1219077us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:12.638583 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:12.639132 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:12.639164 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:07:12.639180 (+    16us) tablet.cc:662] Decoding operations
0709 13:07:12.639557 (+   377us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:12.639605 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:12.639636 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:12.639818 (+   182us) tablet.cc:701] Row locks acquired
0709 13:07:12.639836 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:12.639981 (+   145us) write_op.cc:270] Start()
0709 13:07:12.640090 (+   109us) write_op.cc:276] Timestamp: P: 1783602432639935 usec, L: 0
0709 13:07:12.640113 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:12.640765 (+   652us) log.cc:844] Serialized 543 byte log entry
0709 13:07:12.661022 (+ 20257us) op_driver.cc:464] REPLICATION: finished
0709 13:07:12.661575 (+   553us) write_op.cc:301] APPLY: starting
0709 13:07:12.661656 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:12.661755 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:12.661852 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:12.662072 (+   220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:12.662216 (+   144us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:12.662259 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:12.662456 (+   197us) log.cc:844] Serialized 22 byte log entry
0709 13:07:12.662648 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.662724 (+    76us) write_op.cc:454] Released schema lock
0709 13:07:12.662765 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:12.665947 (+  3182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:12.665989 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16156,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":313,"apply.run_cpu_time_us":1515,"apply.run_wall_time_us":1516,"num_ops":1,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":2552,"prepare.run_wall_time_us":30593,"replication_time_us":19849}]]}
I20260709 13:07:12.801403 22572 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:12.821086 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.699039 23632 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:12.802285 23597 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:07:12.836513 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 166407us
I20260709 13:07:12.837491 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.838258 22579 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:12.836303 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.800458 23410 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.833232 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.838538 22468 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:12.787004 23522 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:07:12.841296 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.800622 23653 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.806890 23501 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.833479 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:12.852527 23625 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.827446 22647 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.806522 23458 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.840386 23630 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:12.852810 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.846505 22617 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:12.891588 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55408.3us
I20260709 13:07:12.855628 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:12.883857 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.893085 22543 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:12.896121 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:12.899257 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57463.1us
W20260709 13:07:12.902187 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68794.6us
I20260709 13:07:12.903784 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:12.841179 23636 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.908723 22545 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:12.855896 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.860006 23606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46826 (request call id 35) took 1399 ms. Trace:
I20260709 13:07:12.858899 23644 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.855034 22645 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:12.947402 22580 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:12.927805 23636 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.908833 23627 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.856612 23609 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:07:12.909983 23632 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.885164 23630 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.989594 23570 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.991353 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.911456 23593 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:07:12.907675 23624 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:12.870289 23638 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:12.931213 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.932765 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:12.933135 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.991747 23570 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.934645 22578 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:12.845854 23633 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.890187 23571 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:12.949107 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.905126 23410 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.907408 23614 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:07:12.953688 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.908562 23574 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:12.860356 23645 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:07:12.865046 23581 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:07:12.961122 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:13.025295 22572 raft_consensus.cc:2368] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3.
I20260709 13:07:13.026741 22572 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:13.028457 22572 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:12.961848 22573 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:12.906682 23631 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.960448 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:12.859052 23543 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:07:12.948971 23457 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:12.959952 23636 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.968657 22645 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:13.030018 23636 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.969632 22580 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:12.859855 23643 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:07:12.970429 22646 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:12.971925 22501 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:12.867089 23639 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:07:12.951480 23515 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:12.975011 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:12.976001 22647 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:12.977118 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:12.910125 23647 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:07:12.906226 23612 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:07:12.984405 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:12.985612 22502 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:12.880541 23522 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.987937 23632 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.964754 23547 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:12.989027 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:12.929929 23634 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.858466 23646 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:07:12.995265 22543 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:12.873994 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:12.998569 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 98589.8us
I20260709 13:07:13.003859 22576 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:12.994874 22575 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:12.998632 23624 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.999876 23657 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.999255 23625 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:13.038870 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 108220us
I20260709 13:07:13.173900 22496 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:13.020582 23633 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:13.180164 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:13.181067 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 185848us
I20260709 13:07:13.101233 22580 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.197892 22545 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.039894 22574 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:13.045537 22645 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:13.204375 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 300638us
I20260709 13:07:13.176544 23624 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.214030 22576 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.132434 23571 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:13.180358 23614 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.149209 23410 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.211609 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.208055 22578 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:13.196475 23638 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:13.201642 23501 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:13.217914 22654 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:13.101567 23582 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:13.202304 23609 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.030041 23457 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.208240 23645 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.215780 23458 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.242339 23571 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.241204 22646 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:13.258737 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83921.8us
I20260709 13:07:13.041412 23627 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:13.218997 23614 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.273298 23614 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.274114 23632 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.274436 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:13.274672 23614 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.239125 22648 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:13.269013 22653 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.272157 22646 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:13.274765 23675 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.203156 23657 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:13.271739 23664 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:07:13.283648 23674 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.255311 23609 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.259212 23645 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.259121 23501 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:13.286240 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.245014 22571 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:07:13.262046 23662 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:13.240346 23410 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:13.304142 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101225us
I20260709 13:07:13.306505 22575 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.307006 23609 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.308122 22575 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.308306 23609 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.294414 23674 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.311661 23674 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:13.311924 23428 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.000s
I20260709 13:07:13.312350 23428 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:13.313441 22574 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.314433 22653 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:13.314851 22574 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:13.317040 23662 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.318559 23410 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.319316 23662 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.319562 22645 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:13.320196 23671 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.320724 23671 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.321404 22571 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:13.321239 23627 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.322970 22571 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.323163 23671 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:13.325238 22571 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.326722 22571 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.281533 23633 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:12.940392 23606 rpcz_store.cc:276] 0709 13:07:11.460629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.460818 (+   189us) service_pool.cc:224] Handling call
0709 13:07:11.695835 (+235017us) ts_tablet_manager.cc:934] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
0709 13:07:12.048887 (+353052us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:12.644693 (+595806us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:12.644817 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:12.859150 (+214333us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:12.859490 (+   340us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:12.859854 (+   364us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:12.859925 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54169,"tablet-copy.queue_time_us":180678,"thread_start_us":193472,"threads_started":2}
I20260709 13:07:13.274442 23457 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:13.302723 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.333703 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47531.7us
I20260709 13:07:13.279626 23639 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:07:13.286316 23612 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:07:13.363925 23639 consensus_queue.cc:1243] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:13.364717 23612 consensus_queue.cc:1243] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:13.288683 23653 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:07:13.366487 23501 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.324155 23645 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.369804 23606 tablet_copy_client.cc:806] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:13.370716 23606 tablet_copy_client.cc:670] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:13.373107 23428 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.373312 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:13.373749 23428 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.374764 23677 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.377560 23677 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.375286 23645 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.374845 23547 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:13.380520 23547 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:13.381624 23547 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:13.382593 23636 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.383888 22577 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 3. Ops: []
I20260709 13:07:13.297515 23646 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:07:13.288470 23581 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:13.385744 23581 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:13.386243 23581 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.291378 23673 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:07:13.400424 23522 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.304368 23675 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.410591 23639 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.411212 23639 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.420214 23612 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.420836 23612 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.425369 23612 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.421775 23531 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:13.427446 23531 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.422184 23629 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:13.429596 23629 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:07:13.441905 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 166325us
I20260709 13:07:13.430635 23629 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:13.422683 23646 consensus_queue.cc:1243] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:13.428332 23531 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.471498 23636 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.412302 23639 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.477232 23543 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.477680 23543 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.477815 23639 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.478492 23643 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.479103 23643 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.478694 23543 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.480052 23543 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.481180 23531 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:13.483206 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 285365us
I20260709 13:07:13.484071 22652 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:13.484601 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:13.480113 23643 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.485719 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:13.493811 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.504561 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.508584 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.509980 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.508605 22653 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:13.515226 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.520912 22650 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:13.525255 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.526877 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:13.529173 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.501395 23625 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.533373 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.497008 23612 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.509042 23629 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:13.539175 23643 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:13.539916 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54281.5us
I20260709 13:07:13.539827 22502 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:13.540952 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:13.561781 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.541702 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:13.555188 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:13.512786 23653 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.563740 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:13.508235 23677 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:13.549099 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.583405 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.584487 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.475859 23624 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.526784 23662 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:13.567025 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.609993 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.528545 23644 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.585457 22652 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:13.545210 23410 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.617158 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.618959 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.590323 22573 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:13.598938 22653 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.601343 22496 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:13.622222 22496 pending_rounds.cc:85] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:13.613358 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:13.601653 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:13.632241 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83258us
W20260709 13:07:13.585057 23630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.013s	sys 0.012s
I20260709 13:07:13.581948 23458 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.636844 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:13.637616 22572 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:13.646123 22579 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:13.640640 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:13.582269 23634 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.633766 22496 pending_rounds.cc:107] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:13.618103 23440 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.592891 23632 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:13.651005 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:13.638231 23630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.013s	sys 0.012s
I20260709 13:07:13.662042 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:13.662307 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:13.582281 23533 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:07:13.637794 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:13.636624 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:13.554352 23570 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:07:13.648130 22496 raft_consensus.cc:2889] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.643644 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:13.648932 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:13.555796 23625 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:13.685600 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49067.2us
I20260709 13:07:13.686229 22573 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:13.547796 23457 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:07:13.688331 23663 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:13.688838 23663 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.689262 23663 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.694607 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:13.582496 23653 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.640520 23522 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:13.672821 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:13.645008 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.675613 22650 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.654193 23634 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.662438 22646 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:13.643985 23657 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.683614 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:13.643450 23524 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.651780 23662 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:13.706043 22652 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:13.751757 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.655889 23632 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:13.669379 23646 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:07:13.753108 23632 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.754040 23653 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.634907 23644 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.758064 23262 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Advancing to term 3
I20260709 13:07:13.758677 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:13.759325 22573 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:13.760422 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.747802 22496 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:13.761178 22652 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:13.741665 22579 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:07:13.701648 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 188917us
I20260709 13:07:13.672650 23627 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:07:13.804489 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:13.856937 22652 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.798432 23662 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:13.746217 23690 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:13.817636 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:13.872323 22573 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:07:13.817338 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.760875 23524 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.852545 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:13.874670 22579 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.864127 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.671461 23440 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.763167 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:13.747170 22574 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:13.880430 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 117368us
I20260709 13:07:13.882078 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:13.746399 23654 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.746536 23685 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.879484 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.700932 23638 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.168s
I20260709 13:07:13.856954 23653 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.723477 23522 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:13.902060 23630 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.895082 22619 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.870425 23636 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.861824 23675 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:07:13.902608 23522 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.899617 23631 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.899284 23653 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:13.896349 23654 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.889098 23645 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.870484 23644 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.888835 23410 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:13.946209 23410 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.946686 23410 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:13.947170 23694 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.003s
I20260709 13:07:13.883355 23633 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.883961 23625 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.911527 22573 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:13.911854 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:13.917449 23685 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.911015 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 600) took 1369 ms. Trace:
I20260709 13:07:13.959309 23685 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.959236 22651 rpcz_store.cc:276] 0709 13:07:12.541587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.938175 (+396588us) service_pool.cc:224] Handling call
0709 13:07:12.965487 (+ 27312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.042701 (+ 77214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.042725 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.201690 (+158965us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.362089 (+160399us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:13.505299 (+143210us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.534756 (+ 29457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.534859 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.910769 (+375910us) raft_consensus.cc:1685] finished
0709 13:07:13.910793 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.910958 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161840,"prepare.queue_time_us":142763,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":5108,"raft.queue_time_us":122639,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":30512,"thread_start_us":154295,"threads_started":2,"wal-append.queue_time_us":381340}
I20260709 13:07:13.962100 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:13.962745 22498 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:13.963155 22498 pending_rounds.cc:85] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:13.963399 22498 pending_rounds.cc:107] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:13.963647 22498 raft_consensus.cc:2889] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.886701 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 609) took 1052 ms. Trace:
I20260709 13:07:13.896047 23657 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:13.962805 22651 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.744927 23683 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.368s
W20260709 13:07:13.966234 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.942030 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.967846 22646 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:13.943547 23524 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.947499 23654 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:13.892968 23581 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.910457 23630 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.953183 22573 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:13.950127 23634 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:13.947925 23645 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:13.956013 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44252.2us
I20260709 13:07:13.916781 23571 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:07:13.915025 23636 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.956986 23653 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.958354 23569 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.899106 22501 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.970329 22543 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:13.969157 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:13.964425 23657 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:13.980490 22573 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:13.947844 23624 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:13.921303 23631 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:13.999270 22652 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
W20260709 13:07:14.011408 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.000907 22579 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:14.010953 22543 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:14.034840 22651 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:14.006042 23657 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:14.000522 22501 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:07:14.034039 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 424570us
W20260709 13:07:14.034780 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.042351 23697 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:14.042692 22503 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:14.045596 22503 pending_rounds.cc:85] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:14.045902 22503 pending_rounds.cc:107] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:14.046155 22503 raft_consensus.cc:2889] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.016341 23524 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:14.078205 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:14.068423 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.084497 22468 leader_election.cc:400] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3.
I20260709 13:07:14.085018 22468 leader_election.cc:403] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:14.040233 23501 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:14.039728 22571 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:14.087471 23262 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:14.049003 22574 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:14.088171 22575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.050s	sys 0.064s
I20260709 13:07:14.078370 23524 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.108584 22468 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:14.108964 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.110859 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.086357 23581 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:14.107812 22575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.050s	sys 0.064s
I20260709 13:07:14.108632 23501 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:14.091326 23639 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3.
I20260709 13:07:14.099152 23571 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.108099 22501 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.207643 23636 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:14.208711 23703 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:14.209108 23689 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:14.209748 23543 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.001s
I20260709 13:07:14.209925 23698 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:14.113484 23609 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:07:14.182606 23685 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.083829 23632 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:14.215104 23629 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.001s
I20260709 13:07:14.115419 23524 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.220947 23647 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:07:13.971298 22647 rpcz_store.cc:276] 0709 13:07:12.828937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.239986 (+411049us) service_pool.cc:224] Handling call
0709 13:07:13.270908 (+ 30922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.305789 (+ 34881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.356564 (+ 50775us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.380974 (+ 24410us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.599357 (+218383us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:13.599570 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.656293 (+ 56723us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.789340 (+133047us) raft_consensus.cc:1685] finished
0709 13:07:13.789369 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.881196 (+ 91827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127045,"raft.queue_time_us":26128,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":54958,"thread_start_us":193161,"threads_started":1,"wal-append.queue_time_us":374993}
I20260709 13:07:14.179535 23688 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:07:14.088215 23643 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
W20260709 13:07:14.539060 23612 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.985s	user 0.002s	sys 0.008s
I20260709 13:07:14.321542 22500 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:14.590350 22500 pending_rounds.cc:85] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:14.590598 22500 pending_rounds.cc:107] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:14.180572 23569 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:14.226488 23501 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.114526 23515 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.159s
I20260709 13:07:14.141590 23708 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:07:14.595944 23708 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:14.413672 22577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.004s	sys 0.029s
W20260709 13:07:14.596482 22577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.004s	sys 0.033s
I20260709 13:07:14.596170 23630 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:14.596786 22497 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:14.597460 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 912) took 1045 ms. Trace:
W20260709 13:07:14.476044 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.597841 22497 rpcz_store.cc:276] 0709 13:07:13.552376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.752563 (+200187us) service_pool.cc:224] Handling call
0709 13:07:14.596219 (+843656us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b5800003698. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:14.596434 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.597196 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.597405 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17218816}
W20260709 13:07:14.598786 23695 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.616s	user 0.007s	sys 0.010s
W20260709 13:07:14.599205 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.599665 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.600311 23715 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:14.601717 23629 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:14.602125 23629 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:14.599324 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.602878 23629 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.603762 22497 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:14.604452 23708 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:14.604744 22617 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:14.604923 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.605324 23708 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.605825 22617 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:14.606269 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.606889 22497 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:14.607161 23708 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:14.607995 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.557225 23457 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.609270 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.609128 23457 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.610373 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.610934 23570 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:14.611227 23457 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.379739 22576 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.574209 22579 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:14.574542 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 578) took 1065 ms. Trace:
I20260709 13:07:14.530853 23685 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:14.582031 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:14.618856 22579 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:14.575752 23632 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:14.570231 23410 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.001s
I20260709 13:07:14.631784 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 579) took 1118 ms. Trace:
I20260709 13:07:14.586855 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 573) took 1084 ms. Trace:
I20260709 13:07:14.272217 23571 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:14.327523 22501 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:14.488459 23663 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.799s	user 0.005s	sys 0.006s
I20260709 13:07:14.587862 22502 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:14.320139 23636 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:14.590806 22500 raft_consensus.cc:2889] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.628137 23689 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:14.485522 23645 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.595628 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 583) took 1054 ms. Trace:
I20260709 13:07:14.329347 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:14.547055 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 438539us
I20260709 13:07:14.581317 22580 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.614089 22504 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:07:14.615757 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.648638 22504 pending_rounds.cc:85] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:14.648924 22504 pending_rounds.cc:107] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:07:14.649040 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.649175 22504 raft_consensus.cc:2889] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.611598 23570 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.628273 23457 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.629056 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 905) took 1078 ms. Trace:
I20260709 13:07:14.629333 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 910) took 1147 ms. Trace:
I20260709 13:07:14.629091 23533 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:14.583030 23711 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.638127 22578 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:14.632345 22650 rpcz_store.cc:276] 0709 13:07:13.513164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.522074 (+  8910us) service_pool.cc:224] Handling call
0709 13:07:13.546936 (+ 24862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.705395 (+158459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.631486 (+926091us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400237654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:14.631697 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295127424}
I20260709 13:07:14.590821 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 576) took 1434 ms. Trace:
I20260709 13:07:14.612651 22649 rpcz_store.cc:276] 0709 13:07:13.509201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.531566 (+ 22365us) service_pool.cc:224] Handling call
0709 13:07:13.606597 (+ 75031us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:13.606865 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.607182 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.607221 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.635599 (+ 28378us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.873394 (+237795us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:13.873446 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.873557 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.547247 (+673690us) raft_consensus.cc:1685] finished
0709 13:07:14.547274 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.574482 (+ 27208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11404672,"thread_start_us":237383,"threads_started":1,"wal-append.queue_time_us":389385}
I20260709 13:07:14.620204 23717 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.642963 22545 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:14.595608 23569 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.632428 23547 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:14.604027 23629 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.639468 23633 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:14.644634 23689 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:14.639276 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:14.644258 23631 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.650466 22498 rpcz_store.cc:276] 0709 13:07:13.550274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.703181 (+152907us) service_pool.cc:224] Handling call
0709 13:07:13.703646 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.964179 (+260533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.628819 (+664640us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54001a9854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:14.629001 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594978560}
I20260709 13:07:14.665165 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:14.665796 22503 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.666642 22650 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.667127 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 584) took 1125 ms. Trace:
I20260709 13:07:14.667415 22650 rpcz_store.cc:276] 0709 13:07:13.541554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.658452 (+1116898us) service_pool.cc:224] Handling call
0709 13:07:14.666524 (+  8072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.666929 (+   405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.667070 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.668370 22649 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:14.652496 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46753.7us
I20260709 13:07:14.651917 22577 rpcz_store.cc:276] 0709 13:07:13.482428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.607686 (+125258us) service_pool.cc:224] Handling call
0709 13:07:13.608124 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.596951 (+988827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.596981 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.597442 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.628947 (+ 31505us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.628983 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.629114 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.629165 (+    51us) raft_consensus.cc:1685] finished
0709 13:07:14.629175 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.629284 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24639,"raft.queue_time_us":45813,"raft.run_cpu_time_us":552,"raft.run_wall_time_us":32789,"thread_start_us":986882,"threads_started":2,"wal-append.queue_time_us":28281}
I20260709 13:07:14.647533 23632 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.669341 22652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.020s	sys 0.030s
I20260709 13:07:14.651302 22468 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:14.639179 23410 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.600937 23715 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.669332 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:14.670491 23612 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.671478 23612 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:14.671720 23410 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.671921 23715 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:14.669979 22652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.021s	sys 0.030s
I20260709 13:07:14.672325 23698 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:14.672514 23643 consensus_queue.cc:1059] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:14.673448 23698 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:14.673834 23698 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:14.674603 23643 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:14.675227 23643 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:14.674827 23515 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:14.677418 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 585) took 1132 ms. Trace:
I20260709 13:07:14.678067 22649 rpcz_store.cc:276] 0709 13:07:13.545491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.658452 (+1112961us) service_pool.cc:224] Handling call
0709 13:07:14.664720 (+  6268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.677034 (+ 12314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.677325 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.654479 23457 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.679637 22498 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:14.680135 22498 pending_rounds.cc:85] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:14.680387 22498 pending_rounds.cc:107] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:14.680780 22498 raft_consensus.cc:2889] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.681051 23715 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:14.683830 23720 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:07:14.685105 22574 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:14.660710 23717 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.679955 23639 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:14.688177 23717 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.657109 23533 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.689782 22650 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:14.690198 23571 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.690640 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 620) took 1143 ms. Trace:
I20260709 13:07:14.691109 23569 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.691008 22650 rpcz_store.cc:276] 0709 13:07:13.547425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.667975 (+1120550us) service_pool.cc:224] Handling call
0709 13:07:14.689447 (+ 21472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.690403 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.690586 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.644832 23663 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.693224 22650 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:14.693511 23663 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.659099 23711 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.694532 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 587) took 1138 ms. Trace:
I20260709 13:07:14.660564 23633 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.700517 23633 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.674640 23698 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.643627 23685 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.658659 23547 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.695752 22650 rpcz_store.cc:276] 0709 13:07:13.555757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.692210 (+1136453us) service_pool.cc:224] Handling call
0709 13:07:14.692733 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.693856 (+  1123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.694379 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.688570 23639 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:14.681690 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 915) took 1128 ms. Trace:
I20260709 13:07:14.734596 22498 rpcz_store.cc:276] 0709 13:07:13.553542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.678966 (+1125424us) service_pool.cc:224] Handling call
0709 13:07:14.679290 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.681406 (+  2116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.681635 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.663015 23522 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:14.683226 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:14.712745 23723 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:07:14.738229 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55128.3us
I20260709 13:07:14.713315 22503 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:14.713390 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:14.715072 23440 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.677521 23531 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:07:14.715976 23569 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:14.677173 23680 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.728277 22579 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:14.732543 23457 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.732684 23570 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.733439 22650 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.675515 23688 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:07:14.678275 23515 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:14.734004 23547 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:14.738389 22651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.040s	sys 0.069s
W20260709 13:07:14.757002 22651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.040s	sys 0.069s
I20260709 13:07:14.734529 23639 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:14.744457 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 896) took 1206 ms. Trace:
I20260709 13:07:14.670001 23632 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.744925 23571 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:07:14.647616 22647 rpcz_store.cc:276] 0709 13:07:13.541276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.587435 (+1046159us) service_pool.cc:224] Handling call
0709 13:07:14.593634 (+  6199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.595218 (+  1584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.595252 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.595315 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.595371 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.595437 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.595573 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.751579 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 588) took 1195 ms. Trace:
I20260709 13:07:14.758312 22617 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:14.796767 22650 rpcz_store.cc:276] 0709 13:07:13.556037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.729639 (+1173602us) service_pool.cc:224] Handling call
0709 13:07:14.733239 (+  3600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.750882 (+ 17643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.751499 (+   617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.740737 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 17) took 1067 ms. Trace:
I20260709 13:07:14.742141 23634 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.743664 23663 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.639791 22645 rpcz_store.cc:276] 0709 13:07:13.502528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.505543 (+  3015us) service_pool.cc:224] Handling call
0709 13:07:13.519297 (+ 13754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.556640 (+ 37343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.560084 (+  3444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.647614 (+ 87530us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.044627 (+397013us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.077571 (+ 32944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.077707 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.547462 (+469755us) raft_consensus.cc:1685] finished
0709 13:07:14.568449 (+ 20987us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.581185 (+ 12736us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":341288,"threads_started":1,"wal-append.queue_time_us":482928}
W20260709 13:07:14.805892 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.806325 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.749260 23724 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:14.791615 22577 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.795596 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:14.747074 23717 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:07:14.807911 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:14.808207 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:14.786105 23457 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.785977 23570 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:07:14.816758 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:14.753594 23680 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.808996 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:14.756825 23440 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:07:14.797909 22503 rpcz_store.cc:276] 0709 13:07:13.673429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.739759 (+1066330us) service_pool.cc:224] Handling call
0709 13:07:14.740073 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.740304 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.740344 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.740422 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:14.740468 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.740541 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.740668 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.749831 23569 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:14.744501 23723 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.814193 23639 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.834537 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 580) took 1316 ms. Trace:
I20260709 13:07:14.834903 22652 rpcz_store.cc:276] 0709 13:07:13.518431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.011719 (+493288us) service_pool.cc:224] Handling call
0709 13:07:14.012172 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.012662 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.012703 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.013319 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.672663 (+659344us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.672703 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.672776 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.834331 (+161555us) raft_consensus.cc:1685] finished
0709 13:07:14.834352 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.834483 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3094,"raft.queue_time_us":1424,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8050,"thread_start_us":590745,"threads_started":1,"wal-append.queue_time_us":685732}
I20260709 13:07:14.821943 22650 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:14.771699 23698 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.792165 23631 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:14.826562 23653 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:14.827569 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69400.9us
I20260709 13:07:14.810375 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 917) took 1256 ms. Trace:
I20260709 13:07:14.851212 22498 rpcz_store.cc:276] 0709 13:07:13.554106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.736771 (+1182665us) service_pool.cc:224] Handling call
0709 13:07:14.737122 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.810039 (+ 72917us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:14.810068 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.810111 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.810139 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.810204 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.810318 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":68211,"threads_started":1}
I20260709 13:07:14.657753 22575 rpcz_store.cc:276] 0709 13:07:13.151858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.374284 (+222426us) service_pool.cc:224] Handling call
0709 13:07:13.374689 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.374933 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.374963 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.481274 (+106311us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.211845 (+730571us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.211934 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.212045 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.547282 (+335237us) raft_consensus.cc:1685] finished
0709 13:07:14.568873 (+ 21591us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.580770 (+ 11897us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":684875,"threads_started":1,"wal-append.queue_time_us":900328}
I20260709 13:07:14.832765 23711 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.836725 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 622) took 1184 ms. Trace:
I20260709 13:07:14.856668 22498 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.857446 22650 rpcz_store.cc:276] 0709 13:07:13.652897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.797678 (+1144781us) service_pool.cc:224] Handling call
0709 13:07:14.821607 (+ 23929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.836480 (+ 14873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.836676 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.759591 23643 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.869833 23524 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.870415 22498 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:14.871788 22498 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:14.872102 23524 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.838274 23606 tablet_copy_client.cc:538] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:14.873251 22498 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:14.811021 23663 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.829349 23717 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:14.754812 23689 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:14.789013 22505 rpcz_store.cc:276] 0709 13:07:13.537560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.545026 (+  7466us) service_pool.cc:224] Handling call
0709 13:07:14.713204 (+1168178us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5800003698. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:07:14.744370 (+ 31166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7985408}
I20260709 13:07:14.822674 23457 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.856630 23718 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:14.880686 23524 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:14.912184 22498 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:14.913396 22498 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:07:14.902314 23657 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.857s	user 0.007s	sys 0.005s
I20260709 13:07:14.898660 22654 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.897871 23639 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:14.925209 23719 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:07:14.925844 23708 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.862403 23631 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.910832 22575 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:14.914458 22498 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.902489 23643 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.911522 23689 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.853722 23515 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.915628 22648 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:14.920809 23718 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.940649 23708 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.938706 23632 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:14.919608 23711 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.922134 23715 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.911088 23440 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:14.919960 23524 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.961297 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:15.164038 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.921479 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 623) took 1268 ms. Trace:
I20260709 13:07:15.165236 22498 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.927877 23685 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.178295 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:14.944684 23631 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.944470 23569 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:07:15.162465 23725 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:07:14.948902 23501 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.188231 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.155589 23629 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:14.957013 23522 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.186070 22619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.129:38445 timed out after 1.512s (SENT) [suppressed 7 similar messages]
I20260709 13:07:14.947141 23680 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:14.954401 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 576) took 1450 ms. Trace:
I20260709 13:07:14.930419 23657 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:14.947770 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:15.197439 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 572) took 1694 ms. Trace:
I20260709 13:07:15.197520 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:15.172545 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 312615us
I20260709 13:07:15.198158 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 582) took 1660 ms. Trace:
I20260709 13:07:15.184190 23545 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:07:15.218791 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.184401 23636 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:15.195245 23531 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:15.194718 23501 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.223479 23633 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.007s
I20260709 13:07:14.954049 23732 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:15.193503 23715 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:15.191241 23685 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:15.172996 23711 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.258239 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:14.946448 23733 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.379s
I20260709 13:07:15.197553 23737 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.255625 23515 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.262470 23735 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.250970 22646 rpcz_store.cc:276] 0709 13:07:13.537626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.078097 (+540471us) service_pool.cc:224] Handling call
0709 13:07:14.108077 (+ 29980us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.298038 (+189961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.310646 (+ 12608us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.545510 (+234864us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.652727 (+107217us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.658705 (+  5978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.661593 (+  2888us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.192723 (+531130us) raft_consensus.cc:1685] finished
0709 13:07:15.192745 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.198088 (+  5343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57917,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":152,"thread_start_us":95024,"threads_started":1,"wal-append.queue_time_us":154428}
I20260709 13:07:15.200659 23629 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.202435 23522 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.280689 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:15.291630 22574 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:15.294266 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 577) took 2142 ms. Trace:
I20260709 13:07:15.296264 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 581) took 1766 ms. Trace:
I20260709 13:07:15.310777 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 904) took 1760 ms. Trace:
I20260709 13:07:15.311080 22651 rpcz_store.cc:276] 0709 13:07:13.530358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.040686 (+510328us) service_pool.cc:224] Handling call
0709 13:07:14.088757 (+ 48071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.757435 (+668678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.757471 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.786377 (+ 28906us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.861908 (+ 75531us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.861947 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.862037 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.295973 (+433936us) raft_consensus.cc:1685] finished
0709 13:07:15.296003 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.296180 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116491,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":163,"thread_start_us":705781,"threads_started":2,"wal-append.queue_time_us":350419}
I20260709 13:07:15.312281 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 577) took 1803 ms. Trace:
I20260709 13:07:15.297978 23727 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:15.298949 22502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 913) took 1746 ms (client timeout 1512 ms). Trace:
I20260709 13:07:15.299175 23457 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.300840 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 575) took 2149 ms. Trace:
I20260709 13:07:15.312662 22653 rpcz_store.cc:276] 0709 13:07:13.508930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.511660 (+  2730us) service_pool.cc:224] Handling call
0709 13:07:13.526988 (+ 15328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.621837 (+ 94849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.312038 (+1690201us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400168d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.312225 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164232064}
I20260709 13:07:15.331764 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:15.332878 23657 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.301054 23708 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.260488 23545 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.331354 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:15.334952 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:15.335522 23545 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.336150 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:15.336612 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:15.331341 22571 rpcz_store.cc:276] 0709 13:07:13.151555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.327466 (+175911us) service_pool.cc:224] Handling call
0709 13:07:13.466751 (+139285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.090924 (+624173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.300557 (+1209633us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54003ca5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.300773 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246524288}
I20260709 13:07:15.337499 22646 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:15.338291 23522 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.338320 22571 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:15.338869 23522 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.339308 23522 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.333040 23727 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:15.340309 22646 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:15.203629 22654 rpcz_store.cc:276] 0709 13:07:13.503678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.505621 (+  1943us) service_pool.cc:224] Handling call
0709 13:07:14.856802 (+1351181us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:14.881047 (+ 24245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.930324 (+ 49277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.954336 (+ 24012us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9021312}
I20260709 13:07:15.336800 22650 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:15.342195 22650 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:15.260427 23636 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.265899 23531 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.346707 23531 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.281354 23685 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:15.348174 23629 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.348266 23685 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.303009 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 911) took 1751 ms. Trace:
I20260709 13:07:15.302887 23735 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:15.310499 22572 rpcz_store.cc:276] 0709 13:07:13.152133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.514703 (+362570us) service_pool.cc:224] Handling call
0709 13:07:13.517635 (+  2932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.645997 (+128362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.294008 (+1648011us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003ac0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.294196 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275429120}
W20260709 13:07:15.344369 22501 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.003s
I20260709 13:07:15.328424 23700 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:15.331943 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:15.301928 23524 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.339833 22571 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:15.171777 22647 rpcz_store.cc:276] 0709 13:07:13.653211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.811672 (+1158461us) service_pool.cc:224] Handling call
0709 13:07:14.857723 (+ 46051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.882996 (+ 25273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.884242 (+  1246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.892083 (+  7841us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:14.899764 (+  7681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.906730 (+  6966us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.917404 (+ 10674us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:15.353374 22471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.023s	sys 0.037s
I20260709 13:07:15.320798 23723 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.353333 22500 rpcz_store.cc:276] 0709 13:07:13.552096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.714295 (+162199us) service_pool.cc:224] Handling call
0709 13:07:13.742360 (+ 28065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.643308 (+900948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.302793 (+659485us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54001b9754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.302955 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330817408}
I20260709 13:07:15.222337 22648 rpcz_store.cc:276] 0709 13:07:13.500838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.505485 (+  4647us) service_pool.cc:224] Handling call
0709 13:07:14.873374 (+1367889us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6eee 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:14.884712 (+ 11338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.172211 (+287499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.195016 (+ 22805us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32772480}
I20260709 13:07:15.311168 22496 rpcz_store.cc:276] 0709 13:07:13.549918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.680700 (+130782us) service_pool.cc:224] Handling call
0709 13:07:13.681292 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.761308 (+ 80016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.310547 (+1549239us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b540033ead4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.310720 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151929088}
I20260709 13:07:15.263119 23633 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.269279 23715 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.304049 23533 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:15.360903 23688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.014s	sys 0.049s
W20260709 13:07:15.322620 22502 rpcz_store.cc:269] 0709 13:07:13.552673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.629444 (+ 76771us) service_pool.cc:224] Handling call
0709 13:07:15.298745 (+1669301us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54001d9cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:15.298885 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057304960}
W20260709 13:07:15.384372 22471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.023s	sys 0.038s
W20260709 13:07:15.406790 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.290886 23737 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.393426 22652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.006s	sys 0.015s
I20260709 13:07:15.344444 23636 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.419816 22653 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:15.407968 22501 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:15.408756 23522 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.410115 23738 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:15.410652 23629 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:15.309140 22498 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:15.425029 22498 pending_rounds.cc:85] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:15.276129 23732 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:15.425310 22498 pending_rounds.cc:107] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:15.425591 22498 raft_consensus.cc:2889] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.411738 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 920) took 1519 ms. Trace:
I20260709 13:07:15.426196 22503 rpcz_store.cc:276] 0709 13:07:13.892617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.831751 (+939134us) service_pool.cc:224] Handling call
0709 13:07:14.855002 (+ 23251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.897387 (+ 42385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.897418 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.906419 (+  9001us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.381646 (+475227us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:15.403224 (+ 21578us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.403438 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.403511 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.411406 (+  7895us) raft_consensus.cc:1685] finished
0709 13:07:15.411427 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.411614 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56831,"prepare.queue_time_us":25432,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":217807,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":31730,"thread_start_us":444998,"threads_started":1,"wal-append.queue_time_us":488616}
W20260709 13:07:15.414196 22652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.007s	sys 0.015s
I20260709 13:07:15.411178 23531 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.404320 23700 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:15.408546 23730 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.418924 23708 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.421125 23733 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.423627 22501 pending_rounds.cc:85] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
W20260709 13:07:15.407449 23688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.015s	sys 0.049s
I20260709 13:07:15.432725 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 922) took 1391 ms. Trace:
I20260709 13:07:15.421584 23653 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.442824 22498 rpcz_store.cc:276] 0709 13:07:14.041712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.887426 (+845714us) service_pool.cc:224] Handling call
0709 13:07:14.907279 (+ 19853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.432329 (+525050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.432646 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.438366 23735 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.424329 23738 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.458304 23738 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.444943 22501 pending_rounds.cc:107] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:15.439476 23730 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.464193 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.003s	sys 0.018s
W20260709 13:07:15.465440 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.004s	sys 0.018s
W20260709 13:07:15.466286 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 288071us
W20260709 13:07:15.465785 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 614849us
W20260709 13:07:15.469005 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.019s
W20260709 13:07:15.469482 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.003s	sys 0.019s
I20260709 13:07:15.471467 23718 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.435303 23531 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.475713 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.479210 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.481637 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 295576us
I20260709 13:07:15.440418 23629 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.483510 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.484369 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.463492 22501 raft_consensus.cc:2889] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.445113 23708 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.488966 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.489283 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:15.464957 23501 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.452901 23653 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.492810 23547 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.002s
I20260709 13:07:15.449174 23733 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.507637 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:15.491098 23636 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.488284 23723 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.488225 23741 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.488912 23711 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:15.497896 23717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.024s	sys 0.063s
I20260709 13:07:15.496888 23522 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:07:15.508852 23733 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.532220 23688 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.495788 23582 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:15.508572 23612 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.493396 23639 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:07:15.537264 23748 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.525585 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 907) took 1974 ms. Trace:
I20260709 13:07:15.538160 23700 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:15.538264 23634 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.002s
W20260709 13:07:15.527652 23717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.024s	sys 0.064s
I20260709 13:07:15.538578 23428 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.542049 23629 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.546109 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.549095 23639 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:15.549659 23747 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.551177 23708 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.551659 23715 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.513484 23547 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.525357 23636 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.544274 23688 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.572256 23639 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:15.526466 23723 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.562069 23643 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
I20260709 13:07:15.553337 22501 rpcz_store.cc:276] 0709 13:07:13.550912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.716010 (+165098us) service_pool.cc:224] Handling call
0709 13:07:13.872180 (+156170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.500122 (+1627942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.517431 (+ 17309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.546094 23612 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.585974 23428 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.586501 23582 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:15.587474 23547 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.561039 23633 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.560114 23634 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:15.560581 23522 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.547008 23733 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:15.559989 23717 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:15.605561 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116366us
I20260709 13:07:15.698318 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.542070 23732 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:15.661548 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.692263 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:15.576097 23747 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:15.696593 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 307511us
I20260709 13:07:15.514622 23727 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.715878 22573 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:15.717849 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.743538 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 926) took 2089 ms. Trace:
I20260709 13:07:15.743875 22503 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:15.716538 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 903) took 2167 ms. Trace:
I20260709 13:07:15.747430 22500 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
W20260709 13:07:15.747490 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 239917us
I20260709 13:07:15.748531 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.749084 22500 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:15.749191 23643 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.750139 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.751791 22500 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:15.752540 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.753530 22500 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:07:15.742779 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43859.5us
I20260709 13:07:15.753809 22500 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:15.718662 23685 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.527621 23741 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.672986 23582 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.757575 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.744047 22573 rpcz_store.cc:276] 0709 13:07:13.653786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.004723 (+350937us) service_pool.cc:224] Handling call
0709 13:07:15.715157 (+1710434us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b58000fa298. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:15.715419 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.743139 (+ 27720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.743351 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2820352}
W20260709 13:07:15.735373 23736 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:07:15.760401 22502 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:15.758236 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:15.766793 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 578) took 1210 ms. Trace:
I20260709 13:07:15.716974 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:15.735519 23663 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.745218 22504 rpcz_store.cc:276] 0709 13:07:13.549598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.682250 (+132652us) service_pool.cc:224] Handling call
0709 13:07:13.683123 (+   873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.653406 (+970283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.716212 (+1062806us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54001db0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.716446 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139916544}
I20260709 13:07:15.756187 23685 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.767284 22580 rpcz_store.cc:276] 0709 13:07:14.572969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.573145 (+   176us) service_pool.cc:224] Handling call
0709 13:07:14.581139 (+  7994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.648060 (+ 66921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.766593 (+1118533us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b540027abd0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:15.766736 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17536896}
I20260709 13:07:15.743686 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:15.746618 23737 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.773298 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 586) took 2224 ms. Trace:
W20260709 13:07:15.778805 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.781293 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:15.784020 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.784338 22504 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
W20260709 13:07:15.784511 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.785108 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.764954 23651 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.738756 23633 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:07:15.694600 23428 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.768379 23582 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.697212 23522 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.783020 22649 rpcz_store.cc:276] 0709 13:07:13.548955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.679226 (+1130271us) service_pool.cc:224] Handling call
0709 13:07:14.708643 (+ 29417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.857166 (+148523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.857197 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.873670 (+ 16473us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.392699 (+519029us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:15.392762 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.673693 (+280931us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400394254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.673758 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.673821 (+    63us) raft_consensus.cc:1685] finished
0709 13:07:15.673839 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.773246 (+ 99407us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52253,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":19928,"spinlock_wait_cycles":325329664,"thread_start_us":486931,"threads_started":1,"wal-append.queue_time_us":424999}
I20260709 13:07:15.789999 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.764751 22500 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.806079 22500 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.802363 22502 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:15.799605 23651 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.717480 23639 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.817670 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.818882 22504 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:15.771468 23547 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:15.820540 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 923) took 2181 ms. Trace:
I20260709 13:07:15.737308 23717 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.786700 22646 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:07:15.822739 22576 rpcz_store.cc:276] 0709 13:07:13.639238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.959226 (+319988us) service_pool.cc:224] Handling call
0709 13:07:13.959516 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.612058 (+652542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.820194 (+1208136us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000e6354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.820455 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839134976}
I20260709 13:07:15.829478 23723 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.803239 23636 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:15.823946 23689 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.003s
I20260709 13:07:15.842705 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.825269 23654 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.851032 23651 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:15.854840 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 584) took 1279 ms. Trace:
I20260709 13:07:15.855263 22579 rpcz_store.cc:276] 0709 13:07:14.575264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.632321 (+ 57057us) service_pool.cc:224] Handling call
0709 13:07:14.643165 (+ 10844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.747494 (+104329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.854587 (+1107093us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54003c82d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:15.854777 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195293568}
I20260709 13:07:15.857641 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:15.847781 23698 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.995s	user 0.009s	sys 0.005s
I20260709 13:07:15.853655 23428 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:15.843235 23639 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.877408 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:15.867368 23543 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:15.884296 23543 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:07:15.884455 23758 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:15.885146 23543 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:15.869347 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.933005 23543 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:15.926478 23515 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.619s	user 0.003s	sys 0.007s
I20260709 13:07:15.927124 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.935842 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:15.862814 23654 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:16.040078 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.040787 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.041412 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.042003 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.042374 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.990561 23698 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.048053 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.048718 22502 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:16.042945 23647 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.042631 23515 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.054905 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 630) took 2087 ms. Trace:
I20260709 13:07:16.055212 22652 rpcz_store.cc:276] 0709 13:07:13.967312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.852531 (+885219us) service_pool.cc:224] Handling call
0709 13:07:14.852809 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.429268 (+576459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.429313 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.454020 (+ 24707us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.589848 (+135828us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:15.589887 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.589968 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.054733 (+464765us) raft_consensus.cc:1685] finished
0709 13:07:16.054747 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.054850 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55707,"spinlock_wait_cycles":24486272,"thread_start_us":674370,"threads_started":2,"wal-append.queue_time_us":314661}
W20260709 13:07:16.055783 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.038851 23741 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:16.060621 23756 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.459s	user 0.000s	sys 0.006s
I20260709 13:07:16.043982 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.069422 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 926) took 1987 ms. Trace:
I20260709 13:07:16.051218 23647 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:16.047163 23582 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.082371 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:16.083482 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.083721 22500 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.050318 23698 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.053153 23515 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.078907 22501 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 1.
I20260709 13:07:16.096766 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.102062 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.075712 22505 rpcz_store.cc:276] 0709 13:07:14.081922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.946276 (+864354us) service_pool.cc:224] Handling call
0709 13:07:15.173775 (+227499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.198347 (+ 24572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.198380 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.198882 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.501840 (+302958us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:15.505121 (+  3281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.517257 (+ 12136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.060045 (+542788us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:07:16.069035 (+  8990us) raft_consensus.cc:1685] finished
0709 13:07:16.069071 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.069338 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21172,"raft.queue_time_us":24990,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":148,"spinlock_wait_cycles":16014592,"thread_start_us":290020,"threads_started":1,"wal-append.queue_time_us":402735}
I20260709 13:07:16.103411 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:16.104176 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:16.105057 23440 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.105124 23717 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.106041 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.104529 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.108183 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:16.110667 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.111897 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.113112 23723 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.113548 23515 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.114913 23717 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.115023 23440 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:16.117091 23724 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:07:16.107086 23654 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.117652 22619 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:16.112586 22502 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:16.117910 23582 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.122341 22619 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:16.126048 22500 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:16.119611 23743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.009s	sys 0.010s
W20260709 13:07:16.118829 22545 connection.cc:256] RPC call timeout handler was delayed by -1.0820107060000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 13:07:16.128667 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.126425 23571 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:16.129983 23571 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.130328 23571 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.131155 23662 raft_consensus.cc:1064] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:16.121428 23647 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.132058 23647 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.135509 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 919) took 2243 ms. Trace:
I20260709 13:07:16.139063 23543 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.139166 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:16.139707 23543 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:16.143428 22499 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.144999 22499 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:16.141623 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.145823 22499 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.146581 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.146934 22499 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.147488 22504 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.141852 23698 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.142653 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.163793 22501 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.164721 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.165334 22501 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:16.166186 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.166796 23606 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:16.143612 23651 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.148123 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.168054 22649 raft_consensus.cc:2410] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.127524 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.168536 22500 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
W20260709 13:07:16.128754 22545 connection.cc:256] RPC call timeout handler was delayed by -1.0469107059999487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:07:16.169517 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.170375 22499 raft_consensus.cc:2410] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.173321 22580 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:16.174340 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.174592 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.174940 22580 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.175155 22500 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:16.148478 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.142735 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.148978 22652 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:16.180128 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.180889 22652 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:16.181300 22500 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:16.181799 22500 pending_rounds.cc:85] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:16.182176 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.183513 22652 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.183630 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.149243 22502 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.184568 22580 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:16.151659 22543 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:16.129102 23582 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:16.145390 23543 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.157966 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:16.158713 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.159437 23653 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.159376 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.160138 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.160732 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:16.184723 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:16.211143 22650 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.186077 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.188105 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:16.212760 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.192529 23582 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.193672 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.195509 22573 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.199872 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:16.206012 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.206679 22572 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:16.190265 23733 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:07:16.167328 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.194140 23410 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.190357 23663 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.182102 22500 pending_rounds.cc:107] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:16.226053 22500 raft_consensus.cc:2889] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.227268 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.227875 22500 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:16.155896 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:16.228767 22498 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:16.189448 23636 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:16.222476 22580 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:16.198402 23625 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:16.206933 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.224748 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.203377 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.216311 23771 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:16.242072 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.232028 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.243093 22572 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.221554 23582 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.190025 23651 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.216848 23731 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:16.251332 23570 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.239508 22545 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:16.243692 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.233891 23730 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.240598 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:16.241739 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 47101.5us
I20260709 13:07:16.246160 22652 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:16.246764 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.246822 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.242336 23680 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.250854 23651 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.242098 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:16.255450 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:16.258061 22543 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:16.258103 22578 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.260797 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.136132 22497 rpcz_store.cc:276] 0709 13:07:13.892346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.754334 (+861988us) service_pool.cc:224] Handling call
0709 13:07:14.797375 (+ 43041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.883911 (+1086536us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:07:15.883953 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.884010 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:15.884073 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.135139 (+251066us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400082ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:16.135212 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.135424 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2468,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":69963,"spinlock_wait_cycles":2469065472}
I20260709 13:07:16.241029 23625 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.255311 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.242365 23771 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:16.259388 23569 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:16.229646 23410 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.290501 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.296039 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.296499 22652 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:16.296772 22578 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.288877 23651 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.305122 23749 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.305480 23651 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:16.254192 23624 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.305991 23749 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:16.237038 23663 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.306857 23624 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.309516 23663 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.309715 23777 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:16.310330 23663 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.310436 23777 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.310921 23663 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:16.311161 23777 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.253172 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:16.313577 22505 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.314076 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.306113 23651 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.315677 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.316753 22580 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.317448 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.319147 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.321060 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 625) took 2625 ms. Trace:
I20260709 13:07:16.286972 23625 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.321638 22645 rpcz_store.cc:276] 0709 13:07:13.695783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.823146 (+1127363us) service_pool.cc:224] Handling call
0709 13:07:16.094884 (+1271738us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:16.095111 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.095515 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.095548 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.096069 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.192136 (+ 96067us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:16.202631 (+ 10495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.210499 (+  7868us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.320675 (+110176us) raft_consensus.cc:1685] finished
0709 13:07:16.320706 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.321004 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":446,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":122,"spinlock_wait_cycles":27132160,"thread_start_us":82537,"threads_started":1,"wal-append.queue_time_us":156879}
I20260709 13:07:16.289474 23673 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.351516 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.352447 22573 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.289726 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.295795 23569 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.299546 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.300060 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.300966 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.359092 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.242914 23636 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.302909 23410 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.259200 23570 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.303833 22572 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.270757 23680 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.297719 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:16.349990 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.570266 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.570257 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:16.570815 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.570969 23680 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.571295 22652 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:16.571579 23698 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:16.364742 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.294287 23771 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.572400 23606 tablet_bootstrap.cc:700] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Time spent opening tablet: real 0.116s	user 0.002s	sys 0.002s
I20260709 13:07:16.572150 23698 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.572532 23543 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:16.573091 23543 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.574337 23698 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.574875 23698 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:16.575018 23543 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.575357 23698 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.575987 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 644) took 1400 ms. Trace:
I20260709 13:07:16.359807 22649 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:16.577623 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.578747 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.580147 23771 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:16.443311 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 185531us
W20260709 13:07:16.589958 23765 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.740s	user 0.004s	sys 0.000s
I20260709 13:07:16.591691 23771 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.610180 23685 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:16.591738 23753 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.738s	user 0.006s	sys 0.049s
I20260709 13:07:16.591884 23683 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:16.576344 22653 rpcz_store.cc:276] 0709 13:07:15.175684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.331715 (+156031us) service_pool.cc:224] Handling call
0709 13:07:16.575768 (+1244053us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54002995d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:16.575909 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112275840}
I20260709 13:07:16.580147 22505 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:16.601445 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.621328 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 633) took 1663 ms. Trace:
I20260709 13:07:16.621891 22651 rpcz_store.cc:276] 0709 13:07:14.958247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.332763 (+374516us) service_pool.cc:224] Handling call
0709 13:07:16.601278 (+1268515us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:07:16.621256 (+ 19978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3611392}
W20260709 13:07:16.626257 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.626955 22651 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:16.596598 23662 raft_consensus.cc:1068] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Unable to promote non-voter fa2f181263f446a6962b649f9348c15f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:16.615341 23612 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.631999 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.633301 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:16.633903 22572 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.604995 22501 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:16.550566 23624 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.327683 23752 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:16.382624 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.551107 22650 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.641731 22650 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.642678 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.445151 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.551672 23653 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.591998 23780 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:07:16.551622 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:16.552630 23570 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.547418 22500 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:16.420634 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.679814 23570 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.552448 23571 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:16.351531 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115040us
I20260709 13:07:16.555195 23777 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.556723 23582 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:16.557628 23639 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.007s
I20260709 13:07:16.691912 22499 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:16.692487 22499 pending_rounds.cc:85] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:16.693053 22499 pending_rounds.cc:107] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:16.693364 22499 raft_consensus.cc:2889] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.351811 23673 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:16.558395 23631 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.558627 23636 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.559504 23625 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.391937 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.561014 23651 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.324816 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.543192 23569 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.312093 23663 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:16.418864 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.716187 23651 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.568149 22504 pending_rounds.cc:85] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:16.716993 22504 pending_rounds.cc:107] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:16.717604 22504 raft_consensus.cc:2889] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:16.439134 23773 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:07:16.353606 23730 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.571147 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:16.449285 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 176664us
I20260709 13:07:16.572170 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.543201 23440 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.581523 23731 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:16.582026 23698 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.586915 22498 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:16.551940 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.737174 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:16.738026 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.680032 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 128491us
I20260709 13:07:16.745057 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.694456 22572 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:16.642673 23522 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.700515 22649 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:07:16.645826 23752 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:07:16.701227 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.701675 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.747208 22580 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:16.747582 22576 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:16.708086 22573 raft_consensus.cc:2368] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:16.748353 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:16.714129 22647 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:16.691773 22648 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:16.714926 23582 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:16.719380 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.718487 22645 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 1.
I20260709 13:07:16.727361 22617 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:16.696485 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 591) took 1884 ms. Trace:
W20260709 13:07:16.732831 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46669us
I20260709 13:07:16.745492 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:16.681689 22653 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:16.704257 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:16.679665 23653 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.749282 22580 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:16.754673 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.760107 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.754595 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.762276 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.763679 22543 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:16.763026 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.787804 22650 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:16.766744 22579 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:16.770015 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.790407 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.790853 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.758158 22574 rpcz_store.cc:276] 0709 13:07:14.812254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.954626 (+142372us) service_pool.cc:224] Handling call
0709 13:07:14.955007 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.319742 (+364735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.696233 (+1376491us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003bcc54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:16.696411 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773586688}
I20260709 13:07:16.791651 22579 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:16.792270 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.792325 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.793625 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.794176 22579 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:16.794247 22574 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:16.795737 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.797698 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:16.799351 23606 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:07:16.804158 23606 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:16.804507 22580 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:16.806079 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81317.9us
W20260709 13:07:16.807909 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44302.2us
I20260709 13:07:16.808288 22545 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:16.809304 22543 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:16.809921 23683 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.811363 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:16.812337 23683 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:16.812515 23636 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:16.758193 22571 raft_consensus.cc:2368] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:16.813160 23651 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:16.813313 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.816543 22651 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
W20260709 13:07:16.817142 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.809072 23522 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.767068 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:16.821499 22576 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:16.814810 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:16.828393 22503 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:16.828778 22503 pending_rounds.cc:85] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:16.829027 22503 pending_rounds.cc:107] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:16.829295 22503 raft_consensus.cc:2889] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.736335 23731 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.726888 23730 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.750247 23752 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.787621 23723 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:16.755648 23788 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.768606 23570 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:16.816186 23651 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.815923 23776 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:16.814610 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55300.7us
I20260709 13:07:16.815999 23683 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:16.818910 23636 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:16.816103 23501 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:07:16.826860 23673 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.859457 23749 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:16.870795 23749 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.871332 23749 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.831162 23571 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:16.863123 23730 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.873517 23606 tablet_bootstrap.cc:492] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:16.858736 23788 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.874783 23606 ts_tablet_manager.cc:1403] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.708s	user 0.020s	sys 0.017s
I20260709 13:07:16.857053 22579 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:16.901938 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83894.8us
I20260709 13:07:16.851123 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.859247 23651 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.862366 23636 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.862919 23777 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.863897 23625 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.917431 22579 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.861301 23683 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.859673 23776 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.920573 23788 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:16.922101 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:16.837795 23791 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
W20260709 13:07:16.969121 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 47091.6us
I20260709 13:07:16.973277 23625 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.973909 23625 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:16.975135 23625 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:16.971692 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:16.981635 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.983701 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.989761 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:16.992190 23625 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.994848 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.000391 22579 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:16.865307 23653 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:17.006649 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.008155 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:17.015947 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:17.021241 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 932) took 1251 ms. Trace:
I20260709 13:07:17.021737 22500 rpcz_store.cc:276] 0709 13:07:15.770144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.238033 (+467889us) service_pool.cc:224] Handling call
0709 13:07:16.238334 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.679607 (+441273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.020955 (+341348us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b540007c954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:17.021173 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709724416}
I20260709 13:07:17.023489 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:17.024482 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:17.025647 22500 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.916253 22645 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:17.027241 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:16.967031 23440 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:16.967511 23776 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.034648 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:17.035459 23747 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.034693 22401 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:17.035624 22577 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:17.003049 23673 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.037390 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 931) took 1267 ms. Trace:
W20260709 13:07:17.041810 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 214639us
I20260709 13:07:17.041689 22499 rpcz_store.cc:276] 0709 13:07:15.769954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.189504 (+419550us) service_pool.cc:224] Handling call
0709 13:07:16.691444 (+501940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.701110 (+  9666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.037144 (+336034us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54003fb450. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:17.037320 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153604864}
I20260709 13:07:17.045832 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:17.046741 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:17.047009 22499 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.051793 22576 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.031569 23728 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.013571 23797 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.028023 23531 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.059584 22572 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.039088 23569 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.062390 22499 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:17.050036 23631 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.027563 23614 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:17.102895 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:17.116343 22499 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.104144 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:16.998185 23796 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:07:17.036988 23571 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:07:17.115310 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58157.1us
W20260709 13:07:17.164482 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63665.1us
I20260709 13:07:17.111084 22500 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:17.042148 23440 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.109042 23569 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:17.095918 23570 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.165320 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:17.159518 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.166599 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:17.219825 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:17.106143 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:17.109696 23647 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.117324 23631 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.120770 23728 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:17.163506 23685 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.245481 22499 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:17.277992 22651 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:17.176277 23569 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.286046 23685 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.290159 23685 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.246537 23631 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.277761 23730 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.317494 23606 raft_consensus.cc:359] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.319056 23606 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:17.319768 23606 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:17.321772 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 156511us
I20260709 13:07:17.322537 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:07:17.322795 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.325237 23531 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:17.328192 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.324602 23614 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.308193 23730 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:17.325727 23531 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:17.317325 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 687) took 1213 ms. Trace:
I20260709 13:07:17.332728 23614 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.394124 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 963) took 1178 ms. Trace:
I20260709 13:07:17.394678 22499 rpcz_store.cc:276] 0709 13:07:16.215700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.278516 (+1062816us) service_pool.cc:224] Handling call
0709 13:07:17.278831 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.279043 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:17.279400 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.393620 (+114220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.393692 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:17.393748 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.393882 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.394045 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44615,"prepare.queue_time_us":1144,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":69138,"threads_started":1}
I20260709 13:07:17.398237 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 20) took 1165 ms. Trace:
I20260709 13:07:17.398710 22499 rpcz_store.cc:276] 0709 13:07:16.233290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.396458 (+1163168us) service_pool.cc:224] Handling call
0709 13:07:17.397586 (+  1128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.397832 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.397869 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.397924 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.397968 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.398044 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.398170 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.381902 23531 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:17.408583 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.419066 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.410919 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 363221us
I20260709 13:07:17.388001 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.380752 23653 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:07:17.407591 23808 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.402702 23614 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.330530 23804 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:07:17.382712 23522 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.466144 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46313.7us
I20260709 13:07:17.447130 23795 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.484545 23795 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.487669 23795 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.461645 23570 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:17.490072 23570 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.490121 23639 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.493782 23639 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.491603 23522 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:17.497279 23639 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:17.500139 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52871.8us
I20260709 13:07:17.501078 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:17.502125 22619 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:17.477385 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:07:17.470278 23815 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.355s	user 0.002s	sys 0.000s
I20260709 13:07:17.507064 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:17.511638 22619 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:17.468708 23806 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:17.453899 23803 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:07:17.503584 23795 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.474586 23808 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.409507 23728 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.443447 23730 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.514439 23440 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:17.474838 23801 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:07:17.526046 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.545083 23827 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:17.570458 23730 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.555474 23677 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:07:17.570706 23440 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.545181 23806 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.577970 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 960) took 1363 ms. Trace:
W20260709 13:07:17.554436 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89461.3us
I20260709 13:07:17.578578 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 947) took 1024 ms. Trace:
I20260709 13:07:17.584734 22577 rpcz_store.cc:276] 0709 13:07:16.554604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.048217 (+493613us) service_pool.cc:224] Handling call
0709 13:07:17.104788 (+ 56571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.105379 (+   591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.105408 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.115504 (+ 10096us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.310257 (+194753us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:17.310340 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.310597 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.578387 (+267790us) raft_consensus.cc:1685] finished
0709 13:07:17.578408 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.578527 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9105,"thread_start_us":90552,"threads_started":1,"wal-append.queue_time_us":301030}
I20260709 13:07:17.580714 22496 rpcz_store.cc:276] 0709 13:07:16.214739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.715938 (+501199us) service_pool.cc:224] Handling call
0709 13:07:16.716360 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.913347 (+196987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.913374 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.914997 (+  1623us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.989595 (+ 74598us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:16.989632 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.989689 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.577739 (+588050us) raft_consensus.cc:1685] finished
0709 13:07:17.577763 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.577906 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22608,"raft.queue_time_us":52295,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":25201,"thread_start_us":264015,"threads_started":2,"wal-append.queue_time_us":568519}
W20260709 13:07:17.574657 23799 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
W20260709 13:07:17.591044 23813 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:17.592298 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 961) took 1377 ms. Trace:
I20260709 13:07:17.592717 22498 rpcz_store.cc:276] 0709 13:07:16.215042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.737099 (+522057us) service_pool.cc:224] Handling call
0709 13:07:16.765361 (+ 28262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.053049 (+287688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.053076 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.053573 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.399436 (+345863us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:17.452452 (+ 53016us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.469057 (+ 16605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.469180 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.592072 (+122892us) raft_consensus.cc:1685] finished
0709 13:07:17.592094 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.592237 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68108,"prepare.queue_time_us":71659,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":19614,"raft.queue_time_us":126866,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":12090,"thread_start_us":473734,"threads_started":2,"wal-append.queue_time_us":526024}
I20260709 13:07:17.594411 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:17.595108 22646 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.554353 23820 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:17.596633 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 957) took 1382 ms. Trace:
W20260709 13:07:17.597268 23824 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:07:17.597663 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:17.598320 23818 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:17.598912 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 660) took 1408 ms. Trace:
I20260709 13:07:17.599421 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 953) took 1504 ms. Trace:
I20260709 13:07:17.599421 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 946) took 1045 ms. Trace:
I20260709 13:07:17.599956 22504 rpcz_store.cc:276] 0709 13:07:16.095466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.567645 (+472179us) service_pool.cc:224] Handling call
0709 13:07:16.567986 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.718450 (+150464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.718493 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.719023 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.969885 (+250862us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:16.969933 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.970007 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.599223 (+629216us) raft_consensus.cc:1685] finished
0709 13:07:17.599241 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.599362 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":228008,"threads_started":1,"wal-append.queue_time_us":331607}
I20260709 13:07:17.574223 23817 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:07:17.603919 23817 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:17.553977 23795 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.599387 22653 rpcz_store.cc:276] 0709 13:07:16.190729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.616001 (+425272us) service_pool.cc:224] Handling call
0709 13:07:16.616425 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.758759 (+142334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.598578 (+839819us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b5400169254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:17.598831 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149273344}
I20260709 13:07:17.610759 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.611572 22653 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:17.612509 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.614339 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.600517 22579 rpcz_store.cc:276] 0709 13:07:16.554204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.001790 (+447586us) service_pool.cc:224] Handling call
0709 13:07:17.027872 (+ 26082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.028234 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.028272 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.028770 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.237032 (+208262us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:17.237076 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.237152 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.599223 (+362071us) raft_consensus.cc:1685] finished
0709 13:07:17.599241 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.599361 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3137,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9376,"thread_start_us":175839,"threads_started":1,"wal-append.queue_time_us":364487}
I20260709 13:07:17.627763 22653 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.596797 23820 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:17.592727 23702 raft_consensus.cc:1064] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:17.606076 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:17.588559 23801 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:17.657220 22499 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:17.659567 22499 pending_rounds.cc:85] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:17.659884 22499 pending_rounds.cc:107] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:17.660185 22499 raft_consensus.cc:2889] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.660116 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:17.661778 22620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.010s	sys 0.009s
W20260709 13:07:17.662240 22620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.009s
W20260709 13:07:17.663233 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.663743 23673 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.618s	user 0.018s	sys 0.000s
I20260709 13:07:17.570801 23831 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:07:17.659263 23625 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.381250 22497 rpcz_store.cc:276] 0709 13:07:16.103526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.607406 (+503880us) service_pool.cc:224] Handling call
0709 13:07:16.607770 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.637461 (+ 29691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.638350 (+   889us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.719551 (+ 81201us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.043534 (+323983us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:17.052554 (+  9020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.056609 (+  4055us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.316987 (+260378us) raft_consensus.cc:1685] finished
0709 13:07:17.317017 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.317242 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49,"raft.queue_time_us":111,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":193159,"threads_started":1,"wal-append.queue_time_us":392594}
I20260709 13:07:17.668256 23801 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.682144 23677 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.683452 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.683673 23636 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.005s
I20260709 13:07:17.699244 23636 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.682087 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 959) took 1467 ms. Trace:
W20260709 13:07:17.703460 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.010s	sys 0.025s
W20260709 13:07:17.703836 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.011s	sys 0.025s
I20260709 13:07:17.651764 23820 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:17.655408 23702 raft_consensus.cc:1068] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Unable to promote non-voter fa2f181263f446a6962b649f9348c15f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:17.698041 23677 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.818472 23677 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:17.818758 22574 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.819470 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 935) took 1550 ms. Trace:
I20260709 13:07:17.820123 23808 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.820555 23727 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.818553 23820 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:17.822161 23651 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.903s	user 0.014s	sys 0.004s
I20260709 13:07:17.822651 23651 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.689625 22572 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:17.700565 22501 rpcz_store.cc:276] 0709 13:07:16.214418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.697985 (+483567us) service_pool.cc:224] Handling call
0709 13:07:16.757252 (+ 59267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.031149 (+273897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.041222 (+ 10073us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.159437 (+118215us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.436805 (+277368us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:17.439339 (+  2534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.459996 (+ 20657us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.668387 (+208391us) raft_consensus.cc:1685] finished
0709 13:07:17.681828 (+ 13441us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.682017 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8284,"raft.queue_time_us":76566,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4847,"thread_start_us":296063,"threads_started":2,"wal-append.queue_time_us":391175}
I20260709 13:07:17.581264 23827 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.800630 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 949) took 1245 ms. Trace:
I20260709 13:07:17.835327 22575 rpcz_store.cc:276] 0709 13:07:16.555468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.605725 (+1050257us) service_pool.cc:224] Handling call
0709 13:07:17.800546 (+194821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.836625 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:17.836794 23651 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.837891 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 647) took 1673 ms. Trace:
W20260709 13:07:17.800643 23816 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.563s	user 0.002s	sys 0.000s
I20260709 13:07:17.838256 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:17.838404 22648 rpcz_store.cc:276] 0709 13:07:16.164344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.190527 (+ 26183us) service_pool.cc:224] Handling call
0709 13:07:16.646825 (+456298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.756483 (+109658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.837660 (+1081177us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54001c7fd0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:17.837832 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996673920}
W20260709 13:07:17.802064 23800 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.526s	user 0.001s	sys 0.000s
W20260709 13:07:17.840582 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.841513 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 958) took 1627 ms. Trace:
W20260709 13:07:17.799085 23749 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.927s	user 0.029s	sys 0.000s
I20260709 13:07:17.597103 22505 rpcz_store.cc:276] 0709 13:07:16.213788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.620096 (+406308us) service_pool.cc:224] Handling call
0709 13:07:16.637536 (+ 17440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.847439 (+209903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.851514 (+  4075us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.919250 (+ 67736us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.977034 (+ 57784us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:16.977095 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.977201 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.596371 (+619170us) raft_consensus.cc:1685] finished
0709 13:07:17.596394 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.596559 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10156,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":18831,"thread_start_us":190535,"threads_started":2,"wal-append.queue_time_us":519250}
W20260709 13:07:17.800573 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 985136us
I20260709 13:07:17.851869 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:07:17.807938 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.867102 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:17.868263 23809 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.868692 23809 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:17.869374 23809 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.871372 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 948) took 1316 ms. Trace:
I20260709 13:07:17.871548 23627 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.871814 22576 rpcz_store.cc:276] 0709 13:07:16.555004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.052990 (+497986us) service_pool.cc:224] Handling call
0709 13:07:17.097300 (+ 44310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.109587 (+ 12287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.109624 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.160820 (+ 51196us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.681244 (+520424us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:17.681308 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.681435 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.871139 (+189704us) raft_consensus.cc:1685] finished
0709 13:07:17.871158 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.871309 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":388,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":11364,"thread_start_us":404881,"threads_started":1,"wal-append.queue_time_us":603609}
I20260709 13:07:17.874191 22576 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.874414 22545 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:17.874763 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 965) took 1314 ms. Trace:
I20260709 13:07:17.875139 22576 rpcz_store.cc:276] 0709 13:07:16.560396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.873553 (+1313157us) service_pool.cc:224] Handling call
0709 13:07:17.873859 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.874546 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.874714 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.876438 23802 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.876591 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 33) took 1151 ms. Trace:
I20260709 13:07:17.876781 23787 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.876909 23802 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:17.877245 23787 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.877187 22576 rpcz_store.cc:276] 0709 13:07:16.725285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.875829 (+1150544us) service_pool.cc:224] Handling call
0709 13:07:17.876136 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.876294 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.876318 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.876359 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.876388 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.876440 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.876544 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.819855 22574 rpcz_store.cc:276] 0709 13:07:16.269315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.817996 (+1548681us) service_pool.cc:224] Handling call
0709 13:07:17.818394 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.819197 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.819414 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.656754 23522 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:17.878619 22543 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:17.686061 23673 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:17.879514 22576 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:17.879446 23673 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.841887 22502 rpcz_store.cc:276] 0709 13:07:16.214078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.690742 (+476664us) service_pool.cc:224] Handling call
0709 13:07:16.695174 (+  4432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.719877 (+ 24703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.719920 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.725314 (+  5394us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.891564 (+166250us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:17.030824 (+139260us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.105886 (+ 75062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.105972 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.797226 (+691254us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b18002ee7c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:07:17.801374 (+  4148us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:07:17.841320 (+ 39946us) raft_consensus.cc:1685] finished
0709 13:07:17.841340 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.841457 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51395,"prepare.queue_time_us":149701,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":105461,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":34581,"spinlock_wait_cycles":15288064,"thread_start_us":272211,"threads_started":3,"wal-append.queue_time_us":367355}
W20260709 13:07:17.825941 23685 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.003s
I20260709 13:07:17.881404 23685 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.882036 23653 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.882583 23653 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:17.883489 23685 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.883440 23653 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.884846 23653 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.889499 23662 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.890117 23662 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.890599 23662 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.891961 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 617) took 1128 ms. Trace:
I20260709 13:07:17.850754 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 659) took 1671 ms. Trace:
I20260709 13:07:17.892366 22651 rpcz_store.cc:276] 0709 13:07:16.763224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.989435 (+226211us) service_pool.cc:224] Handling call
0709 13:07:17.891697 (+902262us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002981d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:17.891892 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660335488}
I20260709 13:07:17.890232 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:17.893049 22649 rpcz_store.cc:276] 0709 13:07:16.179684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.580360 (+400676us) service_pool.cc:224] Handling call
0709 13:07:16.580647 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.750039 (+169392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.850120 (+1100081us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000fd2d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:17.850665 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266776448}
I20260709 13:07:17.893747 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.877748 23787 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:17.895941 22573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 931) took 1628 ms (client timeout 2121 ms). Trace:
W20260709 13:07:17.896373 22573 rpcz_store.cc:269] 0709 13:07:16.267566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.353302 (+ 85736us) service_pool.cc:224] Handling call
0709 13:07:17.895739 (+1542437us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001e50d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:17.895858 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311488896}
I20260709 13:07:17.878579 23522 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.895880 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.899217 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 620) took 1135 ms. Trace:
I20260709 13:07:17.899565 22647 rpcz_store.cc:276] 0709 13:07:16.764059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.895629 (+1131570us) service_pool.cc:224] Handling call
0709 13:07:17.899157 (+  3528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.882117 23673 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.901171 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 678) took 1007 ms. Trace:
I20260709 13:07:17.901559 22647 rpcz_store.cc:276] 0709 13:07:16.893972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.900248 (+1006276us) service_pool.cc:224] Handling call
0709 13:07:17.900568 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.900755 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.900783 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.900835 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:17.900890 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.900966 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.901102 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.872152 23627 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:17.904310 23627 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.905512 23543 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.905803 23627 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.905946 23543 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:17.880671 22576 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:17.907856 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 670) took 1134 ms. Trace:
I20260709 13:07:17.908244 22654 rpcz_store.cc:276] 0709 13:07:16.773504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.597382 (+823878us) service_pool.cc:224] Handling call
0709 13:07:17.907386 (+310004us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b54002d9f28. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0d8924 00007fec2b2c1227 00007fec2b2c0ab8 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6
0709 13:07:17.907799 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23756160}
I20260709 13:07:17.912463 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 684) took 1809 ms. Trace:
I20260709 13:07:17.913019 22503 rpcz_store.cc:276] 0709 13:07:16.102817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.606636 (+503819us) service_pool.cc:224] Handling call
0709 13:07:16.606967 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.829698 (+222731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.912165 (+1082467us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001a7f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:17.912377 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508432640}
I20260709 13:07:17.921896 23636 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.922935 23636 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:17.650695 23828 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:17.829587 23752 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.981s	user 0.001s	sys 0.012s
W20260709 13:07:17.926599 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 253633us
W20260709 13:07:17.925843 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 290869us
W20260709 13:07:17.833120 23776 consensus_meta.cc:287] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.782s	user 0.004s	sys 0.015s
I20260709 13:07:17.947870 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.696193 23625 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.842264 23749 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.949676 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 932) took 1681 ms. Trace:
I20260709 13:07:17.925064 23702 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.960294 22580 rpcz_store.cc:276] 0709 13:07:16.267919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.991776 (+723857us) service_pool.cc:224] Handling call
0709 13:07:16.992166 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.992537 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.992575 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.993095 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.034682 (+ 41587us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:17.034733 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.034810 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.799962 (+765152us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:07:17.851088 (+ 51126us) raft_consensus.cc:1685] finished
0709 13:07:17.851110 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.949606 (+ 98496us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":8967424,"thread_start_us":41184,"threads_started":1,"wal-append.queue_time_us":102583}
I20260709 13:07:17.971832 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.973423 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.971120 23653 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.975742 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:17.975988 23653 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.945497 23806 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:17.948168 23830 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.949070 23771 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:17.980962 22617 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:17.985726 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.986927 22468 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:17.985816 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.997171 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:17.967728 23828 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:17.970021 23702 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:18.000890 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:17.971866 23612 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.955327 23817 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:17.963464 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:18.007808 22654 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:17.960781 23841 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:17.981268 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:18.004047 23808 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.951208 23776 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.034173 23776 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.034938 23625 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.019299 23612 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:18.036376 23683 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.019s	user 0.015s	sys 0.005s
I20260709 13:07:18.037073 23612 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.036804 23683 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.038967 23683 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.004382 23698 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:18.039988 23698 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.040392 23698 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.041051 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:18.041740 22499 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:18.042323 23801 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.014246 23831 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.014743 23828 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:17.947399 23752 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:18.015364 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:18.026515 23795 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.026980 22497 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:17.997107 23771 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.009984 22571 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:18.010392 23702 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.030073 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:18.059540 23771 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.060352 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:18.030885 23830 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.034087 23653 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.064980 23261 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:18.065703 22650 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:18.052484 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:18.018340 23569 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.007s
I20260709 13:07:18.051092 22619 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:18.047711 23606 ts_tablet_manager.cc:1434] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 1.172s	user 0.029s	sys 0.044s
W20260709 13:07:18.021271 23731 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.176s	user 0.018s	sys 0.000s
W20260709 13:07:18.056475 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.024039 23808 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:18.028213 23543 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.074815 23731 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:18.077122 23531 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.631s	user 0.013s	sys 0.006s
I20260709 13:07:18.077600 23531 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.079042 22652 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:18.079061 22499 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:18.060398 23771 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:07:17.564301 23797 consensus_queue.cc:1175] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:18.025281 23809 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.068638 22646 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:18.074476 23808 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.071048 23752 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.100567 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 682) took 1056 ms. Trace:
W20260709 13:07:18.070020 23606 ts_tablet_manager.cc:1467] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Tablet startup took 1194ms
I20260709 13:07:18.034008 23802 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.071417 23569 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.023540 23841 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.101284 22619 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:18.229070 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.191017 22500 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:18.352089 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:18.409020 22620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.000s	sys 0.042s
W20260709 13:07:18.410662 22498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.019s	sys 0.016s
I20260709 13:07:18.434196 22652 rpcz_store.cc:276] 0709 13:07:17.044206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.910945 (+866739us) service_pool.cc:224] Handling call
0709 13:07:17.911285 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.079480 (+168195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.100235 (+ 20755us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54002986d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:18.100477 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385335680}
I20260709 13:07:18.080957 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 684) took 1036 ms. Trace:
W20260709 13:07:18.139565 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.440131 22498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.020s	sys 0.017s
W20260709 13:07:18.439810 22620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.000s	sys 0.043s
W20260709 13:07:18.453922 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 473025us
W20260709 13:07:18.444114 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.464749 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.464540 22617 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:18.464532 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.467159 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:18.448741 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 347506us
I20260709 13:07:18.472358 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:18.473307 22499 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.105080 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 683) took 1060 ms. Trace:
W20260709 13:07:18.330811 23614 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.849s	user 0.015s	sys 0.000s
W20260709 13:07:18.106652 23631 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.799s	user 0.010s	sys 0.010s
W20260709 13:07:18.291190 23730 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.715s	user 0.015s	sys 0.002s
W20260709 13:07:18.411381 23440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.020s	sys 0.015s
I20260709 13:07:18.480439 22646 rpcz_store.cc:276] 0709 13:07:17.044539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.594122 (+549583us) service_pool.cc:224] Handling call
0709 13:07:18.104988 (+510866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:18.413720 23795 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.437913 23819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.010s	sys 0.026s
I20260709 13:07:18.350219 23663 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.105417 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 945) took 1551 ms. Trace:
I20260709 13:07:18.359079 23830 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.351294 23731 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.182914 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:18.216719 23831 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:18.546743 22504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.011s	sys 0.029s
W20260709 13:07:18.437444 23571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.007s	sys 0.029s
I20260709 13:07:18.185689 23749 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.438414 23796 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.330528 23809 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.529739 23683 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:18.500772 23614 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.457429 22645 rpcz_store.cc:276] 0709 13:07:17.047432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.055568 (+  8136us) service_pool.cc:224] Handling call
0709 13:07:18.015159 (+959591us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:07:18.078883 (+ 63724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7969536}
W20260709 13:07:18.551362 23571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.008s	sys 0.029s
I20260709 13:07:18.547091 23831 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.552158 23731 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:18.589026 22574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.006s	sys 0.015s
W20260709 13:07:18.589721 22574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.007s	sys 0.015s
W20260709 13:07:18.465451 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.172667 23787 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:18.490473 23781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.655s	user 0.015s	sys 0.032s
I20260709 13:07:18.151332 23662 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:18.490891 23440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.022s	sys 0.016s
W20260709 13:07:18.231914 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44481.1us
I20260709 13:07:18.537566 22499 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:18.522488 23819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.011s	sys 0.027s
W20260709 13:07:18.540941 23698 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.500s	user 0.012s	sys 0.000s
W20260709 13:07:18.542641 23627 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 13:07:18.533406 23730 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:18.500077 23631 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.350740 23702 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.513574 23795 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.352970 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 49) took 1294 ms. Trace:
W20260709 13:07:18.547652 22504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.011s	sys 0.030s
W20260709 13:07:18.609838 23781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.778s	user 0.015s	sys 0.032s
I20260709 13:07:18.583324 23831 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.589083 23569 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.530054 22571 rpcz_store.cc:276] 0709 13:07:16.553867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.979060 (+425193us) service_pool.cc:224] Handling call
0709 13:07:16.979562 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.057960 (+1078398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.105085 (+ 47125us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003ac5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:18.105338 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309506432}
W20260709 13:07:18.610241 23582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.014s	sys 0.021s
I20260709 13:07:18.565948 23683 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.615424 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:18.669523 22499 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:18.556818 23796 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.664685 23797 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:18.665886 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 967) took 1644 ms. Trace:
I20260709 13:07:18.620484 23830 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:18.634263 23662 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.650473 23730 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.618310 23440 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:18.677920 22500 rpcz_store.cc:276] 0709 13:07:17.021847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.219537 (+197690us) service_pool.cc:224] Handling call
0709 13:07:18.665643 (+1446106us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b540007ce54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:18.665821 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230882560}
I20260709 13:07:18.620263 23806 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.687142 23787 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.687207 23797 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.655659 23261 rpcz_store.cc:276] 0709 13:07:17.058107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.059801 (+  1694us) service_pool.cc:224] Handling call
0709 13:07:17.174752 (+114951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.070718 (+895966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.352606 (+281888us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540035d754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:18.352831 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945382784}
I20260709 13:07:18.691186 23795 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.693538 23683 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.639479 23698 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.695057 22578 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:18.662431 23582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.015s	sys 0.022s
I20260709 13:07:18.657470 23731 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:18.678625 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:18.735592 22543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.017s	sys 0.027s
W20260709 13:07:18.739866 22543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.017s	sys 0.027s
W20260709 13:07:18.740345 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 861712us
W20260709 13:07:18.732507 22647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.000s	sys 0.045s
W20260709 13:07:18.732585 23803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.020s	sys 0.020s
I20260709 13:07:18.730523 23702 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:18.738505 23820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.008s	sys 0.036s
W20260709 13:07:18.743347 22653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.010s	sys 0.019s
W20260709 13:07:18.779843 22653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.010s	sys 0.019s
W20260709 13:07:18.744905 22647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.001s	sys 0.045s
I20260709 13:07:18.736552 23780 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.741590 22501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.010s	sys 0.042s
W20260709 13:07:18.767002 23803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.021s	sys 0.020s
W20260709 13:07:18.793183 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.730809 23806 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.801769 23631 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.802211 23683 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.803457 23614 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.800734 23841 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.797384 23702 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:18.805581 23797 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.788686 23846 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:18.798327 22501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.011s	sys 0.043s
I20260709 13:07:18.813151 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:18.814296 23809 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:18.797188 23780 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.810331 23531 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.833015 23809 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:18.817310 23806 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.813308 23440 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:18.821405 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 975) took 1190 ms. Trace:
I20260709 13:07:18.834079 22498 rpcz_store.cc:276] 0709 13:07:17.631066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.631180 (+   114us) service_pool.cc:224] Handling call
0709 13:07:17.648398 (+ 17218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.648884 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.648929 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.657604 (+  8675us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.480741 (+823137us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.480798 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.480918 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.821169 (+340251us) raft_consensus.cc:1685] finished
0709 13:07:18.821192 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.821343 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":883,"raft.queue_time_us":103,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9316,"thread_start_us":762232,"threads_started":1,"wal-append.queue_time_us":1112301}
W20260709 13:07:18.821935 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 939) took 2530 ms (client timeout 2147 ms). Trace:
I20260709 13:07:18.823196 23827 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.823835 23831 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:18.745751 23835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.011s	sys 0.005s
W20260709 13:07:18.826153 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.831037 23698 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.741820 23731 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:18.836247 22578 rpcz_store.cc:269] 0709 13:07:16.291607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.357430 (+ 65823us) service_pool.cc:224] Handling call
0709 13:07:18.821689 (+2464259us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54003b3654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:18.821828 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4728311680}
W20260709 13:07:18.779258 23820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.008s	sys 0.037s
W20260709 13:07:18.841977 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.841930 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 21) took 1022 ms. Trace:
W20260709 13:07:18.439616 23606 ts_tablet_manager.cc:1469] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Trace:
0709 13:07:11.460629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.460818 (+   189us) service_pool.cc:224] Handling call
0709 13:07:11.695835 (+235017us) ts_tablet_manager.cc:934] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
0709 13:07:12.048887 (+353052us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:12.644693 (+595806us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:12.644817 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:12.859150 (+214333us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:12.859490 (+   340us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:12.859854 (+   364us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:12.859925 (+    71us) inbound_call.cc:177] Queueing success response
0709 13:07:16.166422 (+3306497us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:16.875281 (+708859us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:17.058604 (+183323us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:17.059272 (+   668us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":54169,"raft.queue_time_us":237583,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":12809,"tablet-copy.queue_time_us":180678,"tablet-download-pool.queue_time_us":1441,"tablet-download-pool.run_cpu_time_us":1522,"tablet-download-pool.run_wall_time_us":1459735,"thread_start_us":344234,"threads_started":3}
I20260709 13:07:18.847729 23831 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:18.843519 23787 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:18.843437 23835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.011s	sys 0.007s
I20260709 13:07:18.859189 23702 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:07:18.881775 23702 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:18.882831 23702 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:18.883693 23702 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:18.886509 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.004s	sys 0.016s
I20260709 13:07:18.870476 22543 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:18.892963 22503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.000s	sys 0.020s
I20260709 13:07:18.885176 23730 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:18.894901 22575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.021s	sys 0.039s
W20260709 13:07:18.893478 22505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.024s	sys 0.013s
W20260709 13:07:18.893214 23522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.003s	sys 0.039s
W20260709 13:07:18.886974 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.005s	sys 0.016s
I20260709 13:07:18.886824 23702 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.849454 22499 rpcz_store.cc:276] 0709 13:07:17.819633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.670487 (+850854us) service_pool.cc:224] Handling call
0709 13:07:18.840969 (+170482us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800003698. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:07:18.841289 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.841495 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.841530 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.841603 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.841644 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.841720 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.841858 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4128640}
W20260709 13:07:18.894621 22577 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.021s	sys 0.030s
I20260709 13:07:18.890074 23787 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:18.905012 22577 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.022s	sys 0.030s
W20260709 13:07:18.893688 22503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.001s	sys 0.021s
W20260709 13:07:18.903451 22505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.024s	sys 0.014s
W20260709 13:07:18.903584 23522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.004s	sys 0.040s
W20260709 13:07:18.902458 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.00698e+06us
W20260709 13:07:18.899343 22575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.021s	sys 0.039s
W20260709 13:07:18.930806 22649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.013s	sys 0.010s
I20260709 13:07:18.930663 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:18.931244 22649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.013s	sys 0.010s
I20260709 13:07:18.874151 23809 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:18.937485 23683 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:18.908209 23677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.015s	sys 0.010s
W20260709 13:07:18.945640 22496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.009s	sys 0.016s
W20260709 13:07:18.946173 22496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.009s	sys 0.017s
W20260709 13:07:18.909142 23825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.003s	sys 0.041s
W20260709 13:07:18.926465 23728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.001s	sys 0.020s
I20260709 13:07:18.908162 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-be7264d3053b44989c5504d296ea482b received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:18.909967 23796 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:18.909689 23787 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:18.988679 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.988986 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:18.989706 22654 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:18.911577 23821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.009s	sys 0.025s
I20260709 13:07:18.942485 22545 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:18.922053 23730 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:18.947854 23677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.015s	sys 0.010s
W20260709 13:07:18.926584 23828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.016s	sys 0.005s
W20260709 13:07:18.964053 22648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.028s
I20260709 13:07:18.954109 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 979) took 1322 ms. Trace:
W20260709 13:07:18.966600 23825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.003s	sys 0.044s
W20260709 13:07:18.972201 23728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.003s	sys 0.021s
I20260709 13:07:18.992178 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-be7264d3053b44989c5504d296ea482b on tablet be7264d3053b44989c5504d296ea482b with peer fa2f181263f446a6962b649f9348c15f
W20260709 13:07:18.988229 23808 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.005s
W20260709 13:07:19.027717 23828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.019s	sys 0.006s
W20260709 13:07:18.993691 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51312.7us
W20260709 13:07:18.997954 22502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.007s	sys 0.018s
W20260709 13:07:19.043000 22502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.008s	sys 0.018s
W20260709 13:07:19.002755 22651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.008s	sys 0.032s
I20260709 13:07:19.043320 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:18.988476 23731 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:07:18.997180 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.997133 23781 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:19.037420 22572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.170s	user 0.010s	sys 0.020s
W20260709 13:07:19.028566 22648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.008s	sys 0.029s
I20260709 13:07:18.994575 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 976) took 1363 ms. Trace:
W20260709 13:07:19.064937 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.007s	sys 0.026s
W20260709 13:07:19.028163 22652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.029s	sys 0.035s
W20260709 13:07:19.071552 22652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.029s	sys 0.035s
I20260709 13:07:19.074020 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 624) took 1131 ms. Trace:
W20260709 13:07:19.045773 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.992580 23821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.009s	sys 0.029s
W20260709 13:07:19.063179 22572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.010s	sys 0.023s
W20260709 13:07:19.043696 22651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.009s	sys 0.032s
I20260709 13:07:19.067936 22545 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.063982 22496 rpcz_store.cc:276] 0709 13:07:17.631332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.631444 (+   112us) service_pool.cc:224] Handling call
0709 13:07:17.631719 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.631920 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:17.647558 (+ 15638us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.047898 (+400340us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b18002ef000. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:07:18.994155 (+946257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.994231 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:18.994288 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.994374 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.994523 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11626,"prepare.queue_time_us":15262,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":30480,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":23635,"spinlock_wait_cycles":21415808,"thread_start_us":915325,"threads_started":1}
I20260709 13:07:19.038698 23809 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:19.076670 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.026s
I20260709 13:07:19.074782 22652 rpcz_store.cc:276] 0709 13:07:17.942764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.441521 (+498757us) service_pool.cc:224] Handling call
0709 13:07:18.441956 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.442217 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:18.491929 (+ 49712us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.073565 (+581636us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.073639 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.073697 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.073786 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.073953 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26079,"prepare.queue_time_us":57938,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":9964,"thread_start_us":579855,"threads_started":1}
I20260709 13:07:19.069103 23663 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:19.069314 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:07:19.091866 23849 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:07:19.046525 23808 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.130947 23543 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.132496 23808 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:19.135133 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 622) took 1193 ms. Trace:
I20260709 13:07:19.135571 22648 rpcz_store.cc:276] 0709 13:07:17.942142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.061425 (+119283us) service_pool.cc:224] Handling call
0709 13:07:18.061733 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.071564 (+  9831us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:18.399582 (+328018us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.080162 (+680580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.094297 (+ 14135us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.134861 (+ 40564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.134953 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.135075 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6966,"prepare.queue_time_us":276294,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":5803,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":14242,"thread_start_us":653366,"threads_started":1}
W20260709 13:07:19.137436 23847 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.615s	user 0.000s	sys 0.006s
I20260709 13:07:19.137643 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.138356 22648 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:19.101778 23723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.814s	user 0.024s	sys 0.031s
W20260709 13:07:19.140815 23723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.854s	user 0.025s	sys 0.031s
W20260709 13:07:19.041100 23843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.017s	sys 0.013s
W20260709 13:07:19.144932 23843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.017s	sys 0.013s
I20260709 13:07:19.069816 23804 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:19.145623 23804 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:19.146544 23804 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.065062 23730 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.149494 23804 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:19.149893 23861 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:19.150418 23730 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:19.152432 23857 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:07:19.127496 23728 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:19.153648 23728 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.154630 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.155956 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:19.127298 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 660186us
I20260709 13:07:19.140365 23781 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:19.159039 22648 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:19.159883 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 632) took 1212 ms. Trace:
I20260709 13:07:19.160513 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:19.160384 22650 rpcz_store.cc:276] 0709 13:07:17.947743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.803822 (+856079us) service_pool.cc:224] Handling call
0709 13:07:18.804116 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.865798 (+ 61682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.865844 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.865901 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:18.865946 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.159596 (+293650us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b5400412154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:07:19.159663 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.159810 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141289216}
I20260709 13:07:19.161881 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.162076 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.162969 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.161881 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.163019 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:19.170187 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 673) took 2395 ms. Trace:
I20260709 13:07:19.170491 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.171160 22650 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.171797 22652 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:19.172626 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 633) took 1214 ms. Trace:
I20260709 13:07:19.172950 22652 rpcz_store.cc:276] 0709 13:07:17.958635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.171101 (+1212466us) service_pool.cc:224] Handling call
0709 13:07:19.171571 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.172375 (+   804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.172575 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.174798 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 634) took 1211 ms. Trace:
I20260709 13:07:19.175186 22652 rpcz_store.cc:276] 0709 13:07:17.962934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.173841 (+1210907us) service_pool.cc:224] Handling call
0709 13:07:19.174181 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.174414 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.174451 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.174506 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.174549 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.174615 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.174738 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.160369 22617 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.170497 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:19.177207 23571 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.177626 23571 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:19.177660 22648 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:19.177917 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.178210 23571 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.180011 23410 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:19.180437 23410 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:19.181304 23410 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.183326 23410 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.186022 23802 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:19.186437 23571 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.176772 22652 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:19.193287 23846 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:19.193976 23846 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.194967 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.197307 22617 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.198020 23828 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:19.199479 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.205017 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.205543 22543 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:19.141542 23860 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:07:19.209337 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.170800 22653 rpcz_store.cc:276] 0709 13:07:16.774288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.630015 (+855727us) service_pool.cc:224] Handling call
0709 13:07:17.891832 (+261817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.892059 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:17.892341 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.780300 (+887959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.780356 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:18.780402 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.780484 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.169815 (+389331us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54002981d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:19.169984 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5108,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":12875,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":11615,"spinlock_wait_cycles":601242368,"thread_start_us":887621,"threads_started":1,"wal-append.queue_time_us":1143135}
I20260709 13:07:19.219069 23723 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:19.228816 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.229533 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.235037 23680 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:19.236466 23522 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:07:19.241699 23522 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:19.242236 23522 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:19.243028 23522 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.244151 23522 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.186456 22648 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:19.247522 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 961) took 2688 ms. Trace:
I20260709 13:07:19.027379 22505 rpcz_store.cc:276] 0709 13:07:17.632068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.946138 (+314070us) service_pool.cc:224] Handling call
0709 13:07:17.978820 (+ 32682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.002928 (+ 24108us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:18.068054 (+ 65126us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.928933 (+860879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.929016 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:18.929086 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.929191 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.945826 (+ 16635us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45312,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":171,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":838608,"threads_started":1}
I20260709 13:07:19.251713 23780 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:19.219497 23781 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.252686 23781 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:19.236195 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 139336us
W20260709 13:07:19.253971 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.000s	sys 0.037s
W20260709 13:07:19.254339 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.000s	sys 0.038s
I20260709 13:07:19.231001 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:19.247963 22575 rpcz_store.cc:276] 0709 13:07:16.559074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.837768 (+1278694us) service_pool.cc:224] Handling call
0709 13:07:17.838143 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.841560 (+  3417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.841614 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.842257 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.964499 (+1122242us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.966980 (+  2481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.992662 (+ 25682us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.245949 (+253287us) raft_consensus.cc:1685] finished
0709 13:07:19.247283 (+  1334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.247456 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2973,"raft.queue_time_us":4515,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":73504,"thread_start_us":1091074,"threads_started":1,"wal-append.queue_time_us":1396200}
I20260709 13:07:19.252756 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 981) took 1620 ms. Trace:
I20260709 13:07:19.256590 22503 rpcz_store.cc:276] 0709 13:07:17.632443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.044149 (+411706us) service_pool.cc:224] Handling call
0709 13:07:18.044564 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.045164 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.045219 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.075142 (+ 29923us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b2c000014c8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:07:18.075551 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.909170 (+833619us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.909210 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.909284 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.252402 (+343118us) raft_consensus.cc:1685] finished
0709 13:07:19.252430 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.252685 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1019,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"spinlock_wait_cycles":7612672,"thread_start_us":833143,"threads_started":1,"wal-append.queue_time_us":1175060}
I20260709 13:07:19.254820 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:19.233647 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.188766 23571 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:19.260113 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.267779 22545 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.269958 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.261160 22617 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.262123 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:19.271294 22653 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:19.263202 22543 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:19.274343 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.276777 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:19.280048 22650 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:19.284227 23730 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.284790 23723 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.233512 23543 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:19.286468 22543 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:19.286463 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:07:19.287865 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.284672 23831 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:19.289518 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 973) took 1473 ms. Trace:
I20260709 13:07:19.307909 22574 rpcz_store.cc:276] 0709 13:07:17.833625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.879575 (+ 45950us) service_pool.cc:224] Handling call
0709 13:07:17.879859 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.880211 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.880241 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.880739 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.032195 (+151456us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b4800002dd8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:07:18.590237 (+558042us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.590297 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.590405 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.286037 (+695632us) raft_consensus.cc:1685] finished
0709 13:07:19.286058 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.289434 (+  3376us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4095,"raft.run_cpu_time_us":3064,"raft.run_wall_time_us":148046,"spinlock_wait_cycles":123908864,"thread_start_us":706588,"threads_started":1,"wal-append.queue_time_us":1064445}
W20260709 13:07:19.272759 22646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.026s	sys 0.049s
I20260709 13:07:19.285411 23780 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.266665 23662 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:19.306306 22620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.000s	sys 0.044s
W20260709 13:07:19.326032 22620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.000s	sys 0.045s
I20260709 13:07:19.229979 23787 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:19.302436 23865 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
W20260709 13:07:19.338541 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.285976 23571 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.272986 23872 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:19.290668 23636 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.290478 23835 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.373857 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:19.329449 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52726.1us
W20260709 13:07:19.309598 23854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.040s	sys 0.045s
W20260709 13:07:19.333459 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45102.2us
I20260709 13:07:19.289081 23859 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.313271 23702 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:19.368432 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.339233 22645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.029s	sys 0.031s
I20260709 13:07:19.318212 23723 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:19.314404 22646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.027s	sys 0.049s
I20260709 13:07:19.333076 23868 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:19.324337 23728 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:19.382150 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:19.383401 22504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.018s	sys 0.030s
W20260709 13:07:19.418874 22504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.018s	sys 0.030s
I20260709 13:07:19.419914 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 974) took 1789 ms. Trace:
I20260709 13:07:19.303146 23781 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.381913 22654 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:19.381963 22617 leader_election.cc:400] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:19.426139 22617 leader_election.cc:403] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.306951 23730 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:19.396782 23882 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:19.379094 23854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.040s	sys 0.045s
I20260709 13:07:19.408187 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.438405 23723 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.439150 23871 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:19.439659 23871 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.418376 23543 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.440026 23871 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.440361 23543 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.418164 23868 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:19.379372 23662 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:19.433179 23680 raft_consensus.cc:2764] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:19.354342 23848 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:07:19.358209 22497 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.020s	sys 0.016s
W20260709 13:07:19.359156 23771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.026s	sys 0.010s
I20260709 13:07:19.420640 22504 rpcz_store.cc:276] 0709 13:07:17.630757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.630904 (+   147us) service_pool.cc:224] Handling call
0709 13:07:17.656176 (+ 25272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.656435 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:17.687157 (+ 30722us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.419425 (+1732268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.419503 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.419563 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.419652 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.419822 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32565,"prepare.run_cpu_time_us":8443,"prepare.run_wall_time_us":123069,"raft.queue_time_us":84756,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4606,"thread_start_us":1731816,"threads_started":2,"wal-append.queue_time_us":1204647}
I20260709 13:07:19.379915 23636 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:19.380455 23571 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:19.435937 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.433053 23728 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.437673 23866 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:19.393744 23702 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:19.409970 23864 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.338s	user 0.001s	sys 0.001s
W20260709 13:07:19.444414 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62606us
W20260709 13:07:19.375617 23440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.021s
I20260709 13:07:19.409452 23780 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.441987 23868 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.446358 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 978) took 1814 ms. Trace:
W20260709 13:07:19.455286 22498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.017s	sys 0.025s
W20260709 13:07:19.395300 22645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.029s	sys 0.032s
I20260709 13:07:19.388842 23677 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:07:19.458833 22577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.028s	sys 0.043s
W20260709 13:07:19.515420 22577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.028s	sys 0.043s
W20260709 13:07:19.515059 22498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.017s	sys 0.025s
I20260709 13:07:19.516321 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 959) took 2957 ms. Trace:
W20260709 13:07:19.451845 22497 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.020s	sys 0.016s
I20260709 13:07:19.389245 23843 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 13:07:19.484812 22499 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.012s	sys 0.010s
W20260709 13:07:19.524039 22499 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.012s	sys 0.010s
W20260709 13:07:19.485229 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.033s	sys 0.025s
W20260709 13:07:19.524973 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.033s	sys 0.025s
W20260709 13:07:19.488101 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.506035 23440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.009s	sys 0.021s
I20260709 13:07:19.451577 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 627) took 1507 ms. Trace:
I20260709 13:07:19.455593 23831 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.457134 23570 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.515084 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:19.444123 23662 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.449445 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:19.457378 23771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.026s	sys 0.012s
I20260709 13:07:19.500586 23808 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:19.534374 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 964) took 2974 ms. Trace:
I20260709 13:07:19.583117 23808 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:19.583206 22572 rpcz_store.cc:276] 0709 13:07:16.560040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.839559 (+1279519us) service_pool.cc:224] Handling call
0709 13:07:17.839908 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.840151 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:19.094819 (+1254668us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.533881 (+439062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.533959 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.534020 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.534116 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.534283 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27113,"prepare.queue_time_us":1409756,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":14092,"thread_start_us":1665650,"threads_started":2}
I20260709 13:07:19.455652 23848 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:19.585681 23752 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:19.586941 23848 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:07:19.537194 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.537946 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.501483 23702 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:19.564293 23881 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 13:07:19.589387 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.565241 23879 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:19.590958 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 675) took 2764 ms. Trace:
I20260709 13:07:19.591320 22649 rpcz_store.cc:276] 0709 13:07:16.826969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.894363 (+1067394us) service_pool.cc:224] Handling call
0709 13:07:17.894770 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.957310 (+ 62540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.957387 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.962633 (+  5246us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.931748 (+969115us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.931806 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.931900 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.590752 (+658852us) raft_consensus.cc:1685] finished
0709 13:07:19.590771 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.590903 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53935,"raft.queue_time_us":99373,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":25472,"thread_start_us":936877,"threads_started":1,"wal-append.queue_time_us":1419379}
I20260709 13:07:19.569972 23662 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:19.578343 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 135397us
I20260709 13:07:19.547833 22646 rpcz_store.cc:276] 0709 13:07:17.943683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.504274 (+560591us) service_pool.cc:224] Handling call
0709 13:07:18.512347 (+  8073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.512597 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:18.539814 (+ 27217us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.446492 (+906678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.448707 (+  2215us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.451312 (+  2605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.451392 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.451516 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33057,"prepare.queue_time_us":27369,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":21025,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6624,"thread_start_us":868802,"threads_started":1,"wal-append.queue_time_us":951791}
I20260709 13:07:19.584241 23808 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:19.598526 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:19.607853 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 129011us
W20260709 13:07:19.610654 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.616722 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80744.8us
I20260709 13:07:19.610443 22504 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
W20260709 13:07:19.605823 23878 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:07:19.625670 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.558468 23868 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.498275 23728 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:19.518453 23780 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.632797 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:19.668321 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:19.688637 22503 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:19.695396 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:19.604600 23887 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.113s
W20260709 13:07:19.704306 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 417919us
I20260709 13:07:19.705907 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:07:19.706364 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 419943us
I20260709 13:07:19.710101 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.712528 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:19.714110 22503 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.666599 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 679) took 2749 ms. Trace:
I20260709 13:07:19.615777 23636 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.718607 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:19.720057 23859 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:19.720489 23859 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:19.720885 23859 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.717087 22647 rpcz_store.cc:276] 0709 13:07:16.910786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.903099 (+992313us) service_pool.cc:224] Handling call
0709 13:07:17.903412 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.903641 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.903668 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.904125 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.800989 (+896864us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.805994 (+  5005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.806084 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.623921 (+817837us) raft_consensus.cc:1685] finished
0709 13:07:19.623948 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.659659 (+ 35711us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":884881,"threads_started":1,"wal-append.queue_time_us":1115658}
I20260709 13:07:19.725906 23410 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.667053 23828 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:19.726888 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:19.710100 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:19.737244 23410 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:19.737706 23410 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:19.737746 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:19.738188 23410 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.740692 22545 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:19.708026 23876 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:07:19.747560 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:19.692828 23440 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.776261 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.724665 23809 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.000s
I20260709 13:07:19.699405 23808 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.700970 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 628) took 1747 ms. Trace:
I20260709 13:07:19.707726 23261 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Advancing to term 4
I20260709 13:07:19.747018 23683 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:19.847781 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.848274 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.772583 23863 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.630074 23571 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:19.844744 23522 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.600s	user 0.014s	sys 0.000s
I20260709 13:07:19.838486 23440 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.514657 22501 rpcz_store.cc:276] 0709 13:07:17.631837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.898964 (+267127us) service_pool.cc:224] Handling call
0709 13:07:17.899352 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.899610 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.899642 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.900133 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.844136 (+944003us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.856577 (+ 12441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.858856 (+  2279us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.273145 (+414289us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:07:19.442544 (+169399us) raft_consensus.cc:1685] finished
0709 13:07:19.442567 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.446285 (+  3718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15896448,"thread_start_us":932384,"threads_started":1,"wal-append.queue_time_us":1158105}
I20260709 13:07:19.857299 23522 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.858001 23702 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.858345 23440 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:19.860227 23702 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:19.861066 23570 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:19.861976 23702 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.862462 23702 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:19.862828 23846 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.003s
I20260709 13:07:19.863195 23846 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.863334 23702 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.864913 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 984) took 1826 ms. Trace:
I20260709 13:07:19.865329 22500 rpcz_store.cc:276] 0709 13:07:18.038879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.725331 (+686452us) service_pool.cc:224] Handling call
0709 13:07:18.725766 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.726252 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.726293 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.726970 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.525418 (+798448us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:19.525468 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.525552 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.864659 (+339107us) raft_consensus.cc:1685] finished
0709 13:07:19.864681 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.864817 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31675,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9859,"thread_start_us":783964,"threads_started":1,"wal-append.queue_time_us":1115458}
I20260709 13:07:19.866664 22649 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:19.867563 22500 pending_rounds.cc:85] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:19.867982 22500 pending_rounds.cc:107] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:19.868263 22500 raft_consensus.cc:2889] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.869105 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 982) took 2236 ms. Trace:
I20260709 13:07:19.869639 22502 rpcz_store.cc:276] 0709 13:07:17.632589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.048581 (+415992us) service_pool.cc:224] Handling call
0709 13:07:18.064542 (+ 15961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.068245 (+  3703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.068275 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.072382 (+  4107us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.043390 (+971008us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:19.043434 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.043504 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.864385 (+820881us) raft_consensus.cc:1685] finished
0709 13:07:19.864408 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.869025 (+  4617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3321,"raft.queue_time_us":5160,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6823,"thread_start_us":951637,"threads_started":1,"wal-append.queue_time_us":1357951}
I20260709 13:07:19.873462 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:19.837809 23890 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.876991 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 378247us
I20260709 13:07:19.877059 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:07:19.878921 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.867624 23893 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:07:19.854290 23809 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.884217 23440 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.876508 23863 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:19.949559 22503 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:19.953132 23410 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.897152 23843 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:19.973199 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.946126 23781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.001s	sys 0.020s
W20260709 13:07:19.946301 23787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.001s	sys 0.021s
W20260709 13:07:19.983165 23870 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:07:19.984637 23895 log.cc:927] Time spent T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:07:19.984513 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 677) took 3124 ms. Trace:
I20260709 13:07:19.985196 22651 rpcz_store.cc:276] 0709 13:07:16.859902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.894962 (+1035060us) service_pool.cc:224] Handling call
0709 13:07:17.895252 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.955462 (+ 60210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.955489 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.962372 (+  6883us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.092899 (+1130527us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:19.092970 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.093152 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.984197 (+891045us) raft_consensus.cc:1685] finished
0709 13:07:19.984227 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.984442 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53692,"raft.queue_time_us":99336,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"thread_start_us":1085182,"threads_started":1,"wal-append.queue_time_us":1711895}
W20260709 13:07:19.996551 23802 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.000s
I20260709 13:07:19.917434 23848 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:07:19.997524 23846 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:20.002724 23871 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.003s
I20260709 13:07:20.002157 23863 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.907946 23821 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:07:19.908318 23890 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.979717 23410 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:20.015398 23899 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:07:19.979022 23787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.001s	sys 0.021s
W20260709 13:07:19.979147 23781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.002s	sys 0.022s
I20260709 13:07:19.976819 23662 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.011030 23804 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.033149 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 284067us
I20260709 13:07:20.023834 23780 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.020979 23871 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:19.516678 22577 rpcz_store.cc:276] 0709 13:07:16.558527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.694692 (+1136165us) service_pool.cc:224] Handling call
0709 13:07:17.830250 (+135558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.830663 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:18.907241 (+1076578us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.515938 (+608697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.516013 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.516061 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.516134 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.516267 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1418954,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":85,"thread_start_us":1644733,"threads_started":2}
W20260709 13:07:20.055441 22496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.008s	sys 0.033s
I20260709 13:07:20.081828 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 992) took 1595 ms. Trace:
I20260709 13:07:20.082482 22496 rpcz_store.cc:276] 0709 13:07:18.486199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.095930 (+609731us) service_pool.cc:224] Handling call
0709 13:07:19.096350 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.096608 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:19.553983 (+457375us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.081267 (+527284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.081359 (+    92us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:20.081424 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.081546 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.081737 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24294,"prepare.queue_time_us":748034,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":40,"thread_start_us":894656,"threads_started":2}
I20260709 13:07:20.088213 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.089140 22572 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.090444 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.091254 22574 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.093264 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 989) took 2000 ms. Trace:
I20260709 13:07:20.093875 22498 rpcz_store.cc:276] 0709 13:07:18.092637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.850160 (+757523us) service_pool.cc:224] Handling call
0709 13:07:18.857943 (+  7783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.859026 (+  1083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.859081 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.859629 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.516084 (+656455us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:19.516126 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.516196 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.092923 (+576727us) raft_consensus.cc:1685] finished
0709 13:07:20.092957 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.093179 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4938,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1171,"thread_start_us":656108,"threads_started":1,"wal-append.queue_time_us":874977}
I20260709 13:07:20.105721 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.106557 22574 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.107268 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.111478 22572 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.110071 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.112501 22577 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:20.112591 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.110654 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.113875 22572 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.113911 22580 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.115468 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.115532 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:20.118803 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 183460us
I20260709 13:07:20.116652 22572 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.035948 23804 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.128248 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:20.056710 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 351689us
I20260709 13:07:20.125247 22619 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:20.126297 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.129374 22573 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.127028 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.126379 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:20.127271 22498 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:20.130635 22498 pending_rounds.cc:85] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
W20260709 13:07:20.130745 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.130975 22498 pending_rounds.cc:107] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:20.131345 22498 raft_consensus.cc:2889] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.130654 22578 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.126190 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.133306 22576 raft_consensus.cc:2410] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:20.109664 23723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.008s	sys 0.016s
W20260709 13:07:20.135355 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 387827us
I20260709 13:07:20.137130 22579 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:20.139228 22496 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:20.141570 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.142138 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.141590 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.143733 22503 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:20.143832 22498 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:20.144748 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.142586 22579 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.110954 23728 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:20.137789 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.152287 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.156751 22652 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.155555 23410 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.157732 23410 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:20.161369 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.161128 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.162528 22503 raft_consensus.cc:2410] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:20.136773 23723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.017s
I20260709 13:07:20.164546 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.166250 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.140200 23835 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:20.180842 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.182279 22503 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:20.170826 23410 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.167981 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:20.183640 22651 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.173416 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 991) took 1687 ms. Trace:
I20260709 13:07:20.138155 23261 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:20.146891 23846 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.185088 22499 rpcz_store.cc:276] 0709 13:07:18.485700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.903630 (+417930us) service_pool.cc:224] Handling call
0709 13:07:18.904108 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.904358 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:19.524442 (+620084us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.173107 (+648665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.173156 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:20.173196 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.173262 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.173366 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":940076,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":91880,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1500,"thread_start_us":1262396,"threads_started":3,"wal-append.queue_time_us":580016}
I20260709 13:07:20.186093 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.191300 22579 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.191996 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.192802 22649 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:20.198545 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.199330 22499 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.204759 22503 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:20.204979 22579 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:20.205189 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.163811 23683 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:20.210029 22499 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:20.213913 22653 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:20.215143 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.215950 22503 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.190459 23261 pending_rounds.cc:85] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 2
I20260709 13:07:20.164601 23802 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:07:20.236047 22651 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:20.239194 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:20.239603 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.244652 22499 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.247650 22503 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:20.237035 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:20.241611 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 130844us
I20260709 13:07:20.196390 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:20.249291 22579 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.251495 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.251616 23677 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:20.259227 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.236548 23261 pending_rounds.cc:107] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:20.256825 22499 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
W20260709 13:07:20.257380 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.005s (SENT) [suppressed 41 similar messages]
W20260709 13:07:20.257851 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 84418.3us
I20260709 13:07:19.838047 22645 rpcz_store.cc:276] 0709 13:07:17.943964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.587743 (+643779us) service_pool.cc:224] Handling call
0709 13:07:18.642677 (+ 54934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.678310 (+ 35633us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:18.739381 (+ 61071us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.804400 (+ 65019us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b18002f2d80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:07:19.618954 (+814554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.627575 (+  8621us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.632940 (+  5365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.660345 (+ 27405us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.691079 (+ 30734us) inbound_call.cc:177] Queueing success response
0709 13:07:19.848458 (+157379us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
Metrics: {"mutex_wait_us":90938,"prepare.queue_time_us":26570,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":111236,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":29215,"spinlock_wait_cycles":52459648,"thread_start_us":737971,"threads_started":1,"wal-append.queue_time_us":881221}
I20260709 13:07:20.201047 23828 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:07:20.275218 22499 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:20.275450 22617 leader_election.cc:400] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:20.211961 23835 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:20.275784 22617 leader_election.cc:403] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.277261 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:20.283478 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:20.285125 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.284425 22579 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.294502 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.230894 23683 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.265398 23261 raft_consensus.cc:2889] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.305845 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.360540 22579 raft_consensus.cc:2410] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:20.315330 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.322340 22502 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:07:20.326197 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.330829 23804 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.333447 23871 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:20.346508 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.383421 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.350457 23888 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:07:20.353247 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.384300 22499 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:20.355103 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 65715.9us
I20260709 13:07:20.282277 23571 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:20.278065 23662 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.385528 22617 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:20.390511 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.394016 22572 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:20.395931 22576 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:20.356999 23859 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
W20260709 13:07:20.406829 22468 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.504s (SENT)
W20260709 13:07:20.407706 22468 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.504s (SENT)
I20260709 13:07:20.283964 23820 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:07:20.304088 23890 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.408213 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:20.396250 23921 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:20.435700 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.460561 22573 raft_consensus.cc:2410] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:20.440550 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.435992 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.461948 22579 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:20.462623 22572 raft_consensus.cc:2410] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:20.462908 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.394266 23888 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:20.401453 23731 raft_consensus.cc:2764] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:20.444006 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.474761 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.475113 22574 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:20.446440 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.459106 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:20.476378 22580 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.476270 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:20.441781 22468 leader_election.cc:336] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.550s (SENT)
I20260709 13:07:20.477569 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:20.477685 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:20.478785 22468 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.570s (SENT)
I20260709 13:07:20.478897 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.479256 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:20.479533 22572 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:20.463835 22579 raft_consensus.cc:2368] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
W20260709 13:07:20.427249 23908 log.cc:927] Time spent T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 13:07:20.418326 23904 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:07:20.481499 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.482482 22580 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.482796 22543 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:20.483675 23410 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:20.483500 22468 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.655s (SENT)
I20260709 13:07:20.484447 23410 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.484809 23410 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.483258 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.486120 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.486229 22580 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.487006 22579 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.488338 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.490218 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.415455 23543 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.491966 22579 raft_consensus.cc:2410] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:20.463254 23906 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:07:20.494414 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.503118 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.494621 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.497548 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.511358 22652 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.505383 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.463315 23890 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.510545 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.506135 22580 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:20.513810 22579 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.515990 22649 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:20.516644 22650 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.459928 23921 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:20.433589 23919 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:07:20.546581 22580 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:20.542795 22572 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:20.595263 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.595940 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.596779 22572 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.597698 22580 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:07:20.491448 23911 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 13:07:20.498857 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.013s	sys 0.013s
I20260709 13:07:20.416247 23859 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.473953 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:20.556874 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.577759 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 80925.5us
I20260709 13:07:20.498103 23804 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:20.481377 23522 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.463794 23440 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:20.515252 23663 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:07:20.603367 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:20.603672 23929 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:20.505107 23926 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.604148 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:20.604606 23915 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 13:07:20.456460 23902 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:07:20.491360 23835 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.606305 23921 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.509613 23903 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:20.610893 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.611578 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.632009 22499 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
W20260709 13:07:20.618168 23924 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:07:20.625721 23831 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.061s	user 0.013s	sys 0.001s
W20260709 13:07:20.625874 23868 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.987s	user 0.014s	sys 0.000s
W20260709 13:07:20.608825 23808 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.770s	user 0.005s	sys 0.006s
W20260709 13:07:20.649031 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.652802 22574 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.601538 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:20.653894 22468 leader_election.cc:336] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.693s (SENT)
W20260709 13:07:20.647656 23922 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.417s	user 0.001s	sys 0.001s
I20260709 13:07:20.665395 23410 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.669584 22572 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:20.677569 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.678575 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:20.643513 22505 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.700299 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.701529 22499 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:20.703685 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.704654 22572 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.706406 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.689178 22468 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:20.693975 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.722026 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.722793 22572 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:20.648324 23702 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.717654 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.722956 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69096.7us
I20260709 13:07:20.687726 23917 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:20.726447 23808 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.727509 23683 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.729146 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 1002) took 1262 ms. Trace:
I20260709 13:07:20.729833 23410 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.739791 22500 rpcz_store.cc:276] 0709 13:07:19.467050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.867015 (+399965us) service_pool.cc:224] Handling call
0709 13:07:19.867377 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.875008 (+  7631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.875060 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.875658 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.138138 (+262480us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:20.138187 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.138289 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.728949 (+590660us) raft_consensus.cc:1685] finished
0709 13:07:20.728972 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.729097 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":202943,"threads_started":1,"wal-append.queue_time_us":350536}
I20260709 13:07:20.687206 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 985) took 2631 ms. Trace:
I20260709 13:07:20.730783 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.728562 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.743160 22572 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:20.732272 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.690832 23903 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:20.649760 23522 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.696079 23831 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:20.743956 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:20.732367 22468 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.701s (SENT)
I20260709 13:07:20.682950 23934 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:07:20.751601 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.752640 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.783908 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.784337 22500 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.729934 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:20.756174 23927 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.148s	user 0.000s	sys 0.003s
I20260709 13:07:20.757587 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.651604 23888 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.759917 23843 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:20.749797 22497 rpcz_store.cc:276] 0709 13:07:18.049314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.806760 (+757446us) service_pool.cc:224] Handling call
0709 13:07:18.807101 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.807336 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:19.519706 (+712370us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.641127 (+1121421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.644329 (+  3202us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:20.653458 (+  9129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.661728 (+  8270us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.680396 (+ 18668us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1019322,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":70836,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":11449,"thread_start_us":1808440,"threads_started":3,"wal-append.queue_time_us":614229}
I20260709 13:07:20.733507 23917 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:20.781505 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:20.803253 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70928.3us
W20260709 13:07:20.803936 22468 leader_election.cc:336] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.719s (SENT)
I20260709 13:07:20.804316 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:20.782248 22572 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.718025 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.785482 22401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 30) took 5270 ms. Trace:
I20260709 13:07:20.805579 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.806187 22572 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:20.807108 22572 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:20.807915 22572 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:20.787259 22573 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:20.790613 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.799655 22500 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:20.809432 22579 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:20.815138 22468 leader_election.cc:336] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.721s (SENT)
I20260709 13:07:20.815608 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:20.816742 22468 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.733s (SENT)
I20260709 13:07:20.817305 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:20.818182 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.820016 22504 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:20.821414 22501 raft_consensus.cc:2410] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:20.821854 23926 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:20.821297 23923 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.823051 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.824381 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.804531 23843 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:20.827461 23843 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:20.744434 23702 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:20.766033 23440 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.805231 22401 rpcz_store.cc:276] 0709 13:07:15.525137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.531951 (+  6814us) service_pool.cc:224] Handling call
0709 13:07:20.779941 (+5247990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:17.544932 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:17.605646 (+ 60714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:17.605684 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:17.605706 (+    22us) tablet.cc:662] Decoding operations
0709 13:07:17.606060 (+   354us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:17.606128 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:17.606158 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:17.657688 (+ 51530us) tablet.cc:701] Row locks acquired
0709 13:07:17.657736 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:07:17.691591 (+ 33855us) write_op.cc:270] Start()
0709 13:07:17.703851 (+ 12260us) write_op.cc:276] Timestamp: P: 1783602437685765 usec, L: 0
0709 13:07:17.730799 (+ 26948us) op_driver.cc:348] REPLICATION: starting
0709 13:07:17.826948 (+ 96149us) log.cc:844] Serialized 602 byte log entry
0709 13:07:19.624959 (+1798011us) op_driver.cc:464] REPLICATION: finished
0709 13:07:20.500845 (+875886us) write_op.cc:301] APPLY: starting
0709 13:07:20.517025 (+ 16180us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:20.590102 (+ 73077us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:20.647267 (+ 57165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:20.660837 (+ 13570us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:20.692833 (+ 31996us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:20.700843 (+  8010us) write_op.cc:312] APPLY: finished
0709 13:07:20.737867 (+ 37024us) log.cc:844] Serialized 22 byte log entry
0709 13:07:20.760772 (+ 22905us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.760890 (+   118us) write_op.cc:454] Released schema lock
0709 13:07:20.760935 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:20.761286 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:20.761337 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":829774,"apply.run_cpu_time_us":2790,"apply.run_wall_time_us":285255,"num_ops":1,"prepare.queue_time_us":423195,"prepare.run_cpu_time_us":42165,"prepare.run_wall_time_us":1129228,"raft.queue_time_us":814472,"raft.run_cpu_time_us":16164,"raft.run_wall_time_us":514474,"replication_time_us":1745206,"spinlock_wait_cycles":21958528,"thread_start_us":2070783,"threads_started":4,"wal-append.queue_time_us":867723,"wal-append.run_wall_time_us":1763662}]]}
I20260709 13:07:20.874594 22577 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:20.878572 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61858.2us
I20260709 13:07:20.882196 22572 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:20.829280 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:20.882798 22572 pending_rounds.cc:85] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 2
I20260709 13:07:20.883092 22572 pending_rounds.cc:107] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:20.883322 22572 raft_consensus.cc:2889] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.883421 23262 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 3: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:07:20.884639 23522 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.871685 23903 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.887076 23702 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.856850 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.889497 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.891505 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:20.810969 23728 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.818485 23888 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:20.895092 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.895977 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.896761 22504 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.817885 23863 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.897332 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.897478 23863 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.898093 22580 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 2: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.899019 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.899657 22580 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:20.899883 23863 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:20.879060 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.901129 22468 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.799s (SENT)
I20260709 13:07:20.901561 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:20.902724 22468 leader_election.cc:336] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.802s (SENT)
I20260709 13:07:20.903108 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:20.912467 22468 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.804s (SENT)
W20260709 13:07:20.913978 22468 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.877s (SENT)
I20260709 13:07:20.875085 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:20.921850 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:20.918674 22504 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
W20260709 13:07:20.918741 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.880049 23926 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:20.905433 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.936249 22504 pending_rounds.cc:85] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:20.941242 22654 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 3. Ops: []
I20260709 13:07:20.911243 23808 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:20.904760 23859 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:20.909328 23923 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:20.944029 22504 pending_rounds.cc:107] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:20.947063 22504 raft_consensus.cc:2889] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.921334 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:20.963519 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:20.964648 22654 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:07:20.971442 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.876502 23917 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:20.998888 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:20.969035 23859 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.994668 23863 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.007915 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.008652 22654 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.009099 22649 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:21.010119 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:21.010389 23949 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:21.012470 22649 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:21.002058 23917 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:21.024160 23951 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:21.005847 23859 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.026947 23859 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.012781 23863 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.034340 23863 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:21.039836 23910 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.454s	user 0.000s	sys 0.002s
I20260709 13:07:21.069306 22497 pending_rounds.cc:85] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
W20260709 13:07:21.069888 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 132334us
I20260709 13:07:21.070293 22497 pending_rounds.cc:107] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:21.070924 22497 raft_consensus.cc:2889] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:21.071338 22468 leader_election.cc:336] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.042s (SENT)
I20260709 13:07:21.072124 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:21.074892 22468 leader_election.cc:336] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.091s (SENT)
I20260709 13:07:21.076990 22505 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:21.077849 22468 leader_election.cc:336] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.112s (SENT)
I20260709 13:07:21.078523 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:21.081923 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:21.082252 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:21.082660 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.083614 22498 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:21.083868 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:21.084792 22502 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.085706 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.081898 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:21.090039 22496 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.090411 22501 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:21.113799 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.121302 23728 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.122759 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.123785 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.124396 23808 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:21.124996 22649 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:21.125792 23808 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.126555 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.127511 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.128281 22649 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:21.128572 22571 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:07:21.129736 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.124213 22654 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:21.129917 23888 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:21.129920 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:21.171497 22468 leader_election.cc:336] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.925s (SENT)
I20260709 13:07:21.130213 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.192677 23808 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.257414 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.185400 22649 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.301949 22468 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:21.171507 22571 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.306037 22496 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:21.174611 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.180698 23923 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:21.313511 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.314646 22645 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
W20260709 13:07:21.317483 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.193084 23888 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.322037 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.323705 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.324283 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:21.320501 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.191874 23886 raft_consensus.cc:1027] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: attempt to promote peer fa2f181263f446a6962b649f9348c15f: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:21.256613 23926 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.330207 22503 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.328588 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:21.351240 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.330273 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 636) took 1125 ms. Trace:
I20260709 13:07:21.355427 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.356321 22502 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:21.346189 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.357676 22654 raft_consensus.cc:2410] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:21.363008 22572 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
W20260709 13:07:21.367863 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.369099 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.370309 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.371004 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.371315 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.372125 22572 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.372397 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:21.373275 22647 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.373284 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.376843 22572 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:21.358565 23808 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.378690 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:21.373606 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 202215us
I20260709 13:07:21.361979 23888 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:21.353699 22576 rpcz_store.cc:276] 0709 13:07:20.204810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.204944 (+   134us) service_pool.cc:224] Handling call
0709 13:07:21.329751 (+1124807us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540027abd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:21.330051 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436147456}
I20260709 13:07:21.371332 22648 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.390069 22645 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:21.398176 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.400334 23926 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.402050 23787 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:21.402969 23787 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.400683 22575 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:21.411147 22496 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:21.412004 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.410468 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.413048 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.433290 22573 raft_consensus.cc:2410] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:21.435395 23926 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:21.437394 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.438390 22468 leader_election.cc:336] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.181s (SENT)
I20260709 13:07:21.450263 22654 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.452395 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.454674 22575 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.454695 23888 raft_consensus.cc:1027] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: attempt to promote peer fa2f181263f446a6962b649f9348c15f: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:21.460206 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.461155 22580 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:07:21.440542 22468 leader_election.cc:336] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.186s (SENT)
I20260709 13:07:21.463883 22571 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.465075 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:21.469496 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.484766 23940 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:21.492677 22578 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:21.493014 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 644) took 1014 ms. Trace:
I20260709 13:07:21.494729 22574 rpcz_store.cc:276] 0709 13:07:20.472506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.475975 (+  3469us) service_pool.cc:224] Handling call
0709 13:07:21.486686 (+1010711us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003cbed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:21.486934 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403743104}
I20260709 13:07:21.493320 22573 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:21.499006 23828 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:21.500072 23828 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.503863 23828 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:21.505173 23543 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:21.506227 23543 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.512663 22571 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 1. Current term is 3. Ops: []
I20260709 13:07:21.509459 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:21.498476 23787 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.523746 23543 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:21.536216 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.538916 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 98527.4us
W20260709 13:07:21.535220 23907 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.014s	sys 0.014s
W20260709 13:07:21.540285 23907 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.014s	sys 0.014s
I20260709 13:07:21.546257 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:21.546958 22468 leader_election.cc:336] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.701s (SENT)
I20260709 13:07:21.547223 22502 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
W20260709 13:07:21.547966 22468 leader_election.cc:336] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.701s (SENT)
I20260709 13:07:21.548506 22468 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:21.549278 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.549388 22503 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:21.552256 23543 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.554731 22503 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:07:21.555537 23942 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.806s	user 0.001s	sys 0.001s
I20260709 13:07:21.556525 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.557176 23730 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.542275 23828 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:21.559684 23969 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:07:21.561059 23921 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:21.571568 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 996) took 1021 ms. Trace:
I20260709 13:07:21.572121 22579 rpcz_store.cc:276] 0709 13:07:20.550412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.809980 (+259568us) service_pool.cc:224] Handling call
0709 13:07:20.812343 (+  2363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.815994 (+  3651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.816020 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.858547 (+ 42527us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.570117 (+711570us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5400358f20. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec262726b8 00007fec262fb92b 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c
0709 13:07:21.570207 (+    90us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:21.570592 (+   385us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.570858 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.570966 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.571009 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:21.571121 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.571365 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3139,"prepare.queue_time_us":2786,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":9440,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":820,"spinlock_wait_cycles":23062912,"thread_start_us":426358,"threads_started":1,"wal-append.queue_time_us":269308}
I20260709 13:07:21.585559 22497 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:21.587452 23680 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.588490 23680 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.591804 23680 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:21.593833 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:21.594563 22499 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.598281 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:21.604561 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.565388 23828 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.605695 23835 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:21.606048 23828 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.601059 23843 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.603150 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.610584 22499 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:21.612185 23835 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:21.615064 22576 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:21.616254 23835 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.620180 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.621388 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 639) took 1142 ms. Trace:
I20260709 13:07:21.621858 22646 rpcz_store.cc:276] 0709 13:07:20.479162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.481520 (+  2358us) service_pool.cc:224] Handling call
0709 13:07:21.619769 (+1138249us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:07:21.621286 (+  1517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154380160}
I20260709 13:07:21.625952 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 978) took 1185 ms. Trace:
I20260709 13:07:21.626430 22577 rpcz_store.cc:276] 0709 13:07:20.440806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.441062 (+   256us) service_pool.cc:224] Handling call
0709 13:07:21.625562 (+1184500us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54002797d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:21.625754 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685686528}
I20260709 13:07:21.628439 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:07:21.629853 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.631132 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 651) took 1135 ms. Trace:
I20260709 13:07:21.631489 22652 rpcz_store.cc:276] 0709 13:07:20.496076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.543985 (+ 47909us) service_pool.cc:224] Handling call
0709 13:07:20.727667 (+183682us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:07:21.628792 (+901125us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6e9c 00007fec231d6a5b 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:07:21.631039 (+  2247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45938944}
I20260709 13:07:21.640483 22502 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:21.641072 22502 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:21.641996 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 1001) took 1088 ms. Trace:
I20260709 13:07:21.656608 22574 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.657956 22571 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.660784 23828 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.665220 22575 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:21.666188 22576 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:21.666496 23828 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:21.645648 22468 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.070s (SENT)
W20260709 13:07:21.672410 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57644.3us
I20260709 13:07:21.644894 22580 rpcz_store.cc:276] 0709 13:07:20.551349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.469284 (+917935us) service_pool.cc:224] Handling call
0709 13:07:21.495366 (+ 26082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.534233 (+ 38867us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:21.542194 (+  7961us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.639034 (+ 96840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.639118 (+    84us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:21.639175 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.639263 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.639401 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4761,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":1316,"raft.queue_time_us":24918,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":44856,"threads_started":1}
W20260709 13:07:21.684814 22468 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.070s (SENT)
I20260709 13:07:21.685472 22468 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:21.690503 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 723) took 1413 ms. Trace:
I20260709 13:07:21.691077 22651 rpcz_store.cc:276] 0709 13:07:20.276785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.276983 (+   198us) service_pool.cc:224] Handling call
0709 13:07:21.670254 (+1393271us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:21.690297 (+ 20043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550753664}
I20260709 13:07:21.692263 23935 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.693056 23935 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:21.695703 23923 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:21.704402 22468 leader_election.cc:336] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.091s (SENT)
I20260709 13:07:21.704945 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:21.706094 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.706538 23932 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.099s	user 0.002s	sys 0.002s
I20260709 13:07:21.709692 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.711884 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.696587 23935 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.699242 23843 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:21.714977 23923 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.709246 22502 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.716975 23543 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.719980 22499 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:07:21.719245 23843 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:21.717520 23730 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:07:21.721750 23923 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:21.722500 22502 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:21.729569 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 101336us
I20260709 13:07:21.732370 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.727761 23843 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.728505 23923 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:21.743934 22502 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:21.753357 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:21.754280 22500 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.757929 22503 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:21.766074 23923 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.767738 23923 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.775061 23888 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:21.776661 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:21.779469 22499 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:21.779886 22499 pending_rounds.cc:85] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:21.781997 22499 pending_rounds.cc:107] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:21.782409 22499 raft_consensus.cc:2889] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.791157 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.791290 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:21.783190 23935 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:21.793865 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:21.794512 22503 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.787223 23680 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:21.792784 23935 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.797446 23935 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.797612 23888 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.792296 22645 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.797430 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.800153 22504 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:21.801218 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.804682 23920 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:21.805466 23920 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.795612 22401 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 3 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:21.808127 23916 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.808358 23946 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:21.808895 23916 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.810981 23835 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:21.812171 23825 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:21.812593 23825 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:21.813256 22648 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.813704 23825 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.814802 23825 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.816310 22646 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:21.835503 23916 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.836795 23920 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.838146 23888 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:21.838402 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.838725 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:21.839468 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.841320 23926 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:21.845355 23926 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:21.846352 23926 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.847761 23926 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.848397 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.850481 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.851029 22646 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:21.851265 22502 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:21.852214 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.853158 22504 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:21.841651 22580 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:07:21.842079 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.841725 23843 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:21.854015 22580 pending_rounds.cc:85] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 1
I20260709 13:07:21.854331 22580 pending_rounds.cc:107] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:21.854590 22580 raft_consensus.cc:2889] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:21.861665 22468 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.551s (SENT)
W20260709 13:07:21.862426 22468 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.551s (SENT)
I20260709 13:07:21.862775 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:21.862872 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.863906 22504 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:21.862920 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.866175 22647 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 1.
I20260709 13:07:21.866329 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.867080 23953 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:21.867238 22649 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:21.867434 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.868032 22499 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
W20260709 13:07:21.868589 22468 leader_election.cc:336] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.554s (SENT)
I20260709 13:07:21.869349 22651 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:07:21.870368 23920 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.870540 23843 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:21.870929 23920 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.877597 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.879848 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:21.876725 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:21.881489 22468 leader_election.cc:336] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.554s (SENT)
I20260709 13:07:21.881968 22468 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:21.882445 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:21.883383 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.884177 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56602.3us
I20260709 13:07:21.884457 23920 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.884418 23923 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.885568 22578 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:21.883293 22468 leader_election.cc:336] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.779s (SENT)
I20260709 13:07:21.901994 22500 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:21.908644 22498 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:21.909142 22498 pending_rounds.cc:85] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
W20260709 13:07:21.911767 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.910446 22468 leader_election.cc:336] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.779s (SENT)
I20260709 13:07:21.914983 22468 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:21.918409 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.888972 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:21.924216 23848 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.924629 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.924880 23848 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:21.926671 22500 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:21.927505 23848 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:21.909345 22498 pending_rounds.cc:107] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:07:21.948206 22498 raft_consensus.cc:2917] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:07:21.965210 22498 raft_consensus.cc:2889] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.966342 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48192 (request call id 1) took 12382 ms. Trace:
I20260709 13:07:21.966711 22498 rpcz_store.cc:276] 0709 13:07:09.583764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.593800 (+ 10036us) service_pool.cc:224] Handling call
0709 13:07:10.013409 (+419609us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4c0027ef80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec245c7a20 00007fec245d8a29 00007fec2459e644 00007fec245c5f2d 00007fec245c5b93 00007fec262541af 00007fec26253f3e 00007fec262d9888 00007fec262f675c 00007fec262f776a 00007fec262f691b
0709 13:07:10.105338 (+ 91929us) log.cc:844] Serialized 513 byte log entry
0709 13:07:21.966203 (+11860865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27342,"raft.queue_time_us":29587,"raft.run_cpu_time_us":1565,"raft.run_wall_time_us":1564,"spinlock_wait_cycles":3538816,"thread_start_us":544993,"threads_started":1,"wal-append.queue_time_us":703823,"wal-append.run_cpu_time_us":4100,"wal-append.run_wall_time_us":1190193}
I20260709 13:07:21.932538 23935 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:21.969861 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet be7264d3053b44989c5504d296ea482b: Aborted: Op aborted by new leader
I20260709 13:07:21.971073 23935 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:21.922837 22645 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:21.944993 23890 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.980028 23261 raft_consensus.cc:2368] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4.
I20260709 13:07:21.980340 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:21.981256 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.989894 22496 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:21.995203 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:21.996366 22572 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:07:21.998512 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 94564us
W20260709 13:07:21.999291 22468 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.877s (SENT)
I20260709 13:07:21.999775 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:22.001647 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 110379us
I20260709 13:07:21.985978 23888 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:07:22.006311 22468 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.153s (SENT)
I20260709 13:07:21.991850 23843 raft_consensus.cc:1027] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: attempt to promote peer fa2f181263f446a6962b649f9348c15f: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:22.004012 23890 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.009325 23888 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.010979 23863 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.011786 23888 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:22.005360 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.018270 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:22.018249 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:22.019210 22498 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.020190 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:22.011790 23863 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.022238 23902 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.022831 23902 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.024058 23863 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:22.024828 23902 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:22.024958 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.031699 22576 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:07:22.029083 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.026921 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.029408 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.036273 22496 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:22.038393 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:22.042536 22580 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:22.003793 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:22.048775 22578 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:22.066205 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:22.069799 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.075217 23907 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:22.053882 23888 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.067107 23940 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.088420 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:22.090646 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 64013.1us
I20260709 13:07:22.076184 23848 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.086858 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:22.091554 22503 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:22.067627 22648 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.094331 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:22.095359 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 94468.1us
I20260709 13:07:22.095136 22579 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:22.101172 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.094008 23848 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:22.115531 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:22.118878 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:22.119709 22501 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.120568 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:22.122735 22617 leader_election.cc:400] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3.
I20260709 13:07:22.123780 23835 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.123919 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.124881 23843 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.126268 23843 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:22.126391 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:22.128051 23843 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.128475 23843 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.126521 22500 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:22.133037 22500 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:22.133958 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.124755 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.138074 22498 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:07:22.093739 23888 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.143520 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.145475 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:22.128825 23843 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.148301 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.155472 22579 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
W20260709 13:07:22.149080 23998 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:22.095950 23907 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:22.153877 23888 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:22.112378 23848 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.155934 22500 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:22.142618 23828 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:07:22.156850 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:22.164134 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:22.164762 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:22.165416 22579 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:22.166193 22618 leader_election.cc:400] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4.
I20260709 13:07:22.166503 22618 leader_election.cc:403] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:07:22.168172 24000 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:07:22.172643 23934 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:22.173621 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:22.170785 23940 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.175618 22504 raft_consensus.cc:2410] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:22.175241 23935 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.177667 23935 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:07:22.178622 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:22.178895 23935 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:22.179670 23920 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:22.185426 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:22.188287 23902 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:22.175443 23934 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:22.191815 23723 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:22.192272 23934 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.193774 23907 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:22.194106 23934 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.195343 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:22.196246 22579 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:22.199596 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:22.200013 23828 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:22.197299 23940 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.201330 23940 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.201789 23907 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:22.189293 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:22.205081 22504 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:22.207401 23723 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:22.208130 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.208843 22502 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:22.210474 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.190196 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:22.215622 22497 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:22.213474 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:22.212105 23902 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.218518 23835 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.219043 23926 raft_consensus.cc:2764] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:22.214772 23920 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:22.219969 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:22.221136 22498 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:22.221561 23996 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.207938 23723 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:22.222193 23996 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:22.219733 23780 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.223356 23996 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.224092 23780 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.224494 23780 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.214236 22545 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.227775 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:22.231823 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.232575 23787 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.233836 23902 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.240028 22503 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:07:22.241984 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.246016 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:22.247212 22649 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:22.247982 22545 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.249643 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:22.253564 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 95366.1us
I20260709 13:07:22.259433 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:22.260108 22652 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 2.
I20260709 13:07:22.249091 22648 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:07:22.251981 23787 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.249765 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:22.255072 23680 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.272037 22617 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.257652 23926 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.270975 23886 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4.
I20260709 13:07:22.271641 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:22.290307 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55046.7us
I20260709 13:07:22.274940 23926 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.294271 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44948us
I20260709 13:07:22.274113 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:22.298417 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:22.313462 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51706.6us
I20260709 13:07:22.313655 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:22.317083 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.300650 23926 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.268724 23723 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.307304 22647 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:22.323050 23863 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.320575 23890 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.334739 22617 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.323925 24013 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.349890 22545 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:22.326870 23723 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.326428 23890 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.352694 23980 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:07:22.386459 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47905.5us
I20260709 13:07:22.338562 23848 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.338711 23843 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.325364 24012 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:07:22.392822 22650 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:22.386227 24013 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:22.399677 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 65075.3us
I20260709 13:07:22.348129 23825 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:07:22.389509 23920 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:22.397498 24012 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:22.406584 22617 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.390868 23890 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.385062 23780 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:22.414395 24011 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:22.414841 23780 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:22.415424 23920 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:22.410000 24009 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:07:22.404740 24014 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:22.422927 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.437335 23946 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.438357 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:22.439312 23946 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:22.439836 23946 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:22.440645 23863 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:22.438755 23940 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.441841 23863 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:22.442224 23863 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:22.443225 23940 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:22.411504 24012 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:22.440672 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.419049 23848 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:22.452179 24012 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.453585 24012 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.443079 23863 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:22.454954 24006 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:22.455389 23863 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.483891 22501 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:22.422515 24014 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:22.494457 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53886.6us
W20260709 13:07:22.495215 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.497140 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.496613 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 185130us
I20260709 13:07:22.499058 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:22.485491 23780 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.485504 23848 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.502693 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:22.503334 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.504247 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet ea7bfa694a734e68806da48189a7e004: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:22.506500 22654 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:22.508363 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.506052 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:22.500488 23843 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:22.512650 22543 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:22.506405 23680 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.505052 23787 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.444003 23920 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.519641 23787 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:22.521672 23907 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.521943 23787 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.522266 23907 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:22.525374 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.529706 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 123119us
I20260709 13:07:22.536509 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:22.539722 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:22.540300 22498 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.532348 22496 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:07:22.542783 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.523219 23907 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.543610 22545 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.489328 23946 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:22.549641 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.520027 23916 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.557243 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:22.558651 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.560995 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44539.4us
I20260709 13:07:22.514132 23886 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:07:22.551506 23916 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.555066 23996 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:22.564266 24008 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:07:22.579005 23916 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.587347 23843 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:07:22.638365 22498 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
W20260709 13:07:22.640357 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.648659 24022 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.649305 24022 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.650910 24014 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.652118 24014 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:22.656692 24017 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.264s	user 0.003s	sys 0.000s
W20260709 13:07:22.658826 24026 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:07:22.661299 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 106333us
I20260709 13:07:22.662734 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:22.663350 23996 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:22.664058 22545 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.668983 24027 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:22.670063 24027 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:22.670403 24027 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:22.671233 24027 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.677693 24012 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:22.678994 24024 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:22.680239 23723 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:22.680744 23723 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:22.637670 23809 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.681823 23723 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.684826 23835 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.700970 24028 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.701227 22651 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.701792 23926 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.703970 23926 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:22.706221 22505 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:22.707790 24034 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.708607 23940 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:07:22.707927 22468 leader_election.cc:336] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.653s (SENT)
I20260709 13:07:22.708688 24034 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:22.709764 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:22.715485 22651 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
W20260709 13:07:22.682976 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 99262.8us
I20260709 13:07:22.685204 24027 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.694819 23863 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.717382 23723 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.709359 23940 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:22.721674 22468 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.869s (SENT)
I20260709 13:07:22.724618 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:22.707840 23680 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:07:22.742394 22468 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.914s (SENT)
I20260709 13:07:22.747143 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:22.751181 22401 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 2 to 4, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 4 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.754570 22646 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:22.733933 23923 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:22.756258 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 5314aa61dd7f4a7f9b148f71ea5055c4: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } }
I20260709 13:07:22.756548 23680 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.721530 23926 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.761972 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:22.720719 24013 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:22.700062 23787 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.770991 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:22.756325 24022 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:22.814855 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44953.6us
I20260709 13:07:22.822116 23787 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:22.769938 23923 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.723593 23996 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:07:22.824576 24034 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:22.825680 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63789.2us
I20260709 13:07:22.839157 22496 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:22.826215 23835 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.823101 24013 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.826562 23935 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:22.828011 23940 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:22.829763 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110290us
I20260709 13:07:22.832185 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:22.832798 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 156630us
I20260709 13:07:22.833482 23946 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:07:22.853626 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:22.854301 22645 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.854679 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:22.856395 22468 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:22.858351 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:22.867105 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.906711 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 50384us
I20260709 13:07:22.849207 23835 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:22.886883 23940 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.887176 23926 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.884688 23996 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:22.839105 23890 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.907688 24014 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.921463 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:22.922972 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:22.923121 23923 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.929992 23907 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:22.930194 24024 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:22.931452 22645 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:22.933127 24038 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.935105 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:22.933357 23940 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.919847 24014 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.942138 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.946131 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:22.916519 23926 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:22.948562 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:22.937574 24038 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:22.944346 23946 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:22.940115 23996 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:22.946167 24014 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.959462 23926 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.957998 23886 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.961417 23848 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:22.962777 24038 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.945544 23940 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.933178 23835 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:22.968833 23863 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.957674 24041 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:23.012943 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:22.980901 23946 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:23.011886 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70967.6us
I20260709 13:07:23.013635 22579 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.052569 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:23.067323 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:23.070693 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.995579 23916 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.088397 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:23.096096 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.096794 22651 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:23.111670 22580 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.114403 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:23.113739 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:23.071003 23863 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:23.119800 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.122932 22576 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:23.123457 22576 pending_rounds.cc:85] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 1
I20260709 13:07:23.123745 22576 pending_rounds.cc:107] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:23.124027 22576 raft_consensus.cc:2889] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.136747 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:23.051045 23680 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.139768 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.143939 22654 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:23.146719 24046 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:07:23.158851 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.159835 22653 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.160733 23680 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:23.161953 24031 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.444s	user 0.004s	sys 0.012s
I20260709 13:07:23.162124 23940 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.158936 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.162964 23940 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:23.163448 22647 raft_consensus.cc:2410] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:23.163480 23940 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.172897 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:23.174239 24048 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:23.093410 23996 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.155576 22645 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:23.181525 22579 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:23.189268 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.157648 23890 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.171031 23809 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:23.174255 23916 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.193504 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:23.198132 22579 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
W20260709 13:07:23.208582 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.212055 24049 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:23.214954 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.198477 23946 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.216225 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.218410 24019 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.218933 24019 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.219995 23787 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:23.189584 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 138672us
I20260709 13:07:23.224810 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.229413 23863 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.231098 22646 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:23.233160 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.220439 23787 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:23.236637 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56712.6us
I20260709 13:07:23.228307 23926 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:23.241052 23926 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:23.246716 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52986.9us
I20260709 13:07:23.201929 23940 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.268602 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.270272 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.271553 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:23.272150 22496 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.270550 24055 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.284196 24057 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:23.284837 24057 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.287096 23920 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.286412 24055 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.291747 24055 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.287964 22402 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 2, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 2 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:23.301375 22496 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:23.200310 23809 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.259541 23980 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.319630 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64904.2us
I20260709 13:07:23.324064 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:23.336107 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 76673.6us
I20260709 13:07:23.339385 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.344798 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.345562 22649 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.344159 22651 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.346145 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.342675 22545 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.349313 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:23.349478 22468 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.528s (SENT)
W20260709 13:07:23.357769 22468 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.535s (SENT)
W20260709 13:07:23.358661 22468 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.535s (SENT)
I20260709 13:07:23.359140 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:23.295964 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.368422 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.368573 22504 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.369174 22651 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.366722 22402 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:23.320252 24057 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.379895 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.380878 22402 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.386200 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.392143 22402 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.376492 24028 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:23.395277 22651 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:23.398733 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.401681 22647 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:23.401229 22402 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.402864 22402 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.324885 23787 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.415033 24019 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:23.415630 23787 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.360719 23980 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.395123 24056 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 13:07:23.408383 24065 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:23.388826 24057 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.427099 22649 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:23.429059 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.429245 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:23.426407 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.432631 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.439392 22652 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:23.418781 24028 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.443629 24028 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.446105 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:23.446616 24055 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:23.446802 22501 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:23.447189 24055 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:23.447759 24055 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.454530 24065 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:23.458997 22619 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:23.461031 24012 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:23.461289 23940 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:23.461985 24012 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:23.462322 23940 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:23.462746 23940 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:23.469543 22653 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.477566 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.440539 22402 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:23.463641 23940 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.512465 22402 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.513643 23980 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:23.513988 23809 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:23.512455 24038 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.003s
I20260709 13:07:23.514573 24038 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.456087 24065 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.462360 24012 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:23.519200 22468 leader_election.cc:336] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.723s (SENT)
I20260709 13:07:23.514315 22402 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.481091 23926 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.485975 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.529309 22653 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:23.533059 22402 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.516777 24038 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.527165 24012 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.541391 22402 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.553208 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:23.554188 22504 raft_consensus.cc:606] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:23.556533 24023 raft_consensus.cc:1064] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:23.518877 24057 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 13:07:23.566113 22468 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.751s (SENT)
I20260709 13:07:23.562397 24038 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:23.575331 24038 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.578158 24038 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.566814 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:23.579818 22468 leader_election.cc:336] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.768s (SENT)
I20260709 13:07:23.580361 22468 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:23.560727 23940 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:23.570730 24014 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 13:07:23.531703 23926 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:23.594175 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 252611us
I20260709 13:07:23.595033 23902 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:23.596853 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 120555us
I20260709 13:07:23.571750 24065 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.607936 22468 leader_election.cc:336] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.816s (SENT)
I20260709 13:07:23.614539 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.609925 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:07:23.626361 22468 leader_election.cc:336] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.816s (SENT)
I20260709 13:07:23.627002 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:23.623792 22543 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:23.636171 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:23.638871 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.643565 22402 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.644511 23934 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.645053 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.645424 22402 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.661279 22500 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:23.605616 23907 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.664378 24041 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.664489 23907 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.666836 23907 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:23.622463 23890 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.667225 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57396.1us
I20260709 13:07:23.667593 23890 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.668383 22545 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.668951 23923 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.650573 23920 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:23.669536 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:23.673409 22502 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:23.605882 24058 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.559160 24023 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:23.678891 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52562.3us
W20260709 13:07:23.683542 22468 leader_election.cc:336] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.825s (SENT)
I20260709 13:07:23.684232 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:23.679780 22402 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.686894 22617 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.687337 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:23.687474 22402 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:23.692317 22499 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:23.694383 22503 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:23.637617 24038 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:23.597157 23863 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:07:23.674753 24028 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:23.596823 24055 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.695547 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.608281 24014 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.705687 24024 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.707309 23934 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:23.712983 22468 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.948s (SENT)
W20260709 13:07:23.801301 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 89860.3us
I20260709 13:07:23.801678 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:23.698757 23920 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:23.797667 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129407us
I20260709 13:07:23.694320 23907 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.626210 24065 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.702661 23923 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:23.814584 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:23.822359 22650 raft_consensus.cc:2368] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5.
I20260709 13:07:23.698953 24041 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
W20260709 13:07:23.831050 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 118102us
W20260709 13:07:23.837126 22468 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.953s (SENT)
W20260709 13:07:23.837954 22468 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.953s (SENT)
I20260709 13:07:23.834738 22500 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:23.838431 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:23.846387 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.802671 24058 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:23.852461 23926 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.853369 23926 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.854458 23926 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.832121 24033 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:23.835565 23946 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:23.866430 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:23.866766 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.848445 24038 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.860762 23843 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:07:23.876201 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:23.876288 23890 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.870194 24033 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:23.892612 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:23.885815 23919 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:23.881321 24055 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:23.905296 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73525.4us
W20260709 13:07:23.901598 24074 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:07:23.876667 24034 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:23.898553 23890 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:23.900084 24057 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:23.887092 23946 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.915509 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:23.925326 22619 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:23.869583 24058 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.894018 24038 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.908303 23863 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:23.931231 22580 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:23.935338 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:23.951296 22573 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:23.911104 23919 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:23.933892 22545 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:23.923684 24057 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:23.935007 23787 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:23.929442 23890 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.974244 23787 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:23.948791 24058 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.987322 24057 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.949774 24036 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:07:23.926908 24033 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:23.974491 23863 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:23.990284 23946 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.953244 23980 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:23.991596 24065 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:23.924785 23934 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:07:23.946552 24038 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:23.996299 23907 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.992311 23996 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:23.967454 22545 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:23.995844 22576 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:23.997011 22572 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:23.924693 23780 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:07:23.961755 24014 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:24.001612 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 163699us
W20260709 13:07:24.013175 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45850.8us
I20260709 13:07:23.984170 24088 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.999409 23787 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.006783 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.010965 23946 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.016314 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.019099 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.019796 22649 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:24.007491 24065 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:24.008793 24057 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.003017 23980 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.947161 24012 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.035246 23980 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.037448 24012 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.039433 23890 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.022383 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.010913 24038 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.022586 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.051347 22649 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:24.013214 24033 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:24.059880 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.024210 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.025192 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.025794 22646 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:24.026137 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:24.025590 22468 leader_election.cc:336] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.989s (SENT)
I20260709 13:07:24.034368 23787 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.008836 23996 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.047258 22651 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:24.066336 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:24.011824 23907 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.000311 24028 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:24.057490 23680 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:24.023811 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.072605 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.072965 22578 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.074465 24013 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:24.075068 24013 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:24.061254 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.067476 22545 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:24.020604 24088 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.013016 23919 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.045009 24065 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.063504 23996 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.087251 22545 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:24.072984 23946 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.072662 23680 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:24.090378 23920 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.094460 23920 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.094972 23920 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.084197 23890 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.096078 24088 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.093863 24091 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:24.089919 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:24.063864 24038 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.100943 24038 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.096499 23890 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.105893 24028 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.106767 23890 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.097590 23787 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.098397 24091 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.109691 24091 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.108520 23261 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:24.098016 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 72451.7us
W20260709 13:07:24.125427 22468 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.069s (SENT)
I20260709 13:07:24.125860 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.129989 24034 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.131932 24034 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.132510 24034 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.132694 23946 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:24.068310 23863 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.123983 24036 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.140772 22468 leader_election.cc:336] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.079s (SENT)
I20260709 13:07:24.141353 23890 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.142514 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:24.144261 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54426.3us
I20260709 13:07:24.146185 24038 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.147111 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:24.139209 23946 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:24.150993 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:24.151829 24038 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:24.155835 24065 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.146214 23680 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.162074 23680 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.161087 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:24.142630 24067 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:24.166477 23890 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.166970 23890 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.167303 23890 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.167569 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.169606 23723 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.169708 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.170337 22580 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.170248 23723 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.170753 23780 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.171881 23780 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.172962 24038 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:24.174017 24038 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.170071 23980 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.177407 22652 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.180334 23980 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.181679 22580 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:24.182848 23907 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.170424 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.186398 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:24.187265 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:24.187479 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.131903 23920 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.188900 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.189772 22580 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.188812 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.189934 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:24.193154 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.193490 24055 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.193670 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.193996 24055 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.194384 24055 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.194626 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.194861 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.195776 22574 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:24.197132 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:24.197858 24080 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.310s	user 0.002s	sys 0.000s
I20260709 13:07:24.198148 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.188882 24088 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:24.199570 22580 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:24.199995 24088 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:24.209498 23780 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.194402 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.209770 24088 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.211253 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.212467 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.204926 24095 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.156675 22647 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:24.172729 23723 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.206483 23946 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.144188 24036 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.253450 22649 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:24.254534 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.254591 24055 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.255388 22649 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:24.195742 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.256029 22576 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:24.256127 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.203301 23923 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:24.256932 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.213240 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.257695 22576 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:24.258285 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.258394 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.259369 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.219851 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.260957 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.220813 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.263234 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:24.225099 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.265086 24057 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.237689 22652 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:24.265985 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.266240 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.266768 22645 raft_consensus.cc:2368] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5.
I20260709 13:07:24.267843 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.268059 24091 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.268551 23926 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.268587 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.269490 23926 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.272754 23940 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.273394 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.274288 22646 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:24.274581 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.274880 24091 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.276767 23940 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.278096 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.213783 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.251116 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.255075 24036 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.257036 23923 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.279981 23940 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.280220 23923 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.281210 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.283078 23940 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.282833 24034 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.284226 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.246037 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.220434 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:24.285144 24034 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.285256 22653 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
W20260709 13:07:24.286036 24085 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.403s	user 0.004s	sys 0.000s
I20260709 13:07:24.289693 24090 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:07:24.289871 23923 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.292533 23923 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:24.292719 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49198.5us
I20260709 13:07:24.302912 24013 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:24.189550 24067 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.300366 24055 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.308032 22468 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.316154 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.319022 22502 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:24.319636 22502 pending_rounds.cc:85] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 2
I20260709 13:07:24.319931 22502 pending_rounds.cc:107] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:24.320215 22502 raft_consensus.cc:2889] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.322927 23940 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.323161 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.323724 22497 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:24.323874 22501 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:24.324141 22497 pending_rounds.cc:85] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 1
I20260709 13:07:24.312853 24013 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.324553 22497 pending_rounds.cc:107] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:24.324890 22497 raft_consensus.cc:2889] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.328079 24067 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.329165 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.329999 22498 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:24.330628 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.331105 22504 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:24.331277 22505 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.332360 24057 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.333398 22468 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.333425 22499 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.341570 22573 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:07:24.341846 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.342741 24034 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:24.344409 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.345291 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.345599 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.346813 22580 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:24.347474 22617 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:24.347805 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.348404 22576 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:24.349107 23940 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.349798 23940 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.349107 23919 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:24.345292 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:24.342015 22573 pending_rounds.cc:85] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 1
I20260709 13:07:24.350891 23919 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:24.351045 22573 pending_rounds.cc:107] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:07:24.351454 22573 raft_consensus.cc:2889] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.351632 24034 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:24.352171 24034 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:24.351711 23923 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.353009 24034 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.353999 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.354568 23907 raft_consensus.cc:2764] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:24.354948 23923 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.355127 24022 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:24.356824 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.350912 22575 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.357718 23923 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.356943 23848 raft_consensus.cc:1027] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: attempt to promote peer fa2f181263f446a6962b649f9348c15f: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:07:24.351372 23919 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:24.360203 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.360674 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.361018 23980 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:24.356887 24022 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:24.363175 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.365592 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.359153 23919 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.354214 24034 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.377431 24033 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:24.379588 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.380298 22573 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.381569 23863 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.388473 22499 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:24.372008 23890 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.393606 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.372960 22496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:24.303454 23996 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:24.421809 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61038.6us
W20260709 13:07:24.421759 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 61160.4us
I20260709 13:07:24.398334 23923 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.426285 22468 leader_election.cc:400] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5.
I20260709 13:07:24.425351 23890 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.427917 22468 leader_election.cc:403] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:24.428809 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:24.434219 22572 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:24.434996 22400 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } }
I20260709 13:07:24.435963 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:24.405157 22571 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:24.437359 22499 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:24.422073 23919 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.438747 22400 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.439971 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.354081 22505 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:24.432719 22573 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:24.443815 22496 raft_consensus.cc:606] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.442865 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.445077 22496 raft_consensus.cc:614] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.442853 22400 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.446053 22400 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.447870 22468 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.447876 22400 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.436765 23848 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:24.453454 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:24.455216 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:24.455281 22400 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.456357 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.439396 23923 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.458459 22400 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.460259 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 143) took 3755 ms. Trace:
I20260709 13:07:24.460978 22400 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.463001 22400 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.464774 22400 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.449081 24057 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:24.457645 24055 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:24.459681 24089 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:24.500473 23886 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:24.531085 23920 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:24.664986 22400 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 3, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.637897 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.639447 22498 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:24.460330 24014 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
W20260709 13:07:24.640990 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.641366 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.640784 22504 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:24.443610 23890 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:24.647387 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.461117 22402 rpcz_store.cc:276] 0709 13:07:20.723890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.729331 (+  5441us) service_pool.cc:224] Handling call
0709 13:07:24.454511 (+3725180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:23.840080 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:23.901153 (+ 61073us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:23.901197 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:23.901213 (+    16us) tablet.cc:662] Decoding operations
0709 13:07:23.933688 (+ 32475us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:23.933745 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:23.933776 (+    31us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:23.935011 (+  1235us) tablet.cc:701] Row locks acquired
0709 13:07:23.935049 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:07:23.935236 (+   187us) write_op.cc:270] Start()
0709 13:07:23.935368 (+   132us) write_op.cc:276] Timestamp: P: 1783602443935160 usec, L: 0
0709 13:07:23.935392 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:23.936097 (+   705us) log.cc:844] Serialized 6014 byte log entry
0709 13:07:23.939631 (+  3534us) op_driver.cc:464] REPLICATION: finished
0709 13:07:23.940123 (+   492us) write_op.cc:301] APPLY: starting
0709 13:07:23.940230 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:23.940637 (+   407us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:23.940775 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:23.942979 (+  2204us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:23.943327 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:07:23.943395 (+    68us) write_op.cc:312] APPLY: finished
0709 13:07:23.943844 (+   449us) log.cc:844] Serialized 106 byte log entry
0709 13:07:23.944068 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:23.944269 (+   201us) write_op.cc:454] Released schema lock
0709 13:07:23.944342 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:23.948360 (+  4018us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:23.948399 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104273,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":260,"apply.run_cpu_time_us":4642,"apply.run_wall_time_us":8135,"num_ops":15,"prepare.queue_time_us":91799,"prepare.run_cpu_time_us":5965,"prepare.run_wall_time_us":108626,"replication_time_us":4062}]]}
I20260709 13:07:24.664316 23787 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.646967 23848 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:24.646179 24055 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.677243 24055 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.677438 23848 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.666383 22400 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.681689 23923 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5.
I20260709 13:07:24.676651 23787 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.664381 23886 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:24.684006 23886 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.684481 23787 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:24.689762 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.692638 23890 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:24.692970 24089 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:24.693881 24089 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.695190 22496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:24.695771 22496 raft_consensus.cc:606] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.696094 22496 raft_consensus.cc:614] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.693835 23890 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.681882 22400 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:24.702561 22502 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:24.704720 22573 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:24.708077 23996 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:24.710354 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 251012us
I20260709 13:07:24.712303 23926 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:24.720674 22649 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:24.714329 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.721800 22650 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:24.712311 24067 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:07:24.724167 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:24.724886 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.717187 23680 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.008s
I20260709 13:07:24.741092 22504 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:24.748919 22653 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:24.751536 22502 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:24.753448 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.758497 22650 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:24.758586 22651 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:24.756064 22653 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:24.758967 22651 pending_rounds.cc:85] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 1
I20260709 13:07:24.759500 22577 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:24.759693 22651 pending_rounds.cc:107] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:24.760046 22651 raft_consensus.cc:2889] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.737288 23980 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:07:24.722398 23886 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.781213 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.789177 24013 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:24.789791 24013 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:24.791179 23886 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:24.790838 24013 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.799033 22502 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
W20260709 13:07:24.802328 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.798149 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.769881 24088 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.792585 24013 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.846050 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.853729 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.854535 22503 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.853520 23940 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:24.859179 23920 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:24.859632 23940 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.863109 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.864078 22497 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:24.864971 24032 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:24.874411 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.829998 24055 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:24.855293 23946 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:24.886951 22651 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:24.889837 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.890151 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.890450 22651 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.892761 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:24.893324 22650 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.895076 22653 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:24.857702 24088 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:24.880796 24032 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:07:24.908243 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:24.916560 22503 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:24.921386 22580 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.926751 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:24.933053 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:24.941552 22580 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:24.889154 23780 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:07:24.947971 22503 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:24.958364 22651 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:24.918534 22497 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:24.933830 23923 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.944077 23926 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:24.943397 22505 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:25.011030 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:24.963634 24095 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:25.012228 22503 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:24.954058 24094 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:07:25.013943 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.028460 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:25.029508 22577 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:25.013577 22645 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:25.051951 23825 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.984908 23923 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.058806 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.048460 24089 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.025753 23926 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:07:25.022773 24095 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.052917 24088 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:25.081843 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:25.067771 23825 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:25.101285 23825 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:25.100803 23980 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.120810 23940 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.085057 24036 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:07:25.086210 24089 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.121290 23980 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:25.152462 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:25.193029 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.194660 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44802.4us
I20260709 13:07:25.196725 22573 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:25.198889 22503 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:25.247594 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.194291 24032 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.249219 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.131420 23825 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.199990 24088 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:25.265707 24109 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:07:25.275486 24095 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:25.276835 24121 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:25.285267 24055 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.285816 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:25.286456 22499 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.287317 22502 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:25.230540 23940 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:25.288522 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:25.293305 22502 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.289126 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.308246 22504 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:25.242293 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.290292 22650 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:07:25.294261 22500 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:25.295862 23907 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.301208 23980 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.220592 24057 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:07:25.289253 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.261659 22497 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:25.300585 22505 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:25.316612 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.232187 23888 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:07:25.287462 23890 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:25.337528 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.308913 23923 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:25.342799 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 93666.4us
I20260709 13:07:25.258971 24032 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.308985 24055 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.311120 23825 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.359022 22577 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:25.375643 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:25.324186 24125 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:25.309719 23940 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.319291 23907 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:25.292517 24088 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.357321 22648 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:25.385277 22499 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:25.362476 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.390544 22502 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:25.395027 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.373687 23680 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:25.375211 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 128614us
I20260709 13:07:25.368314 23890 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.406183 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:25.398056 23680 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:25.416155 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:07:25.436291 24126 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:25.435884 23680 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.435878 24089 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.458289 23940 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.459770 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.467662 23890 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.468297 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.473717 22501 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:25.432133 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.424681 24138 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:25.475203 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 118707us
I20260709 13:07:25.503971 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.507053 22653 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:25.506368 24127 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:25.469075 23907 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.512418 23907 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.516924 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.518054 22501 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:25.473361 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.533215 24136 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.533947 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.541214 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.536142 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:25.477867 22505 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:25.546386 22503 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.474912 24091 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:25.556815 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.557739 22498 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:25.556845 22496 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:25.563928 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.565716 22468 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.570403 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.571305 22499 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:25.578300 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.579497 22503 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
W20260709 13:07:25.585425 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48021us
I20260709 13:07:25.588692 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.594923 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.599846 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.605201 24141 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.605819 24141 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.606041 23848 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.609133 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.584196 23940 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.586810 23926 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:25.573185 22497 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:25.594730 23890 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.598023 24095 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.513710 24138 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.631879 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:25.633419 22503 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 2: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:25.583789 24091 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.631498 23926 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:25.550336 24136 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.639779 23926 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.642244 24136 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:25.643481 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.626772 24088 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.614305 24028 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:07:25.649206 23787 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.656103 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62512.1us
I20260709 13:07:25.653561 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.629724 24137 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.655515 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.667280 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.668828 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.670691 23940 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.672936 24089 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.674903 22576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:25.643713 24032 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.693867 22504 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:25.698724 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 50260.5us
I20260709 13:07:25.665427 23787 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.699862 24094 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:25.706185 24094 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:25.708480 24144 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.197s	user 0.004s	sys 0.000s
I20260709 13:07:25.707278 24135 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
W20260709 13:07:25.765018 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.766719 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:25.753803 22545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.129:38445 timed out after 1.603s (SENT) [suppressed 30 similar messages]
W20260709 13:07:25.769698 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.774015 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.780020 22503 raft_consensus.cc:2410] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:25.771948 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.771922 24158 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:25.769204 24160 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.851385 22645 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
W20260709 13:07:25.857758 24161 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:25.860481 23787 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.747273 24094 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.843312 23940 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.812703 24141 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:25.888712 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 97656.8us
W20260709 13:07:25.892912 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 139142us
I20260709 13:07:25.899149 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.900830 22468 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.911824 22468 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.913355 24088 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:25.914103 24088 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:25.915253 24088 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.894326 23918 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:25.889761 23940 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.898268 24094 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.844983 24158 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.907342 23946 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.861433 24160 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.909979 23980 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.946146 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51791.4us
I20260709 13:07:25.947228 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:25.930531 24089 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:25.946779 24163 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:07:25.955593 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 43897.3us
I20260709 13:07:25.927825 23918 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:25.958587 24165 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:07:25.961877 23940 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.958410 24089 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.965014 24138 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.965477 24089 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.967088 23918 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.967643 24089 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.949373 23980 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:25.970395 24167 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:25.970814 23980 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:25.973001 22576 raft_consensus.cc:606] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:25.973443 22576 raft_consensus.cc:614] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:25.976119 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.977155 22501 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:25.946121 23946 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:25.979494 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:25.980127 22503 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:25.958600 24095 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.982086 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:25.983847 22647 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:07:25.984505 23946 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:25.992632 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.994086 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:25.985167 24091 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:25.995324 22571 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:26.009392 22619 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:25.997505 23980 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:07:26.011082 24141 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:26.015244 24141 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:26.017977 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:07:26.019351 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.019641 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.022943 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.028013 23825 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:26.032255 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.034417 24067 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.016203 24141 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.038302 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.039202 22501 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:26.045594 24067 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.046502 23229 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.048153 24139 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:26.048265 24146 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.539s	user 0.003s	sys 0.001s
I20260709 13:07:26.062282 24139 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.071368 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.074968 22619 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.077376 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.080590 23825 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:26.087194 22619 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:26.080570 24182 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:26.087754 23934 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:26.090267 24182 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:26.091648 24182 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.081830 23907 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:26.093410 23907 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.093789 23907 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.095362 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:26.089097 23825 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.097218 23934 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:26.097694 23825 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.097735 23934 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.098385 23934 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.099058 23680 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.103500 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.106359 22505 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:26.102239 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.108393 22500 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:26.116772 24154 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:26.117170 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.130255 22619 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.121028 24013 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:26.122370 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 189100us
I20260709 13:07:26.123986 22504 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.096376 24090 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:26.133273 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 186071us
I20260709 13:07:26.134155 22578 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:26.137002 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.137677 22578 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:07:26.143967 24157 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.144284 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.145345 23888 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.164646 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.169629 22545 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.181036 22545 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.135468 24090 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.183761 24094 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:07:26.186791 24033 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:07:26.193378 22576 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.138540 24028 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.189289 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.205963 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.168110 24057 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.186450 23920 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.214898 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.184746 24135 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.222903 22545 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:26.200001 24090 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.188293 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.227803 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.194567 24177 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.194250 23780 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:07:26.239774 22545 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.221827 24057 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.244429 22545 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.245180 24057 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.247973 24154 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.248706 24154 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.238422 22575 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:26.225200 24180 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.231077 24170 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:26.274216 24170 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:26.268014 23907 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.274665 24170 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:26.265178 24136 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.266113 22545 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.241750 23920 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.271579 24088 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.231014 24181 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:07:26.289976 24088 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.234869 24141 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:07:26.288781 24138 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.227989 24028 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:07:26.280469 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.302376 22650 raft_consensus.cc:2410] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:26.295857 24136 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.289045 24089 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.305485 24136 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.308568 24158 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.315657 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.230257 24135 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.292831 24088 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.328840 24135 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.322207 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc845449beb4f859e55185200f34bd2"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:26.329568 22503 raft_consensus.cc:606] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:26.329934 22503 raft_consensus.cc:614] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:26.297679 23934 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.331404 22653 raft_consensus.cc:2368] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:07:26.299311 24057 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.332760 24057 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.333693 24157 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.304512 24089 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.334429 22649 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.334206 24090 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.335587 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:26.336125 24089 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.337945 24057 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.297936 24180 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.296651 24138 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:26.341182 24138 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.342959 24157 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.343477 24157 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.344448 24033 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:26.344844 24033 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:07:26.346223 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59779.8us
I20260709 13:07:26.346881 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:26.349713 22650 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.355392 22650 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:26.357642 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.359021 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:26.361276 24137 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.361799 24137 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.364029 24137 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.364997 24033 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.360682 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.353780 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.372283 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.373426 24160 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.375150 23920 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:26.397562 23920 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:26.398535 23920 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.379325 24158 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:26.377772 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.376215 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.380069 22545 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.383631 24137 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.389914 24136 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:26.391319 23907 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:26.392199 24095 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:26.393383 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.394997 23940 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.376541 23825 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.396947 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:26.401007 24033 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.380085 22650 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:26.369038 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:26.401247 23926 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.412576 22545 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.426632 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.427671 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:26.427790 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.428462 22502 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:26.415745 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:26.415546 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:26.429365 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.429710 22500 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.429387 22505 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.412205 24180 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:26.411796 24176 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.428311 22498 raft_consensus.cc:2376] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3. Re-sending same reply.
I20260709 13:07:26.407617 24057 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.410578 24137 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.443485 24170 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.445406 23934 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:26.431756 23946 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.445825 24034 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:26.446463 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.464497 22577 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.464696 22499 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:26.465950 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:26.416703 24032 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:26.419803 23780 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:07:26.419200 24177 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:07:26.450989 23825 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:26.451543 22652 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:26.461045 22543 leader_election.cc:400] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:07:26.467459 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.469234 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.478655 22543 leader_election.cc:403] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:26.470127 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56654.6us
I20260709 13:07:26.471957 22580 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.480113 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.481259 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.420542 23940 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.473158 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.474757 22573 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:26.482592 22573 pending_rounds.cc:85] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 2
I20260709 13:07:26.482843 22573 pending_rounds.cc:107] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:26.483089 22573 raft_consensus.cc:2889] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.475890 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.476073 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.484815 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.485481 22576 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:07:26.490353 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.491971 22500 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:26.492079 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.493539 22577 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.497148 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:26.472764 23980 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.506045 22505 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:26.497977 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:26.499647 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.497999 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:26.514407 22505 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:26.438136 23926 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.519097 24157 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:26.464237 24057 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.527148 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.535763 22577 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:26.531734 22580 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:07:26.489545 24181 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.541697 22580 pending_rounds.cc:85] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 1
I20260709 13:07:26.542590 22580 pending_rounds.cc:107] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:07:26.542965 22580 raft_consensus.cc:2889] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:26.544602 24202 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:26.549816 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:26.552240 22646 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.553526 24137 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.554003 24180 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:26.554178 22571 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.555773 24090 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:26.556082 23940 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.533818 24138 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:26.539333 24028 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:26.600801 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51042.8us
I20260709 13:07:26.523350 23980 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.609131 22545 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:26.609330 22501 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:26.620273 24057 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.594604 24169 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:26.624503 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:26.606174 24036 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:26.638284 23926 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.621968 24028 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:26.630585 22651 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:26.638686 24036 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.606017 24180 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:26.654983 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45946.7us
I20260709 13:07:26.655892 24178 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:26.656023 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.656385 24178 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.656795 24178 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.657011 24032 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.628607 24138 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.665232 22573 raft_consensus.cc:2410] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:26.666716 24033 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:26.667060 24138 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.605738 24135 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:07:26.667763 24169 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:26.668143 24169 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:26.668937 24169 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.683158 24178 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.687269 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:26.654093 24036 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.691224 24138 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:26.692852 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 93182.2us
I20260709 13:07:26.693856 22468 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.694561 24138 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.695631 22468 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.696309 24138 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.697324 22468 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:07:26.702471 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46528.9us
I20260709 13:07:26.704600 24176 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.705791 24179 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:26.703272 22545 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:26.720791 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.721561 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:26.705789 22399 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 34) took 2280 ms. Trace:
I20260709 13:07:26.713498 24179 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:26.737468 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.719043 24178 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.726305 24138 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.741873 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.725528 24032 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.730048 24176 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:26.795419 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53677.4us
I20260709 13:07:26.796597 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.806962 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.735088 24090 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.766242 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 107074us
I20260709 13:07:26.821724 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:26.803714 24188 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:26.742080 24181 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:07:26.810273 24057 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:26.803387 24176 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.818449 24206 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.819334 24135 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.745313 24138 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.855566 24057 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:26.836288 24179 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.740617 23926 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:07:26.829008 24136 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.830412 23940 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:26.733765 24028 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.833590 24089 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:07:26.752967 23946 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:07:26.858625 24176 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.828117 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:26.866812 24138 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:26.889158 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61108.9us
I20260709 13:07:26.830535 24090 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.732645 22399 rpcz_store.cc:276] 0709 13:07:24.425737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.425963 (+   226us) service_pool.cc:224] Handling call
0709 13:07:26.705575 (+2279612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126750,"reported_tablets":1}
I20260709 13:07:26.881382 24179 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.906533 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.910457 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.912659 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.888353 24136 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.918018 22574 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:26.868175 24057 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.894526 24028 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.927770 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.930626 22572 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:26.879194 23940 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.941213 24089 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:26.967137 24089 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:26.950413 24204 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:26.886106 24143 consensus_queue.cc:1175] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ca917eaada84bf38a5daae9f8ffa066" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:26.970733 24089 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:26.937079 24136 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:26.939919 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:26.943197 24088 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:26.989822 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.994231 24057 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.000787 24169 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.002948 23980 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.062350 22647 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:27.078384 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:27.079035 22574 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:27.075232 24211 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:07:27.063207 24057 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.013275 24136 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.004799 24180 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.094524 22574 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
W20260709 13:07:27.082140 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92211.2us
W20260709 13:07:27.095297 24209 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.241s	user 0.007s	sys 0.000s
I20260709 13:07:27.095784 24216 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.133330 23940 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.138188 24180 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.109397 24206 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:27.139488 24215 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:07:27.139734 24206 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.142724 24206 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.087574 23919 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:07:27.152112 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.154418 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.087041 24036 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.160233 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.109678 24090 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.090196 24057 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:27.175799 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.155821 24089 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.116051 24216 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.200381 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.188010 24219 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.188548 24089 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.218211 24088 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:07:27.210557 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 150830us
I20260709 13:07:27.259444 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.238042 24136 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.272464 22500 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:27.272367 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.280048 22502 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:27.216801 24219 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.275986 22505 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:07:27.290858 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.278506 24095 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:07:27.296603 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.297900 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:27.298481 22504 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.302501 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.303143 22579 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:27.289801 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:27.303742 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.310592 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:27.311832 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:27.311888 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.282416 24088 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.314467 24089 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.296078 24036 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.315232 24088 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.313267 22497 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:27.316748 24219 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.318257 22503 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:27.321388 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.322556 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.322482 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:27.317538 24229 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:27.321812 23848 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:27.329430 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:27.330358 22579 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.309383 23886 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.333781 22577 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:27.311986 24057 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.324958 23934 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:27.338827 23886 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.323591 24147 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.347613 24095 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.348111 23934 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:27.348248 24095 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.349517 23934 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.350823 24095 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.352180 24170 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.360041 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:27.366467 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.367406 22577 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:27.375468 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:27.353312 24224 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:07:27.343606 24216 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.342196 24090 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:07:27.385514 22505 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:27.346218 24176 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.380970 24089 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:27.379489 23886 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:27.393131 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 58884.3us
I20260709 13:07:27.392534 22504 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:27.379779 24057 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:07:27.364382 24147 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.402374 22572 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:27.406172 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:27.408233 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87566.4us
I20260709 13:07:27.432431 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:27.418412 22579 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:27.435645 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:27.436563 24235 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:27.438071 24148 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:27.444018 23848 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:27.459990 23848 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:27.491354 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54357.3us
W20260709 13:07:27.492069 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53621.2us
I20260709 13:07:27.511727 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:27.503351 24176 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:27.572388 24240 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:27.522384 23934 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.573114 23934 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.573498 23934 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:27.573837 24138 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.008s
I20260709 13:07:27.574281 24138 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:27.575507 24233 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:27.578012 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:27.578688 22571 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.579946 22497 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:27.585382 24147 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.586432 24138 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.526021 24237 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:07:27.597489 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61839.6us
I20260709 13:07:27.630909 23934 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.643213 23934 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.611073 22571 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:07:27.643718 24028 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.000s
I20260709 13:07:27.645084 22468 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:27.645946 24204 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:27.646431 24204 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:27.647300 24204 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:27.649765 24178 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.650375 24178 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.653941 23940 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.654497 23940 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.656628 23940 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.662106 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:27.605476 24235 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:07:27.660259 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109897us
I20260709 13:07:27.665776 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:27.652709 24178 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.671262 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.671972 22650 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
W20260709 13:07:27.674043 24238 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:27.683367 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.685118 24249 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:27.685668 24249 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.686182 24248 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:27.686110 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.686915 24248 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:27.687898 24249 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.688055 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.689842 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.696817 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.696564 24235 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.684020 24198 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:27.698985 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.688154 24248 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.700276 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.703490 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.706537 23907 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:27.707145 23907 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.713424 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.714128 22502 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:27.711735 24176 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:27.734324 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.735220 22499 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:27.691447 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.757987 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:27.766173 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.766094 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.767158 22651 raft_consensus.cc:2368] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:07:27.768529 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.769088 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.769224 22648 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:07:27.759774 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.761296 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.761432 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:27.771358 22500 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:27.763612 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.773768 24233 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:27.774376 24233 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.774741 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.776741 24233 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.776842 22403 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 1 to 2, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:27.779903 22500 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:27.441522 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:27.764151 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.711437 23907 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:27.865337 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:07:27.865430 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109640us
I20260709 13:07:27.868285 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.868747 22496 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:07:27.880873 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71748.8us
I20260709 13:07:27.883000 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:27.889052 24217 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.889794 24176 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:27.889663 24217 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:27.890338 24176 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:27.891227 24176 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.894009 23919 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.894620 23919 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.897775 24033 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.898324 24033 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:27.898437 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.899370 22649 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:27.900417 24033 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.909149 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.913763 22619 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:27.921108 22545 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:27.926456 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:27.932199 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:27.932905 22653 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.934675 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.915050 23919 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.917641 24148 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:27.940893 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.941619 22579 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:27.923401 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:27.944885 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.943403 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:27.950117 22653 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:27.944362 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.952620 22572 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:07:27.957192 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:27.938851 24180 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:27.961537 22619 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:27.965138 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:27.967139 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:27.969522 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.970425 24137 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:27.970964 24137 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:27.971366 24137 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.959059 23680 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.972074 23680 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.972438 23680 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:27.973034 24243 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.352s	user 0.005s	sys 0.006s
I20260709 13:07:27.963528 24217 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:27.974030 24217 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.974679 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.976009 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:27.981211 22579 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:27.986146 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:27.987448 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:27.988600 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:27.993155 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:27.954252 23919 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:27.997422 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:28.008380 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:27.944989 24148 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.030470 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.035548 24178 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.036152 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:27.999347 24204 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:27.999071 24138 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:27.998942 24089 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.011363 24057 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.011528 24235 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:28.039983 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.039827 24088 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.036940 23946 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.037544 23886 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:28.066576 23886 consensus_queue.cc:1243] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:28.067391 23886 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:28.067826 23886 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:28.010980 23919 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.071058 23919 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.047703 24217 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.038061 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.083402 24198 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:28.086699 24244 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.472s	user 0.013s	sys 0.020s
I20260709 13:07:28.089473 23888 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:28.101375 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63393.1us
I20260709 13:07:28.032931 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:28.092098 24235 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:28.102216 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:07:28.104526 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 65675.2us
I20260709 13:07:28.113118 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:28.112843 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.113804 22580 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.117451 22574 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.119837 23946 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.120393 23946 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.120682 22580 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:28.120765 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.121946 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:28.122014 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.122498 23780 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.122730 23946 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.123179 23780 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.123770 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:28.108577 24235 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.126139 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:28.123201 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:28.127113 24262 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.131664 24089 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.113019 22647 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:07:28.133251 24137 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.101531 23888 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:28.135409 24137 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.135924 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.137195 22468 leader_election.cc:400] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:07:28.137475 22468 leader_election.cc:403] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.139247 23888 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.140705 23680 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.143610 24088 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.144320 24088 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.145210 23680 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:28.146528 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 131) took 5820 ms. Trace:
I20260709 13:07:28.147145 24148 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:28.107303 24246 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.144176 22403 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 1 to 2, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:28.109259 24180 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.109894 24057 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.149763 22468 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.156574 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.150846 22403 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 1 to 3, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.159250 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:28.159926 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:28.160549 22503 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:28.162537 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.158396 22403 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.166041 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.165024 22403 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.164371 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.171634 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:28.171947 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:28.172211 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:28.172693 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:28.173326 22576 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.154942 24246 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.177199 22571 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:28.183197 23934 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:28.186888 23934 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:28.187299 23934 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:28.150370 24177 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.190491 22617 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.178167 24204 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.211958 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.173893 24138 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:28.213227 22617 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.216984 22502 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:28.149535 22400 rpcz_store.cc:276] 0709 13:07:22.325984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.381040 (+ 55056us) service_pool.cc:224] Handling call
0709 13:07:28.146436 (+5765396us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:25.267071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:25.323636 (+ 56565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:25.323675 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:07:25.323689 (+    14us) tablet.cc:662] Decoding operations
0709 13:07:25.324926 (+  1237us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:25.324979 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:25.325005 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:25.326068 (+  1063us) tablet.cc:701] Row locks acquired
0709 13:07:25.333509 (+  7441us) write_op.cc:260] PREPARE: finished
0709 13:07:25.357822 (+ 24313us) write_op.cc:270] Start()
0709 13:07:25.376562 (+ 18740us) write_op.cc:276] Timestamp: P: 1783602445349825 usec, L: 0
0709 13:07:25.377695 (+  1133us) op_driver.cc:348] REPLICATION: starting
0709 13:07:25.431417 (+ 53722us) log.cc:844] Serialized 5232 byte log entry
0709 13:07:25.706810 (+275393us) op_driver.cc:464] REPLICATION: finished
0709 13:07:25.950535 (+243725us) write_op.cc:301] APPLY: starting
0709 13:07:25.951833 (+  1298us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:25.978871 (+ 27038us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:25.997930 (+ 19059us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:26.003275 (+  5345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:26.003544 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:07:26.003600 (+    56us) write_op.cc:312] APPLY: finished
0709 13:07:26.003959 (+   359us) log.cc:844] Serialized 94 byte log entry
0709 13:07:26.004144 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.004286 (+   142us) write_op.cc:454] Released schema lock
0709 13:07:26.004337 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:26.027700 (+ 23363us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f6e28 00007fec29d31581 00007fec29d30d58 00007fec29d359f1 00007fec29d359a9 00007fec29d35939 00007fec29d35901 00007fec29d34b2d 000000000038f354 000000000038f199
0709 13:07:26.027908 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.027942 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":284036,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":221106,"apply.run_cpu_time_us":4837,"apply.run_wall_time_us":61322,"num_ops":13,"prepare.queue_time_us":503385,"prepare.run_cpu_time_us":24922,"prepare.run_wall_time_us":779697,"raft.queue_time_us":82044,"raft.run_cpu_time_us":57906,"raft.run_wall_time_us":143209,"replication_time_us":324476,"spinlock_wait_cycles":5537024,"thread_start_us":560780,"threads_started":4,"wal-append.queue_time_us":130627,"wal-append.run_cpu_time_us":14809,"wal-append.run_wall_time_us":1404509}]]}
I20260709 13:07:28.108244 23886 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:28.211376 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45422.5us
I20260709 13:07:28.217821 22545 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.219477 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.220652 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.190344 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:28.223852 24263 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.216789 23848 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.227370 23848 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.228109 24088 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:07:28.230096 24246 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:28.230638 23825 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:28.220942 24248 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.196593 24177 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.236742 24177 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.237598 23934 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.238720 23261 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:28.239257 23261 pending_rounds.cc:85] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 3
I20260709 13:07:28.239499 23261 pending_rounds.cc:107] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.4
I20260709 13:07:28.239763 23261 raft_consensus.cc:2917] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Aborting config change with OpId 4.4: Aborted: Op aborted by new leader
I20260709 13:07:28.240152 23261 raft_consensus.cc:2889] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.241262 24235 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.214891 24262 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.215359 24138 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:28.243400 24138 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.248395 24138 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.253482 22580 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:28.253518 22575 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:28.254420 24143 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.254918 24143 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.256119 22573 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:28.238806 23934 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.258561 24242 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:28.197736 24175 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:28.264698 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44133.1us
I20260709 13:07:28.252573 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:28.262504 22576 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:28.256969 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:28.269557 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:28.266175 22468 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.281936 22505 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.260448 23886 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.289156 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:28.291913 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:28.296779 22504 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:28.261538 24154 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:28.312330 22646 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:28.312798 22646 pending_rounds.cc:85] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 3
I20260709 13:07:28.313053 22646 pending_rounds.cc:107] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.4
I20260709 13:07:28.313277 22646 raft_consensus.cc:2917] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Aborting config change with OpId 4.4: Aborted: Op aborted by new leader
I20260709 13:07:28.313649 22646 raft_consensus.cc:2889] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.294324 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:28.301802 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:28.279906 24135 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:28.283602 23848 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:28.265198 22647 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:28.279778 24137 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:28.260701 23980 consensus_queue.cc:1175] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ca917eaada84bf38a5daae9f8ffa066" responder_term: 5 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: [4.2-4.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:28.263453 24036 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:07:28.284348 24175 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:28.302197 24033 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:28.286327 22571 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:28.364641 24175 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.354023 24033 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.368839 24033 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.262795 24262 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:07:28.355044 24143 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.356105 24235 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:28.324479 24263 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.330247 24135 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:28.378749 24263 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.332139 24028 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.384167 22505 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
W20260709 13:07:28.386816 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 171453us
I20260709 13:07:28.394817 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:28.395197 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:28.395576 22502 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:07:28.387717 22619 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.398566 22504 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:28.400002 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:28.395777 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:28.386978 24028 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.385447 24135 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.415303 22572 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:28.440721 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43986.2us
I20260709 13:07:28.388320 23848 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:28.421001 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:28.449416 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:28.450330 22503 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:28.438071 24057 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.455341 22502 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:28.414515 24270 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:28.466784 24270 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.467159 24270 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.443912 24028 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.445238 23825 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:28.515141 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.443184 23940 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:28.465857 24178 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:28.438057 24273 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:07:28.461297 24177 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:07:28.473160 24237 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:07:28.531085 24178 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:28.559540 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.556510 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 99073.1us
I20260709 13:07:28.534053 23926 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:28.565914 24178 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.567101 24138 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.607333 22496 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:28.566255 24270 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.546955 23848 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.583103 24249 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:07:28.630997 24263 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:28.709661 24278 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:28.700541 23888 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:28.698246 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52860.6us
W20260709 13:07:28.727553 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 118615us
I20260709 13:07:28.736599 24282 raft_consensus.cc:1064] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:28.737140 24282 raft_consensus.cc:1068] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Unable to promote non-voter fa2f181263f446a6962b649f9348c15f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:28.722927 22497 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:28.751735 24033 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.762915 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:28.765803 24135 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.772744 24033 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.784809 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:28.785054 24028 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.786520 22576 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:28.790542 24158 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.804675 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:28.805650 22646 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:28.806114 22652 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.797416 24178 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.800426 24135 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.825062 22652 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:28.830359 24176 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:28.831670 24275 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:28.833201 24275 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.833572 24275 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:28.830986 24176 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:28.847332 24176 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.813262 24028 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:28.870115 24275 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:28.872339 24275 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.878293 24270 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:28.880277 24262 raft_consensus.cc:1064] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:28.881196 24262 raft_consensus.cc:1068] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Unable to promote non-voter fa2f181263f446a6962b649f9348c15f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:28.867738 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:28.883313 22647 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.904783 22647 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:28.910808 22619 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:28.913985 23848 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.917017 22500 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:28.918500 22496 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:28.918979 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:28.919678 22502 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.920795 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:28.922539 22499 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:28.921604 23907 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:28.940361 22502 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:07:28.941860 22503 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:07:28.941707 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:28.948969 22579 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.957719 22499 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:28.971482 22579 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:28.984372 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:28.987351 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:28.995882 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:28.999063 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:29.024220 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:29.026086 22573 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:29.031997 22648 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:07:29.033656 24299 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:29.034680 24289 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:29.035256 24289 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:29.035670 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:29.031873 23946 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:29.040535 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:29.049135 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:29.049154 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:29.050967 22499 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.050494 22579 raft_consensus.cc:2368] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:07:29.053602 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:29.058266 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:29.037062 24177 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:07:29.062418 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.025440 23780 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:07:29.070012 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:29.073760 22499 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:29.076807 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:29.060513 24143 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:29.069701 24291 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:07:29.079934 24034 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:29.090893 24034 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:29.091900 24034 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.077000 23926 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.075071 24178 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:29.098780 24143 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:29.069218 23946 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:29.104199 23946 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.086922 24177 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:29.105557 24177 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:29.106441 24177 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.069029 24292 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.094444 24034 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:29.116676 24300 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:29.129973 22576 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:29.137363 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:29.141383 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:29.142289 22647 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.160275 23825 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:29.171254 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.099987 24143 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.180012 22576 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:29.188788 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:29.201476 22500 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:07:29.224576 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 154629us
I20260709 13:07:29.226879 22647 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:29.183518 24036 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:07:29.259295 22468 leader_election.cc:400] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:07:29.259675 22468 leader_election.cc:403] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.036321 24289 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.273144 22502 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:29.278290 24286 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:29.284051 24180 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:07:29.289592 24282 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:07:29.284749 24180 consensus_queue.cc:1243] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:07:29.325304 22496 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:29.501852 24176 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:29.519547 24275 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.004s
I20260709 13:07:29.523167 22648 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:29.383047 23825 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:07:29.531406 22647 pending_rounds.cc:85] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 1
I20260709 13:07:29.531761 22647 pending_rounds.cc:107] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:07:29.532002 22647 raft_consensus.cc:2889] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.533047 24036 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.552120 24036 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.628364 22653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:29.636683 22650 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:29.629561 22653 raft_consensus.cc:606] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:29.638509 22653 raft_consensus.cc:614] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.654057 24034 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:29.657507 24310 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:29.662109 23886 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:29.668220 24176 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.669095 24176 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.671720 24176 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:29.679694 22653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
W20260709 13:07:29.683493 24309 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.182s	user 0.000s	sys 0.009s
I20260709 13:07:29.716925 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:29.717715 22502 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:29.719630 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:29.720433 22646 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:29.738952 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:29.695531 24305 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.182s	user 0.004s	sys 0.000s
I20260709 13:07:29.763785 22502 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:29.745604 24176 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.770792 24265 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.782174 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:29.784164 22653 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:29.782842 22498 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:29.784592 22653 raft_consensus.cc:614] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.779228 24176 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.775765 24036 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:29.794476 22652 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:29.796674 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:29.786332 24265 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.799321 24176 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.813356 24280 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:07:29.825800 22653 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:29.826169 22653 pending_rounds.cc:85] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 3
I20260709 13:07:29.826376 22653 pending_rounds.cc:107] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:29.826722 22653 raft_consensus.cc:2889] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.812775 24175 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.832226 24034 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:29.813606 23926 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:29.851513 23926 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.859184 23926 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:29.844550 24175 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.870244 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:29.874024 24265 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:29.875867 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:29.876552 22503 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:29.877727 22619 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:29.879078 24289 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.879498 24289 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.879868 24289 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:29.879602 24292 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.000s
I20260709 13:07:29.882143 24292 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:29.884234 24316 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:29.885507 22400 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 4 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:29.889518 24175 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.891450 24135 raft_consensus.cc:1064] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:29.894186 24135 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:29.895898 22500 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:29.897293 22503 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:29.897982 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:29.898766 22571 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:29.906144 24281 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.906667 24281 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.911054 22504 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:29.911389 24177 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:29.911810 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:29.916810 24281 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:29.920433 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:29.921171 22571 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:29.928954 22646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ec411c33594ae08408279ef5c44410"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:29.929375 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:29.929585 22646 raft_consensus.cc:606] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:29.929989 22646 raft_consensus.cc:614] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.905782 24289 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.931059 22648 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:29.932027 24289 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:29.933360 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:29.933959 22499 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.938143 24033 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.947499 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:29.952457 22468 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:29.950098 22571 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.953562 22403 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 124) took 6833 ms. Trace:
I20260709 13:07:29.954327 22499 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:29.956192 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:29.957873 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:29.965093 22648 raft_consensus.cc:606] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:29.965512 22648 raft_consensus.cc:614] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.967309 22619 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:29.972359 22545 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:29.977303 22571 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:29.985172 24181 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.988437 24204 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.989084 24204 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:29.998364 22571 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:29.969807 24057 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:29.972844 23848 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:30.009258 22649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:30.009891 22649 raft_consensus.cc:606] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:29.962671 24033 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:29.954383 22403 rpcz_store.cc:276] 0709 13:07:23.137352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.159639 (+ 22287us) service_pool.cc:224] Handling call
0709 13:07:29.951428 (+6791789us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:28.432258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:28.433067 (+   809us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:28.433117 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:07:28.433135 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:28.433993 (+   858us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:28.434095 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:28.434135 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:07:28.435079 (+   944us) tablet.cc:701] Row locks acquired
0709 13:07:28.435107 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:07:28.435291 (+   184us) write_op.cc:270] Start()
0709 13:07:28.435441 (+   150us) write_op.cc:276] Timestamp: P: 1783602448435236 usec, L: 0
0709 13:07:28.435472 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:07:28.436420 (+   948us) log.cc:844] Serialized 2108 byte log entry
0709 13:07:28.821704 (+385284us) op_driver.cc:464] REPLICATION: finished
0709 13:07:28.945711 (+124007us) write_op.cc:301] APPLY: starting
0709 13:07:28.945896 (+   185us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:28.946099 (+   203us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:28.946209 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:28.946959 (+   750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:28.947140 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:07:28.947184 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:28.947382 (+   198us) log.cc:844] Serialized 46 byte log entry
0709 13:07:28.947600 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:28.947736 (+   136us) write_op.cc:454] Released schema lock
0709 13:07:28.947789 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:28.948144 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:28.948163 (+    19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1129973,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":123781,"apply.run_cpu_time_us":2391,"apply.run_wall_time_us":2392,"num_ops":5,"prepare.queue_time_us":165353,"prepare.run_cpu_time_us":49566,"prepare.run_wall_time_us":92230,"raft.queue_time_us":201212,"raft.run_cpu_time_us":46846,"raft.run_wall_time_us":94479,"replication_time_us":386092,"thread_start_us":509097,"threads_started":4,"wal-append.queue_time_us":132909,"wal-append.run_cpu_time_us":9289,"wal-append.run_wall_time_us":1375407}]]}
I20260709 13:07:30.024411 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:30.026412 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:30.031486 23848 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:30.046161 23848 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.048231 24176 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.049638 22576 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:30.024631 24235 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:07:30.141501 24332 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:30.186185 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:30.186899 22576 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:30.190685 24175 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.196668 24176 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:30.139793 23261 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:30.158360 24204 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:30.202271 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:30.231081 22504 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.233748 22576 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:30.210855 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:30.214670 22501 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:30.217377 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:30.245255 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:30.247299 22646 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 6: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:07:30.250046 22653 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:30.250079 22504 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:07:30.245321 24135 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:30.250757 24204 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:07:30.291750 24135 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.333244 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 99928us
I20260709 13:07:30.307966 24135 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:30.347270 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89462us
W20260709 13:07:30.350144 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 91172.1us
I20260709 13:07:30.363369 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:30.365758 22501 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:30.361595 24248 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:07:30.345129 24292 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:07:30.438577 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 192535us
I20260709 13:07:30.428500 24175 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:30.442786 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72490.9us
I20260709 13:07:30.446036 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:30.443264 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 76280.5us
I20260709 13:07:30.447273 24341 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:30.447813 24341 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:30.481120 24341 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.487814 24135 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.505710 24135 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:30.505867 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56572.7us
I20260709 13:07:30.504597 24057 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 2 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:30.513644 24219 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:30.525249 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:30.544536 22499 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:30.563472 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:30.567021 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:30.567672 22575 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.567719 22573 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 2 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:30.577024 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:30.578662 24345 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.585136 24175 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:30.600472 22648 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 2 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:30.607986 22575 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:30.612722 24235 raft_consensus.cc:993] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:30.613428 24235 raft_consensus.cc:1081] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:30.626168 22498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:30.626842 22498 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.627221 22498 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.628536 24135 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.631587 24135 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.633875 24135 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:30.642793 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:30.644019 22498 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.644577 24262 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:30.649187 24262 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:30.650166 24262 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.654487 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:30.655200 22576 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:07:30.648511 23262 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 2 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:30.656109 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:30.656746 22653 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:07:30.648267 24036 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:30.662688 24036 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.664441 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:30.665467 24135 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:30.665933 24135 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.670339 24135 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.677268 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 36) took 1817 ms. Trace:
I20260709 13:07:30.681597 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:30.682205 22502 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:07:30.687098 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:30.687676 22502 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:07:30.666481 24036 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:30.667896 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:30.669210 22498 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:30.688661 22576 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:30.690665 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:30.692028 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:30.694531 22573 raft_consensus.cc:2368] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4.
I20260709 13:07:30.693980 22579 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.677722 22400 rpcz_store.cc:276] 0709 13:07:28.859746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.859940 (+   194us) service_pool.cc:224] Handling call
0709 13:07:29.165470 (+305530us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:07:30.677189 (+1511719us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.049222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.049801 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.049839 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:30.049859 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:30.061145 (+ 11286us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.061224 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.061265 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:30.061502 (+   237us) tablet.cc:701] Row locks acquired
0709 13:07:30.061517 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:07:30.063533 (+  2016us) write_op.cc:270] Start()
0709 13:07:30.073132 (+  9599us) write_op.cc:276] Timestamp: P: 1783602450061631 usec, L: 0
0709 13:07:30.076208 (+  3076us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.154326 (+ 78118us) log.cc:844] Serialized 602 byte log entry
0709 13:07:30.580040 (+425714us) op_driver.cc:464] REPLICATION: finished
0709 13:07:30.646897 (+ 66857us) write_op.cc:301] APPLY: starting
0709 13:07:30.646978 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:30.647085 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:30.647196 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:30.647384 (+   188us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:30.647561 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:30.647608 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:30.669580 (+ 21972us) log.cc:844] Serialized 22 byte log entry
0709 13:07:30.669770 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.669857 (+    87us) write_op.cc:454] Released schema lock
0709 13:07:30.669910 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:30.670266 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.670292 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":635119,"reported_tablets":1,"spinlock_wait_cycles":126611200,"child_traces":[["op",{"apply.queue_time_us":66548,"apply.run_cpu_time_us":1619,"apply.run_wall_time_us":23353,"num_ops":1,"prepare.queue_time_us":160785,"prepare.run_cpu_time_us":29540,"prepare.run_wall_time_us":300897,"raft.queue_time_us":170492,"raft.run_cpu_time_us":8587,"raft.run_wall_time_us":97701,"replication_time_us":485999,"spinlock_wait_cycles":1920,"thread_start_us":479630,"threads_started":4,"wal-append.queue_time_us":217153}]]}
I20260709 13:07:30.711161 24270 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.711830 22579 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:30.714035 22617 leader_election.cc:400] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4.
I20260709 13:07:30.714876 22617 leader_election.cc:403] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:30.715646 24270 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.724932 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:30.725627 22653 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:30.725901 22653 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:30.727762 22579 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:30.726590 22653 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.733647 22653 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.739470 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:30.745313 22653 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:30.735956 24135 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.761771 24137 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:30.762787 24135 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:30.765554 22399 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.766758 24292 raft_consensus.cc:993] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
W20260709 13:07:30.770655 22389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60727.5us
I20260709 13:07:30.770522 22399 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 5, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.772763 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:30.772336 22399 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.776809 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:30.777268 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:30.777415 22579 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.777808 22653 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.767271 24292 raft_consensus.cc:1081] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:30.785380 22579 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:30.787700 24270 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4.
I20260709 13:07:30.789737 22653 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:30.786651 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:30.769958 24137 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:30.793853 22502 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:07:30.795585 22653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45766
I20260709 13:07:30.796237 22653 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.796711 22653 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.796526 24137 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.792526 24282 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:30.800108 24282 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:30.801039 24282 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:30.815392 22399 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.822248 22399 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 2 to 4, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.828364 22653 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:30.831590 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:30.832267 22498 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.832603 22498 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:30.832990 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:30.833815 22579 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:30.844472 22449 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:07:30.844973 22449 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 6f42f0567ae14f62b39e69ed29a409cf already in progress
I20260709 13:07:30.845230 22579 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
W20260709 13:07:30.845257 22449 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 6f42f0567ae14f62b39e69ed29a409cf already in progress
I20260709 13:07:30.854189 22653 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:30.845810 22498 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:30.859809 22498 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.859002 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:30.862952 23262 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.869349 22399 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.871575 23262 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:07:30.871218 22399 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.873369 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:30.875208 24036 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:30.875720 24036 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:30.876503 24036 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:30.879360 22498 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:07:30.890202 22399 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.892534 22399 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 2 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.895093 22399 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.897153 22399 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.898912 22399 catalog_manager.cc:5697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 2, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 2 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.900681 22399 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 2, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.902654 22399 catalog_manager.cc:5697] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.912353 22399 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.914743 22399 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.917053 22399 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 2 to 4, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.919379 22399 catalog_manager.cc:5697] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.921590 22399 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.927338 22399 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 4, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.929312 22399 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 3, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.932987 22399 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 1 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:30.984361 22502 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:30.985965 22400 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 2 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:31.016558 24348 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.027621 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:31.051635 22653 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:31.055709 24342 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.056526 22403 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.059719 22403 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 4, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.061384 22403 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.063019 22403 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.068298 22403 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.070528 22403 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 1 to 2, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 2 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.073163 22403 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.074613 22399 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 144) took 1914 ms. Trace:
I20260709 13:07:31.077270 22403 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.079763 22403 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 5, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 5 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.087985 22403 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.075053 22399 rpcz_store.cc:276] 0709 13:07:29.160712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.161901 (+  1189us) service_pool.cc:224] Handling call
0709 13:07:31.074546 (+1912645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.953507 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.954144 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.954188 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:30.954208 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:30.956982 (+  2774us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.957119 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.957153 (+    34us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:07:30.960119 (+  2966us) tablet.cc:701] Row locks acquired
0709 13:07:30.960188 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:07:30.966466 (+  6278us) write_op.cc:270] Start()
0709 13:07:30.966634 (+   168us) write_op.cc:276] Timestamp: P: 1783602450966367 usec, L: 0
0709 13:07:30.966662 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.967517 (+   855us) log.cc:844] Serialized 8755 byte log entry
0709 13:07:30.976172 (+  8655us) op_driver.cc:464] REPLICATION: finished
0709 13:07:30.977101 (+   929us) write_op.cc:301] APPLY: starting
0709 13:07:30.977197 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:30.977703 (+   506us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:30.977814 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:30.980096 (+  2282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:30.980461 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:07:30.980518 (+    57us) write_op.cc:312] APPLY: finished
0709 13:07:30.981040 (+   522us) log.cc:844] Serialized 151 byte log entry
0709 13:07:30.982058 (+  1018us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.982250 (+   192us) write_op.cc:454] Released schema lock
0709 13:07:30.982327 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:30.990427 (+  8100us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.990458 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":437343,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":661,"apply.run_cpu_time_us":4730,"apply.run_wall_time_us":13266,"num_ops":22,"prepare.queue_time_us":9730,"prepare.run_cpu_time_us":6769,"prepare.run_wall_time_us":22424,"replication_time_us":9338,"thread_start_us":7951,"threads_started":1}]]}
I20260709 13:07:31.260821 22403 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 132) took 1080 ms. Trace:
I20260709 13:07:31.262079 22403 rpcz_store.cc:276] 0709 13:07:30.180104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.180300 (+   196us) service_pool.cc:224] Handling call
0709 13:07:30.460074 (+279774us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:07:31.260538 (+800464us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:31.095852 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:31.096230 (+   378us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:31.096253 (+    23us) write_op.cc:435] Acquired schema lock
0709 13:07:31.096264 (+    11us) tablet.cc:662] Decoding operations
0709 13:07:31.096960 (+   696us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:31.097023 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:31.097058 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:31.097880 (+   822us) tablet.cc:701] Row locks acquired
0709 13:07:31.097900 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:07:31.098047 (+   147us) write_op.cc:270] Start()
0709 13:07:31.098179 (+   132us) write_op.cc:276] Timestamp: P: 1783602451097998 usec, L: 0
0709 13:07:31.098205 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:07:31.103423 (+  5218us) log.cc:844] Serialized 4063 byte log entry
0709 13:07:31.105594 (+  2171us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f6e28 00007fec29d31581 00007fec29d30d58 00007fec29d359f1 00007fec29d359a9 00007fec29d35939 00007fec29d35901 00007fec29d34b2d 000000000038f354 000000000038f199
0709 13:07:31.110501 (+  4907us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.111008 (+   507us) write_op.cc:301] APPLY: starting
0709 13:07:31.111091 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:31.111338 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:31.111364 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:31.112408 (+  1044us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:31.112652 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:31.112713 (+    61us) write_op.cc:312] APPLY: finished
0709 13:07:31.113505 (+   792us) log.cc:844] Serialized 76 byte log entry
0709 13:07:31.113701 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.113853 (+   152us) write_op.cc:454] Released schema lock
0709 13:07:31.113903 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:31.114230 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.114261 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32,"reported_tablets":49,"spinlock_wait_cycles":373943168,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":2743,"apply.run_wall_time_us":3186,"num_ops":10,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":5487,"prepare.run_wall_time_us":9887,"replication_time_us":12167,"spinlock_wait_cycles":10509568}]]}
I20260709 13:07:31.310117 22573 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:31.324887 22648 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:31.326296 22654 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:31.339427 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:31.343051 23926 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.357836 22498 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:31.320742 22402 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.377952 22653 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:31.375486 24057 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:31.383361 24135 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.375321 23926 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:07:31.374235 22402 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.393016 22402 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.408143 24365 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:31.416704 23262 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:31.424033 24270 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:31.426782 22402 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.428434 22402 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.430881 22402 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.445103 22576 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:31.458091 22576 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:31.461431 24365 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:31.477648 22575 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:31.474733 24057 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:07:31.542273 24219 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:31.538930 22402 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 6 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.547839 22402 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.681602 22573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:31.682898 22573 raft_consensus.cc:606] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:31.695178 22646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:31.695860 22646 raft_consensus.cc:606] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:31.700214 22646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:31.700904 22646 raft_consensus.cc:606] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:31.701344 22646 raft_consensus.cc:614] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.704774 22646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be7264d3053b44989c5504d296ea482b"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:31.705790 22646 raft_consensus.cc:606] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:31.711627 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:31.712455 22654 raft_consensus.cc:606] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:31.721832 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:31.722438 22654 raft_consensus.cc:606] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:31.727284 22403 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 6 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:31.728623 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:31.732378 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:31.745306 24273 raft_consensus.cc:993] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:31.745913 24273 raft_consensus.cc:1081] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:31.756162 22498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be7264d3053b44989c5504d296ea482b"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:31.756898 22498 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.757304 22498 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.766685 24366 raft_consensus.cc:993] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:31.767379 24366 raft_consensus.cc:1081] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:31.769642 22502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:31.770191 22502 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.770568 22502 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.770799 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 125) took 1094 ms. Trace:
I20260709 13:07:31.774271 22399 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.775285 22498 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:31.776255 22399 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.771169 22402 rpcz_store.cc:276] 0709 13:07:30.676837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.677141 (+   304us) service_pool.cc:224] Handling call
0709 13:07:31.770743 (+1093602us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:31.630436 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:31.642354 (+ 11918us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:31.642413 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:07:31.642436 (+    23us) tablet.cc:662] Decoding operations
0709 13:07:31.643563 (+  1127us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:31.643678 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:31.643704 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:31.655179 (+ 11475us) tablet.cc:701] Row locks acquired
0709 13:07:31.655222 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:07:31.655401 (+   179us) write_op.cc:270] Start()
0709 13:07:31.655571 (+   170us) write_op.cc:276] Timestamp: P: 1783602451655340 usec, L: 0
0709 13:07:31.655606 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:07:31.662000 (+  6394us) log.cc:844] Serialized 3277 byte log entry
0709 13:07:31.698846 (+ 36846us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.710502 (+ 11656us) write_op.cc:301] APPLY: starting
0709 13:07:31.710654 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:31.710905 (+   251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:31.711631 (+   726us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:31.713073 (+  1442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:31.713379 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:07:31.713452 (+    73us) write_op.cc:312] APPLY: finished
0709 13:07:31.713818 (+   366us) log.cc:844] Serialized 64 byte log entry
0709 13:07:31.714998 (+  1180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.715124 (+   126us) write_op.cc:454] Released schema lock
0709 13:07:31.715188 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:31.745148 (+ 29960us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.745184 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2083,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":9302,"apply.run_cpu_time_us":3485,"apply.run_wall_time_us":34590,"num_ops":8,"prepare.queue_time_us":18846,"prepare.run_cpu_time_us":5409,"prepare.run_wall_time_us":35032,"replication_time_us":43085,"thread_start_us":18500,"threads_started":2}]]}
I20260709 13:07:31.779410 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:31.788264 22580 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.788475 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:31.789131 22654 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.789430 22654 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:31.790277 22654 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:31.791529 22654 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.778337 22399 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.780643 22498 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:31.787358 22502 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:31.793810 22399 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 6 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:07:31.802204 22580 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:31.803357 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:31.804029 22573 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.804096 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:31.806142 24057 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:31.806676 24057 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:31.807304 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:31.807963 22646 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:31.807683 24057 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:31.808283 22646 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:31.809167 22646 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:31.810293 22646 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.810446 22654 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:31.827217 22502 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:31.828645 22573 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:31.832342 22646 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:31.832435 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:31.833647 24204 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:31.834316 24204 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:31.835534 24204 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:31.918599 22654 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:31.959414 24034 raft_consensus.cc:993] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:31.960012 24034 raft_consensus.cc:1081] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:31.963088 23262 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:31.976269 24365 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.992431 22504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59530
I20260709 13:07:31.993101 22504 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.993511 22504 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.997458 22580 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:31.999203 24273 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:32.007452 22504 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.009876 22504 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:32.012912 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:32.013622 22580 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.013968 22580 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:32.015058 22580 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.016368 22580 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.015782 24366 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:32.023554 22579 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:32.029348 22580 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:32.030728 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:32.031713 24204 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.032475 24204 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:32.033561 24204 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.056830 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:07:32.065994 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101965us
I20260709 13:07:32.073410 22654 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.114589 23262 raft_consensus.cc:2955] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:32.163607 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f42f0567ae14f62b39e69ed29a409cf with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:32.197484 22647 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:32.217664 22579 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:32.219339 24204 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.235081 22654 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
W20260709 13:07:32.250847 22618 consensus_peers.cc:597] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6530ceb18c814f10ad99777fb17a2ea1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:32.253363 22580 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.261245 22402 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.263566 22402 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.267040 24273 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.287525 22399 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 5 to 7, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:32.318307 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f42f0567ae14f62b39e69ed29a409cf with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:32.335265 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 145) took 1085 ms. Trace:
I20260709 13:07:32.335755 22400 rpcz_store.cc:276] 0709 13:07:31.250621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.252076 (+  1455us) service_pool.cc:224] Handling call
0709 13:07:32.335079 (+1083003us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6500,"reported_tablets":34}
I20260709 13:07:32.344938 22504 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.354015 24270 raft_consensus.cc:993] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:32.355080 24366 raft_consensus.cc:1081] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:32.358376 22648 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:32.361393 22400 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.379521 22647 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:32.381652 24204 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:07:32.394222 24387 tablet_replica.cc:333] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:07:32.400029 24365 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:32.404843 24387 raft_consensus.cc:2243] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:32.409415 24265 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:32.414565 24387 raft_consensus.cc:2272] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:32.418015 24270 raft_consensus.cc:993] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:32.419302 24270 raft_consensus.cc:1081] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:32.416153 22580 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:32.424901 24387 ts_tablet_manager.cc:1916] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:32.437413 22501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:32.438310 22501 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.437214 22576 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:32.438690 22501 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.449645 22496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:32.450325 22496 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.450721 22496 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.453292 22403 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:32.458467 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73861us
I20260709 13:07:32.473717 24390 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.475844 22579 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:32.485734 24204 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:32.506053 22575 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:32.510878 24057 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.519999 22496 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.494134 22501 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.527987 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:32.528625 22575 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.534976 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:32.535619 22648 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:32.535907 22648 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:32.536068 22499 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:32.536791 22648 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.538019 22648 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.537315 22501 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:32.547111 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:32.547745 22577 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.564965 22648 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:32.566646 22575 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:32.567711 22496 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:32.571609 22468 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:32.576921 22577 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:32.580220 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:32.580648 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:32.581121 22654 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.583823 22654 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:32.576027 24204 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:32.588270 24135 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.595184 24204 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:32.627810 24135 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:32.642388 24135 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.675869 24204 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:32.678467 24394 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:07:32.680398 22654 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:32.681735 22654 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:32.686039 24396 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:07:32.686486 22544 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a60725e5550479db8d1e52b48126750. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:32.701246 22654 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
W20260709 13:07:32.714407 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 128387us
W20260709 13:07:32.740216 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 107664us
I20260709 13:07:32.748231 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:32.783254 24395 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:07:32.795288 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50948.1us
I20260709 13:07:32.813318 22647 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:32.818549 24387 ts_tablet_manager.cc:1929] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:07:32.819818 24387 log.cc:1199] T 6f42f0567ae14f62b39e69ed29a409cf P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/6f42f0567ae14f62b39e69ed29a409cf
I20260709 13:07:32.827212 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet 6f42f0567ae14f62b39e69ed29a409cf (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
W20260709 13:07:32.838858 24380 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:32.849414 22403 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.888326 22501 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:32.910987 22647 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:32.923992 24421 ts_tablet_manager.cc:933] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:32.934530 24410 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.934789 24421 tablet_copy_client.cc:323] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:32.946619 22663 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 6530ceb18c814f10ad99777fb17a2ea1 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:32.947245 22663 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 6530ceb18c814f10ad99777fb17a2ea1 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-6530ceb18c814f10ad99777fb17a2ea1
I20260709 13:07:32.956359 22663 tablet_copy_source_session.cc:215] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:32.968739 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:32.969081 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 159922us
I20260709 13:07:32.970481 24421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6530ceb18c814f10ad99777fb17a2ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:32.986210 24413 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.999549 24181 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.009222 24410 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.011483 22647 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.023566 22399 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.024845 24421 tablet_copy_client.cc:806] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:33.025645 24421 tablet_copy_client.cc:670] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:33.036722 24421 tablet_copy_client.cc:538] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:33.055279 24421 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:33.066643 22400 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.109582 22501 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.121773 22580 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.128027 22576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:33.128808 22576 raft_consensus.cc:606] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:33.131280 24413 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.137238 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:33.137910 22654 raft_consensus.cc:606] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:33.139451 22580 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:33.141212 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:33.141803 22654 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:33.145776 24421 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:33.147011 24421 tablet_bootstrap.cc:492] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:33.147284 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:33.147898 22654 raft_consensus.cc:606] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:33.147964 24421 ts_tablet_manager.cc:1403] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.007s
I20260709 13:07:33.151474 22647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:33.152100 22647 raft_consensus.cc:606] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:33.151788 24421 raft_consensus.cc:359] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:33.153190 24421 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:33.154048 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:33.153935 24421 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:33.155881 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:33.170351 24421 ts_tablet_manager.cc:1434] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:07:33.177197 22663 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-6530ceb18c814f10ad99777fb17a2ea1 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:33.177733 22663 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-6530ceb18c814f10ad99777fb17a2ea1 on tablet 6530ceb18c814f10ad99777fb17a2ea1 with peer fa2f181263f446a6962b649f9348c15f
W20260709 13:07:33.187126 22544 consensus_peers.cc:597] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 360d81cdb43c4dd69ba77b3db56e94e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.187527 22654 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.189143 24410 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.190335 22501 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.195640 24181 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:33.199419 22647 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.214481 22580 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:33.224021 24421 ts_tablet_manager.cc:933] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:33.225394 24420 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.231423 22647 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:33.230628 24091 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.235133 22648 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.245258 24421 tablet_copy_client.cc:323] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:33.247596 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet 0a60725e5550479db8d1e52b48126750 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:33.248190 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet 0a60725e5550479db8d1e52b48126750 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-0a60725e5550479db8d1e52b48126750
I20260709 13:07:33.248165 22501 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.256842 22590 tablet_copy_source_session.cc:215] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:33.262310 24419 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.263782 24421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a60725e5550479db8d1e52b48126750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:33.273428 24401 raft_consensus.cc:993] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:33.274011 24401 raft_consensus.cc:1081] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:33.280668 22502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:33.281250 22502 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.281168 23262 raft_consensus.cc:1217] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:07:33.281777 22502 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.288672 22502 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:33.296468 22502 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:33.294622 24420 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:07:33.281777 22648 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:33.301122 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:33.301720 22576 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.304428 22399 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.307930 22576 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:33.309710 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:33.310464 24420 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.310959 24420 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:33.311811 24420 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:33.312564 24402 raft_consensus.cc:993] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:33.313120 24402 raft_consensus.cc:1081] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:33.318399 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:33.319231 22653 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:33.319608 22653 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:33.325039 22501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:33.325718 22501 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.328089 22501 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.333850 22653 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:33.343425 22653 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.356654 24421 tablet_copy_client.cc:806] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:33.357465 24421 tablet_copy_client.cc:670] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
W20260709 13:07:33.358132 22618 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b79bbacdb324d378e564aba36fc4014. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.361693 24414 raft_consensus.cc:993] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:33.363942 22501 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.362371 24414 raft_consensus.cc:1081] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:33.372506 22504 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.374183 24414 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.386178 22501 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:33.389098 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:33.389901 22576 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.402488 22575 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.405896 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:33.406764 22648 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:33.407219 22648 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:33.408376 22576 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:33.409698 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:33.411345 22575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:07:33.412110 22575 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.412554 22575 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.415601 22653 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:33.419269 22648 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.426740 24408 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.426537 24403 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:33.464344 22576 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:33.471941 22575 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:33.477497 24402 raft_consensus.cc:993] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:33.478279 24402 raft_consensus.cc:1081] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:33.479619 22575 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:33.483424 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:33.484126 23262 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.484774 22648 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.489312 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:33.490195 22654 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:33.490597 22654 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:33.491436 22654 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:33.492628 22654 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.455380 24408 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:33.504535 24408 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.495627 22403 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.510111 22499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:33.510713 22499 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.511058 22499 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.517808 22648 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:33.521766 24409 raft_consensus.cc:993] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:33.522358 24409 raft_consensus.cc:1081] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
W20260709 13:07:33.526799 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71235.1us
I20260709 13:07:33.529743 22499 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.535923 24414 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.537400 22502 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.543505 22654 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:07:33.549930 22648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:33.550530 22648 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.550904 22648 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.562047 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:33.562479 23262 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:07:33.562698 22580 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.563985 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:33.564916 24181 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:33.565629 24181 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:33.566534 24181 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:33.570788 22580 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:33.571342 22499 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:33.573154 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:33.574242 24420 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.574754 24420 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:33.575640 24420 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.596349 22648 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.596091 22580 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.600303 22648 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:33.604265 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:33.605167 22576 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:33.606109 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:33.606740 22499 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.606452 22576 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:33.609680 24421 tablet_copy_client.cc:538] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:33.607512 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:33.612687 22654 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:33.613044 22654 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:33.616544 22499 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:33.619400 22576 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.626848 22576 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.630308 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:33.632750 24401 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:33.633421 24401 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:33.634459 24401 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.641963 22654 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:33.649698 22576 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:33.649904 22403 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.654007 22654 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.653841 22403 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:33.675349 22403 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.677790 24421 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:33.709023 22654 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:33.717845 22400 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 7 to 8, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 8 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.720184 24445 ts_tablet_manager.cc:933] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:33.725958 22648 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.736070 24399 raft_consensus.cc:1064] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:33.747514 24399 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:33.731128 24408 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:33.761543 22580 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.763885 24445 tablet_copy_client.cc:323] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:33.762620 22400 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.766089 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet 360d81cdb43c4dd69ba77b3db56e94e4 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:33.769526 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet 360d81cdb43c4dd69ba77b3db56e94e4 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-360d81cdb43c4dd69ba77b3db56e94e4
I20260709 13:07:33.786770 24408 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.807996 22590 tablet_copy_source_session.cc:215] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:33.812435 24445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d81cdb43c4dd69ba77b3db56e94e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:33.816022 23262 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:33.819159 22576 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:33.820959 24401 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.823464 22499 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:33.833045 24399 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.838666 24414 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.860531 24445 tablet_copy_client.cc:806] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:33.861240 24445 tablet_copy_client.cc:670] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:33.902297 24421 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:33.903314 24421 tablet_bootstrap.cc:492] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:33.904006 24421 ts_tablet_manager.cc:1403] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.226s	user 0.027s	sys 0.005s
I20260709 13:07:33.893297 24445 tablet_copy_client.cc:538] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:33.915836 24421 raft_consensus.cc:359] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:33.916802 24421 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:33.917640 24421 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:33.932329 24414 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:33.947238 23261 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:33.949560 24421 ts_tablet_manager.cc:1434] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:07:33.952342 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-0a60725e5550479db8d1e52b48126750 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:33.952826 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-0a60725e5550479db8d1e52b48126750 on tablet 0a60725e5550479db8d1e52b48126750 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:33.960842 24445 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:33.974531 24421 ts_tablet_manager.cc:933] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:33.978889 23264 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:33.980768 24091 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:33.988903 22576 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:33.996518 22580 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:34.013549 24420 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:34.015004 22403 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.003548 22499 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.041505 22648 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:34.049224 22575 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:34.050927 24417 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:34.058139 22648 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:34.059960 24399 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.060437 23261 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:34.068284 24445 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:34.079072 22575 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.083817 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6530ceb18c814f10ad99777fb17a2ea1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:34.084422 24342 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:34.085497 24445 tablet_bootstrap.cc:492] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:34.086396 24445 ts_tablet_manager.cc:1403] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.126s	user 0.034s	sys 0.008s
I20260709 13:07:34.092125 24445 raft_consensus.cc:359] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:34.102895 24445 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:34.103839 24445 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:34.108454 24445 ts_tablet_manager.cc:1434] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:07:34.110607 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-360d81cdb43c4dd69ba77b3db56e94e4 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:34.111081 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-360d81cdb43c4dd69ba77b3db56e94e4 on tablet 360d81cdb43c4dd69ba77b3db56e94e4 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:34.116827 22575 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:34.127210 22648 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:34.134217 24408 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:34.168380 22654 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:34.169498 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.173741 24418 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:34.092908 24417 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:34.195775 22575 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:34.195775 22504 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:34.200697 24439 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:34.217831 24421 tablet_copy_client.cc:323] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:34.219715 22663 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 5b79bbacdb324d378e564aba36fc4014 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:34.220301 22663 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 5b79bbacdb324d378e564aba36fc4014 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-5b79bbacdb324d378e564aba36fc4014
I20260709 13:07:34.233748 22663 tablet_copy_source_session.cc:215] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:34.236896 23262 raft_consensus.cc:1217] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:07:34.242179 22403 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.247816 24421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b79bbacdb324d378e564aba36fc4014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.250676 24402 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:34.256147 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet 6530ceb18c814f10ad99777fb17a2ea1 with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:34.256053 24418 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:34.281555 24421 tablet_copy_client.cc:806] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:34.283185 24421 tablet_copy_client.cc:670] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:34.283265 23261 raft_consensus.cc:1217] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:07:34.263561 23264 raft_consensus.cc:2955] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.308569 24421 tablet_copy_client.cc:538] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:34.355863 24463 tablet_replica.cc:333] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:07:34.416882 24463 raft_consensus.cc:2243] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:34.417786 24463 raft_consensus.cc:2272] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:34.424751 24421 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:34.440579 24463 ts_tablet_manager.cc:1916] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:34.480855 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.513516 24463 ts_tablet_manager.cc:1929] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:07:34.514070 24463 log.cc:1199] T 6530ceb18c814f10ad99777fb17a2ea1 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/6530ceb18c814f10ad99777fb17a2ea1
I20260709 13:07:34.516112 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet 6530ceb18c814f10ad99777fb17a2ea1 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:34.596944 24421 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:34.598052 24421 tablet_bootstrap.cc:492] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:34.598807 24421 ts_tablet_manager.cc:1403] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.174s	user 0.030s	sys 0.000s
I20260709 13:07:34.602360 24421 raft_consensus.cc:359] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:34.603276 24421 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:34.603966 24421 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:34.609833 24421 ts_tablet_manager.cc:1434] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:34.614603 22663 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-5b79bbacdb324d378e564aba36fc4014 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:34.615134 22663 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-5b79bbacdb324d378e564aba36fc4014 on tablet 5b79bbacdb324d378e564aba36fc4014 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:34.615293 22575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:34.615965 22575 raft_consensus.cc:606] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:34.631289 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:34.631970 22654 raft_consensus.cc:606] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:34.635928 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:34.636722 22502 raft_consensus.cc:606] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:34.652730 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:34.654641 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:34.692579 24181 raft_consensus.cc:1064] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:34.693202 24181 raft_consensus.cc:1068] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Unable to promote non-voter fa2f181263f446a6962b649f9348c15f: Service unavailable: leader transfer in progress
I20260709 13:07:34.704082 24399 raft_consensus.cc:993] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:34.704573 24399 raft_consensus.cc:1081] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:34.712371 22502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:34.713001 22502 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.713384 22502 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.723512 22502 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:34.729920 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:34.730525 22575 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.730885 22502 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:34.731036 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:34.731689 22654 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:34.732004 22654 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:34.732854 22654 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:34.734234 22654 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.745970 22575 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:34.748306 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:34.749763 24420 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:34.750380 24420 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:34.751791 22654 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:34.755877 24420 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:34.776351 22399 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.798702 24407 raft_consensus.cc:1064] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:34.801384 24407 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:34.818423 23264 raft_consensus.cc:1217] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:07:34.825686 22502 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:34.827879 24407 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:34.828811 23264 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:34.832828 22648 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:34.830544 24342 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:34.837059 24181 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:34.886786 24342 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.901714 22502 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.931915 22648 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.952467 24420 raft_consensus.cc:993] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:34.953528 24408 raft_consensus.cc:1081] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:34.956686 22575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:34.957326 22575 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.957696 22575 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.957907 23261 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:34.970819 24475 raft_consensus.cc:993] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:34.971432 24475 raft_consensus.cc:1081] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:34.974061 22654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:34.974758 22654 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.975215 22654 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.023962 22575 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:35.027055 22654 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:35.027676 22575 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:35.028559 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:35.029165 22502 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:35.029462 22502 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:35.029925 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:35.030483 22499 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.030200 22502 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:35.031280 22502 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.040323 22499 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:35.042359 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:35.042378 22619 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:35.043098 22648 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.045002 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:35.045576 24399 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:35.046273 24399 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:35.045657 22575 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:35.047459 22575 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:35.050524 22648 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:07:35.052016 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:35.048249 22575 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:35.052769 24342 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:35.053287 22575 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.053285 24342 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:35.054441 24342 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:35.052253 22502 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:07:35.047847 22402 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:35.064994 22654 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:35.064502 22575 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:35.056571 24399 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:35.135495 22402 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 6 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.136112 22403 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.180650 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:35.181254 22648 raft_consensus.cc:606] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership
I20260709 13:07:35.187280 22575 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:35.187948 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:35.188524 22648 raft_consensus.cc:606] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership
W20260709 13:07:35.189677 22387 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0a60725e5550479db8d1e52b48126750 already in progress [suppressed 3 similar messages]
I20260709 13:07:35.199714 23261 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:35.201561 24091 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.203336 22498 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:35.205688 24181 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.207018 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:35.207587 22648 raft_consensus.cc:606] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership
W20260709 13:07:35.214562 22449 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:07:35.215054 22449 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0a60725e5550479db8d1e52b48126750 already in progress
W20260709 13:07:35.215420 22449 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0a60725e5550479db8d1e52b48126750 already in progress
I20260709 13:07:35.214661 24181 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:35.217453 22498 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:35.219121 23261 raft_consensus.cc:2955] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:35.373556 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 360d81cdb43c4dd69ba77b3db56e94e4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:35.394234 22402 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.454088 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet 360d81cdb43c4dd69ba77b3db56e94e4 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45752
W20260709 13:07:35.477084 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 255295us
I20260709 13:07:35.479431 24483 tablet_replica.cc:333] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:07:35.489786 22575 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:35.506661 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48476.3us
I20260709 13:07:35.513437 24401 raft_consensus.cc:1064] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:35.516312 24401 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:35.534759 22499 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:35.551847 23261 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:35.553284 24414 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.553577 24483 raft_consensus.cc:2243] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.554800 24483 raft_consensus.cc:2272] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.558403 24483 ts_tablet_manager.cc:1916] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:35.559309 24420 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.560108 22499 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:35.579021 23261 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Advancing to term 6
I20260709 13:07:35.586642 24401 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.587384 23261 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:35.591557 24482 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.591969 22653 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:35.597709 24414 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:35.621718 22575 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:35.628808 24483 ts_tablet_manager.cc:1929] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:07:35.629549 24483 log.cc:1199] T 360d81cdb43c4dd69ba77b3db56e94e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/360d81cdb43c4dd69ba77b3db56e94e4
I20260709 13:07:35.631639 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet 360d81cdb43c4dd69ba77b3db56e94e4 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:35.642469 24418 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.655803 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.661110 24402 raft_consensus.cc:1064] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:35.661612 24402 raft_consensus.cc:1068] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Unable to promote non-voter fa2f181263f446a6962b649f9348c15f: Service unavailable: leader transfer in progress
I20260709 13:07:35.682116 24399 raft_consensus.cc:993] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:35.682592 24414 raft_consensus.cc:1081] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:35.685357 22502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:35.690119 22498 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:35.693017 22653 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:35.695169 24181 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.698699 24091 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.723186 22575 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:35.701496 24414 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:07:35.754035 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56021.1us
I20260709 13:07:35.783674 22502 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.784134 22502 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.824715 22502 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:35.860682 24484 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:35.865679 24399 raft_consensus.cc:1064] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:35.866147 24399 raft_consensus.cc:1068] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Unable to promote non-voter fa2f181263f446a6962b649f9348c15f: Service unavailable: leader transfer in progress
I20260709 13:07:35.866885 24495 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:35.906170 22500 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:35.920519 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:35.949967 22502 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:35.981523 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.987993 22576 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:36.055246 23261 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:36.081867 22399 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:36.091905 22653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66564b8595294cedb0956a6878879f95"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:36.092595 22653 raft_consensus.cc:606] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:36.136125 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 207467us
W20260709 13:07:36.142212 24508 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:36.160218 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:36.169087 22504 raft_consensus.cc:606] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:36.181945 22575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:36.182600 22575 raft_consensus.cc:606] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:36.184110 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:07:36.185657 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 50732.2us
I20260709 13:07:36.186007 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:36.189586 22653 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:36.188753 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73017.4us
I20260709 13:07:36.223416 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:36.224074 22648 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.224390 22648 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:36.225543 22504 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:36.225255 22648 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:36.226675 22648 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.235662 22648 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:36.260367 23261 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:36.263370 24484 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:36.270704 22498 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:36.275661 24482 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:36.286615 24399 raft_consensus.cc:993] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:36.287137 24399 raft_consensus.cc:1081] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:36.289161 24499 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:36.300559 22498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66564b8595294cedb0956a6878879f95"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:36.301190 22498 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.301527 22498 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:36.306294 22500 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:36.311434 23261 raft_consensus.cc:2955] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:36.312762 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b79bbacdb324d378e564aba36fc4014 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:36.319944 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:36.321636 24477 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:36.322182 24477 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:36.325143 24477 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:36.326224 22498 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.341456 22498 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:36.344075 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:36.345010 22576 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:36.347725 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:36.348378 22649 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:36.348673 22649 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:36.349545 22649 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.350870 22649 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:36.346114 22399 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.358481 22576 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:36.365473 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:36.374451 22649 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:36.370607 24419 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:36.384467 22402 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 7, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.395955 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b79bbacdb324d378e564aba36fc4014 with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41926
I20260709 13:07:36.394536 24419 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:36.401835 24419 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.419198 24513 tablet_replica.cc:333] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:07:36.422324 24513 raft_consensus.cc:2243] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.423393 24513 raft_consensus.cc:2272] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.427228 24513 ts_tablet_manager.cc:1916] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:36.439065 24342 raft_consensus.cc:993] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:36.439669 24091 raft_consensus.cc:1081] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:36.440421 22402 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.442538 22648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:36.443182 22648 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.443572 22648 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.458015 22648 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.466709 22648 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:36.467319 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:36.468026 22501 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.468730 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:36.470153 22576 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:36.470511 22576 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:36.471340 22576 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.472138 22576 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.463303 24513 ts_tablet_manager.cc:1929] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:07:36.475605 24513 log.cc:1199] T 5b79bbacdb324d378e564aba36fc4014 P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/5b79bbacdb324d378e564aba36fc4014
I20260709 13:07:36.477525 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet 5b79bbacdb324d378e564aba36fc4014 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:36.480309 22576 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:36.481535 22617 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:36.482034 22501 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:36.482450 24414 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:36.483016 24414 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:36.484004 24414 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.488665 24498 raft_consensus.cc:993] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:36.489365 24493 raft_consensus.cc:1081] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:36.493808 22576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:36.494529 22576 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.494983 22576 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.504698 22576 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.507790 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:36.508275 22501 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.508548 22501 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:36.509454 22576 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:36.510133 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:36.510701 22648 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.509240 22501 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.513769 22501 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.517975 22648 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:07:36.519716 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:36.520622 24342 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:36.521191 24342 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:36.521931 24342 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:36.523334 22501 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:07:36.528587 22402 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 5, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.554651 22402 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 6 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:36.702662 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 125398us
I20260709 13:07:36.788187 22648 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:36.790252 24419 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:07:36.837747 23261 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Advancing to term 7
I20260709 13:07:36.856215 23261 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:36.862365 24493 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:36.898492 22577 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.905560 22500 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:36.912799 22577 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:36.921551 24477 raft_consensus.cc:1064] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:36.917321 24484 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:07:36.927546 24493 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:36.929678 24477 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:36.938916 22576 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:36.942842 24419 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:36.972308 22575 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:36.975178 24499 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:36.980521 22653 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:36.992440 24505 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:36.995327 22653 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:36.996829 24517 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:37.017314 22648 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:37.028379 24493 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:37.036513 22573 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:37.040611 23261 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:37.042734 24419 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:37.060657 22499 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:37.172745 24342 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:37.179840 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 121602us
I20260709 13:07:37.181529 24498 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:37.187242 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:37.216338 24530 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:37.240047 22649 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:37.266053 23261 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:37.281561 22577 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:37.298688 22403 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:38.419731 24534 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.049s	sys 0.136s
W20260709 13:07:38.420450 24534 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.049s	sys 0.136s
I20260709 13:07:38.441239 24414 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.442055 24414 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.445538 24414 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.459986 24181 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.460599 24181 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.473897 24181 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:38.481949 24482 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.485697 24482 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.504304 24482 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.422468 24342 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.507067 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:38.524541 22399 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 180) took 1199 ms. Trace:
I20260709 13:07:38.525382 22399 rpcz_store.cc:276] 0709 13:07:37.325248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.325813 (+   565us) service_pool.cc:224] Handling call
0709 13:07:38.524446 (+1198633us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:07:38.523505 24342 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.530172 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 165) took 1204 ms. Trace:
I20260709 13:07:38.530864 22402 rpcz_store.cc:276] 0709 13:07:37.325653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.325784 (+   131us) service_pool.cc:224] Handling call
0709 13:07:37.338723 (+ 12939us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:07:38.530096 (+1191373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12979,"reported_tablets":3,"spinlock_wait_cycles":24557312}
I20260709 13:07:38.536422 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 166) took 1194 ms. Trace:
I20260709 13:07:38.537068 22400 rpcz_store.cc:276] 0709 13:07:37.341573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.341690 (+   117us) service_pool.cc:224] Handling call
0709 13:07:37.358121 (+ 16431us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b5400002438. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0ba173 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:07:38.536335 (+1178214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7556,"reported_tablets":1,"spinlock_wait_cycles":9201792}
I20260709 13:07:38.547439 22499 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:38.553097 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 76207.6us
I20260709 13:07:38.555589 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.557108 24342 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:38.579309 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.570354 24498 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.591895 24556 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.578547 24547 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.595984 24556 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.596726 24547 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.601354 24498 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:38.608734 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9100 after lost signal to thread 21393
W20260709 13:07:38.610054 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080020ec80 after lost signal to thread 22437
I20260709 13:07:38.610414 24547 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:07:38.611325 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800064b60 after lost signal to thread 22529
I20260709 13:07:38.611604 24498 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:07:38.612509 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800038d60 after lost signal to thread 22604
I20260709 13:07:38.614144 24556 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.609917 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:07:38.612815 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800041c80 after lost signal to thread 22605
W20260709 13:07:38.616263 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2bc0 after lost signal to thread 22678
W20260709 13:07:38.616613 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc5e0 after lost signal to thread 22679
W20260709 13:07:38.617843 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080031b860 after lost signal to thread 23288
W20260709 13:07:38.619138 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5100 after lost signal to thread 24535
I20260709 13:07:38.619851 23264 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:38.621770 24548 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.622330 24548 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.624347 24548 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.625119 24498 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:38.631099 24551 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:38.631696 24551 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:07:38.635598 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56615us
I20260709 13:07:38.624794 24548 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.636370 24548 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.638855 24551 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:38.639320 24548 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.641235 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.641242 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.640671 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:38.645174 24548 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.645304 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:38.646032 24551 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.645804 24548 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.648820 24548 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.649917 22577 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:38.651265 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:38.654366 24553 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:38.654814 24530 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.654891 24553 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.657531 24553 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:38.660454 24548 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.661078 24548 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:38.661415 24530 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:38.663295 24548 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:38.675382 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:38.677094 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.678855 24553 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:38.679559 24553 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:38.680958 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 127052us
I20260709 13:07:38.687011 24547 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.687059 24558 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.687688 24547 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.687924 24558 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:38.690420 24547 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.692337 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.692621 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.696683 24559 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.697242 24559 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.698073 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.698849 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.699070 24547 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.698352 24554 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:38.699544 24547 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.700165 24559 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.701628 24547 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.708098 23264 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:38.714799 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.717342 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a60725e5550479db8d1e52b48126750 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:38.718676 22580 raft_consensus.cc:2955] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:38.721943 24553 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:38.728502 24548 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.729354 24548 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.770097 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.770946 24558 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:38.771394 24559 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.778406 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.778276 22402 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:38.779331 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.772219 24547 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.772850 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.781180 24547 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.783262 24547 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.783504 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.784950 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.784497 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.786489 24414 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.778221 24559 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.787240 24547 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:38.787205 24414 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:38.787932 24547 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.789142 24559 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.789186 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.789927 24414 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:38.789966 24547 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.791157 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.792302 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.794088 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.795635 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:07:38.796676 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62938.1us
I20260709 13:07:38.797315 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:38.797647 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:38.801050 22647 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:07:38.807518 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.810194 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:38.811918 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:38.812572 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.813046 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.815343 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:38.819293 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:38.825479 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.828461 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:38.829859 24536 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.830248 24536 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.830379 24548 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.830673 24536 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:38.842247 24536 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.845498 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:38.846712 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.848507 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.849308 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.859238 22501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:38.860038 22501 raft_consensus.cc:606] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:38.871210 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:38.872097 22577 raft_consensus.cc:606] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:38.874908 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:38.876657 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:38.898023 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:38.902321 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:38.903306 24548 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:38.910189 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.910576 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.911715 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.916592 24537 raft_consensus.cc:993] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:38.917095 24537 raft_consensus.cc:1081] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:38.917590 22619 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:38.919219 22654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:38.920029 22654 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.920388 22654 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.844379 24536 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:38.923264 24548 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.928853 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.933176 22654 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.919490 22545 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:38.935760 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.937652 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:38.938962 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:38.939566 22504 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:38.939746 22545 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:38.943184 24530 raft_consensus.cc:993] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:38.943727 24530 raft_consensus.cc:1081] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:38.945214 24091 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.945864 24091 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:38.938962 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.949726 22504 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:38.937794 24536 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:38.965878 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:38.966066 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:38.967005 24558 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:38.967506 24558 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:38.968453 24558 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.982553 24536 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:38.984925 22654 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:38.983130 24536 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:38.987974 24536 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:38.989984 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:38.994861 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:39.004527 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a60725e5550479db8d1e52b48126750 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:39.005306 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:39.010489 22498 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:39.017971 22572 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:39.018848 24091 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:39.019428 24091 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.021589 24342 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:39.022305 24342 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.025270 24342 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:39.025753 24342 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:39.026187 24342 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.026572 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:39.028333 24342 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:39.030365 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:39.031651 24091 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:39.032800 24091 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:39.033317 24091 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.035696 24091 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:39.038790 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:39.039634 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.040426 24548 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.041921 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:39.061503 22617 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.062410 24547 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.063218 22617 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.065557 24536 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:39.071888 24536 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.073495 24558 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.074026 24536 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:39.074153 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:39.074736 22580 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.075090 22580 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.067063 24091 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:39.075665 24091 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.077889 24091 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:39.079294 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:39.082087 22580 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:39.086745 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:39.087373 23264 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.095530 22572 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.095449 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:39.096393 22617 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.069861 24567 tablet_replica.cc:333] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:07:39.098531 22580 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:39.099370 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.100355 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.097909 24558 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.105612 24414 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.105535 24547 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.109117 23264 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:07:39.110144 22617 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.119416 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:39.120404 24414 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.122617 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.119098 24559 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:39.123584 24547 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:39.125130 22617 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.111235 24567 raft_consensus.cc:2243] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.125955 24547 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.126545 24567 raft_consensus.cc:2272] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.127466 22617 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.130267 24547 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.127094 22572 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:39.131845 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.137362 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.136013 22544 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:39.138375 24091 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.138901 24091 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:39.139492 24091 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:39.137112 24547 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.140610 24414 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.141991 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.142835 24414 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.142518 24567 ts_tablet_manager.cc:1916] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:39.143271 22617 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.146217 24414 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:39.146579 24414 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:39.146905 24414 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.147360 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:39.148008 22575 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:39.148303 22575 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:39.149096 22575 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.150216 22575 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:39.162681 22400 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 7 to 8, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 8 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.164780 24414 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.170156 24414 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:39.171133 23264 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.181277 24554 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:39.182384 24554 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.182776 24554 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:39.185349 24554 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:39.186865 24554 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.188966 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:39.192485 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:39.202534 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:39.204342 24554 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:39.206924 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:39.207568 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:39.208328 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:39.211035 24560 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:39.211485 24560 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:39.212365 24560 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.213435 24560 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.213919 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:39.215610 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:39.217154 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:39.224390 22504 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:07:39.225342 22575 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:39.232298 24567 ts_tablet_manager.cc:1929] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:07:39.241353 24567 log.cc:1199] T 0a60725e5550479db8d1e52b48126750 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/0a60725e5550479db8d1e52b48126750
I20260709 13:07:39.243574 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet 0a60725e5550479db8d1e52b48126750 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:39.248677 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:39.250497 22400 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.251595 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.256830 24553 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.263028 22654 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:39.265031 24536 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:39.272739 22544 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b881738a5b7f4910b375833c1cd61083. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.279800 22545 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.280596 24091 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.284157 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.284907 24091 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.286978 24553 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.288793 22617 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.289988 24559 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.294305 22647 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.299733 22545 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.300895 24091 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.304901 22545 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.307847 22498 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:39.312704 22400 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.344233 24536 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.345687 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.346702 24536 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:39.358026 22469 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a76a7949bf24ada8b2cc5dcacab4bf3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.361727 22654 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:39.364514 24530 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.380393 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.381157 24553 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:39.381599 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:39.382381 24553 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:39.396723 24554 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.409904 22647 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.413781 22573 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:39.430817 22654 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:39.433939 24530 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:39.435217 24477 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.435609 24477 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:39.436525 24477 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:39.437829 24477 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.434587 22400 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:39.457558 22544 consensus_peers.cc:597] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9cfd6d3ed51d40fb8cab7d75c1f29423. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.458861 22654 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:39.463846 24553 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:39.490366 22504 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:39.494354 22573 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.499626 22575 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:39.535606 22504 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:39.543309 22504 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:39.545939 24547 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.547955 24536 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.549069 22650 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.553481 22572 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:39.565279 24573 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.574184 24531 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:39.579241 23264 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:39.584754 24537 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:39.591909 24537 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.613298 22399 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.619585 22498 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:39.657968 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44529us
W20260709 13:07:39.661176 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65067.8us
I20260709 13:07:39.663225 24342 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:39.685947 24576 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:07:39.733820 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 70829.9us
W20260709 13:07:39.738008 22469 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77ec411c33594ae08408279ef5c44410. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.749998 22650 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:39.756601 22498 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:39.761557 22504 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.772614 24531 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:39.776738 22498 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.778765 22573 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.801328 24584 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:39.823731 22573 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:39.830457 24477 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.844228 24477 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.848618 22647 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.877674 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:39.892144 22400 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:39.988296 24592 ts_tablet_manager.cc:933] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:39.988744 24593 ts_tablet_manager.cc:933] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:39.996963 22580 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:40.018023 24592 tablet_copy_client.cc:323] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:40.020005 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet b881738a5b7f4910b375833c1cd61083 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:40.020589 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet b881738a5b7f4910b375833c1cd61083 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-b881738a5b7f4910b375833c1cd61083
I20260709 13:07:40.033082 22590 tablet_copy_source_session.cc:215] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:40.044386 24593 tablet_copy_client.cc:323] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:40.046443 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:40.047001 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-6a76a7949bf24ada8b2cc5dcacab4bf3
I20260709 13:07:40.069320 24592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b881738a5b7f4910b375833c1cd61083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.079859 22515 tablet_copy_source_session.cc:215] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:40.095633 24593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.099514 24596 ts_tablet_manager.cc:933] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:40.122400 24596 tablet_copy_client.cc:323] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:40.123358 24592 tablet_copy_client.cc:806] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:40.124094 24592 tablet_copy_client.cc:670] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:40.124348 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:40.125047 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-9cfd6d3ed51d40fb8cab7d75c1f29423
I20260709 13:07:40.134148 22590 tablet_copy_source_session.cc:215] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:40.137735 24596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.138227 24592 tablet_copy_client.cc:538] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:40.143325 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:40.225104 24592 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:40.231315 24598 ts_tablet_manager.cc:933] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:40.237777 24593 tablet_copy_client.cc:806] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:40.240988 24593 tablet_copy_client.cc:670] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:40.243489 24596 tablet_copy_client.cc:806] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:40.244112 24596 tablet_copy_client.cc:670] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:40.248126 24593 tablet_copy_client.cc:538] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:40.248248 24596 tablet_copy_client.cc:538] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:40.271322 24592 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:40.272482 24592 tablet_bootstrap.cc:492] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:40.273237 24592 ts_tablet_manager.cc:1403] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.112s	user 0.033s	sys 0.003s
I20260709 13:07:40.276489 24592 raft_consensus.cc:359] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.277469 24592 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:40.278175 24592 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.281157 24592 ts_tablet_manager.cc:1434] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:40.277932 24598 tablet_copy_client.cc:323] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:40.283715 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet 77ec411c33594ae08408279ef5c44410 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:40.284279 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet 77ec411c33594ae08408279ef5c44410 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-77ec411c33594ae08408279ef5c44410
I20260709 13:07:40.286442 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-b881738a5b7f4910b375833c1cd61083 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:40.286882 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-b881738a5b7f4910b375833c1cd61083 on tablet b881738a5b7f4910b375833c1cd61083 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:40.299957 24596 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
W20260709 13:07:40.304430 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 61221.6us
I20260709 13:07:40.308794 24593 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:40.337165 22515 tablet_copy_source_session.cc:215] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:40.345093 24598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ec411c33594ae08408279ef5c44410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.365887 22647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:40.366575 22647 raft_consensus.cc:606] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:40.371904 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:40.372784 22580 raft_consensus.cc:606] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:40.380319 22498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:40.380985 22498 raft_consensus.cc:606] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:40.382741 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:40.384433 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:40.385572 24598 tablet_copy_client.cc:806] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:40.389245 24598 tablet_copy_client.cc:670] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:40.398110 24598 tablet_copy_client.cc:538] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:40.410432 24598 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:40.425529 24596 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:40.435549 24596 tablet_bootstrap.cc:492] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:40.439534 24593 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:40.442816 24596 ts_tablet_manager.cc:1403] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.143s	user 0.032s	sys 0.004s
I20260709 13:07:40.445396 24593 tablet_bootstrap.cc:492] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:40.446257 24593 ts_tablet_manager.cc:1403] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.138s	user 0.026s	sys 0.010s
I20260709 13:07:40.453666 24593 raft_consensus.cc:359] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.454957 24593 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:40.455657 24593 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.453658 24596 raft_consensus.cc:359] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.459923 24596 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:40.460774 24596 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.463796 24596 ts_tablet_manager.cc:1434] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:07:40.467437 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-9cfd6d3ed51d40fb8cab7d75c1f29423 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:40.479156 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-9cfd6d3ed51d40fb8cab7d75c1f29423 on tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:40.484438 23264 raft_consensus.cc:1217] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:07:40.485504 24593 ts_tablet_manager.cc:1434] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:07:40.488438 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-6a76a7949bf24ada8b2cc5dcacab4bf3 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:40.488938 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-6a76a7949bf24ada8b2cc5dcacab4bf3 on tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:40.520390 24598 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:40.521330 24598 tablet_bootstrap.cc:492] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:40.522028 24598 ts_tablet_manager.cc:1403] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.014s
I20260709 13:07:40.530028 23264 raft_consensus.cc:1217] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:07:40.533593 24598 raft_consensus.cc:359] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.534514 24598 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:40.535373 24598 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:40.550879 24598 ts_tablet_manager.cc:1434] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 13:07:40.552759 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-77ec411c33594ae08408279ef5c44410 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:40.553275 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-77ec411c33594ae08408279ef5c44410 on tablet 77ec411c33594ae08408279ef5c44410 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:40.561806 24091 raft_consensus.cc:993] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:40.562345 24091 raft_consensus.cc:1081] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:40.564311 22654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:40.565145 22654 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.565536 22654 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.581916 24548 raft_consensus.cc:993] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:40.582473 24573 raft_consensus.cc:1081] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:40.584263 22498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:40.584828 22498 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.585603 22498 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:40.586110 23264 raft_consensus.cc:1217] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:07:40.626308 22498 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.655305 22498 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:40.661844 24531 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.662431 24531 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.663707 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:40.664410 22647 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:40.664711 22647 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:40.665567 22647 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.664647 24531 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:40.666697 22647 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:40.673009 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:40.674420 22572 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:40.680241 23261 raft_consensus.cc:1217] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:07:40.683223 22572 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:40.686697 22647 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:40.700578 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:40.707505 24582 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:40.708143 24582 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:40.699487 22654 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.711294 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:40.712011 22650 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:40.713670 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:40.715348 24531 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.716599 24531 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.717609 24531 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.709205 24582 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.723377 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:40.724145 22580 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.724536 22580 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:40.725359 22580 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.726298 22580 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.730034 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:40.730756 22572 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:40.736372 24548 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:40.737108 24548 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.736397 22654 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:40.740711 24548 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:40.741851 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:40.742656 22575 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:40.745220 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:40.745846 22498 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.754904 22498 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:07:40.757215 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:40.760044 22504 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:40.764453 22580 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:07:40.765686 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:40.766762 24573 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:40.767277 24573 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:40.769170 24573 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.797519 22619 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:40.803737 24548 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:40.805105 24548 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:07:40.805591 24548 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.827934 22402 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 8, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.802975 24531 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.836139 24531 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:40.839536 24548 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.845433 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:40.845878 22399 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.849053 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:40.849699 22572 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.850167 24548 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:40.852890 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:40.871332 22580 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:07:40.873798 24582 raft_consensus.cc:993] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:40.874364 24582 raft_consensus.cc:1081] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:40.859834 22572 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:07:40.861339 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:40.877350 22647 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.868247 22504 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:40.881795 22619 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:40.882565 24548 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:40.883054 24548 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:40.883888 24548 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.893967 22647 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:07:40.899868 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:40.900949 24531 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:40.901849 24531 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:40.903020 24531 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.907657 22572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:40.909454 22572 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.909902 22572 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.935027 22572 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.938292 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:40.938928 22504 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:40.939204 22504 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:40.939893 22504 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:40.942263 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:40.942941 22650 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.944550 22399 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.943387 22504 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:40.941174 22572 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:40.955714 22650 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:40.967610 24608 raft_consensus.cc:1064] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:40.972163 22504 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:40.973768 24601 raft_consensus.cc:1064] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:40.980141 24552 raft_consensus.cc:1064] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:40.999583 24601 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 1, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:41.000131 24552 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:40.999258 24608 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:41.000918 22543 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:41.003723 24584 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:40.995405 22399 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.005136 24584 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:41.006098 24584 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:41.030135 23264 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:41.032229 24601 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:41.037389 22498 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:41.038029 22650 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:41.038942 24091 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:41.041551 24091 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:41.063917 24601 raft_consensus.cc:1064] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:41.068928 24601 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:41.087118 22399 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.105683 24342 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.118634 22647 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:41.124786 24582 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:41.141685 23264 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.145164 23261 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:41.147809 22647 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:41.149473 22580 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:41.149535 24531 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:41.153036 24582 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:41.155584 24477 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:41.161405 23262 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:41.163771 22647 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:41.163872 22572 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:41.170164 22504 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:41.172319 24561 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:41.166631 24582 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:41.192919 24477 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.197592 24531 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:41.220642 22575 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:41.237134 24608 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:41.247813 22648 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:41.308781 24615 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:07:41.315575 24617 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:07:41.326412 22402 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.339892 22573 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:41.350805 24091 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.351495 24091 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:41.373101 24091 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:41.382241 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:41.383082 22496 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:41.382393 22498 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.385341 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:41.388638 24548 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:41.390698 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:41.397354 24536 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:41.397955 24536 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.398442 24536 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.398138 24582 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.419616 24624 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:41.434311 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66149.3us
I20260709 13:07:41.454049 22496 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:41.463186 24561 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:41.463905 22647 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:41.465348 23261 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.500007 22580 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.507375 22577 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.540345 24536 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:41.546337 24536 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:07:41.590286 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 170686us
W20260709 13:07:41.591473 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88985.1us
I20260709 13:07:41.597410 22572 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:41.610349 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:41.602464 22502 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:41.630841 23261 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.649026 24636 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:07:41.649601 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:41.680810 22654 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:41.685425 24573 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.689222 24548 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.695402 22650 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:41.713513 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 206134us
I20260709 13:07:41.719848 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:41.722517 24624 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.741142 22572 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:41.710579 22399 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.689841 24548 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:41.747344 24548 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:41.818280 22399 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.831852 24548 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.832172 23261 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:41.839211 24584 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:41.839879 24536 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:41.843103 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:41.847505 24644 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:41.844504 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 140091us
I20260709 13:07:41.853685 24636 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:41.884101 22496 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:41.893092 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 50184.5us
I20260709 13:07:41.895603 24536 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:41.926888 22648 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.927177 22647 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:41.987484 22502 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:41.988957 24649 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:41.995085 23264 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:41.998046 24649 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:42.018179 24636 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.020174 22575 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:42.091913 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.117316 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 77503.2us
I20260709 13:07:42.117316 22502 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:42.121959 22573 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:42.128491 24649 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:42.137117 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 96507.9us
I20260709 13:07:42.141278 24582 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.163468 23264 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.177268 23262 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:42.182579 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:42.183243 23262 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.186398 23261 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:42.188127 24536 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.199841 22504 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:42.201076 24645 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.203612 22645 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:42.203022 23263 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.205350 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77ec411c33594ae08408279ef5c44410 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:42.218091 24638 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:42.215899 22502 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.230249 22504 raft_consensus.cc:2955] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.241039 22400 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.216174 24582 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:07:42.265089 22648 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.277608 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet 77ec411c33594ae08408279ef5c44410 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:42.285859 24662 tablet_replica.cc:333] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:07:42.304123 24662 raft_consensus.cc:2243] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.300495 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b881738a5b7f4910b375833c1cd61083 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:42.294929 22402 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.309275 24643 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.315686 23263 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.320719 22402 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:42.324843 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71041.7us
I20260709 13:07:42.331753 22572 raft_consensus.cc:2955] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.336352 24662 raft_consensus.cc:2272] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:42.331771 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48664us
I20260709 13:07:42.346496 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:42.383780 24662 ts_tablet_manager.cc:1916] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:42.384886 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet b881738a5b7f4910b375833c1cd61083 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45752
W20260709 13:07:42.399365 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45890.1us
I20260709 13:07:42.403872 24647 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:42.421497 22648 raft_consensus.cc:2955] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.458406 24662 ts_tablet_manager.cc:1929] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:07:42.459121 24662 log.cc:1199] T 77ec411c33594ae08408279ef5c44410 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/77ec411c33594ae08408279ef5c44410
I20260709 13:07:42.461258 24662 tablet_replica.cc:333] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:07:42.461979 22403 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.472959 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet 77ec411c33594ae08408279ef5c44410 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
W20260709 13:07:42.485579 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53350.9us
I20260709 13:07:42.494238 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41926
I20260709 13:07:42.515477 24663 tablet_replica.cc:333] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:07:42.522069 24663 raft_consensus.cc:2243] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.523427 22572 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:42.527595 24663 raft_consensus.cc:2272] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.532545 24663 ts_tablet_manager.cc:1916] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:42.533761 24662 raft_consensus.cc:2243] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.534722 24662 raft_consensus.cc:2272] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.537914 24662 ts_tablet_manager.cc:1916] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:42.551121 23263 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:42.552810 24638 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:42.560115 24663 ts_tablet_manager.cc:1929] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:07:42.560781 24663 log.cc:1199] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/6a76a7949bf24ada8b2cc5dcacab4bf3
I20260709 13:07:42.561813 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:42.562526 22648 raft_consensus.cc:606] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:42.563020 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet 6a76a7949bf24ada8b2cc5dcacab4bf3 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:42.567749 22579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:42.568460 22579 raft_consensus.cc:606] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:42.572582 24636 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.577499 22650 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:42.579438 24638 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:42.579294 23263 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.584583 22650 raft_consensus.cc:2955] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:42.598851 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:07:42.602272 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53224.5us
I20260709 13:07:42.611997 22402 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.626933 24662 ts_tablet_manager.cc:1929] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:07:42.646453 22504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:42.642683 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:59516
W20260709 13:07:42.633948 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57744.1us
I20260709 13:07:42.647152 22504 raft_consensus.cc:606] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:42.646898 24662 log.cc:1199] T b881738a5b7f4910b375833c1cd61083 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/b881738a5b7f4910b375833c1cd61083
I20260709 13:07:42.657894 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:42.658514 22648 raft_consensus.cc:606] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:07:42.661571 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:42.662209 22648 raft_consensus.cc:606] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:07:42.663818 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet b881738a5b7f4910b375833c1cd61083 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:42.666437 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:42.667125 22648 raft_consensus.cc:606] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:42.669818 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:42.671732 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:42.680657 24665 tablet_replica.cc:333] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:07:42.682204 24665 raft_consensus.cc:2243] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.683243 24665 raft_consensus.cc:2272] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.716657 24665 ts_tablet_manager.cc:1916] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:42.791126 24665 ts_tablet_manager.cc:1929] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:07:42.791607 24665 log.cc:1199] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/9cfd6d3ed51d40fb8cab7d75c1f29423
I20260709 13:07:42.794310 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet 9cfd6d3ed51d40fb8cab7d75c1f29423 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:42.804512 24638 raft_consensus.cc:993] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:42.805140 24638 raft_consensus.cc:1081] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:42.807068 22650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:42.807757 22650 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.808105 22650 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.824522 24561 raft_consensus.cc:993] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:42.825305 24561 raft_consensus.cc:1081] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:42.831537 22502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:42.832145 22502 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.832497 22502 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.910393 22650 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:42.918474 22502 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:42.920729 22502 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:42.921865 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:42.922293 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:42.922905 22579 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.922799 22504 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.925046 22650 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:42.922305 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:42.926519 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:42.926856 22647 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:42.927191 22647 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:42.928217 22647 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:42.929663 22647 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.927158 22572 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:42.935964 22572 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:42.936767 22572 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:42.938150 22572 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:42.965333 22504 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:42.967178 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:42.969184 24561 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:42.969730 24561 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:42.970610 24561 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:42.980028 24573 raft_consensus.cc:993] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:42.980554 24573 raft_consensus.cc:1081] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:42.989782 22572 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:42.993659 22579 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:42.984040 22647 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:42.994938 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:42.996325 24531 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:42.996847 24531 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:42.998072 24531 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.005303 23263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46820
I20260709 13:07:43.006239 23263 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.006726 23263 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.026499 22402 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 3 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.027554 23263 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:43.033836 23263 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:43.032618 22400 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.038122 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:43.039561 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:43.044618 22572 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.052340 22650 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:43.052805 22650 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:43.054569 22572 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:07:43.055717 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:43.056722 24646 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:43.057693 24646 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:07:43.055656 22650 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:43.058802 24646 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:43.059295 22650 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.075786 24547 raft_consensus.cc:993] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:43.076407 24573 raft_consensus.cc:1081] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:43.079337 23263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46820
I20260709 13:07:43.079936 23263 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.083508 23263 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.082261 22400 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 4 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.089689 22650 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:07:43.093981 23263 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:43.108711 24624 raft_consensus.cc:993] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:43.109444 24624 raft_consensus.cc:1081] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:43.111481 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:43.112167 22502 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.113135 22648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45766
I20260709 13:07:43.113701 22648 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.114107 22648 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.129907 22502 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:07:43.131923 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:43.133263 22650 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:43.133637 22650 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:43.134684 22650 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:43.135855 22650 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.142850 22650 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:07:43.142370 22648 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:43.144158 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:43.146704 24646 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:43.151652 24646 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:07:43.144706 23263 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:43.152523 24646 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:43.156085 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:43.156315 22648 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:43.156653 22572 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.161306 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:43.161919 22502 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:43.162221 22502 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:43.163553 24561 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.163681 22572 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:43.164105 24561 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.165122 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:43.165920 24547 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:43.166352 24547 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:43.166252 24561 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:43.167273 24547 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:43.163237 22502 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:43.167937 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:43.168803 22502 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:43.176074 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:43.176805 22573 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:43.180169 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:43.186574 24561 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.187011 24561 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.187359 24561 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.180439 22502 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:07:43.200050 22400 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 4 to 5, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 5 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.206014 22402 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.209911 24609 raft_consensus.cc:993] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:43.211212 24609 raft_consensus.cc:1081] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:43.212109 24561 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.214376 24561 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:43.216060 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:43.216651 22573 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.216969 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:43.221220 22501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:43.221814 22501 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.222177 22501 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.231086 22573 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:07:43.231462 22501 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.232620 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:43.234360 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:43.235059 22572 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.236023 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:43.236582 22650 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:43.236894 22650 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:43.237679 22650 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.238662 22650 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:43.242626 24547 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:43.245246 24547 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:43.246030 24547 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.235827 22501 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:43.250744 22650 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:43.252873 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:43.254108 24643 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:43.254667 24643 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:43.255659 24643 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.256224 22572 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:07:43.299281 22400 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.309882 22402 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.325914 24643 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:07:43.326428 24643 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:43.329321 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:43.330070 22572 raft_consensus.cc:2368] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:07:43.330165 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:07:43.331501 22468 leader_election.cc:400] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:07:43.332078 22468 leader_election.cc:403] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:43.331460 24643 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:43.332937 24643 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.345506 24643 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:07:43.414985 22573 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.416356 24649 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.457508 22573 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:43.459209 24646 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:43.478349 22650 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:43.479954 24646 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:43.497277 22647 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.499405 24649 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.563766 22501 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:43.565291 24547 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.601229 22573 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:43.603199 24561 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.637527 22496 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:43.640496 24573 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.660429 22579 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:43.662802 24573 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.665045 22496 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:43.672828 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:43.676599 24646 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:43.708350 22647 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:43.710438 24669 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:43.763118 22650 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:43.765475 24624 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.769344 22579 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:43.772379 24624 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.833308 22496 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:43.835153 24573 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:43.845903 22572 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:43.847776 24573 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:43.897289 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 74754us
I20260709 13:07:44.041145 22502 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:44.159102 22572 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:44.166759 22469 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee0a982f0606460f93cc934c9319409d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.169376 24624 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:44.178082 22650 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:44.180119 24692 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:44.259179 24692 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.261571 22572 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.282989 22402 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.289979 22647 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:44.292372 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.293332 22650 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.354341 22572 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:44.378049 22618 consensus_peers.cc:597] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 384f494818f741d1bb257daeaab933f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.465997 22502 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:44.467715 24547 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:44.485508 24609 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:44.515558 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:44.516299 22502 raft_consensus.cc:606] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:44.535494 22579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:44.536293 22579 raft_consensus.cc:606] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:07:44.552809 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83400.1us
I20260709 13:07:44.558709 24710 ts_tablet_manager.cc:933] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:44.578632 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:44.579246 22650 raft_consensus.cc:606] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:44.588444 24710 tablet_copy_client.cc:323] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:44.590788 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet ee0a982f0606460f93cc934c9319409d from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:44.591440 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet ee0a982f0606460f93cc934c9319409d from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-ee0a982f0606460f93cc934c9319409d
I20260709 13:07:44.606683 24706 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.608142 22515 tablet_copy_source_session.cc:215] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:44.611905 24710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0a982f0606460f93cc934c9319409d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:44.613199 22575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc46eb991824d25bde40d1001e04798"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:44.613794 22575 raft_consensus.cc:606] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:07:44.628145 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45557.5us
I20260709 13:07:44.632895 22501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:44.633556 22501 raft_consensus.cc:606] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:44.635107 22573 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.654767 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:44.656606 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:44.669006 24561 raft_consensus.cc:993] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:44.669814 24561 raft_consensus.cc:1081] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:44.673089 22575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:07:44.673684 22575 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:44.674081 22575 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.684135 22403 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.687287 22575 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:44.692982 22575 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:44.696748 24710 tablet_copy_client.cc:806] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:44.697453 24710 tablet_copy_client.cc:670] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:44.699776 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:44.700350 22502 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.701468 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:44.702136 22650 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:44.702425 22650 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:44.703125 22650 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:44.704161 22650 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:44.706141 22502 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:07:44.708364 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:44.709339 24701 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:44.709836 24701 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:44.710685 24701 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:44.723723 22496 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.726181 24710 tablet_copy_client.cc:538] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:44.726424 24712 raft_consensus.cc:993] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:44.728125 24712 raft_consensus.cc:1081] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:44.729866 22579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:44.730458 22579 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:44.730774 22579 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.726934 22575 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:44.737751 22579 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:44.745144 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:44.746798 22502 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:44.747555 22502 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:44.748433 22502 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:44.751744 22502 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.754379 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:44.744318 22403 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 6 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.755002 22647 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.760967 22579 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:44.762338 22647 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:44.762885 22650 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:07:44.769084 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:44.770323 24703 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:44.770823 24703 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:44.771703 24703 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:44.784157 22502 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:44.791401 24710 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:44.801102 24693 raft_consensus.cc:993] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:44.804876 24693 raft_consensus.cc:1081] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:44.807431 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:44.808086 22573 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:44.808516 22573 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.818818 22573 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:44.819955 22544 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3feac7af5754b40a9c951d0a8e31413. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.821579 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:44.822286 22502 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:44.822695 22502 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:44.823632 22502 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:44.825256 22502 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.827956 22650 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:44.829387 22573 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:44.824456 22403 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.830652 24686 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:44.834012 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:44.834601 22647 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.843389 22647 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:44.851935 22496 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:44.862291 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:44.861968 22654 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.863526 24703 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:44.864281 24703 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:44.865216 24701 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:44.858037 24686 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:44.868907 24703 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:44.861001 22502 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:44.993898 22502 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:44.994391 22496 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:07:45.000015 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 102005us
I20260709 13:07:45.013119 22399 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.044569 22403 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:45.142349 22579 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:45.146142 24712 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:45.146932 24724 ts_tablet_manager.cc:933] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:45.155202 22647 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:45.167073 24649 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:45.179543 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 89434us
W20260709 13:07:45.185920 22469 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 799bdeb956cf4c76aa244c0f5bbc89c2. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:45.185411 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 123945us
I20260709 13:07:45.212132 24703 raft_consensus.cc:993] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:45.212602 24703 raft_consensus.cc:1081] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:45.227044 22648 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:45.227309 22653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc46eb991824d25bde40d1001e04798"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:45.274194 22653 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.274690 22653 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.274853 24730 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:45.250947 24724 tablet_copy_client.cc:323] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:45.280573 22663 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 384f494818f741d1bb257daeaab933f2 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:45.281351 22663 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 384f494818f741d1bb257daeaab933f2 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-384f494818f741d1bb257daeaab933f2
I20260709 13:07:45.272930 22496 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:45.296008 22652 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:45.298130 24731 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:45.297668 24732 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:45.304538 24731 raft_consensus.cc:993] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:45.303818 22579 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:45.305398 24731 raft_consensus.cc:1081] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:45.315477 22663 tablet_copy_source_session.cc:215] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:45.323065 24724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384f494818f741d1bb257daeaab933f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.317091 24639 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:45.317880 22504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59530
I20260709 13:07:45.328387 22504 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.328896 22504 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.318887 22502 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:45.338658 22651 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:45.350054 24740 ts_tablet_manager.cc:933] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:45.357111 24703 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:45.360572 24686 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:45.369505 22650 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:45.393767 22502 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:45.400269 24740 tablet_copy_client.cc:323] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:45.426116 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet d3feac7af5754b40a9c951d0a8e31413 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:45.426819 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet d3feac7af5754b40a9c951d0a8e31413 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-d3feac7af5754b40a9c951d0a8e31413
I20260709 13:07:45.435240 22504 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:45.437522 22504 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:45.344580 22653 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:45.438614 24730 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:45.442006 22502 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:45.446328 22590 tablet_copy_source_session.cc:215] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:45.447244 22653 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:45.449574 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:45.450268 22503 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.453106 24740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3feac7af5754b40a9c951d0a8e31413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.420270 22402 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:45.465379 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:45.466799 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:45.467425 22579 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:45.467785 22579 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:45.468286 22503 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:07:45.466070 22651 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.469291 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:45.475983 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:45.476696 22573 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:45.477025 22573 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:45.477869 22573 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:45.479174 22573 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.483513 24609 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:45.484109 24609 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:45.487793 22573 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:45.492431 22579 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:45.505944 22579 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.517756 24710 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:45.519405 24710 tablet_bootstrap.cc:492] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:45.520298 24710 ts_tablet_manager.cc:1403] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.729s	user 0.030s	sys 0.016s
I20260709 13:07:45.513510 24609 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:45.541294 22579 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
W20260709 13:07:45.575861 24702 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:45.575843 22651 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:07:45.582540 24740 tablet_copy_client.cc:806] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:45.600354 24740 tablet_copy_client.cc:670] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:45.612380 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:45.606406 24740 tablet_copy_client.cc:538] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:45.664217 24693 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:45.664884 24693 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:45.665776 24693 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:45.671002 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:45.711022 24748 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:07:45.767995 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 100208us
I20260709 13:07:45.797755 24751 ts_tablet_manager.cc:933] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
W20260709 13:07:45.807372 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 77994.3us
I20260709 13:07:45.820988 24710 raft_consensus.cc:359] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:45.822261 24710 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:45.823019 24710 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:45.827749 24740 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:45.853564 24724 tablet_copy_client.cc:806] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:45.887214 22403 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 2 to 3, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.893709 24724 tablet_copy_client.cc:670] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:45.908444 24710 ts_tablet_manager.cc:1434] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.388s	user 0.007s	sys 0.002s
I20260709 13:07:46.037582 24751 tablet_copy_client.cc:323] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
W20260709 13:07:46.087229 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 91941.4us
I20260709 13:07:46.080420 23261 raft_consensus.cc:1217] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:07:46.091382 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-ee0a982f0606460f93cc934c9319409d received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:46.092021 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-ee0a982f0606460f93cc934c9319409d on tablet ee0a982f0606460f93cc934c9319409d with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:46.126837 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet 799bdeb956cf4c76aa244c0f5bbc89c2 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:46.130173 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet 799bdeb956cf4c76aa244c0f5bbc89c2 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-799bdeb956cf4c76aa244c0f5bbc89c2
I20260709 13:07:46.133750 22579 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:46.185527 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 368437us
I20260709 13:07:46.216629 24724 tablet_copy_client.cc:538] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:46.254801 22515 tablet_copy_source_session.cc:215] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:46.258440 24724 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:46.258496 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bdeb956cf4c76aa244c0f5bbc89c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:46.289542 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 157638us
W20260709 13:07:46.309345 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 122236us
I20260709 13:07:46.387449 24561 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:46.399125 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66813.5us
I20260709 13:07:46.406092 22399 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 3, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 3 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.442549 22500 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:46.448740 24775 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:46.544626 22580 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:46.593034 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47469.8us
I20260709 13:07:46.595501 24778 raft_consensus.cc:1064] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:46.543362 24781 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:07:46.623865 24729 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:46.598304 24778 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:46.673916 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:46.741761 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71504.1us
I20260709 13:07:46.748936 22653 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:46.743391 24751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46826 (request call id 154) took 1104 ms. Trace:
W20260709 13:07:46.805058 24783 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:46.778800 24720 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:07:46.867028 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47320.4us
W20260709 13:07:46.880585 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56463.8us
I20260709 13:07:46.787240 24751 rpcz_store.cc:276] 0709 13:07:45.608036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.609091 (+  1055us) service_pool.cc:224] Handling call
0709 13:07:45.798178 (+189087us) ts_tablet_manager.cc:934] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
0709 13:07:46.257309 (+459131us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:46.431596 (+174287us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:46.444524 (+ 12928us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:46.652785 (+208261us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:46.666690 (+ 13905us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:46.693187 (+ 26497us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:46.712701 (+ 19514us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43018,"tablet-copy.queue_time_us":188030,"thread_start_us":240636,"threads_started":2}
I20260709 13:07:46.933246 24751 tablet_copy_client.cc:806] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:46.934410 24751 tablet_copy_client.cc:670] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
W20260709 13:07:46.951327 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83242.2us
I20260709 13:07:47.043561 24751 tablet_copy_client.cc:538] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:07:47.089885 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 104179us
I20260709 13:07:47.110785 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:47.111696 22503 raft_consensus.cc:606] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:47.133105 23263 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:47.137171 24758 raft_consensus.cc:993] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:47.137873 24758 raft_consensus.cc:1081] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:47.204245 22572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:47.204851 22572 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:47.205271 22572 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.206421 22576 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:47.217490 22575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:47.218357 22575 raft_consensus.cc:606] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:47.217562 22652 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:47.290254 22572 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:47.298327 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 51299.1us
I20260709 13:07:47.208982 24764 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 13:07:47.321022 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82090.5us
I20260709 13:07:47.326000 22572 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:47.327330 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:47.355031 22651 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.381348 24778 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:47.401551 24724 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.403347 22651 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
W20260709 13:07:47.409533 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111274us
I20260709 13:07:47.413851 24785 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:07:47.422504 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:47.424954 22502 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:47.425287 22502 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:47.426115 22502 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:47.403721 24724 tablet_bootstrap.cc:492] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:47.459848 22502 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:47.462244 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47262.4us
I20260709 13:07:47.462826 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:07:47.480434 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 152622us
I20260709 13:07:47.482928 24740 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.492019 24724 ts_tablet_manager.cc:1403] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 1.234s	user 0.045s	sys 0.042s
I20260709 13:07:47.513969 22502 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:47.514360 24774 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:47.514933 24774 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:47.515895 24774 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:47.521765 24751 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:47.528815 24740 tablet_bootstrap.cc:492] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:47.530038 24740 ts_tablet_manager.cc:1403] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 1.703s	user 0.050s	sys 0.019s
W20260709 13:07:47.540707 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45194.2us
W20260709 13:07:47.556290 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 61285.9us
I20260709 13:07:47.612360 24777 raft_consensus.cc:993] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:47.632875 24777 raft_consensus.cc:1081] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
W20260709 13:07:47.635586 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 134319us
I20260709 13:07:47.674392 22572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:47.675215 22572 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:47.729559 24724 raft_consensus.cc:359] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:47.730680 24724 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:47.730064 24740 raft_consensus.cc:359] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:47.741516 24740 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:47.742321 24740 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:47.745016 24740 ts_tablet_manager.cc:1434] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.215s	user 0.011s	sys 0.007s
W20260709 13:07:47.762663 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.763589 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-d3feac7af5754b40a9c951d0a8e31413 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:47.764143 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-d3feac7af5754b40a9c951d0a8e31413 on tablet d3feac7af5754b40a9c951d0a8e31413 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:47.768529 22500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ec411c33594ae08408279ef5c44410"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:47.783948 22500 raft_consensus.cc:606] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:47.785940 24758 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:47.731480 24724 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:47.817518 24777 raft_consensus.cc:993] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:47.818097 24777 raft_consensus.cc:1081] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:47.838165 23263 raft_consensus.cc:1217] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:07:47.842095 23264 raft_consensus.cc:1217] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:07:47.843482 22652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:47.844112 22652 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:47.844534 22652 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.863049 22652 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:47.862025 22653 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:47.870746 23264 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:47.880496 22652 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:47.881923 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:47.883584 22580 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:47.884166 22580 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:47.886260 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:47.886870 23263 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.885442 22645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc46eb991824d25bde40d1001e04798"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:47.887856 22645 raft_consensus.cc:606] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:47.895541 22580 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:47.912967 22578 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:47.896304 24724 ts_tablet_manager.cc:1434] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.386s	user 0.019s	sys 0.005s
I20260709 13:07:47.915340 23263 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:07:47.917171 22580 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.937939 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:47.939262 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:47.955749 22399 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:47.957258 22578 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:47.959378 22403 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.009516 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:48.010468 24775 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:48.011019 24775 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:48.011952 24775 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:48.026903 22663 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-384f494818f741d1bb257daeaab933f2 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:48.043581 22663 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-384f494818f741d1bb257daeaab933f2 on tablet 384f494818f741d1bb257daeaab933f2 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:48.065055 22497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59530
I20260709 13:07:48.065904 22497 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.066322 22497 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.095745 24813 raft_consensus.cc:993] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:48.096316 24813 raft_consensus.cc:1081] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:48.100824 22497 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:48.111265 22497 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:48.132726 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:48.133701 22572 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:48.134089 22572 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:48.135212 22572 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:48.136793 22572 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:48.146710 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60392.6us
I20260709 13:07:48.175444 22497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc46eb991824d25bde40d1001e04798"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:48.176247 22497 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.176637 22497 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:48.180806 22572 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:48.196224 22501 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:48.196899 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:07:48.195109 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 114936us
I20260709 13:07:48.214463 24806 raft_consensus.cc:993] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:48.215041 24806 raft_consensus.cc:1081] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:48.222118 22572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77ec411c33594ae08408279ef5c44410"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:48.222851 22572 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.223296 22572 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:48.203918 24764 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:48.231359 24764 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:48.232046 24764 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:07:48.232414 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:48.233050 22653 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.237581 22572 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:48.240005 22653 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:48.223567 24768 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:48.248579 22651 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:48.253466 24774 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:48.258030 22580 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:07:48.259898 22497 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:48.262900 22496 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:48.267998 22497 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:48.268021 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:48.268759 22580 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:48.273514 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:48.274181 22496 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:48.274457 22496 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:48.274911 22572 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:48.275205 22496 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:48.275887 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:07:48.277595 23264 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:48.281643 22496 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:48.282967 23264 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:48.276002 22580 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:07:48.286603 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:48.296036 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:48.296686 22653 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:48.296981 22496 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:48.296500 24811 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:48.309159 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:48.298327 22653 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:48.299336 24705 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:48.319175 24759 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:48.319731 24759 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:48.320326 24774 raft_consensus.cc:1064] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:48.320613 24759 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:48.312125 24811 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:48.322978 24774 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:48.340442 24811 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:48.399650 22653 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:48.402194 22653 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:48.409453 22653 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
W20260709 13:07:48.411402 24750 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:07:48.414296 23264 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:48.416013 24777 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:48.435822 24754 raft_consensus.cc:1064] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:48.451270 24831 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:48.451517 22648 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:48.453560 24751 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:48.454555 24751 tablet_bootstrap.cc:492] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:48.455586 24751 ts_tablet_manager.cc:1403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.934s	user 0.036s	sys 0.007s
I20260709 13:07:48.462898 24797 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:48.463378 22497 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:48.438833 24754 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:48.474471 24759 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:48.510030 23263 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:48.514482 24826 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:48.516039 24751 raft_consensus.cc:359] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:48.518769 24751 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
W20260709 13:07:48.619200 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 91833.4us
I20260709 13:07:48.633803 24751 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:48.636793 24751 ts_tablet_manager.cc:1434] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.181s	user 0.007s	sys 0.000s
I20260709 13:07:48.683531 24774 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.708284 23264 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.710896 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-799bdeb956cf4c76aa244c0f5bbc89c2 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:48.733579 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-799bdeb956cf4c76aa244c0f5bbc89c2 on tablet 799bdeb956cf4c76aa244c0f5bbc89c2 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:48.761200 22652 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.778745 23263 raft_consensus.cc:1217] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
W20260709 13:07:48.786593 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62656.2us
I20260709 13:07:48.799549 23263 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:48.802105 24825 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:48.802634 22497 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:48.806347 24609 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:48.811810 22500 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:48.826764 23260 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:48.829839 24806 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:48.836623 22580 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:48.838115 22653 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:48.838660 24758 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.841281 22499 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:48.844002 24807 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:48.849654 22499 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.852105 22580 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:48.854586 23260 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.858048 22400 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 8 to 9, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 9 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.865383 22652 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:48.865700 24765 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:48.871098 24848 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:48.876487 22572 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:48.885092 24806 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:48.886941 24775 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:48.892771 22653 raft_consensus.cc:2955] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.904347 24609 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:48.908691 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee0a982f0606460f93cc934c9319409d with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:48.921551 23261 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:48.923190 24772 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:48.927134 24609 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.940181 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:48.947431 22403 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.958148 22403 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.969642 23260 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:48.990579 22579 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:49.005475 22653 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:49.010133 24807 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:07:49.022356 24848 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:49.029951 22497 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:49.038347 22578 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:49.045553 22399 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 7, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.049130 22399 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.050634 22399 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:49.163713 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119827us
W20260709 13:07:49.176396 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 121477us
W20260709 13:07:49.187098 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109210us
W20260709 13:07:49.184675 24830 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:07:49.231292 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44994.3us
W20260709 13:07:49.231153 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46437.4us
W20260709 13:07:49.338146 24855 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:07:49.381592 24830 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:07:49.408215 22578 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:49.475829 24836 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.290s	user 0.000s	sys 0.004s
W20260709 13:07:49.525269 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 270860us
I20260709 13:07:49.495481 22400 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:49.553747 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 298501us
W20260709 13:07:49.620913 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86859.5us
I20260709 13:07:49.637601 22500 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:49.638659 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 81099.2us
I20260709 13:07:49.652791 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0a982f0606460f93cc934c9319409d with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41926
W20260709 13:07:49.727806 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 103681us
W20260709 13:07:49.723997 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 189059us
I20260709 13:07:49.783870 23264 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:49.788777 24873 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:49.803591 24807 raft_consensus.cc:1064] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:07:49.803829 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73329.3us
I20260709 13:07:49.806557 24807 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:49.812796 24864 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:49.877535 24880 tablet_replica.cc:333] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:07:49.878890 24880 raft_consensus.cc:2243] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:49.879851 24880 raft_consensus.cc:2272] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:49.905068 24880 ts_tablet_manager.cc:1916] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:49.913302 24865 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:49.917330 22501 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.061897 23263 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:50.082319 24866 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:07:50.092571 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.133766 22650 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:50.131156 22399 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.144519 23260 raft_consensus.cc:2955] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.249948 24865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41926 (request call id 67) took 1222 ms. Trace:
I20260709 13:07:50.257862 24865 rpcz_store.cc:276] 0709 13:07:49.027930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.028039 (+   109us) service_pool.cc:224] Handling call
0709 13:07:49.036653 (+  8614us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b2c00010828. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c03a0a 00007fec24c03693 00007fec24c03631 00007fec26336902 00007fec263366dd 00007fec26301f3f 00007fec263016b3 00007fec262f99fa 00007fec2b2c14c9 00007fec2483dc54
0709 13:07:49.047785 (+ 11132us) log.cc:844] Serialized 508 byte log entry
0709 13:07:50.249832 (+1202047us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115575,"raft.queue_time_us":120051,"raft.run_cpu_time_us":1012,"raft.run_wall_time_us":1011,"spinlock_wait_cycles":11424640}
I20260709 13:07:50.263480 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3feac7af5754b40a9c951d0a8e31413 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:50.265828 24825 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:07:50.266532 24825 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:50.270035 24825 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:07:50.310842 22572 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:50.312829 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54280.3us
I20260709 13:07:50.324847 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:07:50.332115 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:50.344806 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:07:50.429235 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:07:50.358387 24866 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:50.454075 22651 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:50.459601 24880 ts_tablet_manager.cc:1929] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:07:50.460210 24880 log.cc:1199] T ee0a982f0606460f93cc934c9319409d P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/ee0a982f0606460f93cc934c9319409d
I20260709 13:07:50.463765 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet ee0a982f0606460f93cc934c9319409d (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
W20260709 13:07:50.493371 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 140002us
W20260709 13:07:50.491888 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 168690us
I20260709 13:07:50.505501 22619 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:07:50.506381 24754 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.525141 24892 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:50.582443 23261 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:50.587023 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet d3feac7af5754b40a9c951d0a8e31413 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:50.589553 24609 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:50.632120 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 121120us
I20260709 13:07:50.648491 24899 tablet_replica.cc:333] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:07:50.655926 24899 raft_consensus.cc:2243] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.658782 24899 raft_consensus.cc:2272] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.661172 24775 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.663493 23260 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.681420 22646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:50.682118 22646 raft_consensus.cc:606] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:50.695600 22572 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:50.710604 24899 ts_tablet_manager.cc:1916] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:50.728057 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 384f494818f741d1bb257daeaab933f2 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:50.753006 22400 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.770457 24899 ts_tablet_manager.cc:1929] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:07:50.771911 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet 384f494818f741d1bb257daeaab933f2 with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:50.778963 22499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:50.779697 22499 raft_consensus.cc:606] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:50.781710 24899 log.cc:1199] T d3feac7af5754b40a9c951d0a8e31413 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/d3feac7af5754b40a9c951d0a8e31413
I20260709 13:07:50.787776 24903 tablet_replica.cc:333] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:07:50.786676 24887 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.791335 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet d3feac7af5754b40a9c951d0a8e31413 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:50.792809 24903 raft_consensus.cc:2243] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:50.802163 24903 raft_consensus.cc:2272] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:50.805357 24903 ts_tablet_manager.cc:1916] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:50.830766 23260 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.844373 24825 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:50.850850 24903 ts_tablet_manager.cc:1929] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:07:50.861109 24903 log.cc:1199] T 384f494818f741d1bb257daeaab933f2 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/384f494818f741d1bb257daeaab933f2
I20260709 13:07:50.866876 22400 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.868518 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet 384f494818f741d1bb257daeaab933f2 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:50.889362 22499 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:50.890036 22650 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.890534 22580 raft_consensus.cc:2955] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.890419 22577 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:50.912597 22649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:50.913475 22649 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:07:50.921239 22578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc845449beb4f859e55185200f34bd2"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:50.921941 22578 raft_consensus.cc:606] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:50.926294 22578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e294969b50aa438bb288b913f169f06e"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:50.927075 22578 raft_consensus.cc:606] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:50.928452 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:50.930292 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:50.951078 24761 raft_consensus.cc:993] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:50.951700 24761 raft_consensus.cc:1081] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:50.965750 23260 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:50.978746 24772 raft_consensus.cc:993] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:50.979393 24873 raft_consensus.cc:1081] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:50.982144 22654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc845449beb4f859e55185200f34bd2"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:50.982738 22654 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.983057 22654 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.967563 24758 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:50.993268 22649 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:50.999020 24761 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:51.000666 24892 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:51.000447 23261 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:51.029825 22578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:51.030459 22578 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:51.029120 22649 raft_consensus.cc:2955] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:51.030858 22578 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:51.033349 22654 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.039335 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:51.038595 22654 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:51.040107 22499 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.042030 22578 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.044271 22578 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:51.045483 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:51.078828 22654 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:51.054090 22400 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:51.059258 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:51.069434 24775 raft_consensus.cc:993] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:51.071849 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:51.101619 22504 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:51.102131 22504 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:51.102209 22580 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:51.102600 22580 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:51.102957 22504 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.103464 22580 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.104557 22504 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:51.074798 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 799bdeb956cf4c76aa244c0f5bbc89c2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:51.101552 24775 raft_consensus.cc:1081] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:51.107384 23261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46820
I20260709 13:07:51.098295 22654 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:51.108083 23261 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:51.103477 22499 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:51.108541 23261 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.109115 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:51.110179 22619 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:51.111490 24889 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:51.112042 24889 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:51.112937 24889 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.114480 24775 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:51.115024 24775 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:51.116084 24775 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.123024 23261 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:51.131647 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:51.132090 23261 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:51.132292 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:51.148852 22654 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.132292 22577 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.149408 22654 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:51.157122 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet 799bdeb956cf4c76aa244c0f5bbc89c2 with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:41926
I20260709 13:07:51.161965 22654 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:51.163450 22654 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.165077 22577 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:07:51.167976 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:51.138530 22504 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:51.140012 24798 raft_consensus.cc:993] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:51.169912 24609 raft_consensus.cc:1081] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:51.104773 22580 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.170918 24872 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.172566 22505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:51.173190 22505 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:51.173519 22505 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.188968 24872 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:07:51.189036 24907 tablet_replica.cc:333] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:07:51.190380 24907 raft_consensus.cc:2243] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.190028 24872 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:51.191123 24907 raft_consensus.cc:2272] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.197727 22580 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:51.209803 22400 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 9 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.217200 24907 ts_tablet_manager.cc:1916] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:51.220839 22505 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.251900 22400 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.259193 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:51.259902 22580 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.262079 24907 ts_tablet_manager.cc:1929] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:07:51.267424 24907 log.cc:1199] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/799bdeb956cf4c76aa244c0f5bbc89c2
I20260709 13:07:51.267824 22580 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:51.270679 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:51.271672 24892 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:51.272262 24892 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:51.273152 24892 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.276139 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet 799bdeb956cf4c76aa244c0f5bbc89c2 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:51.278482 22580 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:51.279999 22505 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:51.293515 22400 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.312150 22654 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:07:51.317006 24825 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:51.318430 24775 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:51.318837 24775 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:51.319814 24775 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.325138 24775 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.346061 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:51.354264 22400 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 7, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.363843 22653 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:51.404640 24897 raft_consensus.cc:993] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:51.405274 24897 raft_consensus.cc:1081] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:51.407291 22646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e294969b50aa438bb288b913f169f06e"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:51.408121 22646 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:51.408555 22646 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.416790 22646 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.427490 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:51.429615 22499 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.438337 22646 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:51.444662 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:51.445353 22580 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:51.445681 22580 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:51.446743 22580 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.448227 22499 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:51.449170 22580 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.450397 22619 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:51.452625 24775 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:51.454696 24775 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:51.455623 24775 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:51.494681 22580 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:51.518998 22400 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.527213 22499 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:51.531443 24889 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:51.572310 22650 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:51.580049 24897 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:51.592763 22580 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:51.595271 24910 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:51.675992 22653 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:51.677410 24872 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:51.709412 22499 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:51.712984 24798 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:51.765677 22580 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:51.777619 24798 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:51.888151 22653 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:51.951186 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:51.982846 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45357.6us
I20260709 13:07:51.985733 24892 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:51.964414 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 79327.1us
I20260709 13:07:52.095980 22502 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:52.108328 24825 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:52.114146 22574 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:52.124135 24758 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:52.131628 22578 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:52.187198 24798 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:52.510174 22650 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:52.553138 22618 consensus_peers.cc:597] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f196f572a5c44a1adb647d7ebc64463. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.553921 22572 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:52.557910 24891 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:52.573977 22505 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:52.582731 24609 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:52.600286 24938 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:52.612607 24891 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.630321 22502 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.664103 22572 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.670017 22650 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:52.681687 22496 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:52.683403 24891 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:52.688524 22580 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:52.692907 24934 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:52.698025 24775 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.699721 22505 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:07:52.703169 22618 consensus_peers.cc:597] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e294969b50aa438bb288b913f169f06e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.662420 22400 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.709790 22580 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.746960 22654 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:52.784415 22505 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:07:52.785455 22618 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec33ad69c4af4d379aff74ce15c85af7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.787623 24775 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:52.789975 22572 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:52.791785 24891 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:52.828594 24934 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.830443 22580 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.854638 22496 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.863524 22505 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:52.885852 22469 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9c028af0e9e408792f2900ec24e194b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.885993 22650 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:52.886435 22580 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:52.889027 24892 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:52.893844 24929 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:52.941423 24892 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:52.962002 22403 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.966485 22403 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:53.013294 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64179.4us
I20260709 13:07:53.015846 22572 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:53.022197 22650 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:53.059900 24951 ts_tablet_manager.cc:933] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:53.096913 22400 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 5, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:53.126683 24951 tablet_copy_client.cc:323] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:53.129119 22663 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 1f196f572a5c44a1adb647d7ebc64463 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:53.129887 22663 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 1f196f572a5c44a1adb647d7ebc64463 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-1f196f572a5c44a1adb647d7ebc64463
I20260709 13:07:53.148273 22663 tablet_copy_source_session.cc:215] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.156374 24951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f196f572a5c44a1adb647d7ebc64463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.212602 24951 tablet_copy_client.cc:806] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.213402 24951 tablet_copy_client.cc:670] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.233920 24954 ts_tablet_manager.cc:933] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:53.220332 24951 tablet_copy_client.cc:538] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.244522 24954 tablet_copy_client.cc:323] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:53.246356 22663 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet e294969b50aa438bb288b913f169f06e from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:53.246927 22663 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet e294969b50aa438bb288b913f169f06e from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-e294969b50aa438bb288b913f169f06e
I20260709 13:07:53.256340 22663 tablet_copy_source_session.cc:215] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.271966 24954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e294969b50aa438bb288b913f169f06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.318405 24956 ts_tablet_manager.cc:933] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:53.330780 24954 tablet_copy_client.cc:806] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.331662 24954 tablet_copy_client.cc:670] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.337743 24956 tablet_copy_client.cc:323] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:53.339448 22663 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet ec33ad69c4af4d379aff74ce15c85af7 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:53.340013 22663 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet ec33ad69c4af4d379aff74ce15c85af7 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-ec33ad69c4af4d379aff74ce15c85af7
I20260709 13:07:53.342638 24951 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:53.344937 24954 tablet_copy_client.cc:538] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.348735 22663 tablet_copy_source_session.cc:215] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.362341 24956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec33ad69c4af4d379aff74ce15c85af7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.369840 24954 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:53.403216 24956 tablet_copy_client.cc:806] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.403890 24956 tablet_copy_client.cc:670] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.408491 24956 tablet_copy_client.cc:538] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.434584 24956 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:53.437251 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:53.456297 24954 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.468614 24954 tablet_bootstrap.cc:492] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:53.469553 24954 ts_tablet_manager.cc:1403] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.023s
I20260709 13:07:53.477670 24954 raft_consensus.cc:359] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.481563 24954 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:53.485451 24954 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.481683 24951 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.489923 24951 tablet_bootstrap.cc:492] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:53.490938 24951 ts_tablet_manager.cc:1403] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.149s	user 0.032s	sys 0.001s
I20260709 13:07:53.505797 24951 raft_consensus.cc:359] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.506724 24951 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:53.507778 24951 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.509209 24956 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.510860 24956 tablet_bootstrap.cc:492] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:53.511641 24951 ts_tablet_manager.cc:1434] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.005s
I20260709 13:07:53.511755 24956 ts_tablet_manager.cc:1403] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.077s	user 0.033s	sys 0.007s
I20260709 13:07:53.509665 24954 ts_tablet_manager.cc:1434] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.006s
I20260709 13:07:53.515112 22663 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-1f196f572a5c44a1adb647d7ebc64463 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:53.515671 22663 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-1f196f572a5c44a1adb647d7ebc64463 on tablet 1f196f572a5c44a1adb647d7ebc64463 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:53.517091 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-e294969b50aa438bb288b913f169f06e received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:53.517591 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-e294969b50aa438bb288b913f169f06e on tablet e294969b50aa438bb288b913f169f06e with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:53.526396 24954 ts_tablet_manager.cc:933] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:53.538371 24956 raft_consensus.cc:359] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.539433 24956 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:53.540143 24956 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.541272 24954 tablet_copy_client.cc:323] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:53.543499 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet b9c028af0e9e408792f2900ec24e194b from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:53.544129 24956 ts_tablet_manager.cc:1434] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 13:07:53.544253 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet b9c028af0e9e408792f2900ec24e194b from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-b9c028af0e9e408792f2900ec24e194b
I20260709 13:07:53.555428 22515 tablet_copy_source_session.cc:215] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.559403 24954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c028af0e9e408792f2900ec24e194b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.566991 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-ec33ad69c4af4d379aff74ce15c85af7 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:53.567500 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-ec33ad69c4af4d379aff74ce15c85af7 on tablet ec33ad69c4af4d379aff74ce15c85af7 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:53.611490 24954 tablet_copy_client.cc:806] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.612275 24954 tablet_copy_client.cc:670] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.616483 24954 tablet_copy_client.cc:538] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.627252 24954 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
W20260709 13:07:53.733925 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46625.5us
I20260709 13:07:53.769342 24954 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.770427 24954 tablet_bootstrap.cc:492] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:53.773061 24954 ts_tablet_manager.cc:1403] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.146s	user 0.033s	sys 0.003s
W20260709 13:07:53.789108 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 149474us
I20260709 13:07:53.804128 24954 raft_consensus.cc:359] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.805230 24954 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:53.805991 24954 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:53.812570 24954 ts_tablet_manager.cc:1434] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:07:53.814848 23261 raft_consensus.cc:1217] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:07:53.821882 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-b9c028af0e9e408792f2900ec24e194b received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:53.822422 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-b9c028af0e9e408792f2900ec24e194b on tablet b9c028af0e9e408792f2900ec24e194b with peer fa2f181263f446a6962b649f9348c15f
W20260709 13:07:53.830438 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58362.1us
I20260709 13:07:53.843427 23261 raft_consensus.cc:1217] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:07:53.913144 22574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:53.914160 22574 raft_consensus.cc:606] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:53.957360 23261 raft_consensus.cc:1217] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Deduplicated request from leader. Original: 6.3->[6.4-6.4]   Dedup: 6.4->[]
W20260709 13:07:53.959506 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 81872.4us
I20260709 13:07:53.979614 22496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66564b8595294cedb0956a6878879f95"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:53.980273 22496 raft_consensus.cc:606] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:53.991735 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:53.992388 22654 raft_consensus.cc:606] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:53.995795 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:54.000206 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:54.018294 23261 raft_consensus.cc:1217] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:07:54.102676 24609 raft_consensus.cc:993] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:54.103209 24609 raft_consensus.cc:1081] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:54.106617 22496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:54.107448 22496 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.108142 22496 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.148427 24892 raft_consensus.cc:993] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:54.149019 24892 raft_consensus.cc:1081] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:54.150933 22574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66564b8595294cedb0956a6878879f95"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:54.151638 22574 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.151993 22574 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:54.159538 22574 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.167963 24963 raft_consensus.cc:993] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:54.168562 24963 raft_consensus.cc:1081] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:54.172679 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:54.173209 22650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:54.173846 22650 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.174201 22650 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:54.174882 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:54.175124 22574 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:54.175508 22505 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:54.175889 22505 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:54.173349 22654 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:54.176846 22505 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.178092 22505 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:54.192407 22650 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.199200 22654 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:54.215444 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:07:54.216684 24865 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:54.217338 24865 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:54.217674 22650 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:54.219295 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:54.219949 22502 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:54.218387 24865 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.227640 22502 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:54.230116 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:54.231132 24891 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:54.231663 24891 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:54.232522 24891 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.252027 22399 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.257149 22496 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.262509 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:54.269482 22574 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:54.269851 22574 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:54.270076 22496 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:54.236531 22505 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:07:54.270638 22574 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.272042 24934 raft_consensus.cc:1064] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:54.272148 22574 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:54.273255 24775 raft_consensus.cc:1064] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:54.280115 24775 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:54.287513 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:54.288196 22578 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.290419 24934 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:54.296693 22578 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:07:54.284555 22574 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:07:54.300251 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:54.323285 23261 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:54.312517 24952 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:54.339340 24952 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:54.359998 24952 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:07:54.364773 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54244.4us
I20260709 13:07:54.374711 24609 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:54.384511 22505 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:54.386965 24609 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:07:54.397008 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71960.9us
I20260709 13:07:54.413686 22578 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.415113 22574 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:54.420608 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:54.421224 22654 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:54.421509 22654 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:54.425884 22654 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:54.429206 24758 raft_consensus.cc:1064] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:54.421834 22403 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.441341 24775 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:54.436381 24758 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:54.462936 23261 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:54.482671 22505 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:54.483189 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83561.3us
W20260709 13:07:54.505270 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 103509us
W20260709 13:07:54.513396 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 91301.8us
I20260709 13:07:54.514763 24775 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:54.520519 22580 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:54.482173 24979 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:54.530849 24891 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:54.535867 22654 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.537573 24934 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:54.591456 23262 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:54.595150 22654 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:07:54.605948 22502 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.601805 24978 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.624833 24990 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:54.649369 22646 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:54.673537 24987 raft_consensus.cc:1064] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:54.675943 23264 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.706257 22573 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:54.713600 24967 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:07:54.722458 22400 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 7 to 8, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.677590 24987 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 2, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:54.757071 22403 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.768522 24758 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:54.776669 24973 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.785590 22504 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:54.788951 22578 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:54.792014 24609 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.787568 23261 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.816828 24993 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:54.826071 22654 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:54.811321 22499 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.842993 22654 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:54.850273 24989 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:54.856140 22505 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:54.854871 22572 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.891821 22580 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:54.888964 24990 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:54.866770 24978 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.901785 23264 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:54.906134 24967 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:54.905966 24965 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.915102 22579 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:54.913733 22646 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.922464 22505 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:54.924602 22400 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:54.935850 24934 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:54.938413 24609 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:54.962904 24825 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:54.998929 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 82351.5us
I20260709 13:07:55.019913 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:55.049597 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44820.1us
W20260709 13:07:55.107370 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 182688us
I20260709 13:07:55.112437 22572 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:55.233474 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 165516us
I20260709 13:07:55.326927 22572 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:55.431529 24965 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.523s	user 0.003s	sys 0.009s
W20260709 13:07:55.462502 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75454.2us
W20260709 13:07:55.460034 25018 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:07:55.485725 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 131415us
W20260709 13:07:55.502890 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 151521us
W20260709 13:07:55.555367 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 172847us
W20260709 13:07:55.577786 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69070.3us
W20260709 13:07:55.582532 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 195249us
W20260709 13:07:55.671665 25031 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:07:55.673007 25025 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:07:55.773147 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 111906us
I20260709 13:07:55.821591 23262 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:55.943496 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43595.5us
W20260709 13:07:55.944154 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48258.7us
I20260709 13:07:55.960633 23264 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:55.969935 24979 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:55.996074 22573 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.096395 22400 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 5 to 6, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.122294 22500 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:56.134167 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 110623us
I20260709 13:07:56.223543 22500 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:56.231446 22579 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:56.234707 24758 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.236706 23263 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:56.239390 24967 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.241750 24981 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.250695 22402 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.262401 22579 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.270718 22653 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:56.274875 23263 raft_consensus.cc:2955] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.282023 22651 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:56.291730 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9c028af0e9e408792f2900ec24e194b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:56.316094 22573 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:56.318611 23263 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:56.320044 24979 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.326453 24979 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:56.331372 22500 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:56.332239 23263 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:56.333199 25038 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.334196 24825 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.369092 22402 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 6 to 7, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.390395 22573 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.387939 24979 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.448971 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e294969b50aa438bb288b913f169f06e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:56.467533 22651 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:56.479017 23262 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:56.481066 25038 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.486068 22401 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.480327 25040 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.489970 22500 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.496711 23262 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.493523 25037 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.512042 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c028af0e9e408792f2900ec24e194b with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45752
I20260709 13:07:56.541611 22573 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:56.553279 25038 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:56.582298 22573 raft_consensus.cc:2955] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.563632 22399 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.640430 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f196f572a5c44a1adb647d7ebc64463 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:56.644716 22401 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.641170 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet e294969b50aa438bb288b913f169f06e with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:56.658360 25064 tablet_replica.cc:333] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:07:56.670951 25064 raft_consensus.cc:2243] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:56.671927 25064 raft_consensus.cc:2272] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:56.697846 22489 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f196f572a5c44a1adb647d7ebc64463 with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59516
I20260709 13:07:56.705356 25064 ts_tablet_manager.cc:1916] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:56.712700 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec33ad69c4af4d379aff74ce15c85af7 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:56.716928 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet ec33ad69c4af4d379aff74ce15c85af7 with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:41926
I20260709 13:07:56.719033 25071 tablet_replica.cc:333] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:07:56.720281 25071 raft_consensus.cc:2243] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:56.721851 25071 raft_consensus.cc:2272] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:56.725785 23263 raft_consensus.cc:2955] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.726074 23261 raft_consensus.cc:2955] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:56.738948 25071 ts_tablet_manager.cc:1916] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:56.739950 25069 tablet_replica.cc:333] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:07:56.752451 25069 raft_consensus.cc:2243] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:56.780534 25069 raft_consensus.cc:2272] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:56.789675 25069 ts_tablet_manager.cc:1916] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:56.793943 25064 ts_tablet_manager.cc:1929] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:07:56.794567 25064 log.cc:1199] T b9c028af0e9e408792f2900ec24e194b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/b9c028af0e9e408792f2900ec24e194b
I20260709 13:07:56.888644 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet b9c028af0e9e408792f2900ec24e194b (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:56.902747 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:57.104666 25069 ts_tablet_manager.cc:1929] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:07:57.109269 25071 ts_tablet_manager.cc:1929] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:07:57.109899 25071 log.cc:1199] T ec33ad69c4af4d379aff74ce15c85af7 P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/ec33ad69c4af4d379aff74ce15c85af7
I20260709 13:07:57.105268 25069 log.cc:1199] T e294969b50aa438bb288b913f169f06e P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/e294969b50aa438bb288b913f169f06e
I20260709 13:07:57.121752 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet ec33ad69c4af4d379aff74ce15c85af7 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:57.122839 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet e294969b50aa438bb288b913f169f06e (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:57.124015 25069 tablet_replica.cc:333] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:07:57.128688 25069 raft_consensus.cc:2243] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.129758 25069 raft_consensus.cc:2272] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.149072 25069 ts_tablet_manager.cc:1916] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:57.170765 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66564b8595294cedb0956a6878879f95"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:57.171494 22580 raft_consensus.cc:606] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:57.174727 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc845449beb4f859e55185200f34bd2"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:57.175318 22650 raft_consensus.cc:606] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:07:57.183195 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:07:57.183776 22580 raft_consensus.cc:606] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:07:57.186697 22497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:07:57.187330 22497 raft_consensus.cc:606] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:07:57.187323 25069 ts_tablet_manager.cc:1929] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:07:57.188069 25069 log.cc:1199] T 1f196f572a5c44a1adb647d7ebc64463 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/1f196f572a5c44a1adb647d7ebc64463
I20260709 13:07:57.189975 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet 1f196f572a5c44a1adb647d7ebc64463 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:07:57.191835 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e294969b50aa438bb288b913f169f06e"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:07:57.192467 22650 raft_consensus.cc:606] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:07:57.197256 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:57.198657 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:57.235414 25074 raft_consensus.cc:993] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:57.236238 25074 raft_consensus.cc:1081] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:57.238739 22650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:57.239316 22650 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.240291 22650 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.248819 25039 raft_consensus.cc:993] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:57.249552 25039 raft_consensus.cc:1081] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:07:57.251269 22651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66564b8595294cedb0956a6878879f95"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:07:57.251926 22651 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.252278 22651 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.252393 22650 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.256726 22650 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:57.259081 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:57.259721 22498 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.268770 22498 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:57.268975 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:57.270963 22580 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:57.271346 22580 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:57.270148 22651 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.273018 22619 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:57.274873 25068 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:57.275839 25068 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:57.277098 25068 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.326292 22651 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:57.326927 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:57.327504 22498 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.327807 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:57.328440 22578 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:57.328749 22578 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:57.323922 22580 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.332237 22401 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.329490 22578 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.335704 22578 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.337939 24758 raft_consensus.cc:993] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:57.338346 22498 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:57.338476 24758 raft_consensus.cc:1081] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:07:57.340201 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:57.340291 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:07:57.340956 22573 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.341183 25068 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:57.341360 22573 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.342110 25068 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:57.343309 25068 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.353682 22573 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.356710 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:07:57.357551 22498 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.358053 22498 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:57.358857 22498 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.359387 22580 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:57.359961 22498 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.364207 22578 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:57.367576 22498 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:07:57.370479 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:57.372327 24995 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:57.372885 24995 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:07:57.373703 24995 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.401736 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:57.402441 22651 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.413169 22651 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:07:57.418025 22573 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:57.427584 22580 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:07:57.441597 22401 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 8 to 9, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 9 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.444676 22400 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.566473 25068 raft_consensus.cc:993] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:57.567036 25042 raft_consensus.cc:1081] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:07:57.568601 22497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc845449beb4f859e55185200f34bd2"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:07:57.569092 22497 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.569456 22497 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:57.576189 22497 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.579023 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:57.579197 22497 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:57.579804 22580 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:57.582947 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:57.583572 22650 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:57.583890 22650 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:57.584616 22650 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.585386 25042 raft_consensus.cc:993] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:57.585915 25037 raft_consensus.cc:1081] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:07:57.587021 22650 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:57.587551 23263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e294969b50aa438bb288b913f169f06e"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46820
I20260709 13:07:57.588179 23263 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.588575 23263 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:57.594102 22650 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:57.595567 23263 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:57.596081 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:07:57.597020 24981 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:57.597502 24981 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:07:57.598165 23263 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:57.598506 24981 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:07:57.599781 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:07:57.600389 22573 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:57.600973 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:07:57.604511 22650 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:57.604921 22650 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:07:57.606004 22650 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:57.607254 22650 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:57.607647 22573 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:07:57.609232 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:07:57.610496 25050 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:57.611155 25050 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:07:57.613312 25050 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:57.621104 22400 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 7, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.634068 22401 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 4 to 5, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 5 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.641482 22580 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:07:57.679453 22650 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:07:57.693399 22573 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:57.697876 25037 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:57.773904 22498 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:57.775408 25037 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:57.800264 22578 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:57.800645 22497 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:57.802238 25084 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:57.804414 22650 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:57.806183 24995 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:57.834345 25037 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:57.848291 22497 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:57.851198 24995 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:57.891430 22578 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:57.913189 22544 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eac3c624e2c43fc9505fe5c344151d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.913496 22498 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:57.916803 22526 debug-util.cc:398] Leaking SignalData structure 0x7b080003f540 after lost signal to thread 21393
W20260709 13:07:57.917898 22526 debug-util.cc:398] Leaking SignalData structure 0x7b0800300fc0 after lost signal to thread 22437
W20260709 13:07:57.919167 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08002c95e0 after lost signal to thread 22529
I20260709 13:07:57.919222 24995 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:57.920269 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2620 after lost signal to thread 22604
W20260709 13:07:57.924927 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08003af2c0 after lost signal to thread 22678
I20260709 13:07:57.926295 22650 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:07:57.926563 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08003786e0 after lost signal to thread 23288
I20260709 13:07:57.927996 25039 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.965211 25032 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:57.970396 22654 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:57.986176 22499 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:58.004299 22469 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a14caf28740540799ba1c6db058346a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.006732 22650 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:58.009203 25086 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:58.019960 22399 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.022938 22578 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:58.027637 22580 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:58.033463 25050 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:58.033914 22497 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.039749 25073 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.060601 25073 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.074393 22654 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.101157 22579 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.126562 22401 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.133489 22654 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:58.136528 22653 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:58.148806 24909 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:58.164182 22618 consensus_peers.cc:597] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7452859c008745c19509f4d5d908e8f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.169019 22579 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:58.169338 22499 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:58.172657 25037 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:58.178721 25085 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:58.197268 22654 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:58.199980 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.200138 25086 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:58.219439 22578 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:58.219300 25042 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.221524 25086 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:58.249475 22580 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.274422 22499 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:07:58.286664 22469 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: acc845449beb4f859e55185200f34bd2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.296648 22653 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:58.302485 22403 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 2 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.305806 25086 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:58.316898 25073 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.333765 22653 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.372786 22578 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:58.378911 22401 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.401129 25111 ts_tablet_manager.cc:933] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:07:58.408166 24981 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:58.421999 22579 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.505268 25111 tablet_copy_client.cc:323] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
I20260709 13:07:58.507205 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet 3eac3c624e2c43fc9505fe5c344151d0 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:07:58.507877 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet 3eac3c624e2c43fc9505fe5c344151d0 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-3eac3c624e2c43fc9505fe5c344151d0
I20260709 13:07:58.512111 22497 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:07:58.517508 22590 tablet_copy_source_session.cc:215] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:58.533258 25111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eac3c624e2c43fc9505fe5c344151d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.619215 25113 ts_tablet_manager.cc:933] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:07:58.645048 25114 ts_tablet_manager.cc:933] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:58.654037 25113 tablet_copy_client.cc:323] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:07:58.655962 22664 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 7452859c008745c19509f4d5d908e8f1 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:07:58.656574 22664 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 7452859c008745c19509f4d5d908e8f1 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-7452859c008745c19509f4d5d908e8f1
I20260709 13:07:58.657603 25114 tablet_copy_client.cc:323] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:58.659518 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet a14caf28740540799ba1c6db058346a1 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:58.660094 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet a14caf28740540799ba1c6db058346a1 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-a14caf28740540799ba1c6db058346a1
I20260709 13:07:58.666134 25111 tablet_copy_client.cc:806] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:58.666832 25111 tablet_copy_client.cc:670] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:58.671516 25111 tablet_copy_client.cc:538] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:58.671420 22515 tablet_copy_source_session.cc:215] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:58.684191 25114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14caf28740540799ba1c6db058346a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.718731 25111 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:58.723810 22664 tablet_copy_source_session.cc:215] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:58.727430 25113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7452859c008745c19509f4d5d908e8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.761323 25114 tablet_copy_client.cc:806] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:58.767156 25114 tablet_copy_client.cc:670] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:58.783025 25114 tablet_copy_client.cc:538] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:58.802460 25113 tablet_copy_client.cc:806] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:58.803095 25113 tablet_copy_client.cc:670] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:58.806926 25113 tablet_copy_client.cc:538] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:58.815649 25114 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:58.866262 25119 ts_tablet_manager.cc:933] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:07:58.873014 25113 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:58.884883 25111 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:58.887631 25111 tablet_bootstrap.cc:492] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:58.888505 25111 ts_tablet_manager.cc:1403] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.170s	user 0.026s	sys 0.013s
I20260709 13:07:58.904829 25111 raft_consensus.cc:359] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:58.905850 25111 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:58.906594 25111 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:58.914610 25111 ts_tablet_manager.cc:1434] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.006s
I20260709 13:07:58.909863 25114 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:58.921856 25114 tablet_bootstrap.cc:492] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:58.923660 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-3eac3c624e2c43fc9505fe5c344151d0 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:07:58.924170 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-3eac3c624e2c43fc9505fe5c344151d0 on tablet 3eac3c624e2c43fc9505fe5c344151d0 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:58.930155 25119 tablet_copy_client.cc:323] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:07:58.932155 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet acc845449beb4f859e55185200f34bd2 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:07:58.932770 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet acc845449beb4f859e55185200f34bd2 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-acc845449beb4f859e55185200f34bd2
I20260709 13:07:58.937095 25114 ts_tablet_manager.cc:1403] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.140s	user 0.031s	sys 0.003s
I20260709 13:07:58.940408 25114 raft_consensus.cc:359] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:58.941425 25114 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:58.942206 25114 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:58.948583 25114 ts_tablet_manager.cc:1434] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:58.957727 22515 tablet_copy_source_session.cc:215] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:58.959470 22514 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-a14caf28740540799ba1c6db058346a1 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:58.960033 22514 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-a14caf28740540799ba1c6db058346a1 on tablet a14caf28740540799ba1c6db058346a1 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:58.966007 25119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc845449beb4f859e55185200f34bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.967975 25113 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:58.969024 25113 tablet_bootstrap.cc:492] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:58.969727 25113 ts_tablet_manager.cc:1403] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.008s
I20260709 13:07:59.006278 25113 raft_consensus.cc:359] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:59.012156 25113 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:59.019155 25113 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:59.029814 25113 ts_tablet_manager.cc:1434] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 13:07:59.030577 25119 tablet_copy_client.cc:806] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.031270 25119 tablet_copy_client.cc:670] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.035902 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-7452859c008745c19509f4d5d908e8f1 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:59.036422 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-7452859c008745c19509f4d5d908e8f1 on tablet 7452859c008745c19509f4d5d908e8f1 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:59.037868 25119 tablet_copy_client.cc:538] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.078032 23263 raft_consensus.cc:1217] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:07:59.086556 25119 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:07:59.203248 23263 raft_consensus.cc:1217] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:07:59.241097 25119 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:59.242180 25119 tablet_bootstrap.cc:492] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:07:59.243108 25119 ts_tablet_manager.cc:1403] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.157s	user 0.026s	sys 0.011s
I20260709 13:07:59.278155 23263 raft_consensus.cc:1217] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:07:59.297112 25119 raft_consensus.cc:359] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:59.300918 25119 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:07:59.301910 25119 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:07:59.309763 25119 ts_tablet_manager.cc:1434] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.004s
I20260709 13:07:59.311589 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-acc845449beb4f859e55185200f34bd2 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:07:59.312136 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-acc845449beb4f859e55185200f34bd2 on tablet acc845449beb4f859e55185200f34bd2 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:07:59.334159 23263 raft_consensus.cc:1217] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:07:59.573256 25126 raft_consensus.cc:1064] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:59.575914 25126 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:59.584923 25084 raft_consensus.cc:1064] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:59.588227 25084 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:59.601225 23264 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:59.603492 25127 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.604434 22651 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:59.606554 23264 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:59.605981 25086 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:59.608532 25037 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.613767 22580 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:59.616331 25126 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:59.621202 22580 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:59.622818 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:59.628121 25084 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.628945 22497 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:59.630833 25085 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.677913 25085 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:59.678841 25086 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:59.683298 22578 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:07:59.687007 25074 raft_consensus.cc:1064] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:07:59.689705 25074 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:07:59.698102 22579 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:59.766937 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69225.7us
W20260709 13:07:59.787972 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 59610.4us
I20260709 13:07:59.861956 23264 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:59.882524 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 101424us
I20260709 13:07:59.881171 22403 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.912145 22499 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:07:59.997558 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73345.7us
W20260709 13:07:59.997167 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 96566.6us
I20260709 13:08:00.003433 23264 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:00.008546 23263 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:08:00.013356 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 84230us
I20260709 13:08:00.062992 25147 raft_consensus.cc:1064] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:08:00.071277 25165 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:00.072897 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 56925.3us
I20260709 13:08:00.206228 25147 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:00.220173 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 191434us
I20260709 13:08:00.228709 22500 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:00.245568 22651 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:08:00.281729 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 247690us
I20260709 13:08:00.284286 25174 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:00.290436 23262 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:08:00.291352 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 89028.2us
I20260709 13:08:00.310276 25174 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:00.312264 25141 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:00.346041 22580 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:00.355211 25147 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:00.378161 25032 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.385238 22653 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.401129 25126 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.403074 23263 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.409503 22650 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.422581 22654 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:00.454878 23264 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.463428 22400 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.509407 22399 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.563664 22400 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.607999 25168 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:00.609133 22650 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:00.609449 22578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:08:00.621537 22573 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.625160 23264 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.627079 25158 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:00.629623 22577 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.640906 25167 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.643097 25142 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:00.648669 22580 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:00.669557 22578 raft_consensus.cc:606] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:00.670107 22578 raft_consensus.cc:630] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Rejecting request to transfer leadership because tablet server 5e72fb99f5ee4943a91cf8e6dd73e80e is not a voter in the active config
I20260709 13:08:00.674218 23263 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.680197 22500 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.693204 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:00.693624 23264 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:00.693964 22650 raft_consensus.cc:606] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:00.694281 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56523.9us
I20260709 13:08:00.702044 25166 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:00.703323 22580 raft_consensus.cc:2955] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:08:00.709302 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 70497.2us
I20260709 13:08:00.713248 22498 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:00.714869 22499 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:00.719558 25166 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.727499 23261 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:00.731544 23261 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:00.734479 25125 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:00.736413 25125 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:00.746061 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7452859c008745c19509f4d5d908e8f1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:00.757294 25168 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.763276 25126 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.764727 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3eac3c624e2c43fc9505fe5c344151d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:00.767563 25037 raft_consensus.cc:993] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:00.768181 25037 raft_consensus.cc:1081] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:00.770277 23264 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.774384 23262 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.786268 22654 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.788040 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:08:00.788686 22573 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.789117 22573 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:00.794026 23260 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.800760 22402 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 2 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.802589 22577 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:00.808907 22499 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:00.808480 22497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90227a385eee486dbc981f55629940e4"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:08:00.811412 22650 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:00.810930 22399 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.810197 22400 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.812669 22497 raft_consensus.cc:606] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:08:00.818646 22573 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:00.823767 25127 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:00.845160 25039 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:00.852591 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:00.853407 22651 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:00.853811 22651 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:00.855033 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:00.856967 22500 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:00.854622 22651 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:00.859493 22651 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:00.860615 25154 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:00.864496 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet acc845449beb4f859e55185200f34bd2 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45752
I20260709 13:08:00.854588 22497 raft_consensus.cc:2955] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.872246 22578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:08:00.873070 22578 raft_consensus.cc:606] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:00.877199 22637 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eac3c624e2c43fc9505fe5c344151d0 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45752
I20260709 13:08:00.873939 22577 raft_consensus.cc:2955] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:08:00.898646 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62556.7us
I20260709 13:08:00.830111 22573 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:00.911417 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet acc845449beb4f859e55185200f34bd2 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:00.915047 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a14caf28740540799ba1c6db058346a1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:00.914963 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet 7452859c008745c19509f4d5d908e8f1 with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59516
I20260709 13:08:00.918833 25148 raft_consensus.cc:993] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:00.919484 25148 raft_consensus.cc:1081] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:00.920435 22500 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:00.918867 25186 tablet_replica.cc:333] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:08:00.931510 25186 raft_consensus.cc:2243] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:00.931731 23264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90227a385eee486dbc981f55629940e4"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46826
I20260709 13:08:00.937822 23264 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.938400 23264 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.940549 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:00.941320 22650 raft_consensus.cc:606] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:00.945189 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:00.949851 25174 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:00.950456 25174 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:00.956897 22651 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:00.958707 23264 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:00.951287 25186 raft_consensus.cc:2272] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:00.986910 25185 tablet_replica.cc:333] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:08:00.953909 22400 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:00.951455 25174 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:01.005988 25186 ts_tablet_manager.cc:1916] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.026561 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:01.027406 22497 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:01.028411 22497 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:01.029212 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:01.029302 22497 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:01.030576 22497 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:01.031116 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:01.035516 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:01.036141 23264 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:01.036175 22651 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:01.048667 22651 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:08:01.050040 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:01.051064 25170 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:01.051862 25170 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:01.052078 25185 raft_consensus.cc:2243] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.053066 25185 raft_consensus.cc:2272] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.052816 25170 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:01.059712 25185 ts_tablet_manager.cc:1916] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.063000 22497 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:08:01.065692 22653 raft_consensus.cc:2955] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:01.076804 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet a14caf28740540799ba1c6db058346a1 with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41926
I20260709 13:08:01.087994 25185 ts_tablet_manager.cc:1929] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:08:01.123682 25185 log.cc:1199] T acc845449beb4f859e55185200f34bd2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/acc845449beb4f859e55185200f34bd2
I20260709 13:08:01.125531 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet acc845449beb4f859e55185200f34bd2 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:01.126022 25185 tablet_replica.cc:333] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:08:01.126999 25185 raft_consensus.cc:2243] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.127656 25189 tablet_replica.cc:333] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:08:01.127779 25185 raft_consensus.cc:2272] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.134287 25186 ts_tablet_manager.cc:1929] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:01.146378 25186 log.cc:1199] T 7452859c008745c19509f4d5d908e8f1 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/7452859c008745c19509f4d5d908e8f1
I20260709 13:08:01.137063 25189 raft_consensus.cc:2243] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.145885 22400 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 1 to 2, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 2 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.145124 22399 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 3 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.135548 25185 ts_tablet_manager.cc:1916] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.147382 25189 raft_consensus.cc:2272] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.163254 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet 7452859c008745c19509f4d5d908e8f1 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:01.164719 25189 ts_tablet_manager.cc:1916] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.188650 25185 ts_tablet_manager.cc:1929] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:08:01.188916 25155 raft_consensus.cc:993] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:01.189508 25155 raft_consensus.cc:1081] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:01.191491 22651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:08:01.192008 22651 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.192312 22651 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.193075 25185 log.cc:1199] T 3eac3c624e2c43fc9505fe5c344151d0 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/3eac3c624e2c43fc9505fe5c344151d0
I20260709 13:08:01.200089 22651 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:01.202802 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:01.203421 22497 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.206537 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:01.207212 22580 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:01.207530 22580 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:01.207922 22651 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:01.208307 22580 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:01.219271 22580 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.210553 22497 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:01.213057 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet 3eac3c624e2c43fc9505fe5c344151d0 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:01.225912 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:01.227694 22580 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:01.228775 25037 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:01.229341 25037 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:01.230171 25037 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:01.232460 25189 ts_tablet_manager.cc:1929] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:08:01.233006 25189 log.cc:1199] T a14caf28740540799ba1c6db058346a1 P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/a14caf28740540799ba1c6db058346a1
I20260709 13:08:01.235097 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet a14caf28740540799ba1c6db058346a1 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:01.256026 22399 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 7, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.321092 25167 raft_consensus.cc:993] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:01.321625 25167 raft_consensus.cc:1081] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:01.323227 22497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:08:01.323752 22497 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.324234 22497 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.336066 22497 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:01.339568 22497 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:01.340474 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:01.341146 23264 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.351999 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:01.353103 22654 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:01.353459 22654 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:01.354259 22654 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:01.355518 22654 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:01.356113 23264 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:01.357560 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:01.365252 25127 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:01.365830 25127 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:01.366652 25127 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:01.400359 22654 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:01.411998 22399 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.438587 22497 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:01.442152 25172 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:01.455892 22651 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:01.463831 25170 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:01.465425 22651 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:01.467211 25138 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.496888 22497 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:01.503075 25138 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:08:01.758430 22573 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:01.759816 25142 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:01.774847 23264 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:01.776615 25157 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:01.797358 22500 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:01.799515 25037 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:01.864018 22653 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:01.876078 25184 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:02.036233 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:02.273856 22653 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:08:02.288882 22618 consensus_peers.cc:597] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d36d7ae701b84ad59f37ee479b4bd84f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.292412 22580 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:02.292527 22500 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:02.294675 25167 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:02.306488 25167 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:08:02.349992 25142 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.359206 22573 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.369035 22497 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.379149 22499 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:02.401891 22400 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 3, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.433256 22573 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:02.433801 22653 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:08:02.434180 22469 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0e2410740c9458db983018bbe19dcbf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.435070 25147 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:02.440209 25127 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:02.457929 25184 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.473475 22653 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.478948 22573 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.513761 22497 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:02.526556 22400 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.537364 22653 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:08:02.538802 22469 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34b4979f789f48d0807b87e7a48b9a78. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.543747 22573 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:02.545161 25147 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.546900 25127 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:02.554190 25127 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.558465 22653 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.582716 22402 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 3 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.575636 22497 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:02.600674 22573 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.603214 22650 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:02.605351 25157 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:02.607185 22469 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21b9ab72464841aca55186beb0dbeb53. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.618428 22580 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:02.622160 25157 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:02.626933 25157 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.629577 22653 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.671850 22399 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 3 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.677585 22573 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:02.693061 25231 ts_tablet_manager.cc:933] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:02.752853 25231 tablet_copy_client.cc:323] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:08:02.755025 22664 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet d36d7ae701b84ad59f37ee479b4bd84f from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:08:02.755674 22664 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet d36d7ae701b84ad59f37ee479b4bd84f from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-d36d7ae701b84ad59f37ee479b4bd84f
I20260709 13:08:02.763958 22664 tablet_copy_source_session.cc:215] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.768121 25231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36d7ae701b84ad59f37ee479b4bd84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.804905 25231 tablet_copy_client.cc:806] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.805701 25231 tablet_copy_client.cc:670] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:02.814559 25231 tablet_copy_client.cc:538] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:02.842741 25231 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:08:02.885970 25231 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:02.886866 25231 tablet_bootstrap.cc:492] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:08:02.887545 25231 ts_tablet_manager.cc:1403] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.001s
I20260709 13:08:02.894830 25231 raft_consensus.cc:359] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:02.895773 25231 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:08:02.896567 25231 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:02.899572 25231 ts_tablet_manager.cc:1434] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:08:02.901748 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-d36d7ae701b84ad59f37ee479b4bd84f received from {username='slave'} at 127.0.0.1:37482
I20260709 13:08:02.902271 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-d36d7ae701b84ad59f37ee479b4bd84f on tablet d36d7ae701b84ad59f37ee479b4bd84f with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:08:03.018525 25231 ts_tablet_manager.cc:933] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:03.026834 25231 tablet_copy_client.cc:323] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:08:03.028609 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet 34b4979f789f48d0807b87e7a48b9a78 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:08:03.029225 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet 34b4979f789f48d0807b87e7a48b9a78 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-34b4979f789f48d0807b87e7a48b9a78
I20260709 13:08:03.040189 22515 tablet_copy_source_session.cc:215] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.045449 25231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b4979f789f48d0807b87e7a48b9a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.076457 25235 ts_tablet_manager.cc:933] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:03.087109 25235 tablet_copy_client.cc:323] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:08:03.089157 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet f0e2410740c9458db983018bbe19dcbf from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:08:03.089740 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet f0e2410740c9458db983018bbe19dcbf from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-f0e2410740c9458db983018bbe19dcbf
I20260709 13:08:03.094735 25231 tablet_copy_client.cc:806] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.096407 25231 tablet_copy_client.cc:670] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.101425 25231 tablet_copy_client.cc:538] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.112624 25231 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:08:03.150472 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:03.151770 25231 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.152798 25231 tablet_bootstrap.cc:492] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:08:03.153770 25231 ts_tablet_manager.cc:1403] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.017s
I20260709 13:08:03.157641 25231 raft_consensus.cc:359] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.158674 25231 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:08:03.159546 25231 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.162707 25231 ts_tablet_manager.cc:1434] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:08:03.164752 22514 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-34b4979f789f48d0807b87e7a48b9a78 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:08:03.165473 22514 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-34b4979f789f48d0807b87e7a48b9a78 on tablet 34b4979f789f48d0807b87e7a48b9a78 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:08:03.194703 22515 tablet_copy_source_session.cc:215] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.202229 25235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e2410740c9458db983018bbe19dcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.212106 25231 ts_tablet_manager.cc:933] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
W20260709 13:08:03.218204 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68949.2us
I20260709 13:08:03.261647 25231 tablet_copy_client.cc:323] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.129:38445
I20260709 13:08:03.263633 22515 tablet_copy_service.cc:140] P 6ca917eaada84bf38a5daae9f8ffa066: Received BeginTabletCopySession request for tablet 21b9ab72464841aca55186beb0dbeb53 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:48204)
I20260709 13:08:03.264323 22515 tablet_copy_service.cc:161] P 6ca917eaada84bf38a5daae9f8ffa066: Beginning new tablet copy session on tablet 21b9ab72464841aca55186beb0dbeb53 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:48204: session id = fa2f181263f446a6962b649f9348c15f-21b9ab72464841aca55186beb0dbeb53
I20260709 13:08:03.270311 25235 tablet_copy_client.cc:806] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.271034 25235 tablet_copy_client.cc:670] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.277940 23260 raft_consensus.cc:1217] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:08:03.286911 22515 tablet_copy_source_session.cc:215] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.294963 25231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9ab72464841aca55186beb0dbeb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.297284 25235 tablet_copy_client.cc:538] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.317651 25231 tablet_copy_client.cc:806] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.318311 25231 tablet_copy_client.cc:670] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.328181 25231 tablet_copy_client.cc:538] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.328474 25235 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:08:03.338688 25231 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:08:03.390947 25235 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.391155 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:08:03.392020 25235 tablet_bootstrap.cc:492] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:08:03.391976 22580 raft_consensus.cc:606] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:03.394121 25235 ts_tablet_manager.cc:1403] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.009s
I20260709 13:08:03.395548 22653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:03.396155 22653 raft_consensus.cc:606] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:08:03.400004 25235 raft_consensus.cc:359] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.400940 25235 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:08:03.401644 25235 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.407197 25231 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.407963 22499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:08:03.408600 22499 raft_consensus.cc:606] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:03.413503 22653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:03.414080 22653 raft_consensus.cc:606] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:03.415067 25231 tablet_bootstrap.cc:492] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:08:03.416149 25231 ts_tablet_manager.cc:1403] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.007s
I20260709 13:08:03.419111 25231 raft_consensus.cc:359] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.420326 25231 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:08:03.421381 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:08:03.422029 22580 raft_consensus.cc:606] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:03.423776 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:03.423959 25231 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.425551 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:03.426733 25235 ts_tablet_manager.cc:1434] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:08:03.429190 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-f0e2410740c9458db983018bbe19dcbf received from {username='slave'} at 127.0.0.1:48204
I20260709 13:08:03.429620 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-f0e2410740c9458db983018bbe19dcbf on tablet f0e2410740c9458db983018bbe19dcbf with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:08:03.435926 25231 ts_tablet_manager.cc:1434] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:08:03.437755 22515 tablet_copy_service.cc:342] P 6ca917eaada84bf38a5daae9f8ffa066: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-21b9ab72464841aca55186beb0dbeb53 received from {username='slave'} at 127.0.0.1:48204
I20260709 13:08:03.438200 22515 tablet_copy_service.cc:434] P 6ca917eaada84bf38a5daae9f8ffa066: ending tablet copy session fa2f181263f446a6962b649f9348c15f-21b9ab72464841aca55186beb0dbeb53 on tablet 21b9ab72464841aca55186beb0dbeb53 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:08:03.577260 23264 raft_consensus.cc:1217] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:08:03.589476 23264 raft_consensus.cc:1217] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:08:03.605335 25167 raft_consensus.cc:993] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:03.605877 25167 raft_consensus.cc:1081] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:03.607685 23264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46820
I20260709 13:08:03.608336 23264 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.614775 23264 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.615620 25213 raft_consensus.cc:993] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:03.616173 25213 raft_consensus.cc:1081] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:03.618252 22497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59530
I20260709 13:08:03.618849 22497 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.619184 22497 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.623136 23264 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:03.627097 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:03.627827 22580 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.630311 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:03.630977 22653 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:03.631280 22653 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:03.632071 22653 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:03.633183 22653 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:03.634996 25184 raft_consensus.cc:993] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:03.635705 25214 raft_consensus.cc:1081] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:03.638604 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:08:03.639204 22573 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.639555 22573 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:03.653546 22497 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:03.669283 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:03.669907 23263 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.676939 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:03.677652 22577 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.677942 22577 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:03.678791 22577 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:03.680016 22577 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.701442 22573 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.705757 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:03.706377 22650 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:03.716490 23263 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:03.720643 23264 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:03.661319 22580 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:03.733103 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:03.734308 25194 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.734934 25194 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:03.735922 25194 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:03.746201 22577 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:03.756541 22497 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:03.760700 25215 raft_consensus.cc:993] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:03.761343 25215 raft_consensus.cc:1081] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:03.763573 22651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:08:03.764163 22651 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:08:03.764364 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 55334.5us
I20260709 13:08:03.764520 22651 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.765805 22573 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:03.767577 22650 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:03.768602 22653 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:03.812196 25238 raft_consensus.cc:993] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:03.812749 25238 raft_consensus.cc:1081] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:03.821985 22579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:08:03.822136 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:03.822558 22579 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.822770 22499 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:03.822981 22579 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.823204 22499 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:03.824074 22499 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.833117 22543 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:03.832916 22651 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:03.834451 25213 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:03.835011 25213 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:03.837481 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:03.838099 22577 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:03.838373 22577 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:03.830682 22402 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 6 to 7, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 7 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.839107 22651 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:03.835958 25213 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:03.846349 22577 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:03.847437 22577 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.851024 22579 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:03.854189 22579 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:03.855733 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:03.856380 22653 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.856688 22653 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:03.860107 22653 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:03.861543 22653 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.863523 22577 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:03.857034 22469 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:03.866477 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92340.8us
I20260709 13:08:03.871580 22653 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:03.875166 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:03.881471 25142 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.882086 25142 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:03.883198 25142 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:03.886389 22499 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:03.887622 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:03.888974 25127 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:03.891883 25166 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:03.892493 25166 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:03.893503 25166 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:03.895623 23263 raft_consensus.cc:1217] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:08:03.897817 25127 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:03.898471 22499 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:03.898881 25127 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:03.904063 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:03.910468 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:03.911221 22500 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.912786 22497 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.921619 22651 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:03.948678 22497 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:03.974730 22500 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:03.993242 25209 raft_consensus.cc:1064] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:08:04.014902 22399 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 10, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 10 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:04.013127 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55388.9us
I20260709 13:08:04.015143 22400 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 3 to 4, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:04.039238 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127544us
I20260709 13:08:04.064206 25209 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:04.067270 25246 raft_consensus.cc:1064] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:08:04.051831 22401 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 8 to 9, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 9 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.083899 25246 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:04.099205 23264 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:04.101296 25248 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:04.116019 25214 raft_consensus.cc:1064] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:08:04.117601 22580 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:04.119721 25127 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:04.130455 23263 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:04.134938 22653 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:04.147682 25167 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:04.155529 22499 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:04.119843 25214 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:04.180258 22653 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:04.182754 25194 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:04.191454 25258 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:04.212039 22577 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:04.218286 25167 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.214804 25246 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:08:04.251626 23261 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:04.254743 22499 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:04.254864 25244 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:04.261788 22646 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:04.300413 25215 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:04.307647 22573 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:04.333573 23263 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 3 LEARNER]: Advancing to term 4
I20260709 13:08:04.316447 25244 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:08:04.332368 25194 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:08:04.355304 25167 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.365244 25127 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.361521 22573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41926
I20260709 13:08:04.367355 22573 raft_consensus.cc:606] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:08:04.365489 22654 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:04.369635 25166 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:04.384341 22577 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.388604 23263 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:04.392447 22400 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 8 to 9, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 9 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.401098 22573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41926
I20260709 13:08:04.401707 22573 raft_consensus.cc:606] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Received request to transfer leadership
W20260709 13:08:04.407444 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 90730.9us
W20260709 13:08:04.409298 22387 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 21b9ab72464841aca55186beb0dbeb53 already in progress
W20260709 13:08:04.417024 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 89885.8us
I20260709 13:08:04.418383 23261 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:04.432623 22580 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:04.433998 22579 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.509851 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:04.532362 25285 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:04.438623 22654 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:08:04.596302 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 154476us
I20260709 13:08:04.425828 25166 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
W20260709 13:08:04.613128 22387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 206509us
I20260709 13:08:04.624897 22572 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:08:04.660503 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 138519us
W20260709 13:08:04.677757 25282 log.cc:927] Time spent T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:08:04.596650 25238 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 13:08:04.684335 25281 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:08:04.709580 25277 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 13:08:04.725576 23260 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.741568 22653 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:04.729192 25245 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.773770 23262 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.787350 22499 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.808518 23258 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.799175 25166 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:08:04.826776 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 385504us
I20260709 13:08:04.831604 25302 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:04.839013 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41926
I20260709 13:08:04.839602 22577 raft_consensus.cc:606] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:08:04.844771 25294 raft_consensus.cc:993] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:04.880312 22578 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:04.879993 22496 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:04.901226 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 50336.1us
I20260709 13:08:04.938719 22650 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:04.915993 25294 raft_consensus.cc:1081] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:04.974040 22497 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:08:04.987443 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51454.4us
W20260709 13:08:04.993423 25307 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:08:05.004957 22401 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.020021 22401 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 3 to 4, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.050897 25300 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:08:05.061009 25245 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:05.106595 22502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59530
I20260709 13:08:05.107283 22502 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.107713 22502 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:05.107751 22575 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.113085 25303 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:08:05.144440 22502 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:05.146775 22502 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:05.151618 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:05.152762 22651 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:05.169291 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:05.176081 22649 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:05.185302 22573 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:05.194578 25300 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:05.202195 23264 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:05.202860 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44462.7us
I20260709 13:08:05.206100 25209 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:05.230316 25167 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.236837 23264 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.247961 22399 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.252229 22573 raft_consensus.cc:2955] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.257807 22651 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:05.268129 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d36d7ae701b84ad59f37ee479b4bd84f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.276991 22575 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:05.277472 22575 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:05.278280 22575 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:05.280009 22575 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:05.282567 22449 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:05.283020 22449 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 21b9ab72464841aca55186beb0dbeb53 already in progress
W20260709 13:08:05.283311 22449 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 21b9ab72464841aca55186beb0dbeb53 already in progress
I20260709 13:08:05.306907 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:05.307928 25285 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:05.311429 22502 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:05.316954 25285 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:05.317888 23264 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:05.318986 22577 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:05.319504 25292 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:05.317976 25285 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:05.328312 25246 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.347515 22502 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:05.351266 23261 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.363372 22575 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:05.367990 25184 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:05.371817 23264 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:05.374207 25285 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:05.374794 22399 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 4 to 5, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.376039 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34b4979f789f48d0807b87e7a48b9a78 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.378055 22579 raft_consensus.cc:2955] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.382198 22651 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:05.389951 25184 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.390328 25246 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:05.398789 23264 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.403949 22650 raft_consensus.cc:2955] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.419775 22402 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 5, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 5 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:05.431169 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet d36d7ae701b84ad59f37ee479b4bd84f with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59516
I20260709 13:08:05.431998 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f0e2410740c9458db983018bbe19dcbf with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.427762 22402 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 5 to 6, VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) evicted. New cstate: current_term: 3 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:05.458730 25263 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:08:05.462241 25326 tablet_replica.cc:333] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:08:05.470041 22401 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.474076 25326 raft_consensus.cc:2243] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.475069 25326 raft_consensus.cc:2272] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.479578 25326 ts_tablet_manager.cc:1916] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.483242 22641 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b4979f789f48d0807b87e7a48b9a78 with delete_type TABLET_DATA_TOMBSTONED (TS 5e72fb99f5ee4943a91cf8e6dd73e80e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45752
I20260709 13:08:05.484124 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet f0e2410740c9458db983018bbe19dcbf with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41926
I20260709 13:08:05.520169 25326 ts_tablet_manager.cc:1929] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:08:05.520799 25326 log.cc:1199] T d36d7ae701b84ad59f37ee479b4bd84f P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/d36d7ae701b84ad59f37ee479b4bd84f
I20260709 13:08:05.520979 25328 tablet_replica.cc:333] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:08:05.522763 25327 tablet_replica.cc:333] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:08:05.524199 25327 raft_consensus.cc:2243] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.525571 25327 raft_consensus.cc:2272] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.526022 25328 raft_consensus.cc:2243] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.528904 25327 ts_tablet_manager.cc:1916] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.530061 25328 raft_consensus.cc:2272] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.534147 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet d36d7ae701b84ad59f37ee479b4bd84f (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:05.555825 25327 ts_tablet_manager.cc:1929] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:08:05.556777 25327 log.cc:1199] T 34b4979f789f48d0807b87e7a48b9a78 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/wals/34b4979f789f48d0807b87e7a48b9a78
I20260709 13:08:05.560487 22387 catalog_manager.cc:5028] TS 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): tablet 34b4979f789f48d0807b87e7a48b9a78 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:05.560688 25328 ts_tablet_manager.cc:1916] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.581569 25328 ts_tablet_manager.cc:1929] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:08:05.582121 25328 log.cc:1199] T f0e2410740c9458db983018bbe19dcbf P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/f0e2410740c9458db983018bbe19dcbf
I20260709 13:08:05.584913 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet f0e2410740c9458db983018bbe19dcbf (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:05.812127 22573 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:05.814168 25285 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:05.818280 22650 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:05.834007 25184 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:05.843572 23264 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Advancing to term 5
I20260709 13:08:05.878839 23264 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:05.880441 25248 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:05.908854 25248 raft_consensus.cc:1064] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:08:05.913710 25248 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:05.963390 23264 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:05.964635 22651 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:05.964972 25248 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:05.966900 25243 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:05.973946 22575 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:05.977780 25246 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:05.979208 25248 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.981743 22651 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.987021 22575 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.992472 23262 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:05.999917 22399 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 4 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.026130 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:06.049994 22501 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:06.060920 22651 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:08:06.061362 23262 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:08:06.062772 25292 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:06.063635 25248 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:06.071535 25285 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:06.077052 22650 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:06.088145 23262 raft_consensus.cc:2955] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:06.106096 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21b9ab72464841aca55186beb0dbeb53 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:06.113951 22575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:08:06.114612 22575 raft_consensus.cc:606] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:06.124166 22400 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 7 to 8, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New cstate: current_term: 5 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.130968 22501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:08:06.131734 22501 raft_consensus.cc:606] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:08:06.152828 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet 21b9ab72464841aca55186beb0dbeb53 with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41926
I20260709 13:08:06.155121 25336 tablet_replica.cc:333] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:08:06.155005 22501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:08:06.155834 22501 raft_consensus.cc:606] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:06.156493 25336 raft_consensus.cc:2243] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:06.157312 25336 raft_consensus.cc:2272] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:06.165613 22651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813ede727198414390a20d5845e75e07"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:06.166203 22651 raft_consensus.cc:606] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:06.169265 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:06.175503 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:06.181209 25305 raft_consensus.cc:993] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:06.181914 25252 raft_consensus.cc:1081] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:06.184487 22651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:08:06.181051 25336 ts_tablet_manager.cc:1916] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:06.185446 22651 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.189615 22651 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.199543 22651 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:06.204077 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:06.204712 22502 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.206254 25336 ts_tablet_manager.cc:1929] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 13:08:06.206709 25336 log.cc:1199] T 21b9ab72464841aca55186beb0dbeb53 P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/21b9ab72464841aca55186beb0dbeb53
I20260709 13:08:06.207543 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:06.208133 22575 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:06.208433 22575 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:06.208914 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet 21b9ab72464841aca55186beb0dbeb53 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:06.209167 22575 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:06.210244 22575 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.210747 22651 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:06.220979 22502 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:06.222532 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:06.223574 25254 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:06.224149 25254 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:06.227293 22575 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:06.227087 25254 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:06.230209 25167 raft_consensus.cc:993] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:06.230756 25167 raft_consensus.cc:1081] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:06.232605 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "813ede727198414390a20d5845e75e07"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:08:06.233325 22573 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.233729 22573 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:06.245268 22573 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:06.248198 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:06.248430 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:06.248891 22502 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:06.249125 22651 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:06.249435 22651 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:06.250324 22651 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:06.251384 22651 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:06.252988 22573 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:06.254931 22400 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.260713 22651 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:06.262065 22543 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:06.262872 22502 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:06.263082 25252 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:06.263618 25252 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:06.264532 25252 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:06.282585 22400 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 6 to 7, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.303781 25243 raft_consensus.cc:993] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:06.304400 25292 raft_consensus.cc:1081] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:06.306259 22573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41936
I20260709 13:08:06.306964 22573 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.307379 22573 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.313131 22573 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:06.315119 22573 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:06.315450 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:06.315619 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:06.316186 22651 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.316349 22502 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:06.316816 22502 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:06.317584 22502 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:06.318539 22502 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.324133 22502 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:06.324810 22651 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:06.325358 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:06.326213 25252 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:06.326699 25252 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:06.327564 25252 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:06.337610 22400 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 7 to 8, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 8 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.570068 22651 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:06.580505 22573 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:06.580646 22618 consensus_peers.cc:597] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b09d79da74a54c84ab38db5f54cacc35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.581967 25337 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:06.582399 22502 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:06.583994 25337 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:06.597121 25209 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:06.598172 22575 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:06.603096 22501 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:08:06.618532 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 5314aa61dd7f4a7f9b148f71ea5055c4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:06.619364 22400 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.629879 22650 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:06.652508 22501 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:06.654978 25305 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:06.656324 25285 raft_consensus.cc:993] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:06.656939 25292 raft_consensus.cc:1081] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:06.658953 23262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a60725e5550479db8d1e52b48126750"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46826
I20260709 13:08:06.659794 23262 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.660223 23262 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.674233 22575 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:06.675535 23262 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:06.676709 25337 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:06.680444 22618 consensus_peers.cc:597] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca60e389358849e7bf461e472007a7f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.684661 22502 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:06.684777 22573 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:06.689286 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:06.690001 22496 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:06.690320 22496 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:06.691202 22496 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:06.691901 25337 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:06.692376 22496 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.699664 25167 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:06.726835 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:06.727470 22573 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.727802 23262 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:06.739099 22651 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:06.742305 25305 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:06.743062 25209 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:06.745213 22496 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:06.746359 23229 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:06.747255 25194 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:06.748037 25194 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:06.748986 25194 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:06.753291 22579 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:06.758291 22503 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:06.766271 25337 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:06.765224 22503 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:06.779024 22502 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:06.781912 25252 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:06.768744 22573 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:06.824827 22399 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 9 to 10, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.854626 22648 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:06.881713 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53842.1us
I20260709 13:08:06.885216 22400 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 6, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:06.877997 25356 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:06.931306 22501 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:07.042850 22573 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:07.045648 25243 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:07.049525 23264 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 1 LEARNER]: Advancing to term 4
I20260709 13:08:07.049793 22648 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:07.052341 25285 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.057469 23264 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:07.058377 25369 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:07.060108 22573 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:08:07.062268 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 113982us
I20260709 13:08:07.068259 25292 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.069177 25292 consensus_queue.cc:1243] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer fa2f181263f446a6962b649f9348c15f log is divergent from this leader: its last log entry 1.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:07.070009 25371 ts_tablet_manager.cc:933] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:07.074959 23264 pending_rounds.cc:85] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 1
I20260709 13:08:07.075333 23264 pending_rounds.cc:107] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:08:07.075659 23264 raft_consensus.cc:2917] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:08:07.076118 23264 raft_consensus.cc:2889] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.082543 22650 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:07.093823 22401 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:07.120002 25371 tablet_copy_client.cc:323] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:08:07.136988 22664 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet b09d79da74a54c84ab38db5f54cacc35 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:08:07.137669 22664 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet b09d79da74a54c84ab38db5f54cacc35 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-b09d79da74a54c84ab38db5f54cacc35
I20260709 13:08:07.188709 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.188957 25376 ts_tablet_manager.cc:933] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:07.195106 23264 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:08:07.209364 22573 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:07.221184 25194 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:07.235265 22664 tablet_copy_source_session.cc:215] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:07.239189 25371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b09d79da74a54c84ab38db5f54cacc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:07.254292 22502 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:07.256135 25365 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:07.269361 25376 tablet_copy_client.cc:323] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:08:07.275990 25371 tablet_copy_client.cc:806] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:07.276711 25371 tablet_copy_client.cc:670] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:07.278229 22664 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet ca60e389358849e7bf461e472007a7f7 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:08:07.280435 22664 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet ca60e389358849e7bf461e472007a7f7 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-ca60e389358849e7bf461e472007a7f7
I20260709 13:08:07.296132 22664 tablet_copy_source_session.cc:215] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:07.303066 25371 tablet_copy_client.cc:538] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:07.333154 25376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca60e389358849e7bf461e472007a7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:07.333931 25371 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:08:07.456760 25376 tablet_copy_client.cc:806] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:07.457458 25376 tablet_copy_client.cc:670] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:07.466724 25376 tablet_copy_client.cc:538] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:07.477511 25371 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:07.478641 25371 tablet_bootstrap.cc:492] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:08:07.479559 25371 ts_tablet_manager.cc:1403] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.155s	user 0.030s	sys 0.004s
I20260709 13:08:07.482818 25371 raft_consensus.cc:359] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:07.483752 25371 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:08:07.484498 25371 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:07.494788 25371 ts_tablet_manager.cc:1434] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:07.497941 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-b09d79da74a54c84ab38db5f54cacc35 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:08:07.498447 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-b09d79da74a54c84ab38db5f54cacc35 on tablet b09d79da74a54c84ab38db5f54cacc35 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:08:07.502883 25376 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:08:07.549474 25376 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:07.550603 25376 tablet_bootstrap.cc:492] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:08:07.551424 25376 ts_tablet_manager.cc:1403] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 0.049s	user 0.034s	sys 0.008s
I20260709 13:08:07.554785 25376 raft_consensus.cc:359] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:07.555831 25376 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:08:07.556645 25376 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:07.559626 23264 raft_consensus.cc:1217] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Deduplicated request from leader. Original: 6.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:08:07.563932 25376 ts_tablet_manager.cc:1434] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:07.565959 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-ca60e389358849e7bf461e472007a7f7 received from {username='slave'} at 127.0.0.1:37482
I20260709 13:08:07.566421 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-ca60e389358849e7bf461e472007a7f7 on tablet ca60e389358849e7bf461e472007a7f7 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:08:07.597306 23264 raft_consensus.cc:1217] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 13:08:07.655092 25243 raft_consensus.cc:1064] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:08:07.657189 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.661739 25243 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:07.673125 23264 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 LEARNER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:07.675040 25377 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:07.695484 22650 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:07.698225 25377 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:07.709903 25364 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:07.718523 22573 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:07.730155 22650 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:07.738903 25243 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:07.749627 23264 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:07.760756 22400 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.762982 22575 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:08:08.572692 23229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.004s	sys 0.007s
W20260709 13:08:08.573230 23229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.007s
I20260709 13:08:08.579877 25395 raft_consensus.cc:1064] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
W20260709 13:08:08.581591 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.003s	sys 0.010s
W20260709 13:08:08.582017 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.003s	sys 0.010s
W20260709 13:08:08.582598 23228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.010s
W20260709 13:08:08.582967 23228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.000s	sys 0.010s
W20260709 13:08:08.767112 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 969653us
W20260709 13:08:08.776593 22400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.017s	sys 0.021s
W20260709 13:08:08.789665 22400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.019s	sys 0.021s
I20260709 13:08:08.800601 25395 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 2, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.795907 25254 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:08.829754 25392 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:08.830560 25392 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.835752 25392 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:08.841987 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:08.844723 22575 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:08.847157 25254 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:08.850907 25395 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:08.848316 25392 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.853827 25395 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:08.854198 25392 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.854523 25395 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.860083 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:08.862035 25285 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:08.862665 25285 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:08.864735 25285 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:08.864799 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:08.866022 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 301) took 1108 ms. Trace:
I20260709 13:08:08.867820 25285 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:08.868218 25254 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:08.875156 25285 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:08.879938 25349 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.883669 25390 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.883586 25349 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.884251 25390 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.886304 25390 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:08.886765 25349 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:08.887243 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:08.888391 23264 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:08.866460 22400 rpcz_store.cc:276] 0709 13:08:07.757492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.757655 (+   163us) service_pool.cc:224] Handling call
0709 13:08:08.790058 (+1032403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:08.790093 (+    35us) write_op.cc:454] Released schema lock
0709 13:08:08.865934 (+ 75841us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:08.147160 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:08.147711 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:08.147771 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:08:08.147788 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:08.148159 (+   371us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:08.148233 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:08.148260 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:08.148447 (+   187us) tablet.cc:701] Row locks acquired
0709 13:08:08.148463 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:08.148627 (+   164us) write_op.cc:270] Start()
0709 13:08:08.148728 (+   101us) write_op.cc:276] Timestamp: P: 1783602488148562 usec, L: 0
0709 13:08:08.148747 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:08.149424 (+   677us) log.cc:844] Serialized 603 byte log entry
0709 13:08:08.555232 (+405808us) op_driver.cc:464] REPLICATION: finished
0709 13:08:08.564685 (+  9453us) write_op.cc:301] APPLY: starting
0709 13:08:08.564771 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:08.564892 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:08.565015 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:08.565979 (+   964us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:08.566172 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:08.566222 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:08.566468 (+   246us) log.cc:844] Serialized 23 byte log entry
0709 13:08:08.566659 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:08.566744 (+    85us) write_op.cc:454] Released schema lock
0709 13:08:08.566783 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":353152,"child_traces":[["op",{"apply.queue_time_us":9158,"apply.run_cpu_time_us":1713,"apply.run_wall_time_us":2424,"num_ops":1,"prepare.queue_time_us":380448,"prepare.run_cpu_time_us":5301,"prepare.run_wall_time_us":253615,"raft.queue_time_us":154980,"raft.run_cpu_time_us":1105,"raft.run_wall_time_us":12676,"replication_time_us":406299,"thread_start_us":1442908,"threads_started":4,"wal-append.queue_time_us":248235}]]}
I20260709 13:08:08.876844 25392 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:08.889430 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:08.890465 25392 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.890980 25392 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.892577 25407 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.893157 25407 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:08.895394 25407 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:08.897253 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:08.898025 23261 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:08.899432 25392 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:08.902606 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:08.903030 25388 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:08.903824 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:08.905408 25254 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:08.905817 25254 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.906100 25405 raft_consensus.cc:1064] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:08:08.906181 25254 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:08.910179 25405 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.916278 25386 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.917114 25386 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.921154 25386 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:08.921746 25388 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.922573 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:08.922926 25388 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.923628 25388 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.924736 25386 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:08.990984 25285 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:08.994149 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 90391.2us
I20260709 13:08:08.984889 25407 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.017402 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:08.987313 25386 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:08.996002 25243 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:09.013960 25285 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:09.014508 25407 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.027758 25404 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:09.153093 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 120050us
I20260709 13:08:09.031147 25416 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:09.034112 25411 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:09.054605 25392 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:09.053632 25414 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:09.173846 25414 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.178226 25414 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.178417 25395 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:09.124094 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.180981 25358 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.181550 25358 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.182036 25407 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.183276 25407 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.183920 25407 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.187465 25407 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.189479 25386 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.190066 25392 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.166618 25418 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:09.167608 25415 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:08:09.168588 25412 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:09.056524 25285 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.159973 25406 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.033916 25243 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:09.162828 25419 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:09.200691 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:09.190815 25388 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.224057 25403 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:09.224714 25403 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.225749 25243 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.226933 25403 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.227658 25285 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.229090 25419 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.230540 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.161222 25404 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.203713 25412 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.191339 25411 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.198941 25418 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.213116 25406 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.165601 25416 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.231563 25419 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.233628 25404 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.250248 25404 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.250734 25404 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.252054 25398 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.252693 25398 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.262300 25358 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:09.270013 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 107321us
I20260709 13:08:09.247367 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.242091 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.244964 25416 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:09.315160 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.317791 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.253206 25422 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:09.253000 25404 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.240130 25418 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.261919 25387 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.235718 25412 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.238118 25411 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.242688 25408 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.313371 25419 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.246583 25392 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:09.285606 25403 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.242774 25406 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.337389 25431 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:09.338049 25285 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:09.338147 25431 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.338634 25285 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.339160 25426 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:09.339694 25426 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.332499 25387 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.341823 25408 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.337507 25427 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.344086 25387 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.340994 25419 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.345945 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.355065 22651 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:09.344151 25408 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.344417 25427 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.356130 25419 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.356637 25419 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.357076 25419 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.357434 22574 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:09.358026 25427 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:09.358768 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.358944 25419 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.345775 25396 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.359731 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.359992 25396 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.361874 25285 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.362216 25396 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.325701 25422 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.348378 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.363056 22654 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:09.349545 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.363929 22648 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:09.348013 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.364279 25422 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:09.364771 22652 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:09.350193 25431 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.365983 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.366603 22651 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:09.367224 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.367998 23258 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 LEARNER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:09.351042 25426 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.350664 25403 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.351789 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.370659 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.371608 25403 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.372531 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:09.353852 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.354063 25398 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.325218 25388 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.377664 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.249069 25254 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.384038 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.391352 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.392071 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.412599 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.413983 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.415145 25254 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.415617 25423 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.416186 25423 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.417870 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.418438 25423 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.418570 22651 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:09.420447 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.421105 22648 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:09.421166 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.382428 25422 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.387531 25388 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.431313 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.555190 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.441619 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.556670 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.434080 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.422947 25422 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:09.537458 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 113379us
I20260709 13:08:09.538357 22646 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:09.428171 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.539434 25388 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:09.531507 25428 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:08:09.528359 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:09.541682 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.542416 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.530659 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.430312 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:09.518798 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 96780.2us
I20260709 13:08:09.596370 25434 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:09.602998 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.605443 25434 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.605978 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.606459 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.619642 25398 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:09.606523 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.620152 25398 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.620077 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.620808 25398 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.621193 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.621944 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.604771 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.608101 25434 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.649411 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.609593 25416 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:09.650547 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.651615 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.610778 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.612986 25430 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:09.598482 22498 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:08:09.613787 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83174.2us
I20260709 13:08:09.653496 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.653834 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.654536 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.652599 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.655548 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.613662 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.656113 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.657199 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.655864 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.613001 22650 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:09.617573 22653 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:09.617126 25388 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:09.618211 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:09.622265 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.604029 22500 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:09.556753 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.619988 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.657464 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:09.625043 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 96766.1us
W20260709 13:08:09.615306 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 60950.3us
I20260709 13:08:09.613898 22651 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
W20260709 13:08:09.630744 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45953.8us
I20260709 13:08:09.673461 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.674191 22578 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:09.681057 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.682847 25396 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:09.684296 23227 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.685293 25389 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:09.685808 25389 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.686216 25389 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:09.634759 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:09.617185 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 75570.9us
W20260709 13:08:09.688589 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53919.8us
I20260709 13:08:09.689435 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:09.690886 25416 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:09.706800 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.709354 25389 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.613663 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:09.641008 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 366613us
I20260709 13:08:09.638278 25398 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.720523 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:09.721225 22601 debug-util.cc:398] Leaking SignalData structure 0x7b08000af460 after lost signal to thread 21393
I20260709 13:08:09.721729 23227 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.613639 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.722327 25401 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:09.722456 22580 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:09.722539 23258 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:09.722802 25401 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.657516 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:09.723229 25401 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:09.722309 22601 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9740 after lost signal to thread 22437
I20260709 13:08:09.724668 25433 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:09.725111 25433 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:09.725337 22601 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc7a0 after lost signal to thread 22529
W20260709 13:08:09.726588 22601 debug-util.cc:398] Leaking SignalData structure 0x7b0800362540 after lost signal to thread 22604
W20260709 13:08:09.727667 22601 debug-util.cc:398] Leaking SignalData structure 0x7b080038caa0 after lost signal to thread 22678
I20260709 13:08:09.727741 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:08:09.728192 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.728400 22580 raft_consensus.cc:606] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:09.728899 22601 debug-util.cc:398] Leaking SignalData structure 0x7b080039eb20 after lost signal to thread 23288
I20260709 13:08:09.730484 25389 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.714111 22648 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:09.715910 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.716215 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.743273 25430 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:09.743801 25430 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.720734 23260 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:09.728827 22578 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:09.744305 25430 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.744021 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:09.731484 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.638398 25422 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:09.733450 25398 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.602663 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.747012 25422 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:09.747134 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 144565us
I20260709 13:08:09.736044 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.732982 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.736348 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.738062 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.738276 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:09.748502 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.736601 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.711537 25409 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:09.753317 25409 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.740113 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:09.753722 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.754499 25419 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.740798 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.739873 25421 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:09.755632 25421 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:09.755961 25421 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:09.753460 25422 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.750347 25401 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.725476 25433 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.758235 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.753769 25409 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.756762 25421 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.787425 25421 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:09.792968 25434 consensus_queue.cc:1175] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:08:09.760594 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.794274 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.763142 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.764598 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:09.764801 25418 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:09.754956 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.765570 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.796766 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.797230 22578 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:09.779168 25404 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:09.780234 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.757339 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:09.797938 22544 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.798173 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.785987 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:09.799638 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.799867 25404 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.800086 25406 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:09.800315 25408 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:09.796607 22580 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:09.800810 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.800941 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.802618 23227 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.804140 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.806123 25436 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:09.806581 25436 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.806962 25436 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:09.801808 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.808969 25414 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:09.809890 25422 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:09.810621 25407 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:09.801414 25428 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:09.801323 25416 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:09.801229 25419 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:09.800331 25404 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.800918 25406 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:09.818110 25406 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:09.818547 25406 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.819800 22579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813ede727198414390a20d5845e75e07"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:08:09.820436 22579 raft_consensus.cc:606] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:09.827952 22502 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.839023 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.752390 25430 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.842422 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.853457 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:09.857954 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57115.7us
I20260709 13:08:09.859375 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.860894 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.865633 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.865934 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.859414 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:09.867025 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:09.840117 25416 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:09.870106 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:09.843379 25389 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:09.874737 25392 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:09.875913 25422 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:09.868342 25427 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:09.857604 25396 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:09.876765 25254 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:09.871837 25358 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:09.880716 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:09.850826 25428 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:09.884992 25419 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:09.888756 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.871675 25403 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:09.832772 25409 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.786355 25435 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:08:09.913080 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.858290 25388 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:09.883162 25392 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.887223 25422 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.921360 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.929808 25422 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:09.932368 23260 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:09.924937 25392 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.915354 25403 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:09.934682 25403 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:09.941370 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.935331 25414 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:09.942292 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75608.1us
W20260709 13:08:09.946020 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 93070.6us
I20260709 13:08:09.943554 22400 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:09.936443 25401 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:09.968197 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:09.965621 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:09.959199 23259 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:09.977145 22577 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:09.978140 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:09.988096 25426 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:09.988575 25426 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:09.989424 25426 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:09.984344 25431 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:09.989897 25433 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:09.986735 25401 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:09.994062 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:10.015888 25401 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:10.016422 25401 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.989765 25430 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:10.020244 25409 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:10.021245 25392 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.027143 25435 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:10.027715 25435 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.028038 25401 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.028748 25435 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.032192 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.034067 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:10.034296 23259 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:10.036098 25434 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:10.037493 25434 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:10.037854 25434 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.040287 22652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:10.041004 22652 raft_consensus.cc:606] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.000898 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.045601 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.030277 25435 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:10.007638 25406 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.010013 25404 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.054003 25404 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:10.054867 22579 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:10.011121 25436 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.056605 22580 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:10.056818 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:10.057982 23264 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:10.048202 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 140490us
I20260709 13:08:09.990952 25426 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.051021 22578 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:10.051717 25406 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:10.004966 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:10.059405 22572 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:10.057744 23259 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:10.048017 25392 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:10.067556 25414 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:10.068346 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.039227 25434 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.071585 25434 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:10.069876 22649 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:10.073057 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.069063 25421 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:10.074618 25421 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.075131 25433 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:10.075984 25436 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:10.075548 25421 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.077425 25421 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.068677 25414 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:10.078733 25422 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.079598 25414 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:10.080003 25414 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.081146 25414 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.082387 25414 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.083262 25403 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.008713 25432 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.078765 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.087235 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.087965 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.088307 25387 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:10.090308 25447 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:10.091385 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 86566.8us
I20260709 13:08:10.094337 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:10.096108 25447 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:10.101127 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.100769 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:10.104087 22654 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:10.104749 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.108435 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.109113 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.109826 22468 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:10.110265 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.112113 23227 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.112716 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:10.115590 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:10.121019 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.121600 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:10.118510 25419 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:10.124778 25445 raft_consensus.cc:993] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:10.114168 25447 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.125834 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.127337 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.129030 25418 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:10.129877 25404 raft_consensus.cc:1081] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:10.130275 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:10.131170 25404 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:10.132671 25447 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:10.134061 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:10.134845 25447 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.136061 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:10.137365 25447 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:10.114460 25387 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:10.138576 25387 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:10.138942 25387 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:10.138594 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:10.139838 25387 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.140704 25447 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:10.142025 25387 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.118883 25442 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:10.143141 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:10.145149 25447 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:10.146437 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.148658 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:10.149411 22580 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.147806 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:10.151081 25422 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:10.121519 22574 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.151721 25427 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:10.152478 22654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:08:10.153048 22654 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.153399 22654 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.161729 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.165058 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.165537 22654 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.166589 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.171038 22580 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:10.174189 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:10.173573 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.175127 22504 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.177369 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.179141 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:10.146149 25398 consensus_queue.cc:1175] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:08:10.189096 22654 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:10.196730 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.199910 25435 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:10.201458 25435 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:10.201850 25435 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.202728 25435 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.204022 25435 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.209188 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:10.209825 22572 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:10.209610 25421 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:10.210180 22572 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:10.210863 25414 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:10.210973 22572 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.211333 25414 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.174249 25426 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:10.222072 25446 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:10.223884 25426 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:10.225287 25421 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:10.225951 25421 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.226953 25421 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.229033 25389 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:10.237758 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46469.3us
I20260709 13:08:10.172394 25404 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:10.215436 22652 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:10.215767 22580 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:10.217038 25434 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:10.217789 22502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
new_leader_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:56068
I20260709 13:08:10.163215 25447 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:10.178361 25401 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:10.220561 25450 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:10.221194 25403 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:10.178032 25409 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:10.241465 22502 raft_consensus.cc:606] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Received request to transfer leadership to TS fa2f181263f446a6962b649f9348c15f
I20260709 13:08:10.246479 22502 raft_consensus.cc:614] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:10.241580 22572 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.231177 25421 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.247502 22578 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:10.248639 25434 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:10.249142 25434 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.249953 25434 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.250906 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.251108 25434 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:10.253473 25447 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:10.253890 25447 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.254729 25447 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.244184 22503 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.258332 25414 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.245647 22504 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:10.259982 25427 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:10.302286 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.308037 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:10.308939 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 58131.9us
I20260709 13:08:10.324903 22572 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:10.330256 25414 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:10.306058 25447 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.340258 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:10.342797 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:10.352283 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44332.1us
I20260709 13:08:10.351610 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:10.357867 25392 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:10.358477 25392 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:10.359423 25392 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.365689 25416 raft_consensus.cc:993] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:10.366266 25416 raft_consensus.cc:1081] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:10.378069 25445 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:10.377130 23264 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.382797 25418 raft_consensus.cc:993] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:10.383345 25418 raft_consensus.cc:1081] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:08:10.390674 22651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "813ede727198414390a20d5845e75e07"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:08:10.391374 22651 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.391750 22651 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.399397 22651 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.401578 22496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:08:10.402267 22496 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.402724 22496 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.408504 22496 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.411120 22496 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:10.411592 22651 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:10.414587 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:10.415285 23259 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.419324 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:10.420060 22572 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.426986 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:10.427685 22652 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:10.428730 22652 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:10.429689 22652 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.435286 22652 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.433651 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:10.440418 22578 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:10.440886 22578 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:10.442174 22578 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.448073 22578 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.453202 22503 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.435560 22572 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:10.450995 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:10.458102 22502 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.459627 22401 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 6 to 7, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.466159 22502 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:10.431871 23259 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:10.480623 22469 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:10.481549 25447 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:10.482043 25447 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:10.482976 25447 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.483584 22652 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:10.487082 22578 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
W20260709 13:08:10.503708 22387 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b09d79da74a54c84ab38db5f54cacc35 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.502570 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:10.509029 22400 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 5, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.510504 25392 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:10.511065 25392 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:10.511935 25392 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:10.544483 22399 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 7, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.546275 22652 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:10.553864 22401 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 8, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.560811 23259 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:10.560998 22578 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:10.562664 25388 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:10.563560 25423 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:10.591483 25423 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.607092 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59516
I20260709 13:08:10.607695 22503 raft_consensus.cc:606] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Received request to transfer leadership
I20260709 13:08:10.609748 23259 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.612175 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59516
I20260709 13:08:10.614516 22503 raft_consensus.cc:606] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Received request to transfer leadership
W20260709 13:08:10.616044 22389 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b09d79da74a54c84ab38db5f54cacc35 already in progress
I20260709 13:08:10.622723 22578 raft_consensus.cc:2955] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.632305 22387 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca60e389358849e7bf461e472007a7f7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:10.663997 22389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47986.5us
I20260709 13:08:10.668838 22399 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 7 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:10.679078 22503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59516
I20260709 13:08:10.679719 22503 raft_consensus.cc:606] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Received request to transfer leadership
W20260709 13:08:10.682662 22389 catalog_manager.cc:4755] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): ChangeConfig:REMOVE_PEER RPC failed for tablet b09d79da74a54c84ab38db5f54cacc35: Remote error: Service unavailable: leader transfer in progress
I20260709 13:08:10.684043 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet ca60e389358849e7bf461e472007a7f7 with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:59516
W20260709 13:08:10.688278 22449 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:10.688764 22449 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b09d79da74a54c84ab38db5f54cacc35 already in progress
W20260709 13:08:10.689107 22449 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b09d79da74a54c84ab38db5f54cacc35 already in progress
I20260709 13:08:10.702672 25460 tablet_replica.cc:333] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:08:10.703902 25460 raft_consensus.cc:2243] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.716192 25460 raft_consensus.cc:2272] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.719662 25460 ts_tablet_manager.cc:1916] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:10.738795 25460 ts_tablet_manager.cc:1929] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 13:08:10.739396 25460 log.cc:1199] T ca60e389358849e7bf461e472007a7f7 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/ca60e389358849e7bf461e472007a7f7
I20260709 13:08:10.741271 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet ca60e389358849e7bf461e472007a7f7 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:10.763697 22578 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:10.766858 25427 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.889560 22496 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:10.891701 25395 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.998592 22496 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:11.001189 25427 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:11.017290 22652 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:11.018954 25447 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:11.034605 22577 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:11.037779 25434 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:11.071744 22572 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:11.076421 25395 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:11.112012 23259 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:11.113727 25434 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:11.157991 25434 raft_consensus.cc:993] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: : Instructing follower fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:11.158535 25434 raft_consensus.cc:1081] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Signalling peer fa2f181263f446a6962b649f9348c15f to start an election
I20260709 13:08:11.160591 23259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
 from {username='slave'} at 127.0.0.1:46826
I20260709 13:08:11.161294 23259 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.161721 23259 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.184047 23259 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.187063 23259 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.187372 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:11.191912 22502 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:11.192266 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:11.193181 22502 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:11.194152 22502 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.195286 22502 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.205694 22502 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:11.217773 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:11.218465 22577 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.241137 25434 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.241813 25434 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.244486 25434 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.246358 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:11.250325 25447 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.250953 25447 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.253782 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.254426 22651 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:11.255326 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:11.255498 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.256002 23259 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:11.256428 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.257081 22654 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:11.258095 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:11.259153 25434 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:11.259645 25434 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.260003 25434 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.260581 25395 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.261168 25395 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.266376 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.266603 25395 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:11.267098 22502 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:11.267616 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:11.268406 22578 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:11.268483 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.265625 25471 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:11.270525 25471 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.270972 25471 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.271327 25447 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.271106 25395 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:11.271951 25395 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.272324 25395 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.283577 25471 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.286458 25395 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.297667 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:11.306100 22502 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:11.307109 25395 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:11.309213 25471 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.310228 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:11.310837 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.312435 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:11.313339 22579 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:11.325212 25427 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:11.326272 25427 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:11.327600 25427 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.339783 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:11.343984 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:11.340778 22654 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.370407 25434 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.387205 25434 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.439610 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:11.440258 22649 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.448297 22649 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:11.470242 25473 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.470825 25473 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.471405 25430 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.471937 25430 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.473963 25430 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.474493 25473 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.475713 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.476374 22496 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:11.477277 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.477906 22649 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:11.479243 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:11.479811 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.480216 25430 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:11.480510 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.480751 25430 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.481436 22502 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6.
I20260709 13:08:11.481483 25430 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.484457 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.485349 23229 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6.
I20260709 13:08:11.485697 23229 leader_election.cc:403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:11.486912 25471 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:11.487453 25471 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:11.488615 22654 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:11.488283 25471 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.504320 22577 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:11.507648 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:11.515460 25447 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:11.508961 25401 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.519783 25471 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.521793 25471 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.524391 25471 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.539108 22399 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.547109 25447 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:11.548904 25447 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.547856 25430 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.559479 25430 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.560405 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:11.561065 22502 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.565361 25401 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6.
I20260709 13:08:11.572108 22502 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:11.573052 25427 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:11.573371 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:11.573668 25427 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.574849 25474 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.575878 25427 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.575593 25474 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.577946 25474 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.573083 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:11.574776 25419 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.579486 25482 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.579361 25419 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.580014 25482 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.578820 22577 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:11.584293 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.584924 25419 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:11.585047 22503 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:11.586010 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.586498 25419 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.586835 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.586966 25481 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:11.587590 25481 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.587998 25395 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:11.588269 25427 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.588425 25395 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.588030 25481 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.589092 25395 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:11.593212 25427 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.588897 25482 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.596697 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.596786 25427 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.597379 22503 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:11.598881 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.599982 25388 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:11.600394 25388 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.600766 25388 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.601438 25481 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.603803 25481 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.603528 25395 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.607056 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:11.607697 23258 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.608183 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:11.586990 25419 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.608955 23260 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:11.608583 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:11.610028 25473 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:11.610546 25473 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:11.610934 25419 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:11.611099 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.611778 22496 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:11.611454 25473 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.612999 25396 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.613483 25396 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.614645 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:11.614832 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.615198 22577 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.615474 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:11.615566 25396 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.615490 22652 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:11.616184 23259 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:11.618340 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.618932 22503 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:11.618978 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:11.619974 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:11.620050 22401 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.622469 23258 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:11.612973 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.623972 25423 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:11.624341 25423 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:11.621840 22401 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:11.624495 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56521us
I20260709 13:08:11.623281 25401 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:11.624810 25423 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.632982 25401 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.640797 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:11.631323 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.623031 25427 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:11.622781 22577 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:11.639053 22502 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:11.641455 23262 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:11.642499 22654 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:11.627154 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.646054 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:11.640133 25388 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.651749 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:11.660123 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.672219 22577 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:11.680491 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:11.682788 22577 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:11.684798 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:11.685482 22578 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:11.640851 25401 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.648236 25427 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:11.651576 25395 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:11.682308 25434 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:11.721946 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:11.725782 22577 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:11.726492 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:11.727387 22578 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:11.728710 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:11.729447 22654 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.718268 25475 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:11.730268 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:11.733981 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 84173.1us
I20260709 13:08:11.722815 25427 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:11.725360 25434 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.742630 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:11.743257 22652 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.745118 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.745762 22651 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:11.747164 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.747795 22654 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
W20260709 13:08:11.748075 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 88074.9us
I20260709 13:08:11.731379 25482 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:11.735404 25474 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:11.743733 25434 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.780066 25482 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:11.784685 25482 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.797482 22652 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:11.777604 25474 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.803625 25388 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.815182 25491 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.815754 25491 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.818002 25491 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.822440 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:11.823159 22578 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:11.824297 22389 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b09d79da74a54c84ab38db5f54cacc35 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:11.826778 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:11.807613 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66097.5us
I20260709 13:08:11.833534 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:11.809114 25474 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:11.835606 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.838133 22402 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 4 to 6, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 6 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.845206 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:11.846065 23262 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:11.846881 22503 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:11.854487 25423 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.856832 25495 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:11.834182 25491 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:11.860508 25495 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:11.863430 25495 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.861364 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:11.862176 22496 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:11.859465 25491 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.877306 25491 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.879773 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.881992 25488 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:11.883747 25488 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:11.884509 25500 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:11.886662 25488 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.891440 25434 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.895478 22502 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:11.896220 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:11.908192 22577 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:11.856851 25423 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:11.842413 25475 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:11.888540 25474 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.846107 25427 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.915520 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:11.934894 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.926755 25395 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.949038 25395 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:11.951954 25395 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:11.934324 25419 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:11.955014 25419 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:11.933786 25498 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.958112 25498 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.962365 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:11.963179 22504 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:11.859706 25401 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.970359 25401 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:11.971974 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:11.973308 22649 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:11.985065 22654 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.973522 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:11.973943 25427 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:11.975761 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:11.987291 22504 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.975128 25475 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:11.976543 22652 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:11.956179 25419 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:12.004809 22654 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:11.995808 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:12.007283 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 84311.5us
I20260709 13:08:12.008719 23227 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:12.016563 22504 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:12.019060 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:11.997485 25446 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.014510 25489 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.013316 25472 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.013296 25492 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.018962 25498 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.021826 25496 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:12.024788 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:12.039767 25472 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.095261 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:12.095885 23262 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:12.097492 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 76241us
I20260709 13:08:12.079335 25434 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:12.105600 23258 raft_consensus.cc:2368] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6.
I20260709 13:08:12.108124 22618 leader_election.cc:400] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6.
I20260709 13:08:12.108456 22618 leader_election.cc:403] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.096427 25472 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.114687 23262 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:12.050187 25446 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.039106 25489 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:12.128592 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:12.129390 22572 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.131461 25423 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.132491 25489 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.134923 25446 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:12.066238 25492 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:12.146203 25423 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6.
I20260709 13:08:12.146930 25491 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:12.156222 25491 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.147188 25492 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.163122 25496 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:12.162149 25474 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.165409 25496 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.200393 22496 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:12.209695 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:12.239218 22504 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:12.241596 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:12.245786 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:12.247223 23258 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:12.254874 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106903us
I20260709 13:08:12.269393 25481 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:12.270254 25481 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:12.272804 25493 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:12.283442 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:12.288817 22652 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:12.291533 23259 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:12.293121 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:12.294028 22580 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:12.284098 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:12.297681 22654 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:12.311913 22580 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:12.272112 25481 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.328824 23259 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:12.331067 25480 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:12.337752 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:12.347293 25472 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.349815 25471 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:12.353968 22648 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:12.353749 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:12.354940 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:12.357326 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:12.390470 22647 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:12.357846 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:12.395859 22646 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.363657 22645 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:12.366612 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:12.373405 22651 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:12.365811 22400 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.376596 25474 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:12.413806 22647 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:12.415160 22649 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:12.455652 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:12.458722 22496 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:12.471087 22646 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:12.470610 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:12.474033 22573 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:12.474844 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:12.484294 22573 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:12.497967 22572 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:12.512084 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:12.518854 25493 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:12.519510 25493 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:12.520591 25493 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.528355 25419 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:12.529280 25419 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.536357 22402 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 7 to 8, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 8 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.538679 22402 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 5 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 7 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.542389 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:12.543437 22503 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:08:12.516304 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46727.9us
W20260709 13:08:12.551887 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 80555.3us
I20260709 13:08:12.554008 25419 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:12.555831 22504 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:12.559706 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:12.560560 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:12.562978 22497 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.564096 22572 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:12.565318 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:12.566587 25480 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:12.567091 25480 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:12.569327 25472 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.561143 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:12.568127 25480 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:12.561815 25419 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:12.562180 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:12.576660 25501 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.577297 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:12.580215 25510 raft_consensus.cc:2764] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:12.580133 25481 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:12.582403 25471 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:12.587163 25481 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.590425 25423 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.580220 22400 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 6, now has a pending config: VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129), VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131), VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:12.591349 22401 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 8 to 9, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 9 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.594573 22504 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:12.597930 25522 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.598080 23258 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.598609 25522 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:12.603226 25522 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.605172 22401 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.607790 22504 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:12.611163 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:12.618753 25419 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:08:12.622584 25502 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:08:12.623744 25513 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:12.624310 25513 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:12.625600 25513 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.627161 22401 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 8, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.613430 25501 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:12.647671 22577 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:12.657824 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:12.670873 25515 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:12.681595 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53906.2us
I20260709 13:08:12.681859 22579 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:12.685531 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:12.695518 22572 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:12.697435 25427 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:08:12.700284 22545 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:12.713371 22502 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:12.715607 25493 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:12.754429 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54293us
I20260709 13:08:12.756155 22497 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:12.767369 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:12.781047 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:12.765602 25511 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.787858 25515 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:12.788352 25515 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.788683 25515 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:12.783047 25401 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:12.801229 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 109841us
I20260709 13:08:12.792409 25513 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.804847 22572 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:12.805480 22498 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.812408 25423 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:12.834028 22647 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:08:12.862053 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 97688.7us
W20260709 13:08:12.877575 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86832.2us
I20260709 13:08:12.848922 25474 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:12.839761 25427 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:12.890239 22648 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:08:12.903259 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110604us
I20260709 13:08:12.897482 25401 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:12.915380 25511 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:12.922091 25515 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:12.925156 22572 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:08:12.924678 25515 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:12.925415 25401 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:12.931177 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:14.102732 25553 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.103658 25553 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.105762 25555 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.106546 25555 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.158142 25557 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.159058 25557 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.191998 25556 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.192600 25553 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.193046 25557 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.192903 25556 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.195009 25557 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.193615 25555 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.195617 25557 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.196080 25553 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.199115 25556 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.199430 25557 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.200850 25557 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.201022 25556 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.201351 25554 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.201496 25557 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.201714 25556 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.201953 25554 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.204130 25556 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.204504 25557 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:14.205322 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 1.36037e+06us
I20260709 13:08:14.206539 25554 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.206636 25541 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.207252 25541 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.209030 25481 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.209496 25541 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.209714 25481 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.211889 25481 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.212066 25541 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.212764 25541 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.213305 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 2736) took 1428 ms. Trace:
I20260709 13:08:14.213533 25491 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.214114 25434 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.214389 25491 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.214780 25434 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.214956 25481 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.215032 25541 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.215764 25481 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.216822 25491 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.196774 25553 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.213616 25471 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.213761 22497 rpcz_store.cc:276] 0709 13:08:12.785065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.785793 (+   728us) service_pool.cc:224] Handling call
0709 13:08:12.798704 (+ 12911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.798859 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:12.843212 (+ 44353us) log.cc:844] Serialized 14 byte log entry
0709 13:08:14.202621 (+1359409us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b180033b260. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:08:14.212939 (+ 10318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:14.212987 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:14.213044 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.213108 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.213222 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317,"prepare.queue_time_us":44603,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":1359512,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"spinlock_wait_cycles":11068160}
I20260709 13:08:14.218214 25471 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.219573 25553 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.220161 25434 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.220759 25471 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.221837 25558 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.223166 25471 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.222733 25558 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.223934 25480 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.223798 25471 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.224475 25480 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.224884 25481 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.225855 25471 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.225968 25558 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.226509 25553 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.226568 25480 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.226954 25553 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.227669 25480 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.227833 25434 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.230445 25553 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.229027 25471 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.229417 25560 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.223394 25559 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.228830 25480 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.233844 25471 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.230392 25541 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.228317 25491 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.238359 25491 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.240509 25491 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.241673 25558 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.242272 25558 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.244479 25558 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.231016 25434 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.247927 25434 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.249395 25560 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.250417 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:14.252323 22579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.011s	sys 0.028s
I20260709 13:08:14.235810 25480 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.236977 25471 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.245268 25541 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.252210 25481 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.257671 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.258366 25481 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.259665 25541 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:14.260423 22579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.343s	user 0.011s	sys 0.029s
I20260709 13:08:14.253168 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.261032 22497 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:14.261257 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 423) took 1358 ms. Trace:
I20260709 13:08:14.255597 25553 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.251737 25560 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.261934 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.262449 25559 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.263434 22497 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:14.264390 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.264796 25559 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.265836 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.266475 22497 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:14.262318 25553 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.267524 25481 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.259462 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.261624 22579 rpcz_store.cc:276] 0709 13:08:12.902582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.902774 (+   192us) service_pool.cc:224] Handling call
0709 13:08:12.909944 (+  7170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.916898 (+  6954us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:12.916937 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.917481 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.260922 (+1343441us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:14.260959 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.261021 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.261062 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:14.261074 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.261184 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6348,"raft.queue_time_us":7634,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":1232,"thread_start_us":1343066,"threads_started":1,"wal-append.queue_time_us":43097,"wal-append.run_cpu_time_us":2284,"wal-append.run_wall_time_us":1002294}
I20260709 13:08:14.269398 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.270560 25553 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.232877 25561 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.270794 25555 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:14.271332 25555 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.271751 25555 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.272854 25481 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.271754 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.273440 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.274223 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.273485 25481 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.277510 25481 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.279554 25563 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.280303 25563 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.281056 25401 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:14.281497 25401 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.281881 25401 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.275595 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2778) took 1431 ms. Trace:
I20260709 13:08:14.281983 25553 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:14.279543 25564 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:14.285202 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52481.9us
I20260709 13:08:14.287418 25555 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.284504 25565 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.299340 25565 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.300971 25500 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.301720 25500 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.285341 25564 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.285769 25553 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.304389 25553 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.283780 22572 rpcz_store.cc:276] 0709 13:08:12.843886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.844225 (+   339us) service_pool.cc:224] Handling call
0709 13:08:12.853318 (+  9093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.925655 (+ 72337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.275355 (+1349700us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54003ca0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:14.275539 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164539264}
I20260709 13:08:14.295378 25401 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.306231 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:14.307142 22504 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.297092 25566 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.296991 25473 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.309469 25473 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.284090 25561 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:14.309456 25566 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.316576 22502 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:14.334148 25557 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:14.345412 25561 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.345566 25564 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.353463 25562 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.354256 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 364) took 1630 ms. Trace:
I20260709 13:08:14.354147 25562 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.354723 22496 rpcz_store.cc:276] 0709 13:08:12.723691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.723833 (+   142us) service_pool.cc:224] Handling call
0709 13:08:12.743468 (+ 19635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.774470 (+ 31002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.774522 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.823991 (+ 49469us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b2c000014c8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:08:12.824570 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.879295 (+ 54725us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:12.879351 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.879556 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.894422 (+ 14866us) raft_consensus.cc:1685] finished
0709 13:08:12.894450 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.354185 (+1459735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16906,"raft.queue_time_us":19953,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"spinlock_wait_cycles":22473088,"thread_start_us":54218,"threads_started":1,"wal-append.queue_time_us":54632,"wal-append.run_cpu_time_us":1967,"wal-append.run_wall_time_us":1023289}
I20260709 13:08:14.356659 25562 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.357517 25562 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.357831 25560 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.358525 25560 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.358237 25562 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.360821 25559 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.361485 25559 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.362040 25560 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.364271 25559 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.364804 25560 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.361443 25562 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.365546 25560 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.366452 25562 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.367177 25562 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.368953 25560 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.369566 25562 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.370201 25562 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.365540 25559 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.370754 25562 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.370916 25559 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.357542 25555 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.376379 22504 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:14.378259 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 501) took 1578 ms. Trace:
I20260709 13:08:14.378974 25562 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.298418 25563 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.381682 25559 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.390565 22648 rpcz_store.cc:276] 0709 13:08:12.800117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.800288 (+   171us) service_pool.cc:224] Handling call
0709 13:08:12.809198 (+  8910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.895218 (+ 86020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.377989 (+1482771us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b5400169254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:14.378164 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158095616}
I20260709 13:08:14.394220 25559 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.394889 25559 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.397549 25559 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.399235 25564 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.400609 25564 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.404031 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.404726 22505 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
W20260709 13:08:14.411556 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.47392e+06us
I20260709 13:08:14.400285 25563 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.431905 25563 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.433401 25559 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.434085 25559 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.434397 25561 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.434970 25561 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.436236 25559 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.436997 25561 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.438186 25563 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.439760 25561 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:14.446650 25473 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.447889 25553 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.456601 25569 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.456935 25553 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.457373 25569 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.463276 25563 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.463884 25563 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:14.469059 22546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.575s	user 0.000s	sys 0.033s
W20260709 13:08:14.469660 22546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.576s	user 0.000s	sys 0.033s
I20260709 13:08:14.471585 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 188) took 1945 ms. Trace:
I20260709 13:08:14.471997 22402 rpcz_store.cc:276] 0709 13:08:12.526107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.526311 (+   204us) service_pool.cc:224] Handling call
0709 13:08:14.471503 (+1945192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:12.583364 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:12.584043 (+   679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:12.584078 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:12.584097 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:12.584634 (+   537us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:12.584691 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:12.584721 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:12.585054 (+   333us) tablet.cc:701] Row locks acquired
0709 13:08:12.585076 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:12.585240 (+   164us) write_op.cc:270] Start()
0709 13:08:12.586205 (+   965us) write_op.cc:276] Timestamp: P: 1783602492585192 usec, L: 0
0709 13:08:12.594638 (+  8433us) op_driver.cc:348] REPLICATION: starting
0709 13:08:12.604170 (+  9532us) log.cc:844] Serialized 989 byte log entry
0709 13:08:12.606067 (+  1897us) op_driver.cc:464] REPLICATION: finished
0709 13:08:12.606525 (+   458us) write_op.cc:301] APPLY: starting
0709 13:08:12.606599 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:12.606716 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:12.606824 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.607454 (+   630us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.607634 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:12.607707 (+    73us) write_op.cc:312] APPLY: finished
0709 13:08:12.607958 (+   251us) log.cc:844] Serialized 29 byte log entry
0709 13:08:12.614395 (+  6437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.617503 (+  3108us) write_op.cc:454] Released schema lock
0709 13:08:12.619429 (+  1926us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.641942 (+ 22513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.643012 (+  1070us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59743,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":2468,"apply.run_wall_time_us":28583,"num_ops":2,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":3008,"prepare.run_wall_time_us":21124,"replication_time_us":11255}]]}
I20260709 13:08:14.482214 25571 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.483016 25571 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:14.486555 25571 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:14.499923 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.500731 22501 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:14.501032 25572 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.503626 25574 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.508770 25573 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.512629 22648 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:14.528244 25573 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.530705 25573 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.531280 25573 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.531752 25573 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.501801 25572 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.534488 25572 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.535540 25569 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.510547 25574 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.538358 25573 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.538859 25574 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.543936 22648 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:14.544495 22648 pending_rounds.cc:85] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 8
I20260709 13:08:14.588616 25572 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.589499 25572 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.592053 25573 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.592772 25573 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.545014 22648 pending_rounds.cc:107] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:14.596174 22648 raft_consensus.cc:2889] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.645877 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.647961 22652 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:14.598469 25569 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:14.648697 25569 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.648947 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.648845 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.650022 22646 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:14.650126 22648 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:14.651331 25569 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.653280 25572 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.653429 25573 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.657323 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.657748 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.660553 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.661374 22648 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:14.664635 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.665436 22645 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:14.665546 25500 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.666719 25565 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.668212 25564 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.670033 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 313) took 2125 ms. Trace:
I20260709 13:08:14.673533 25544 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:14.674203 25544 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.674937 25553 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.675791 25553 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.676777 25544 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.677495 25543 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.678128 25543 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.676831 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.670660 22400 rpcz_store.cc:276] 0709 13:08:12.544319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.544976 (+   657us) service_pool.cc:224] Handling call
0709 13:08:12.576566 (+ 31590us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400002490. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d7640 00007fec2c0aeb76 00007fec2c1b8c3e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:08:14.669896 (+2093330us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:12.623355 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:12.623988 (+   633us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:12.624028 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:08:12.624047 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:12.625540 (+  1493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:12.625593 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:12.625616 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:12.625807 (+   191us) tablet.cc:701] Row locks acquired
0709 13:08:12.625819 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:08:12.626193 (+   374us) write_op.cc:270] Start()
0709 13:08:12.626293 (+   100us) write_op.cc:276] Timestamp: P: 1783602492626143 usec, L: 0
0709 13:08:12.626313 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:12.637259 (+ 10946us) log.cc:844] Serialized 794 byte log entry
0709 13:08:12.647649 (+ 10390us) op_driver.cc:464] REPLICATION: finished
0709 13:08:12.648078 (+   429us) write_op.cc:301] APPLY: starting
0709 13:08:12.648151 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:12.648255 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:12.648361 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.648611 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.648777 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:12.648836 (+    59us) write_op.cc:312] APPLY: finished
0709 13:08:12.649219 (+   383us) log.cc:844] Serialized 23 byte log entry
0709 13:08:12.649383 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.649464 (+    81us) write_op.cc:454] Released schema lock
0709 13:08:12.649513 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.649886 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.649925 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1757387,"reported_tablets":4,"spinlock_wait_cycles":54034304,"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":1602,"apply.run_wall_time_us":1746,"num_ops":1,"prepare.queue_time_us":598,"prepare.run_cpu_time_us":2669,"prepare.run_wall_time_us":19131,"replication_time_us":21199}]]}
I20260709 13:08:14.687420 23229 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.698303 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:14.698446 25502 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:14.699039 22499 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.699091 25502 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.699785 25502 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.705088 25557 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:14.705910 25557 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:14.707211 25557 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.709868 22499 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:14.710078 25543 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.713548 25553 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.716578 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.728024 25560 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.739094 25560 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.743692 25566 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.718022 25559 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.744976 25559 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.747808 25559 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.754293 25563 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:14.755550 25471 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:14.728009 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.763700 25554 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:14.764627 25559 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.770882 25559 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.723582 25553 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:14.774720 25563 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.775197 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.763469 25471 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.772531 25561 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.775354 25563 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.780320 25559 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.774032 25553 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.795181 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.795941 22502 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:08:14.797335 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.798966 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.799595 22502 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:08:14.800686 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.800942 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.801522 23264 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:14.802613 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.805955 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.776469 25554 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:14.806629 22502 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:14.808141 25554 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.809598 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.810294 22500 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:14.799682 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.814834 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.814934 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.848955 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.787655 25569 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.858158 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.856436 22500 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:14.872485 22501 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:14.857440 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.860400 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.848367 25471 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.864754 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:14.862737 25560 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:14.870169 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.871006 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.876504 22499 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:14.860695 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:14.851970 25561 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.877048 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:14.876579 23260 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:14.856112 25553 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.877326 23263 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:14.880034 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.919441 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.919741 25571 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:14.920380 25571 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:14.920943 25571 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:14.894474 25481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.012s	sys 0.008s
I20260709 13:08:14.884779 25563 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:14.939659 25481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.014s	sys 0.009s
I20260709 13:08:14.891237 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.943437 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.874514 25569 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:14.947417 25569 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.949473 25401 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:14.886575 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.873622 25544 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:08:14.873843 25543 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:08:14.879009 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:14.977206 25565 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.978027 25565 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.964694 25566 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.989039 25566 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.994478 25502 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:14.996754 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:15.001580 25500 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:15.002014 25500 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.002389 25500 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.002436 25563 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.003027 25563 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.005115 25501 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.005430 22649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:15.006071 25501 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.007148 22649 raft_consensus.cc:606] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:15.008767 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.009577 25575 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.010399 25575 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:15.010715 25575 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:15.011046 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.011629 25575 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.015862 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.022639 23255 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:15.024025 25492 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.035521 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:15.042115 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 168456us
I20260709 13:08:15.043777 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.024883 25575 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.030294 25515 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:15.051687 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.051803 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:15.052376 22648 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:15.051061 25576 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.045033 25561 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.058712 25565 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.051278 25544 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:08:15.053579 25563 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:15.062410 25571 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.063807 25511 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.058063 25515 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.069976 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:15.072947 25548 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.073232 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.073544 25544 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:15.074111 23264 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:15.073954 25544 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.074585 25544 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.076395 25515 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.077005 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.073592 25548 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.082647 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:15.084391 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:15.073854 25502 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:15.086588 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.073163 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.086998 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.088683 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.086627 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.041303 25492 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.086790 25556 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:15.055518 25576 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.087771 23227 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:15.054726 25554 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:15.092010 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.093636 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.086805 25558 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:15.097455 22501 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:15.094099 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.092150 25556 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.064366 25511 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.080199 25571 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.066910 25553 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.096961 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:15.113406 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.100966 25473 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:15.125306 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:15.101347 25558 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.127625 25558 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.127873 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:15.128535 22499 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:15.129145 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:15.129753 22500 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:15.133180 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.125334 25473 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.134509 25473 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.113958 25542 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.118458 25576 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:15.145285 25571 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:15.126677 25566 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.145819 25571 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.146286 25571 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:15.147184 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.149326 25514 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.149525 25561 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:15.116756 23256 raft_consensus.cc:2393] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:15.109654 25556 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.149367 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.117077 25492 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.153570 23262 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:15.156848 22500 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:15.117379 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.161195 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.165957 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.149942 25514 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.144337 25542 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.180434 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.180498 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.182174 22646 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:15.185885 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.185675 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.174737 25492 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.196012 25492 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.196578 25511 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.197206 25511 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:15.197721 25511 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.198146 25593 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.198386 25492 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.198742 25593 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.199748 25511 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.202630 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.207652 22499 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:15.209259 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.203549 22505 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:15.217525 22500 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:15.235963 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.236385 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.237474 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.238103 22653 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:15.239180 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:15.239152 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.200673 25590 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:15.243639 22500 raft_consensus.cc:2410] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:15.246868 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:15.202472 25595 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.265252 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.265726 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.266048 22646 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:15.268603 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.300642 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.313326 22654 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:15.288926 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.311993 22650 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:15.318271 25600 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.330772 25604 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:15.331728 25604 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.333761 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.334631 22654 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:15.307615 25593 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.344095 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.344369 25593 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:15.347862 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfa60 after lost signal to thread 21393
I20260709 13:08:15.264093 25548 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.348278 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.248003 25590 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:15.349195 22675 debug-util.cc:398] Leaking SignalData structure 0x7b0800275b60 after lost signal to thread 22437
W20260709 13:08:15.351667 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82760.8us
W20260709 13:08:15.352592 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1e20 after lost signal to thread 22529
W20260709 13:08:15.353844 22675 debug-util.cc:398] Leaking SignalData structure 0x7b0800113b40 after lost signal to thread 22604
W20260709 13:08:15.354959 22675 debug-util.cc:398] Leaking SignalData structure 0x7b080031cf20 after lost signal to thread 22678
W20260709 13:08:15.355247 22675 debug-util.cc:398] Leaking SignalData structure 0x7b080034e380 after lost signal to thread 22679
I20260709 13:08:15.350467 25593 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:15.356382 22675 debug-util.cc:398] Leaking SignalData structure 0x7b080034fb40 after lost signal to thread 23288
I20260709 13:08:15.356954 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.360659 22579 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:15.298894 25553 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:15.359437 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.361644 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.361930 22650 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:15.362824 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.290295 25473 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.363929 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.368407 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.359916 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.369781 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.371486 22577 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:15.369060 22573 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:15.378044 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.379688 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.356659 25590 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:15.380164 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.268771 25595 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.359148 25548 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.382637 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.380311 22579 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:15.383898 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.387485 22573 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:15.385007 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.384394 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.389572 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.366228 25563 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:15.395431 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.330842 25600 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.393972 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.374110 25565 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:15.397037 25562 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:15.404654 25544 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.405498 25514 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.408004 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.409237 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.410377 22577 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:15.377409 25515 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.386008 25564 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:15.412676 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.380453 25473 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.384384 25575 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.414614 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.430370 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.431612 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.420943 25607 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:15.433177 25607 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.434288 25595 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.421546 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.422425 23256 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:15.423360 25586 raft_consensus.cc:993] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:15.424952 25515 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.411479 25548 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.421559 25593 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.460770 22501 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:15.428469 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.428508 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.432685 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.395721 25538 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:15.464171 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:15.439422 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.439867 25607 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.440069 25604 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.440436 25544 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.470378 23229 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:15.441136 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.441342 25562 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:15.415580 25542 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.408021 25566 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:15.443306 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.414361 25610 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:15.449483 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.434927 23259 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:15.453397 25602 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:15.396822 25563 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.458310 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.458987 22504 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:15.427606 25600 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.461843 22652 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:15.464344 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.465924 22571 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:15.470031 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.483088 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.468649 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:15.417516 25481 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:15.407692 25565 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.436533 25564 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.523545 22652 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:15.523756 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.493685 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:15.503804 22401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 308) took 2931 ms. Trace:
I20260709 13:08:15.467144 25574 raft_consensus.cc:1081] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:08:15.513439 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.485651 25471 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:15.514724 22653 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:15.515333 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.503531 25492 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:15.510208 25563 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:15.517455 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.463752 25538 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.516846 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:15.520344 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56098.5us
I20260709 13:08:15.518564 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:15.528223 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.529036 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.528239 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.544975 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.439800 25500 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.508149 25555 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:15.547762 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.549214 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:15.549160 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52372.5us
W20260709 13:08:15.529016 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 132311us
I20260709 13:08:15.502367 25562 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.556254 25562 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:15.556427 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.557564 25553 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:15.557819 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.506735 25595 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.533438 23257 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:15.523000 25565 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.559217 25595 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.483311 25560 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:08:15.561350 25595 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.528517 25561 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:15.507875 25593 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:15.561971 25561 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.562427 25561 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.562168 25593 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.563309 22579 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:15.564472 25593 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.518630 25481 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.528577 25564 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.547363 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.557704 25586 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:15.558838 25576 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:15.578001 22580 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:15.585255 22652 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:15.559474 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.534072 25471 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.502537 25558 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.593840 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:15.594880 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 182345us
I20260709 13:08:15.538512 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.537338 25492 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.580823 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.524746 22401 rpcz_store.cc:276] 0709 13:08:12.572900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.575955 (+  3055us) service_pool.cc:224] Handling call
0709 13:08:12.587864 (+ 11909us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:08:15.503732 (+2915868us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:12.738375 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:12.738963 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:12.739001 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:12.739020 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:12.739664 (+   644us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:12.739718 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:12.739746 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:12.740150 (+   404us) tablet.cc:701] Row locks acquired
0709 13:08:12.740176 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:08:12.740388 (+   212us) write_op.cc:270] Start()
0709 13:08:12.740553 (+   165us) write_op.cc:276] Timestamp: P: 1783602492740325 usec, L: 0
0709 13:08:12.740593 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:08:12.786847 (+ 46254us) log.cc:844] Serialized 1321 byte log entry
0709 13:08:12.809169 (+ 22322us) op_driver.cc:464] REPLICATION: finished
0709 13:08:12.811044 (+  1875us) write_op.cc:301] APPLY: starting
0709 13:08:12.811125 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:12.811275 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:12.811371 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.811868 (+   497us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.812060 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:08:12.812117 (+    57us) write_op.cc:312] APPLY: finished
0709 13:08:12.812340 (+   223us) log.cc:844] Serialized 35 byte log entry
0709 13:08:12.812705 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.812802 (+    97us) write_op.cc:454] Released schema lock
0709 13:08:12.812844 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.813209 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.813243 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1925200,"reported_tablets":3,"spinlock_wait_cycles":20877568,"child_traces":[["op",{"apply.queue_time_us":1656,"apply.run_cpu_time_us":2136,"apply.run_wall_time_us":2136,"num_ops":3,"prepare.queue_time_us":378,"prepare.run_cpu_time_us":3737,"prepare.run_wall_time_us":51912,"replication_time_us":68427}]]}
I20260709 13:08:15.545348 25538 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.507125 25610 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.596339 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.596138 22571 raft_consensus.cc:2410] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:08:15.596846 22544 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41932 dropped due to backpressure: service queue is full with 50 items
I20260709 13:08:15.596167 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.599646 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.597540 22574 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:15.602577 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.604388 25560 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:15.604823 25500 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.578895 25555 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:15.606536 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.609236 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.583086 25586 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.657274 25586 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:15.657902 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:15.612749 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.610821 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.616240 25592 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:15.580133 25481 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.656526 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.594329 25471 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:15.594368 25576 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.614297 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:15.670131 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 74063.1us
I20260709 13:08:15.655404 22577 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:15.661381 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.672432 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.672049 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.661046 23258 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:15.678964 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.616254 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.678529 25500 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:15.654909 25574 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:15.675951 25592 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:15.693470 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.697357 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.726121 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:15.650411 25610 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.674798 25576 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:15.726022 25592 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.731841 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:15.701087 25617 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:15.706923 25574 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.701910 23259 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:15.674784 25560 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:15.755580 25560 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.756831 25560 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.658994 22544 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41932 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1915)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1921)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1927)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1925)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
I20260709 13:08:15.741034 25538 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.737397 25564 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:08:15.749119 25615 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:08:15.749482 25471 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:15.724499 25556 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.005s
I20260709 13:08:15.765803 25471 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.766578 25471 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:15.764525 25565 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.765486 25556 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.769269 22651 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:15.728235 22617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.941s (SENT) [suppressed 5 similar messages]
W20260709 13:08:15.796550 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68351.6us
W20260709 13:08:15.760917 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 107431us
I20260709 13:08:15.754078 25617 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:15.775954 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 103974us
I20260709 13:08:15.754180 25574 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.794274 22648 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:15.798388 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:15.797977 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:15.775314 25571 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.004s
I20260709 13:08:15.774827 25538 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:15.828238 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.825889 25492 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.838361 25625 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:15.839056 25625 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.839540 25625 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.756696 25590 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.841766 25621 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:15.800637 25617 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:15.843205 23263 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:15.775352 25471 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:15.873533 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.795225 25555 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.879552 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:15.880681 22649 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:15.882634 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.860060 25471 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:15.831249 25571 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:15.892927 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 290470us
I20260709 13:08:15.891919 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.901533 22573 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:08:15.890023 25628 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:15.902026 25628 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:15.902503 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.903172 22573 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:15.902917 25628 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:15.904050 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.904438 25628 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:15.905227 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.906332 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.907341 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:15.892277 22646 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:15.891846 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63695us
I20260709 13:08:15.896824 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:15.909453 25604 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.909785 22650 raft_consensus.cc:606] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:15.899770 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.931527 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.931254 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.889806 25558 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.910655 25514 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:15.900668 25610 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.889983 25621 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:15.948419 25514 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:15.959858 25571 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:15.959479 25514 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:15.967633 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:15.970695 25564 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:15.970840 25556 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:15.971342 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:15.974473 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 90736.6us
I20260709 13:08:15.932555 25501 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:15.971917 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:15.970948 25613 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:15.967547 25560 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:15.973963 25621 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:15.968736 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 162239us
W20260709 13:08:16.003476 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 72379.6us
I20260709 13:08:16.008140 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.009915 22649 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:16.011075 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.008107 25560 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.014230 25560 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:16.003252 25613 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:16.015995 25565 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:16.016114 25613 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:16.004019 25514 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.014142 25629 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:16.015317 25576 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:16.004022 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51564.4us
I20260709 13:08:16.029564 22619 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:16.030619 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:16.031881 25578 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:16.006152 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:16.033610 25620 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:16.014534 25563 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.039156 25563 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:16.032635 25578 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:16.040944 25578 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:16.041507 25481 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.040184 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:16.043715 25481 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:16.044416 22646 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:16.044906 25561 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:16.046294 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:16.047092 25561 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:16.047459 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:16.045243 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:16.051263 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.052716 22653 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:16.053735 25576 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:16.056802 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 50707.9us
I20260709 13:08:16.052660 25522 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:08:16.059103 23257 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:16.057034 25578 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:16.063861 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:15.968474 25610 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.005296 25604 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.067190 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:16.081525 25522 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:16.082021 25522 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:16.082914 25522 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.083396 25630 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:16.084329 25522 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:16.065135 25481 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:16.064539 25556 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:16.087263 25561 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:16.088613 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.064095 25575 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:16.091440 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.095304 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.095448 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:15.941958 22546 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41932 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1927)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1925)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440)
I20260709 13:08:16.100652 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.101979 22499 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:16.096661 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.096941 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:16.111238 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.114310 22504 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:16.108929 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.117556 22501 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.087306 25471 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.120399 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.121325 22654 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:16.124740 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.085493 25481 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:16.120170 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.071300 25576 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:16.110302 22498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:08:16.132198 22498 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.132565 22498 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:16.105849 25563 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:16.135355 23260 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:16.146685 22499 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:16.064949 25492 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:08:16.128582 25481 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.098644 25604 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.137495 25563 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:16.169229 25563 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.112361 25574 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.180253 25574 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:16.178869 22501 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:08:16.186134 22498 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.185717 23256 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:16.187155 22500 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:16.111016 25586 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.191646 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:16.197832 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 180334us
I20260709 13:08:16.197985 22498 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:16.202749 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.203293 22654 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:16.204802 22652 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:16.203583 22654 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:16.178944 25610 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:16.210170 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:16.220098 25558 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:16.229012 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.230310 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75526.8us
I20260709 13:08:16.230928 23227 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:16.231248 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:16.233806 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:16.243818 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.201053 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:16.246383 22646 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:16.258232 25604 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:16.261389 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.262125 22571 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:08:16.262989 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:16.264076 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.244684 22653 raft_consensus.cc:2955] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:16.202148 25617 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.234782 25558 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:16.240942 25471 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:16.270906 22498 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:16.275704 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:16.244944 25627 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:16.353137 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:16.351168 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54890.5us
W20260709 13:08:16.350724 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79067.9us
I20260709 13:08:16.356223 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:16.535462 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 292704us
I20260709 13:08:16.747980 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 320) took 1554 ms. Trace:
I20260709 13:08:16.748473 22400 rpcz_store.cc:276] 0709 13:08:15.193995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.202532 (+  8537us) service_pool.cc:224] Handling call
0709 13:08:16.740913 (+1538381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236684,"reported_tablets":1}
I20260709 13:08:16.719339 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2803) took 1286 ms. Trace:
I20260709 13:08:16.749475 22579 rpcz_store.cc:276] 0709 13:08:15.432200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.488064 (+ 55864us) service_pool.cc:224] Handling call
0709 13:08:16.357822 (+869758us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54003bc754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:16.718508 (+360686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62537600}
I20260709 13:08:16.754671 22498 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:08:16.758546 25522 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.009s
I20260709 13:08:16.763469 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.764420 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2802) took 1332 ms. Trace:
I20260709 13:08:16.768181 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.769199 22579 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:08:16.770032 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1927) took 1254 ms. Trace:
I20260709 13:08:16.770463 22579 rpcz_store.cc:276] 0709 13:08:15.516037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.767723 (+1251686us) service_pool.cc:224] Handling call
0709 13:08:16.769932 (+  2209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.771754 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.772346 22571 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:16.385174 23264 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:16.350432 25621 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:16.426170 25627 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:08:16.729178 25617 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:16.729929 25613 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.661s	user 0.014s	sys 0.000s
I20260709 13:08:16.776355 25613 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.769348 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.778115 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1936) took 1123 ms. Trace:
I20260709 13:08:16.778460 22574 rpcz_store.cc:276] 0709 13:08:15.654732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.769066 (+1114334us) service_pool.cc:224] Handling call
0709 13:08:16.778047 (+  8981us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:16.731317 25578 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.667s	user 0.014s	sys 0.002s
I20260709 13:08:16.778880 25613 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:16.732693 25566 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:16.732856 25625 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.893s	user 0.022s	sys 0.006s
I20260709 13:08:16.733184 25571 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:16.733273 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.350392 25565 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:16.680227 22504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.012s	sys 0.016s
W20260709 13:08:16.734005 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 377821us
W20260709 13:08:16.798924 22504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.013s	sys 0.017s
W20260709 13:08:16.720399 25636 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.368s	user 0.000s	sys 0.021s
W20260709 13:08:16.778916 25629 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.005s
I20260709 13:08:16.799551 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:16.811411 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:16.732699 23256 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.545s	user 0.014s	sys 0.000s
I20260709 13:08:16.736963 25610 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.742913 25481 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.000s
I20260709 13:08:16.743798 25586 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:16.745051 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2217) took 1133 ms. Trace:
I20260709 13:08:16.824939 25613 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:16.825264 22648 rpcz_store.cc:276] 0709 13:08:15.611817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.615126 (+  3309us) service_pool.cc:224] Handling call
0709 13:08:15.615458 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.804599 (+189141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.744785 (+940186us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540017d254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:16.744987 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374326016}
I20260709 13:08:16.247098 25634 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
W20260709 13:08:16.772568 25562 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.216s	user 0.008s	sys 0.014s
W20260709 13:08:16.719899 25563 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.008s
I20260709 13:08:16.732445 25575 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:16.764778 22572 rpcz_store.cc:276] 0709 13:08:15.431931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.763135 (+1331204us) service_pool.cc:224] Handling call
0709 13:08:16.764353 (+  1218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.790475 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:16.787894 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44381.2us
I20260709 13:08:16.796836 22579 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:16.827354 25640 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:16.835608 25575 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.836143 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:16.792656 22580 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:16.836973 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1930) took 1320 ms. Trace:
I20260709 13:08:16.837296 22580 rpcz_store.cc:276] 0709 13:08:15.518158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.732980 (+1214822us) service_pool.cc:224] Handling call
0709 13:08:16.836916 (+103936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.837895 25575 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:16.838238 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.838685 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1920) took 1324 ms. Trace:
I20260709 13:08:16.838964 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 453) took 1349 ms. Trace:
I20260709 13:08:16.839051 22579 rpcz_store.cc:276] 0709 13:08:15.514024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.771363 (+1257339us) service_pool.cc:224] Handling call
0709 13:08:16.838628 (+ 67265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.839567 23260 rpcz_store.cc:276] 0709 13:08:15.490028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.490189 (+   161us) service_pool.cc:224] Handling call
0709 13:08:15.513176 (+ 22987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.136208 (+623032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.838697 (+702489us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54008dead4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:16.838877 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430447360}
I20260709 13:08:16.839381 25563 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.840402 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.841043 22579 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:08:16.841480 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2791) took 1412 ms. Trace:
I20260709 13:08:16.841758 22579 rpcz_store.cc:276] 0709 13:08:15.429175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.840139 (+1410964us) service_pool.cc:224] Handling call
0709 13:08:16.841429 (+  1290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.842187 25563 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:16.842649 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 535) took 1063 ms. Trace:
I20260709 13:08:16.817397 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.821671 22498 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:16.824117 25481 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.843051 22647 rpcz_store.cc:276] 0709 13:08:15.778864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.805075 (+ 26211us) service_pool.cc:224] Handling call
0709 13:08:15.805826 (+   751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.096137 (+290311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.096166 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.096206 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:16.096244 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.842399 (+746155us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400411c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:16.842448 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.842575 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667165056}
I20260709 13:08:16.838981 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 438) took 1069 ms. Trace:
I20260709 13:08:16.849861 22580 rpcz_store.cc:276] 0709 13:08:15.769478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.837961 (+1068483us) service_pool.cc:224] Handling call
0709 13:08:16.838920 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.852303 25613 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:16.853502 25613 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.854311 25563 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:16.854417 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:16.856822 25624 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.857512 25471 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:16.843375 25562 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.857925 25471 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:16.787696 25566 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.858943 25471 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.859817 25566 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:16.860183 25471 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:16.830344 25565 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:16.857278 25624 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:16.861860 25565 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.862676 25624 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.787268 25578 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.866815 25578 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:16.867780 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.830977 25610 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.870698 25610 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:16.871061 25624 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:16.871551 25548 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:16.872594 22654 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:16.872987 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.873775 22654 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:16.873914 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2788) took 1445 ms. Trace:
I20260709 13:08:16.841806 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 456) took 1344 ms. Trace:
I20260709 13:08:16.874524 23257 rpcz_store.cc:276] 0709 13:08:15.497611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.688189 (+190578us) service_pool.cc:224] Handling call
0709 13:08:16.058872 (+370683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.064170 (+  5298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.841559 (+777389us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400855550. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:16.841735 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841783168}
I20260709 13:08:16.821377 25473 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:16.877131 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.877533 22504 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:16.877867 22573 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:16.878511 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2811) took 1393 ms. Trace:
I20260709 13:08:16.875000 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 556) took 1780 ms. Trace:
I20260709 13:08:16.872994 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.878912 22573 rpcz_store.cc:276] 0709 13:08:15.485044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.876810 (+1391766us) service_pool.cc:224] Handling call
0709 13:08:16.878441 (+  1631us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:16.882921 22546 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41936 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 13:08:16.888677 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.883476 22546 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41936 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2830)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2833)
W20260709 13:08:16.905067 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81439.5us
I20260709 13:08:16.880036 23263 rpcz_store.cc:276] 0709 13:08:15.094837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.094945 (+   108us) service_pool.cc:224] Handling call
0709 13:08:15.095211 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.843684 (+748473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.874782 (+1031098us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400719b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:16.874941 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692558592}
I20260709 13:08:16.874392 22575 rpcz_store.cc:276] 0709 13:08:15.428345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.872695 (+1444350us) service_pool.cc:224] Handling call
0709 13:08:16.873848 (+  1153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.909373 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.909605 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:16.894568 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:16.911234 22498 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:16.901469 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:16.913039 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.913690 22501 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:16.910251 22575 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:16.914629 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1929) took 1398 ms. Trace:
I20260709 13:08:16.915052 22575 rpcz_store.cc:276] 0709 13:08:15.516609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.909050 (+1392441us) service_pool.cc:224] Handling call
0709 13:08:16.914532 (+  5482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.915953 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.917470 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.916782 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 435) took 1361 ms. Trace:
I20260709 13:08:16.919090 22575 rpcz_store.cc:276] 0709 13:08:15.555166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.915712 (+1360546us) service_pool.cc:224] Handling call
0709 13:08:16.916724 (+  1012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.913595 22500 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
I20260709 13:08:16.929093 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.918258 22580 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:16.930553 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1925) took 1415 ms. Trace:
I20260709 13:08:16.930976 22580 rpcz_store.cc:276] 0709 13:08:15.515449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.850724 (+1335275us) service_pool.cc:224] Handling call
0709 13:08:16.930480 (+ 79756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.928238 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:16.920650 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:16.933971 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:16.936887 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.937717 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 432) took 1383 ms. Trace:
I20260709 13:08:16.937862 22503 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:16.938246 22573 rpcz_store.cc:276] 0709 13:08:15.554263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.882858 (+1328595us) service_pool.cc:224] Handling call
0709 13:08:16.937649 (+ 54791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.938864 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 434) took 1384 ms. Trace:
I20260709 13:08:16.939615 22572 rpcz_store.cc:276] 0709 13:08:15.554886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.881612 (+1326726us) service_pool.cc:224] Handling call
0709 13:08:16.938791 (+ 57179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.940639 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:16.859835 25562 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:16.872596 25481 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:16.941782 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2797) took 1511 ms (client timeout 1941 ms). Trace:
I20260709 13:08:16.800508 25625 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:16.945778 22577 rpcz_store.cc:269] 0709 13:08:15.430678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.940248 (+1509570us) service_pool.cc:224] Handling call
0709 13:08:16.941696 (+  1448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.955183 22501 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:16.944257 25645 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:16.965098 22502 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:16.966398 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60353.4us
I20260709 13:08:16.914633 22546 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41932 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2830)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2833)
I20260709 13:08:16.992375 22654 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:16.995285 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.966105 25566 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:16.965657 25645 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.007009 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:17.015506 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.002413 25640 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:08:17.002985 25566 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:17.008483 25645 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:17.025823 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:17.028138 22649 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.021154 25566 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.031329 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.017165 25471 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:17.029171 25548 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.032195 25634 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:17.031180 25629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59516 (request call id 83) took 7197 ms. Trace:
I20260709 13:08:17.063885 25634 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:17.064949 25634 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.043083 25515 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:17.047492 25624 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:17.049083 25548 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.108718 22648 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:17.139403 25652 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:17.062731 25629 rpcz_store.cc:276] 0709 13:08:09.821847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.821968 (+   121us) service_pool.cc:224] Handling call
0709 13:08:09.830967 (+  8999us) log.cc:844] Serialized 508 byte log entry
0709 13:08:10.026659 (+195692us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b54002c7ca0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26270dbe 00007fec2627b930 00007fec2627b8d8 00007fec2627b858 00007fec2627b813 00007fec2627aa9c 00007fec2c166626 00007fec2c160dd8 00007fec262b77cb 00007fec262ba2c0
0709 13:08:17.015600 (+6988941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10505,"raft.queue_time_us":8136,"raft.run_cpu_time_us":1309,"raft.run_wall_time_us":1309,"spinlock_wait_cycles":17144576,"thread_start_us":90316,"threads_started":1,"wal-append.queue_time_us":123551,"wal-append.run_cpu_time_us":4103,"wal-append.run_wall_time_us":1072629}
W20260709 13:08:17.141892 25653 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:08:17.155932 22389 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be7264d3053b44989c5504d296ea482b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:17.162449 25590 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:17.172762 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 155982us
I20260709 13:08:17.151027 25625 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:17.179584 25566 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.189661 25548 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:17.189867 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 569) took 1040 ms. Trace:
I20260709 13:08:17.191385 25596 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:17.191838 25596 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:17.190421 23256 rpcz_store.cc:276] 0709 13:08:16.149402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.152790 (+  3388us) service_pool.cc:224] Handling call
0709 13:08:16.185327 (+ 32537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.185578 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:16.831318 (+645740us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.189222 (+357904us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.189466 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.189518 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:17.189569 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.189644 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.189792 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9900,"prepare.queue_time_us":21049,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":8761,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":10231,"thread_start_us":253879,"threads_started":1}
I20260709 13:08:17.193758 22647 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:17.196216 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:17.197561 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.198210 22576 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 2.
W20260709 13:08:17.198665 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2804) took 1766 ms (client timeout 1968 ms). Trace:
I20260709 13:08:17.198751 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:17.199128 22576 rpcz_store.cc:269] 0709 13:08:15.432478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.195424 (+1762946us) service_pool.cc:224] Handling call
0709 13:08:17.198611 (+  3187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.199716 23256 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:17.200176 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.202651 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:17.206609 22645 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:17.208380 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 534) took 1433 ms. Trace:
I20260709 13:08:17.208894 22645 rpcz_store.cc:276] 0709 13:08:15.774985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.808237 (+ 33252us) service_pool.cc:224] Handling call
0709 13:08:17.206321 (+1398084us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:17.206479 (+   158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.208057 (+  1578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.208322 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38914432}
I20260709 13:08:17.214126 25566 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:17.226281 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.227506 22574 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:17.228196 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2815) took 1686 ms. Trace:
I20260709 13:08:17.196420 25596 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.231516 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.232339 25596 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:17.232769 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.232590 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2822) took 1108 ms. Trace:
I20260709 13:08:17.233747 22578 rpcz_store.cc:276] 0709 13:08:16.124124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.231225 (+1107101us) service_pool.cc:224] Handling call
0709 13:08:17.232529 (+  1304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.234757 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:17.235117 22571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1938) took 1188 ms (client timeout 1500 ms). Trace:
W20260709 13:08:17.235523 22571 rpcz_store.cc:269] 0709 13:08:16.060067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.267393 (+207326us) service_pool.cc:224] Handling call
0709 13:08:17.234930 (+967537us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54001e5ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:17.235032 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962288896}
I20260709 13:08:17.228597 22574 rpcz_store.cc:276] 0709 13:08:15.541656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.225756 (+1684100us) service_pool.cc:224] Handling call
0709 13:08:17.228115 (+  2359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.236613 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.238385 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.257622 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2823) took 1105 ms. Trace:
I20260709 13:08:17.283483 22571 rpcz_store.cc:276] 0709 13:08:16.152388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.236313 (+1083925us) service_pool.cc:224] Handling call
0709 13:08:17.257519 (+ 21206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.236008 25492 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:08:17.282073 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:17.284704 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2222) took 1668 ms. Trace:
I20260709 13:08:17.285944 22651 rpcz_store.cc:276] 0709 13:08:15.616444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.616554 (+   110us) service_pool.cc:224] Handling call
0709 13:08:15.650949 (+ 34395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.800591 (+149642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.243945 (+1443354us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400394254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:17.284644 (+ 40699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271643392}
I20260709 13:08:17.283519 25548 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.289749 22576 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:08:17.290330 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2827) took 1016 ms. Trace:
I20260709 13:08:17.290720 22576 rpcz_store.cc:276] 0709 13:08:16.274432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.199937 (+925505us) service_pool.cc:224] Handling call
0709 13:08:17.290276 (+ 90339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.291680 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.292311 22576 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.296082 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.296746 22577 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:17.297238 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1937) took 1630 ms (client timeout 2159 ms). Trace:
W20260709 13:08:17.297600 22577 rpcz_store.cc:269] 0709 13:08:15.667027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.295801 (+1628774us) service_pool.cc:224] Handling call
0709 13:08:17.297185 (+  1384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.297458 25548 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.298743 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.299532 22577 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:17.299799 22576 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:17.300501 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.302938 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.304385 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.300812 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.304993 25548 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:17.305449 22576 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:17.305516 25561 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:17.306422 25561 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:17.307348 25561 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.308635 25561 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:17.314848 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38438 (request call id 35) took 1418 ms. Trace:
I20260709 13:08:17.315498 22650 rpcz_store.cc:276] 0709 13:08:15.896455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.896637 (+   182us) service_pool.cc:224] Handling call
0709 13:08:17.314469 (+1417832us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b5400197e20. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26278520 00007fec262f5652 00007fec2b2c360a 00007fec248497d4 00007fec24849762 00007fec24849691 00007fec2484960c 00007fec248488c2 00007fec2463648c 00007fec246358c6
0709 13:08:17.314764 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87860608}
I20260709 13:08:17.316332 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2824) took 1114 ms. Trace:
I20260709 13:08:17.323149 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.289175 25645 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.324430 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.325838 25645 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:17.316747 22576 rpcz_store.cc:276] 0709 13:08:16.191666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.300575 (+1108909us) service_pool.cc:224] Handling call
0709 13:08:17.306293 (+  5718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.328804 22544 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41932 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2830)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 460)
I20260709 13:08:17.332847 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.333943 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.334656 22580 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
W20260709 13:08:17.335155 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2789) took 1906 ms (client timeout 2413 ms). Trace:
W20260709 13:08:17.335536 22580 rpcz_store.cc:269] 0709 13:08:15.428656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.333658 (+1905002us) service_pool.cc:224] Handling call
0709 13:08:17.335098 (+  1440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.334000 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.337241 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.337361 22577 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:17.338654 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.339244 22580 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:08:17.339419 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.340005 22577 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:17.339852 25592 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:17.340317 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.340924 22580 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:17.340999 25592 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.341747 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.342013 25592 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:17.342849 25473 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:17.343056 25592 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:17.343282 25473 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:17.344313 25473 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.345252 25502 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:17.345646 25473 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.343525 25592 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:17.347580 23262 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.355911 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 2779) took 1261 ms. Trace:
I20260709 13:08:17.357544 22502 rpcz_store.cc:276] 0709 13:08:16.094871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.094980 (+   109us) service_pool.cc:224] Handling call
0709 13:08:17.355693 (+1260713us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54001b8354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:17.355821 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997725440}
I20260709 13:08:17.346661 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.348893 22545 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41932 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2830)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 460)
I20260709 13:08:17.359202 22577 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:17.361742 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.345666 25502 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:17.361430 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.333549 22544 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36354 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2830)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 460)
I20260709 13:08:17.363219 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.371342 22572 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:17.371847 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2817) took 1474 ms. Trace:
I20260709 13:08:17.372171 22572 rpcz_store.cc:276] 0709 13:08:15.897915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.362979 (+1465064us) service_pool.cc:224] Handling call
0709 13:08:17.371791 (+  8812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.373395 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.374487 22580 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:17.380218 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:17.380661 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.365028 25502 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.381702 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.382498 25502 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.382620 22580 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:17.383008 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.384093 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.385097 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.361997 25548 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.386053 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.386191 25548 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.387105 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.388681 25515 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:17.389107 25515 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:17.389313 25548 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:17.363215 25592 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.390264 22580 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:17.391278 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.392349 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.389904 25515 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:17.392848 22580 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.393571 25515 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.395717 22402 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.397729 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:17.400188 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 368910us
I20260709 13:08:17.400569 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.401376 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2825) took 1197 ms. Trace:
I20260709 13:08:17.401466 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.401721 22573 rpcz_store.cc:276] 0709 13:08:16.203755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.400304 (+1196549us) service_pool.cc:224] Handling call
0709 13:08:17.401321 (+  1017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.402732 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.405128 25563 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:17.438817 25563 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.439322 25563 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.405251 25658 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:17.441154 25658 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:17.441594 25658 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.442737 25592 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.406014 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.406867 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:17.405252 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.445335 22572 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:17.445549 22571 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:17.446270 25624 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:17.446367 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.446728 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.447221 22572 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:17.447849 22571 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:17.448112 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.449074 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.446898 25624 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:17.413584 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.449761 22571 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:17.450907 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.450592 25624 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.452140 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.415143 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:17.416204 22648 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:17.402736 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.416607 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:17.454376 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.419653 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.458056 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.454380 22650 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:17.459398 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.459818 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.421202 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:17.461566 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.460035 22576 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:17.450654 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.463925 22571 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:17.464124 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.464773 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:17.465538 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.465855 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.466852 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.467832 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.468842 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.475832 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.476979 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.478075 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.478658 22571 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:08:17.479442 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.482298 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.482416 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.464778 22576 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:17.484611 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.485270 22576 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:17.404367 22402 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:08:17.424926 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.483362 22577 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:17.425478 22574 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:17.490492 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2828) took 1141 ms. Trace:
I20260709 13:08:17.490865 22574 rpcz_store.cc:276] 0709 13:08:16.349608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.237875 (+888267us) service_pool.cc:224] Handling call
0709 13:08:17.490429 (+252554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.431154 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:17.432946 22578 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:17.428514 22575 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:17.433279 22544 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36354 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1946)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1959)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1960)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1947)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1948)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1954)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2830)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 460)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 472)
I20260709 13:08:17.437446 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:17.488054 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:17.501209 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63857.4us
I20260709 13:08:17.503721 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:17.504386 23262 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:17.505399 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:17.508750 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.510361 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.511019 22572 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:17.511843 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.512490 22572 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:17.517081 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.517635 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.518971 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.479928 22571 raft_consensus.cc:2376] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6. Re-sending same reply.
W20260709 13:08:17.472784 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.470940 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.527200 22580 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:17.527864 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.528524 22579 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
W20260709 13:08:17.472956 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.530196 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.473132 22573 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:17.528563 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.531214 22572 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:17.532333 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:17.532398 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.533563 22574 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:08:17.536648 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:17.536908 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 330032us
W20260709 13:08:17.537356 23227 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36354 dropped due to backpressure: service queue is full with 50 items
I20260709 13:08:17.538425 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.470728 22501 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:17.539635 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:17.539486 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.541841 22576 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:17.542315 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.543892 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2794) took 2114 ms. Trace:
I20260709 13:08:17.544291 22580 rpcz_store.cc:276] 0709 13:08:15.429905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.542907 (+2113002us) service_pool.cc:224] Handling call
0709 13:08:17.543308 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.543536 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.543569 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.543634 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:17.543667 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.543718 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.543838 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.546839 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2799) took 2115 ms. Trace:
I20260709 13:08:17.547254 22580 rpcz_store.cc:276] 0709 13:08:15.431200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.545830 (+2114630us) service_pool.cc:224] Handling call
0709 13:08:17.546173 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.546368 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.546398 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.546496 (+    98us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.546554 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.546649 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.546778 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.541023 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2792) took 2111 ms. Trace:
I20260709 13:08:17.529870 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.568291 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.549757 22571 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 3: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:17.573266 25596 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.539511 25515 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.530393 25613 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:17.529496 25565 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:17.578284 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.614737 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2795) took 2173 ms. Trace:
I20260709 13:08:17.615157 22574 rpcz_store.cc:276] 0709 13:08:15.430168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.550127 (+2119959us) service_pool.cc:224] Handling call
0709 13:08:17.598132 (+ 48005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.603486 (+  5354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.603510 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.603549 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:17.603582 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.603633 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.603747 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.616094 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:17.582113 22499 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:17.611295 23229 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:17.579116 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2829) took 1229 ms. Trace:
I20260709 13:08:17.609990 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.617115 22578 rpcz_store.cc:276] 0709 13:08:16.350026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.234495 (+884469us) service_pool.cc:224] Handling call
0709 13:08:17.578934 (+344439us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54003cbed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:17.579055 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436470656}
I20260709 13:08:17.570580 25502 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:17.582454 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.590478 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:17.590981 22579 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:17.591461 22500 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:17.592126 22572 rpcz_store.cc:276] 0709 13:08:15.429443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.540266 (+2110823us) service_pool.cc:224] Handling call
0709 13:08:17.540549 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.540712 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.540735 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.540775 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.540810 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.540878 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.540971 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.623942 23262 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:17.470752 25563 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:17.625430 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.603266 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61018.8us
I20260709 13:08:17.625878 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2806) took 2192 ms. Trace:
I20260709 13:08:17.626250 22574 rpcz_store.cc:276] 0709 13:08:15.435545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.625120 (+2189575us) service_pool.cc:224] Handling call
0709 13:08:17.625392 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.625583 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.625607 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.625648 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.625681 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.625731 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.625831 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.602162 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2800) took 2170 ms. Trace:
I20260709 13:08:17.577894 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2790) took 2149 ms. Trace:
I20260709 13:08:17.605098 22576 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:17.626812 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:17.627950 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2807) took 2192 ms. Trace:
I20260709 13:08:17.628458 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2796) took 2198 ms. Trace:
I20260709 13:08:17.627501 22580 rpcz_store.cc:276] 0709 13:08:15.431415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.548959 (+2117544us) service_pool.cc:224] Handling call
0709 13:08:17.549287 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.549441 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.549462 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.549500 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:17.549528 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.549587 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.602056 (+ 52469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.629045 22576 rpcz_store.cc:276] 0709 13:08:15.430408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.542443 (+2112035us) service_pool.cc:224] Handling call
0709 13:08:17.597756 (+ 55313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.628214 (+ 30458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.628386 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.607350 22502 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:17.629994 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2810) took 2161 ms. Trace:
I20260709 13:08:17.630419 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.631338 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.631454 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.623517 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.633313 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:17.630334 22580 rpcz_store.cc:276] 0709 13:08:15.469034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.629298 (+2160264us) service_pool.cc:224] Handling call
0709 13:08:17.629563 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.629720 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.629742 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.629780 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:17.629808 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.629863 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.629947 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.636310 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2814) took 2141 ms. Trace:
I20260709 13:08:17.636809 22580 rpcz_store.cc:276] 0709 13:08:15.494598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.635049 (+2140451us) service_pool.cc:224] Handling call
0709 13:08:17.635438 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.635849 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.635890 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.635953 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.636002 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.636091 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.636237 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.640055 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:17.641412 22653 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:17.610136 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.614143 23263 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:17.627597 22573 rpcz_store.cc:276] 0709 13:08:15.428917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.536629 (+2107712us) service_pool.cc:224] Handling call
0709 13:08:17.577428 (+ 40799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.577591 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.577616 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.577661 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.577690 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.577741 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.577840 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:17.584422 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2821) took 1685 ms (client timeout 1941 ms). Trace:
W20260709 13:08:17.643326 22575 rpcz_store.cc:269] 0709 13:08:15.899315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.397475 (+1498160us) service_pool.cc:224] Handling call
0709 13:08:17.584215 (+186740us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b5400256a54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:17.584349 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69295360}
I20260709 13:08:17.643854 22573 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:17.644465 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1923) took 2129 ms. Trace:
I20260709 13:08:17.602813 25492 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:17.645594 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:17.645983 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:17.578207 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 132180us
W20260709 13:08:17.618202 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 92108.6us
I20260709 13:08:17.647373 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.648882 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:17.644783 22573 rpcz_store.cc:276] 0709 13:08:15.514897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.643224 (+2128327us) service_pool.cc:224] Handling call
0709 13:08:17.643534 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.644253 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.644411 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.644797 22575 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:17.650873 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 425) took 2124 ms. Trace:
I20260709 13:08:17.650930 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 426) took 2124 ms. Trace:
I20260709 13:08:17.651297 22575 rpcz_store.cc:276] 0709 13:08:15.526334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.644228 (+2117894us) service_pool.cc:224] Handling call
0709 13:08:17.644485 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.650563 (+  6078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.650811 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.651393 22573 rpcz_store.cc:276] 0709 13:08:15.526706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.649947 (+2123241us) service_pool.cc:224] Handling call
0709 13:08:17.650452 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.650633 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.650659 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.650703 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:17.650733 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.650785 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.650880 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.653385 22575 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.568112 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:17.591359 25548 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:17.569590 25650 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:17.647472 22500 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:17.591131 25596 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.628305 22574 rpcz_store.cc:276] 0709 13:08:15.435824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.627197 (+2191373us) service_pool.cc:224] Handling call
0709 13:08:17.627453 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.627621 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.627645 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.627700 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:17.627734 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.627792 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.627885 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.658581 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.659500 23227 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.662528 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.614754 22505 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:17.658950 22650 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:17.631845 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.664546 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.666025 22502 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:17.642513 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1922) took 2127 ms. Trace:
I20260709 13:08:17.664338 22574 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:17.667034 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 429) took 2113 ms. Trace:
I20260709 13:08:17.660701 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.660310 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:17.662928 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.654160 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 427) took 2111 ms. Trace:
I20260709 13:08:17.668673 22575 rpcz_store.cc:276] 0709 13:08:15.542570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.652439 (+2109869us) service_pool.cc:224] Handling call
0709 13:08:17.652763 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.653874 (+  1111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.654082 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.666734 22580 rpcz_store.cc:276] 0709 13:08:15.514610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.639520 (+2124910us) service_pool.cc:224] Handling call
0709 13:08:17.641897 (+  2377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.642122 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.642163 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.642216 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:17.642260 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.642327 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.642446 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.670050 22574 rpcz_store.cc:276] 0709 13:08:15.553395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.663867 (+2110472us) service_pool.cc:224] Handling call
0709 13:08:17.664168 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.666833 (+  2665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.666987 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.670501 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 430) took 2116 ms. Trace:
I20260709 13:08:17.670871 22575 rpcz_store.cc:276] 0709 13:08:15.553671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.669453 (+2115782us) service_pool.cc:224] Handling call
0709 13:08:17.669849 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.670050 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.670076 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.670121 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:17.670151 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.670341 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.670449 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.671550 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 440) took 1877 ms. Trace:
I20260709 13:08:17.671916 22574 rpcz_store.cc:276] 0709 13:08:15.882083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.670835 (+1788752us) service_pool.cc:224] Handling call
0709 13:08:17.671099 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.671259 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.671285 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.671324 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.671361 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.671411 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.671503 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.672405 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2826) took 1425 ms. Trace:
I20260709 13:08:17.661556 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:17.667140 22502 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:17.661638 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 428) took 2108 ms. Trace:
I20260709 13:08:17.676187 22571 rpcz_store.cc:276] 0709 13:08:15.553070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.660181 (+2107111us) service_pool.cc:224] Handling call
0709 13:08:17.660470 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.660659 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.660683 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.660727 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.660768 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.660824 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.661539 (+   715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.614018 25649 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:17.676833 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1934) took 2106 ms. Trace:
I20260709 13:08:17.680367 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2830) took 1323 ms. Trace:
I20260709 13:08:17.672770 22575 rpcz_store.cc:276] 0709 13:08:16.246677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.671698 (+1425021us) service_pool.cc:224] Handling call
0709 13:08:17.671953 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.672112 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.672137 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.672188 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:17.672219 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.672269 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.672357 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.623098 25543 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:17.685456 22574 rpcz_store.cc:276] 0709 13:08:16.357339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.672803 (+1315464us) service_pool.cc:224] Handling call
0709 13:08:17.679878 (+  7075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.680050 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.680073 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.680111 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:17.680152 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.680205 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.680311 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.686455 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2812) took 2197 ms. Trace:
I20260709 13:08:17.686640 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.686868 22576 rpcz_store.cc:276] 0709 13:08:15.489076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.629803 (+2140727us) service_pool.cc:224] Handling call
0709 13:08:17.685993 (+ 56190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.686173 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.686196 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.686232 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:17.686268 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.686317 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.686405 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.688694 22574 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:17.691118 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.690948 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.691932 22574 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:17.680208 22580 rpcz_store.cc:276] 0709 13:08:15.570439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.670235 (+2099796us) service_pool.cc:224] Handling call
0709 13:08:17.673751 (+  3516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.674990 (+  1239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.675029 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.675090 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:17.675133 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.675210 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.676752 (+  1542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:17.693042 25682 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:17.623638 25613 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:17.622459 25502 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.697669 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:17.693874 22580 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:17.661041 25493 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:17.697081 22571 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:17.697288 22648 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:17.699582 22580 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:17.700947 22505 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:17.701280 22504 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:17.624503 25645 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.701206 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.693737 22574 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:17.734306 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 156096us
I20260709 13:08:17.735159 22544 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.735571 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:17.736312 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.702324 22571 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:17.662278 25650 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.620105 25515 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:17.737702 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 90405.6us
I20260709 13:08:17.742002 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.742326 22574 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:17.738850 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:17.712670 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.678282 25473 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:17.742235 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.738369 22576 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:17.685047 25649 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.622856 25658 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.754973 22576 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:17.747182 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.753345 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.758363 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.753118 22571 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.760429 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.734679 22580 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.753523 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:17.763018 23260 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:08:17.694693 25666 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:17.762166 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.701967 25502 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:17.702312 25543 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:17.755913 22576 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.702219 25493 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.769889 22580 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.770242 22577 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:17.765822 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 63545.8us
I20260709 13:08:17.768658 22574 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:17.754290 25566 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.737211 25592 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.743463 25634 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:17.791699 25634 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.792304 25634 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.763060 25624 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:17.794309 25680 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:17.795524 25680 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:17.795859 25680 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:17.775197 22576 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:17.741104 25650 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.740854 25625 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:17.743435 25578 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:17.798935 25578 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:17.799486 25578 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:17.799556 25543 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.804350 25515 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:17.775082 25671 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:17.805086 25671 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.805488 25671 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:17.807394 25596 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:17.763422 25629 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:17.809789 25629 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:17.810202 25629 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:17.769197 25553 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:17.749220 25645 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.813169 25553 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:17.813648 25553 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.813294 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.814762 25645 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:17.815358 25645 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:17.815898 25624 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:17.816594 25624 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:17.778131 22652 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:17.819461 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.819368 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:17.820158 22496 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:17.779820 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.775593 25493 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:17.762406 25649 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.781620 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.785887 25561 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:17.786257 25681 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:17.764989 25660 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:17.798476 25563 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:17.803457 25613 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.779783 22571 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:17.828519 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:17.772128 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:17.859207 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 87157.4us
I20260709 13:08:17.840001 22580 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:17.817456 25500 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:17.840929 22545 connection.cc:256] RPC call timeout handler was delayed by -1.3225085229998967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:08:17.831712 25592 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.842326 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:17.754554 25473 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:17.849661 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69916.8us
I20260709 13:08:17.878731 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:17.849951 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68449.7us
I20260709 13:08:17.851548 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:17.854679 22576 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:17.855755 22648 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:17.882671 22499 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:17.883874 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:17.887168 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 152055us
I20260709 13:08:17.888356 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:17.888789 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.857431 25575 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:17.856463 25659 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:17.896593 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.891662 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:17.895663 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 142200us
I20260709 13:08:17.898276 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.899984 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:17.901340 23260 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:17.901445 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.868399 25555 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:17.904265 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:17.886438 25473 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.891079 25574 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:17.796662 25680 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:17.926075 25680 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:17.926752 25502 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.928011 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:17.928134 25548 consensus_queue.cc:1175] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ca917eaada84bf38a5daae9f8ffa066" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260709 13:08:17.906975 25625 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:17.930296 25640 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:17.930482 25515 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:17.911988 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.919071 25575 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:17.935485 25575 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.919595 25596 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:17.937611 25596 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:17.908962 25621 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.921631 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:17.922540 25658 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:17.947249 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:17.925068 25574 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:17.894147 25681 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:17.873338 25627 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:17.954291 25634 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:17.956750 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52544.6us
I20260709 13:08:17.919662 25659 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:17.932330 25684 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:17.973225 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 103407us
I20260709 13:08:17.974205 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:17.962406 25625 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:17.987071 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.965317 25566 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:17.994752 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.968344 25679 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:17.912720 25624 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:17.989069 25681 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:18.029403 25502 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:18.033870 25473 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.034057 25574 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.036334 25473 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.045552 25492 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:18.045378 25659 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.046021 25492 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:18.046984 25492 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.048529 25492 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.015245 25555 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:18.050611 25682 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:18.051781 25596 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:18.053308 25592 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.075265 22499 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.031153 25561 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.004590 25566 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:18.061264 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:18.082084 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 107980us
I20260709 13:08:18.083461 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.063125 25565 raft_consensus.cc:993] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:18.029744 25634 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.066164 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:18.066432 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:18.071772 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 159896us
I20260709 13:08:18.081219 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 1933) took 2529 ms. Trace:
I20260709 13:08:18.096336 23260 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:18.098470 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.102363 22573 rpcz_store.cc:276] 0709 13:08:15.551808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.652635 (+2100827us) service_pool.cc:224] Handling call
0709 13:08:17.656670 (+  4035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.692814 (+ 36144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.692851 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.693420 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.865154 (+171734us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:17.947087 (+ 81933us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.947322 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.947411 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.058573 (+111162us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800331180. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:08:18.066825 (+  8252us) raft_consensus.cc:1685] finished
0709 13:08:18.081005 (+ 14180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.081155 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61170,"prepare.queue_time_us":131861,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":165466,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":16893,"spinlock_wait_cycles":35032448,"thread_start_us":207981,"threads_started":3,"wal-append.queue_time_us":229463}
I20260709 13:08:18.070636 25682 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:18.110962 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.077013 25596 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:18.111833 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.078085 25693 raft_consensus.cc:2764] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:18.117937 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:18.122373 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 56015.6us
I20260709 13:08:18.122582 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:18.110709 25686 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:18.121529 25679 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:18.121714 25634 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:18.126329 25634 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.126648 25571 raft_consensus.cc:1081] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:18.127772 25586 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:18.128089 25625 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.128257 25586 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:18.128791 25586 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:18.126719 25634 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.125718 25686 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.132745 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.136132 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:18.137353 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.138805 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:18.143766 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 181189us
W20260709 13:08:18.145344 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 198277us
I20260709 13:08:18.147928 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.149652 22544 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.151052 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.129231 25683 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:18.158744 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.160003 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.138170 25686 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.162276 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.162846 22571 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:18.135725 25681 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.163503 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 450) took 1246 ms. Trace:
I20260709 13:08:18.190757 22571 rpcz_store.cc:276] 0709 13:08:16.917229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.695281 (+778052us) service_pool.cc:224] Handling call
0709 13:08:17.696965 (+  1684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.163254 (+466289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.163449 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.163623 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.185290 23260 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:18.152818 25625 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:18.149312 25693 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:18.143849 25548 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.189234 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:18.142925 25561 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:18.143354 25679 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:08:18.217757 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 57933.8us
W20260709 13:08:18.218504 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 121184us
I20260709 13:08:18.218691 22544 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.157778 25683 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:18.152891 25696 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:18.188568 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:18.188369 25515 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.185672 25684 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:08:18.188056 25566 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.202355 25596 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:18.295487 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 76872.8us
I20260709 13:08:18.352735 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:18.351300 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 200252us
W20260709 13:08:18.352239 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 148372us
I20260709 13:08:18.357087 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.359898 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:18.237403 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73846.7us
W20260709 13:08:18.299849 25650 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.008s
I20260709 13:08:18.362648 22571 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:18.362931 25650 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.205317 25682 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.374351 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:18.361389 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.374897 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.231263 25625 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:18.299536 25621 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.258620 25681 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.258878 25693 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:18.288547 25548 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:18.388032 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.228475 25493 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.394874 23262 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:18.402812 25493 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.403720 25596 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.313831 25646 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.200s
I20260709 13:08:18.405095 23264 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:18.226913 25553 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.313599 25694 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.378489 25696 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:18.409519 25696 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.409924 25561 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:18.410005 25696 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:18.410456 25561 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.410890 25561 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:18.412288 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50987.5us
I20260709 13:08:18.413426 23263 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:18.413671 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:18.267087 25697 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:18.250658 25578 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.416105 25578 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:18.316990 25683 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.399839 25625 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.417064 25625 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:18.417887 25663 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:08:18.400753 25621 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:18.397182 25703 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:18.416173 25705 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:18.433104 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.378134 25627 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:18.432571 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 76578.4us
W20260709 13:08:18.440225 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.421068 25621 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.409708 25681 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.454484 22578 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.449728 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:18.455497 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.382232 25695 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.452212 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:18.267392 25690 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.300s
I20260709 13:08:18.460666 22577 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:18.430856 25543 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.465529 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.466946 22574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:08:18.467559 22574 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.467916 22574 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.441772 25627 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.459066 25621 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.446352 25515 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:18.479679 22647 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:18.463272 25629 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.001s
I20260709 13:08:18.386272 25666 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:08:18.489583 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.491856 22651 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:18.493019 22645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:18.496096 22645 raft_consensus.cc:606] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:18.493671 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 137133us
I20260709 13:08:18.497045 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:18.497463 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.497926 22572 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:18.498963 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.501765 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.507164 22574 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.513782 22575 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:18.515622 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:18.516463 22648 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:18.519464 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.470722 25707 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:18.489588 25627 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.490470 25712 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:18.527853 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.494845 25554 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.530843 22574 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:18.528576 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.504364 25697 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.513413 25695 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:18.547847 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:18.548722 22645 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.514765 25681 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:18.549140 22645 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:18.551262 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:18.556360 22496 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:18.551934 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.515807 25698 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.524068 25684 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:18.562697 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:18.472034 25543 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.563313 22645 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.569934 22645 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.570297 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:18.571198 22496 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:18.504336 25629 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.534525 25554 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:18.542965 25515 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:18.565871 25698 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.573874 25634 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:18.586191 25671 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.001s
I20260709 13:08:18.602631 22572 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:18.551178 25645 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:18.572968 25705 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.585705 25500 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:08:18.550994 25575 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:18.602413 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.618109 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:18.598681 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 99623.4us
I20260709 13:08:18.557940 25624 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:08:18.612480 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70852.2us
I20260709 13:08:18.597249 25650 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:18.585680 25586 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.623123 25697 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.596948 25710 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:18.621722 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 268024us
I20260709 13:08:18.592890 25544 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:08:18.597651 25666 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:18.625520 25707 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:18.630554 25704 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:08:18.647135 25707 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.637374 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:18.642817 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:18.597406 25716 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:18.652503 25544 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:18.653352 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:18.654033 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:18.654235 22648 raft_consensus.cc:606] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:18.655742 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.653595 25714 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.656189 22652 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:18.647598 25707 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.658062 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:18.609364 25671 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.659343 23264 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:18.612159 25645 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.660305 22574 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:18.660346 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:18.656635 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 421635us
I20260709 13:08:18.666076 22572 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.668908 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:18.641697 25690 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:18.605669 25681 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:18.625238 25554 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.663630 25716 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:18.684823 22505 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:18.616830 25705 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.685365 22499 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:18.657016 25555 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:18.675271 25629 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.673362 25690 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:18.691447 22572 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:18.658767 25563 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:18.703567 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:18.704459 22648 raft_consensus.cc:606] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:18.696852 22499 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:18.712628 22498 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.715111 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:18.681233 25500 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:08:18.698733 25554 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.716712 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:18.715138 25699 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 13:08:18.728966 22649 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:18.729729 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:18.717624 25723 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:18.740245 25723 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:18.741643 25723 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.743803 25723 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.752691 22646 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:18.754493 25717 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
W20260709 13:08:18.755558 25718 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:18.756240 25660 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:18.756696 25660 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:18.757783 25671 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:18.757587 25660 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.759289 25660 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.760576 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:18.761154 22653 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:18.713327 25698 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:18.769374 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 394528us
I20260709 13:08:18.769606 22649 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:18.769860 22645 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:08:18.771015 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:18.774070 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.783998 25574 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:18.785022 25574 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.788329 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:18.789099 22500 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:18.789414 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2236) took 1151 ms. Trace:
I20260709 13:08:18.789764 22647 rpcz_store.cc:276] 0709 13:08:17.637767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.637924 (+   157us) service_pool.cc:224] Handling call
0709 13:08:17.638332 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.495108 (+856776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.789183 (+294075us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400168854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:18.789359 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919966976}
I20260709 13:08:18.790546 22504 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:18.788409 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:18.793385 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:18.751875 25634 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.769186 25543 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.797057 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.791546 25629 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:18.811683 25726 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:08:18.812495 22500 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.816293 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:18.823136 25645 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:18.794914 25721 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.825264 25691 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:18.825730 25691 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:18.826203 25561 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.817242 22502 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:18.826597 25691 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.835384 25561 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.835476 22505 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:18.835747 25691 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.834649 25727 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:18.805459 25563 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.845007 22500 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:08:18.845222 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48262.6us
I20260709 13:08:18.845933 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.807868 25586 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:18.847326 22504 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:18.848353 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 138315us
I20260709 13:08:18.847299 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:18.827510 25649 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.975s	user 0.008s	sys 0.005s
I20260709 13:08:18.850389 25561 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:18.850652 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.854466 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:18.857543 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:18.852129 25720 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
I20260709 13:08:18.861901 25722 raft_consensus.cc:2764] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:18.852340 25634 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:18.867579 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.837649 25566 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:08:18.853259 25561 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.878971 25561 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.868010 25634 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.881840 25634 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.877988 25682 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:18.856895 25629 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:18.884362 25629 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:18.884806 25629 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.843950 25625 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.881109 25734 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:18.874678 25553 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:18.917624 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 124381us
I20260709 13:08:18.850230 25563 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.855640 25649 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.869851 25722 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:18.862900 25729 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.897682 25696 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.903107 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:18.903483 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:18.930410 22501 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:18.930575 22574 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:18.903962 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:18.931478 22499 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:18.895203 25625 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:18.897699 25686 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.005s
I20260709 13:08:18.946805 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:18.927261 25722 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.948712 25695 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.949266 25722 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.957600 23263 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 3: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:18.958101 22647 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:18.949600 25695 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:18.958384 22574 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:18.950069 25686 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.979905 22496 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:18.981026 25686 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.963805 23262 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:18.963622 25710 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:18.967041 25696 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.927037 25578 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:18.968710 25649 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:18.973353 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:18.921423 25566 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:08:18.989228 23260 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:18.973767 22497 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:18.974534 25706 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:18.974792 23256 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:18.976013 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.976186 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:18.924984 25734 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:18.978223 22499 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:18.962492 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:18.975603 25694 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:18.960399 25712 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:08:18.972456 25634 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.985668 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:18.961117 25729 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.011361 25729 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.011646 25555 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:19.012076 25555 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.012428 25555 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.013427 23258 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:19.015121 25715 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:19.003562 25694 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:19.021754 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:18.937848 25627 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:18.958752 25705 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:18.922641 25621 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.021850 25694 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:18.991389 25706 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:19.001267 25556 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:19.025861 25740 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:19.002156 25734 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:19.029327 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 174958us
W20260709 13:08:19.039634 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.001267 25726 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:19.041790 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.042802 22501 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:19.036823 25556 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.046525 25556 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.030465 25627 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.036592 25563 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:19.048820 25640 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:19.049569 25640 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.049908 25566 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:19.050769 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.051440 22502 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:19.055619 22503 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:19.056365 22468 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:18.996147 25578 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.036522 25694 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:19.007079 25543 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:08:19.065711 25702 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.067695 25578 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.061331 25666 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:19.058923 25726 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.073025 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:19.073200 25719 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.385s	user 0.003s	sys 0.000s
I20260709 13:08:19.073269 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.075080 25621 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:19.058487 25659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.013s	sys 0.010s
I20260709 13:08:19.034057 25712 consensus_queue.cc:1243] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:19.058835 25705 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:19.083240 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:19.032022 25707 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.095160 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.100453 25634 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.085752 23256 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:19.087132 25666 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:19.083678 25696 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:08:19.085263 25745 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:19.116091 22650 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:19.096511 25659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.014s	sys 0.011s
I20260709 13:08:19.054333 25695 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.104954 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:19.107730 22577 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:19.109918 25501 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:19.114833 25726 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.123822 25501 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.124482 23257 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:19.124763 25501 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.125370 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.126076 25501 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:19.119457 22575 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:19.119947 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.120271 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.108453 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.102195 25723 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:19.140723 25723 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:19.141214 25723 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.140844 25561 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.120790 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.121158 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.133119 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.143679 22574 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:19.127274 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.128041 25712 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.128738 25571 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:19.105566 25621 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:19.133286 22652 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:19.133903 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.134207 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.134809 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.134804 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.135267 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.135596 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:19.139364 25566 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:19.089592 25702 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.139811 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:19.136060 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.126654 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.145098 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:19.150722 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.150642 22574 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
W20260709 13:08:19.119040 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.154151 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.154474 22653 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:19.154189 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.157251 22573 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:19.086093 25640 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.143230 25561 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.163283 25693 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.151468 25710 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:08:19.165762 25702 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.166082 25571 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.161846 25712 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.178236 25571 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.179997 25712 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.159294 25686 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.181491 25613 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:19.181586 25686 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.168521 25658 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:19.185873 25683 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.186342 25686 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.168686 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:19.170640 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:19.171700 22573 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:19.145253 25745 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:19.169296 25666 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.172381 25693 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.142802 25690 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.186018 25556 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.188010 23263 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:19.169642 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:19.214921 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45347us
I20260709 13:08:19.215200 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:19.212760 25722 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.171244 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.198123 22580 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:19.217444 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46289.3us
I20260709 13:08:19.217895 25722 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.218513 25722 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:19.182127 25613 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.219547 25613 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.221510 25556 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.221657 25574 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:19.222187 25574 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.222544 25574 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:19.222607 23264 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:19.214119 25702 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:19.224045 25566 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:19.194218 22647 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:19.209949 22578 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:19.207893 22645 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:19.206800 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:19.223162 25686 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:19.227649 25686 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:19.228111 25686 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:19.230578 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:19.231262 22500 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.218446 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.233439 25561 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:19.224467 25566 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.235909 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:19.199400 25745 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:19.226003 25666 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.246479 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:19.244506 25691 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:19.252776 25691 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:19.253350 25691 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.251395 25686 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.254933 25686 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:19.244944 25621 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:19.251595 25725 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:08:19.244997 25702 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:19.258620 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.260522 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:19.262127 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:19.263881 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.266825 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.268545 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.270366 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.261016 25705 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.261641 25561 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:19.273304 25561 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:19.274246 25561 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:19.281340 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.335189 22500 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:19.237758 25722 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:19.247820 25701 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.019s	sys 0.017s
I20260709 13:08:19.245088 25566 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.343845 25621 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:19.344962 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.276105 25727 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:19.279857 25634 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:19.380220 25701 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.020s	sys 0.017s
I20260709 13:08:19.344122 25625 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:19.344355 25696 raft_consensus.cc:2764] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:19.393663 25690 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.378237 25658 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:19.416383 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 414147us
I20260709 13:08:19.392191 25722 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.414970 25727 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:19.398175 25715 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:19.458510 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.413950 25723 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.466848 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:19.471191 22578 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:19.410175 25646 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:08:19.472661 22647 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:19.474733 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.476539 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:19.410658 25732 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:08:19.480347 25732 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.480475 25592 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:19.481070 25592 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:19.480944 25732 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.482066 25592 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.483232 25732 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:19.485710 25624 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:19.486316 25624 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.487726 25624 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.476969 25557 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:19.460963 25707 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.512732 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:19.506250 25682 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.002s
I20260709 13:08:19.528204 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:19.528200 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 134027us
I20260709 13:08:19.535146 22496 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:19.537688 22500 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:19.540834 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:19.541389 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:19.549336 25747 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:08:19.543345 25693 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.471968 25555 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:19.527009 25629 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.001s
I20260709 13:08:19.581997 25629 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.582880 22499 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:19.583741 25624 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.584084 25629 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.576810 25754 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 13:08:19.538019 25680 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.571557 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.584940 25680 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.585059 22498 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:19.587626 25680 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.491231 25694 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:08:19.588372 25694 consensus_queue.cc:1243] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:19.589613 25753 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:19.584264 23262 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:08:19.597332 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 116333us
I20260709 13:08:19.602116 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:19.536520 22578 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:19.590405 25753 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.583652 25555 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:19.620355 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.578329 25660 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:19.618613 25556 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.522926 25734 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.628028 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.629566 22499 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:19.626645 25660 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.644284 22499 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:19.646018 25754 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.638465 25723 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:19.641753 25755 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 13:08:19.672940 22501 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:19.682349 22580 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:19.690979 22504 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:19.643348 25574 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.668557 25754 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.678399 25745 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.736685 22648 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:19.739348 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.744128 25680 consensus_queue.cc:765] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 4 is ahead of the local log (next sequential op: 4). Destination peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.3, Next index: 5, Last known committed idx: 4, Time since last communication: 0.254s
I20260709 13:08:19.755842 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:19.731523 25683 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.004s
W20260709 13:08:19.758194 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.761605 22498 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:19.713243 25660 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.730248 25575 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:19.773273 25565 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:19.773926 25565 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:19.775019 25691 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 13:08:19.775461 25691 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.776206 25565 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.764209 25763 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:19.777257 25763 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.780038 25763 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.780715 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.726214 25566 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.776742 25565 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.757854 25734 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.755419 25686 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:19.796522 25565 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.810376 25754 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.811424 25565 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:19.801935 25501 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.001s
I20260709 13:08:19.802433 25566 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:19.802474 25691 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.814749 25686 consensus_queue.cc:1243] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:19.815281 25723 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:19.815739 25723 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:19.816762 25723 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.818198 25723 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.819084 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.804541 25759 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.805119 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:19.805472 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:19.806540 25574 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.785934 25575 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.820608 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.803956 25563 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:19.821612 22498 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8.
I20260709 13:08:19.854359 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:19.824446 25706 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.820636 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.828825 25759 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.831274 25683 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.860674 25544 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:19.861306 25544 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:19.853860 25563 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:19.831386 25693 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.819756 22505 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:19.860963 25683 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.833158 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:19.838526 25721 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:19.862203 25544 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.843098 25680 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.808604 25556 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:19.857391 25734 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:19.869743 23258 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:19.862994 25563 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.875660 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:19.872041 25706 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.890509 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.891328 22648 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 3: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:19.870015 25680 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:19.875949 25734 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:19.887800 25745 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.895608 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.864998 25693 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.889189 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.883213 22645 raft_consensus.cc:2955] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:19.884968 25659 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.901122 25659 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.879099 25682 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:19.894275 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:19.904412 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:19.898020 25613 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:19.905110 22651 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:19.910506 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:19.913079 25759 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:19.915035 25693 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.916162 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:19.916817 23260 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:19.918200 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:19.920634 22500 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:19.923511 25575 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:19.925213 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.925875 22497 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:19.929100 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.907618 25682 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.930115 25682 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:19.929797 25727 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:19.930449 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:19.931113 25727 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:19.931730 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:19.933400 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.906343 22648 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:19.906695 25659 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:19.934765 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.935436 22496 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:19.935457 22499 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:19.953174 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.953660 22500 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:19.953924 22498 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:19.954398 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.955075 22648 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:19.955226 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44856.2us
I20260709 13:08:19.956941 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.956805 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:19.957705 22498 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:19.958027 22651 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:19.960096 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.960794 22498 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:19.965024 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:19.971334 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:19.973055 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:19.973296 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:19.902647 25680 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:19.976276 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:19.967263 25745 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:19.967077 25621 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:20.002907 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:19.975562 25726 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:08:20.107509 25646 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:19.967021 25707 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:19.959161 25686 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:19.966886 25693 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:20.147140 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:20.112406 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:20.114813 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 138607us
I20260709 13:08:20.116396 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:20.118853 22572 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:20.149641 22573 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:20.121019 22575 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:20.121872 25732 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:20.135246 22648 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:20.078337 25574 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:08:20.144520 25683 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:19.975382 25666 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.078938 25734 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:20.144289 25565 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:20.154119 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:20.182776 22573 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:20.157033 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:20.137305 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.113451 25680 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.159310 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:20.181005 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:20.139844 25544 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:20.145040 25646 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:20.147496 25707 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.251502 25707 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.140182 25621 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:20.235201 22648 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:20.232712 22575 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:20.239738 22651 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:20.241603 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:20.260900 22571 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:20.153381 25693 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.238798 22572 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:20.248775 22573 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:20.240360 25745 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.250079 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:20.266932 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:08:20.249471 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57023.6us
I20260709 13:08:20.191035 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 471) took 1010 ms. Trace:
I20260709 13:08:20.267954 25680 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.233572 25690 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:20.181984 25666 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.296180 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:20.269210 25693 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.156358 25753 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:20.322747 22648 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:20.293661 25544 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:20.317608 25781 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.288821 25745 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.298921 25726 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:08:20.314383 25780 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:20.331044 25754 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:20.304097 25565 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:08:20.338653 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.302769 25690 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.319113 25686 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:08:20.270975 23259 rpcz_store.cc:276] 0709 13:08:19.180852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.181047 (+   195us) service_pool.cc:224] Handling call
0709 13:08:19.976023 (+794976us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:08:20.186899 (+210876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13708032}
I20260709 13:08:20.363706 25779 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.377473 25775 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:08:20.338480 25722 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:20.371654 25754 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:20.401261 25776 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:08:20.370983 25780 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:20.400465 25777 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:20.363495 25781 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:20.376638 25785 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:20.357354 25787 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:08:20.425709 25778 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 13:08:20.426805 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2071) took 1935 ms. Trace:
I20260709 13:08:20.427356 22650 rpcz_store.cc:276] 0709 13:08:18.491001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.503530 (+ 12529us) service_pool.cc:224] Handling call
0709 13:08:19.115919 (+612389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.116558 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.426583 (+1310025us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400236250. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:20.426740 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407586560}
I20260709 13:08:20.428956 25785 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.406368 25779 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:20.430863 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.431376 25785 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:20.431783 25779 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:20.432945 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 381) took 1398 ms. Trace:
I20260709 13:08:20.432691 25544 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.433324 23262 rpcz_store.cc:276] 0709 13:08:19.034130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.034791 (+   661us) service_pool.cc:224] Handling call
0709 13:08:19.035247 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.590880 (+555633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.432691 (+841811us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54007463d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:20.432889 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261941632}
I20260709 13:08:20.415937 25613 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.439683 25613 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:20.431380 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.442898 23260 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:20.447223 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.449296 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:20.446422 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:20.415516 25754 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:20.461683 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 132875us
I20260709 13:08:20.462939 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:20.357257 25621 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:20.465615 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:20.422787 25720 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:20.460127 25721 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.003s
I20260709 13:08:20.447909 25722 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.558136 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 95275.7us
W20260709 13:08:20.545907 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45776.1us
I20260709 13:08:20.420722 25682 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:20.567715 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 242333us
I20260709 13:08:20.464653 25666 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:20.609368 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43770.6us
I20260709 13:08:20.461213 25727 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:20.614157 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54170.1us
I20260709 13:08:20.615916 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:20.616544 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:20.618381 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48777.8us
I20260709 13:08:20.498580 25723 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:08:20.522295 25720 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:20.557385 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:20.452404 25761 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 13:08:20.536633 25680 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:20.508157 25566 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 13:08:20.470327 25571 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.142s
W20260709 13:08:20.625115 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 170675us
I20260709 13:08:20.563849 25785 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:20.627205 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.610240 25788 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:20.607211 25734 raft_consensus.cc:476] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:20.640365 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:20.607837 25624 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:20.569341 25722 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:20.615904 25707 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.659279 25695 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:20.622696 25796 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:20.647003 25666 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.625357 25727 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.628587 25726 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:08:20.646255 25763 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 13:08:20.766055 25544 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:20.822096 22580 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:20.634577 25565 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:08:20.646664 25680 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:20.665092 25779 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:20.669100 25723 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.749486 25690 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:20.820389 25811 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:20.733176 25785 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.731081 25686 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
W20260709 13:08:20.867662 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.766800 25732 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 13:08:20.786723 25706 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.895s	user 0.008s	sys 0.004s
I20260709 13:08:20.842517 25761 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:20.840771 25721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37524 (request call id 0) took 4880 ms. Trace:
I20260709 13:08:20.927484 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:20.928005 25795 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:08:20.928804 25793 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 13:08:20.929700 25816 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:08:20.933354 25799 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 13:08:20.802472 25796 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.901269 25787 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:20.845255 25613 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:20.784965 25695 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.902384 25792 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:20.958667 23261 raft_consensus.cc:2410] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:20.969780 22579 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:20.946197 25781 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:20.843717 25666 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.819391 25720 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:21.028934 23261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 584) took 1830 ms (client timeout 1763 ms). Trace:
I20260709 13:08:20.954749 25761 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:20.896286 25680 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.031629 23260 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:20.991925 25565 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:21.032759 22647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.003s	sys 0.006s
W20260709 13:08:21.029633 23261 rpcz_store.cc:269] 0709 13:08:19.185853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.186008 (+   155us) service_pool.cc:224] Handling call
0709 13:08:20.927306 (+1741298us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:08:21.016173 (+ 88867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398464}
W20260709 13:08:21.034696 22647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.004s	sys 0.006s
W20260709 13:08:21.034195 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.044s	sys 0.056s
W20260709 13:08:21.035753 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.044s	sys 0.056s
I20260709 13:08:20.993643 25780 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:20.914378 25723 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:20.938850 25811 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:20.903585 25779 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.011394 25805 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.034515 25565 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:21.018453 25682 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:21.036120 25693 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.693s	user 0.006s	sys 0.006s
I20260709 13:08:21.039000 25819 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.071286 25802 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:21.073385 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 433085us
W20260709 13:08:21.077953 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 458647us
W20260709 13:08:21.077972 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 462495us
I20260709 13:08:21.088683 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.092460 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:21.092578 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:21.048286 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.099555 23262 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:21.100096 22578 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:21.078373 25722 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.016937 25787 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.078245 25802 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:21.108161 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:21.130411 23262 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.125077 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.131342 22650 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:21.133989 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:21.134672 22576 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 2.
I20260709 13:08:21.128679 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.126286 25695 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.089735 25707 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.076834 25693 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:21.141355 22619 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8.
I20260709 13:08:21.143281 22619 leader_election.cc:403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:21.097918 25788 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:21.144315 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:21.090883 25732 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:21.138589 25810 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.064980 25805 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.162098 25680 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.142401 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:21.165303 25586 consensus_queue.cc:1175] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:08:21.163301 25666 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.140161 25727 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.091759 25761 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.148962 25823 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8.
I20260709 13:08:21.154063 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.080227 25819 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.157184 22505 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:21.185597 23262 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:21.168118 25785 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.196770 25825 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:21.199995 22499 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:21.197294 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2086) took 1463 ms. Trace:
I20260709 13:08:21.201102 22647 rpcz_store.cc:276] 0709 13:08:19.734170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.734301 (+   131us) service_pool.cc:224] Handling call
0709 13:08:19.734626 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.734977 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.735001 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.735457 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.440615 (+705158us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b1800390ee0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:08:21.035271 (+594656us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:21.035341 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.035447 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.194110 (+158663us) raft_consensus.cc:1685] finished
0709 13:08:21.194132 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.197225 (+  3093us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5129,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7653,"spinlock_wait_cycles":14958336,"thread_start_us":594445,"threads_started":1,"wal-append.queue_time_us":1434773}
I20260709 13:08:21.171737 25571 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:21.203773 25813 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:08:21.208405 25821 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.208673 25819 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.205945 25811 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.157209 25565 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.208422 25761 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.214923 25796 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:20.954018 25721 rpcz_store.cc:276] 0709 13:08:15.940362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.940506 (+   144us) service_pool.cc:224] Handling call
0709 13:08:16.730504 (+789998us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54006cd020. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26278520 00007fec26301b42 00007fec26300800 00007fec262f99fa 00007fec2b2c14c9 00007fec2483dc54 00007fec2483dbe2 00007fec2483db11 00007fec2483da8c 00007fec2483cd42
0709 13:08:16.766189 (+ 35685us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b58005495d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262570aa 00007fec262d9447 00007fec262f670a 00007fec262f776a 00007fec262f691b 00007fec2630203c 00007fec263016b3 00007fec262f99fa 00007fec2b2c14c9 00007fec2483dc54
0709 13:08:17.346634 (+580445us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b5800548fd0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262570aa 00007fec262d9447 00007fec262f670a 00007fec262f776a 00007fec262f691b 00007fec2630203c 00007fec263016b3 00007fec262f99fa 00007fec2b2c14c9 00007fec2483dc54
0709 13:08:17.359342 (+ 12708us) log.cc:844] Serialized 508 byte log entry
0709 13:08:20.803036 (+3443694us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15534,"raft.queue_time_us":16495,"raft.run_cpu_time_us":1212,"raft.run_wall_time_us":1210,"spinlock_wait_cycles":260714496,"thread_start_us":19677,"threads_started":1,"wal-append.queue_time_us":111736,"wal-append.run_cpu_time_us":2928,"wal-append.run_wall_time_us":1106786}
I20260709 13:08:21.205036 25571 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.219609 25666 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:21.221065 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.225944 22647 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:21.222222 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.223278 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.209084 25821 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.241161 25832 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.245347 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:21.246574 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:21.227819 25571 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.188726 25802 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.228045 25723 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.241561 25824 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:21.167896 25810 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:21.255766 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82464.9us
W20260709 13:08:21.261767 25806 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:21.263273 22388 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b09d79da74a54c84ab38db5f54cacc35 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
W20260709 13:08:21.263451 25808 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:21.266431 25787 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.244760 25779 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.268347 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.259153 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:21.275776 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:21.279847 25804 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:21.279989 25823 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:21.280375 25804 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.280527 25823 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.280841 25804 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.280999 25823 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.286542 22504 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:21.256837 25565 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.269464 25693 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:21.304840 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.305959 22501 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:21.289183 25732 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:21.309046 25732 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.309836 25732 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:21.313750 25821 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:21.289387 25624 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:21.303844 25787 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.325009 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.304281 25827 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:21.335011 25827 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.335585 25827 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.316223 25621 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.363247 25818 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:21.244371 25832 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.368502 25832 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:21.336629 25745 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.364084 25818 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.344446 25671 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.381997 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.381785 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61726.6us
I20260709 13:08:21.358006 25624 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.392411 25721 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:21.392827 25810 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.397317 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.362783 25621 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.398205 22505 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:08:21.406369 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47473.1us
I20260709 13:08:21.291007 25824 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.360689 25787 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.384148 25671 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.396723 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.412767 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.387193 25624 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.383345 25818 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:21.425371 25645 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:21.425910 25645 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:21.426831 25645 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.427955 25645 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.428292 25624 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.431752 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.441115 25787 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.437048 22504 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:21.445236 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.445967 22651 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:21.451335 22497 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:21.451614 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:21.442902 25624 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.463807 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:21.456355 25592 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:21.464377 25754 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.956s	user 0.014s	sys 0.001s
I20260709 13:08:21.465170 25753 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.485293 25734 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:21.485980 25734 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:21.481534 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2881) took 1369 ms (client timeout 1661 ms). Trace:
W20260709 13:08:21.494282 22580 rpcz_store.cc:269] 0709 13:08:20.111987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.112112 (+   125us) service_pool.cc:224] Handling call
0709 13:08:21.481226 (+1369114us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54003cafd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:21.481444 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546649472}
I20260709 13:08:21.466908 25592 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.468012 25843 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:21.463136 25624 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.504004 25592 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.506264 25843 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.475242 25754 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.532065 22647 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:08:21.528772 25841 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:21.487128 25734 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.553318 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.495082 25823 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.514128 25732 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.535573 25843 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.566357 25823 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:21.522162 25804 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.530604 25827 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.575496 25734 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.582893 25810 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.583149 25723 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.587862 25807 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:21.576660 25671 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.558990 25787 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:21.594162 25810 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.595952 25807 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:21.597563 25690 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.598773 25723 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:21.610097 25837 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.181s	user 0.005s	sys 0.000s
I20260709 13:08:21.611613 25640 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:21.616993 25810 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.606416 25690 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.581945 25571 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.621411 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:21.619801 25807 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.625262 25723 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.627398 25690 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.628036 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:21.631532 25575 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:21.638150 25563 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.638451 25575 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:21.639758 25575 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.631597 25646 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:21.634435 25763 consensus_queue.cc:1175] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 13:08:21.642350 23258 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.644979 25807 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.645205 25621 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.646840 22469 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:21.656064 25660 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.657162 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:21.657783 22505 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.662111 22469 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:21.668179 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.669153 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.671492 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.671967 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.672595 25690 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:21.673146 25690 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.675173 25690 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.675894 25566 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:21.676362 25566 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:21.677249 25566 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.679124 25566 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.658843 25621 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:21.663369 25702 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:21.692917 25702 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.693500 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.694181 23261 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:21.695228 25702 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.695664 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2866) took 2561 ms. Trace:
I20260709 13:08:21.695883 25809 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:21.696107 22579 rpcz_store.cc:276] 0709 13:08:19.133951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.138681 (+  4730us) service_pool.cc:224] Handling call
0709 13:08:19.139002 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.008411 (+1869409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.695407 (+686996us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540027a1d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:21.695586 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4209231232}
I20260709 13:08:21.698383 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.700181 22469 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:21.670682 25723 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:21.696499 25809 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.704001 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.705260 25690 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:21.708554 25690 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.709122 25690 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.699231 25827 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.712007 25824 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.713207 25754 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:21.699865 25804 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.725310 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.725550 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.726581 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.727536 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.728104 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.728263 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.733373 22645 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:21.733398 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.733479 22651 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:21.731094 25571 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:21.731734 25845 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:08:21.720649 25720 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:21.741024 22645 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:21.742573 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:21.739743 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:21.734282 22647 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:21.754737 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:21.756001 22505 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:21.733457 25621 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:21.735879 25732 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:21.760490 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:21.783444 25853 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:21.784400 25812 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:21.785386 25780 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.785171 25812 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.785993 25780 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:21.786478 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.818364 22652 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:21.786482 25853 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.822436 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2901) took 1192 ms. Trace:
W20260709 13:08:21.824604 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 721811us
W20260709 13:08:21.826129 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.823053 22572 rpcz_store.cc:276] 0709 13:08:20.629701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.629813 (+   112us) service_pool.cc:224] Handling call
0709 13:08:20.630110 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:20.630470 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.630500 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:20.631105 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 13:08:20.791595 (+160490us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:20.882428 (+ 90833us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.783986 (+901558us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800401320. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:08:21.817491 (+ 33505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.817736 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.817793 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:21.822051 (+  4258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.822372 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8198,"prepare.queue_time_us":98431,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2894,"raft.queue_time_us":902167,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":384,"spinlock_wait_cycles":26231552,"thread_start_us":193169,"threads_started":2,"wal-append.queue_time_us":446603}
I20260709 13:08:21.828099 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:21.828653 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:21.829406 22578 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:21.828737 22577 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:21.831928 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.834740 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:21.835035 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:21.835412 22572 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:21.835630 22578 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:21.836977 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.820456 25763 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:08:21.837899 25812 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.837922 25780 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.838594 25695 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:21.838349 25847 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:21.839423 25847 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.839814 25847 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.841281 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:21.843262 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:21.843950 22572 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.844076 22580 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:21.844063 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:21.845427 22578 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.846542 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:21.762290 25621 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.857846 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:21.862809 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:21.863548 22576 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:21.867223 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:21.842842 25723 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:21.871021 25790 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:08:21.848281 25571 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.826033 25853 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.854835 25753 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:21.877369 25809 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:21.880801 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:21.896064 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:21.897260 22577 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:21.897451 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:21.898213 22580 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.873409 25613 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:21.852113 25706 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:21.872360 25848 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:08:21.858942 25682 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:21.884550 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:21.922753 25695 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:21.958904 22576 raft_consensus.cc:1217] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 13:08:21.959473 22576 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:08:21.943498 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.963413 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.964277 22496 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:21.958459 25693 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:21.964805 25695 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.966133 25690 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.968055 25695 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.920779 25683 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.968955 25683 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.969403 23258 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:21.971800 25683 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:21.883458 25811 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:21.888505 22578 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:21.899260 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:21.881037 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:21.917798 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:21.919373 22579 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:21.883764 25659 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:21.917200 25849 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:08:21.873077 25779 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:21.881925 25781 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.980690 22648 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:21.918995 25578 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:21.881690 25834 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.920769 25850 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:08:21.918774 25694 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:21.900619 25753 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:21.884737 25571 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:21.904765 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:21.918370 25754 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:21.965694 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.976178 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:21.979174 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:22.010129 22545 connection.cc:256] RPC call timeout handler was delayed by -1.1258179150000842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:08:21.964849 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.998610 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:21.965211 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.965528 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:21.941306 25812 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.070683 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:22.066900 22545 connection.cc:256] RPC call timeout handler was delayed by -1.1042179150000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 13:08:22.071593 22505 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:22.071758 22545 connection.cc:256] RPC call timeout handler was delayed by -1.099717915000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:08:22.072141 22545 connection.cc:256] RPC call timeout handler was delayed by -1.0601179150000917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:08:22.072975 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:22.069607 22497 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
W20260709 13:08:22.068359 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 187414us
I20260709 13:08:21.989270 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.076339 22576 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:22.090297 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:22.091182 22502 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.984087 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:21.918565 25707 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:22.065141 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 160494us
I20260709 13:08:21.982951 25690 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:22.066905 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 90850.8us
I20260709 13:08:21.978443 22577 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.067131 22501 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:22.103718 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:21.983417 25815 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.971s	user 0.003s	sys 0.000s
W20260709 13:08:22.072067 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 288498us
I20260709 13:08:21.976398 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.009423 25500 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.078058 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:22.083781 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.124603 22543 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.705s (SENT) [suppressed 59 similar messages]
I20260709 13:08:21.979206 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:22.086529 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.067049 22571 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:21.965504 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:22.127311 22504 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:22.088217 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:21.989980 25811 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:21.965680 25822 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:21.941306 25706 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.976751 25682 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.094965 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:22.096092 22580 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:22.065343 22649 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:22.098459 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:22.117808 22496 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:22.136432 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:22.120653 22572 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:22.120930 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:22.129244 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54866.3us
I20260709 13:08:22.139691 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:21.972815 25592 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.066381 25754 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:22.132261 23260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 476) took 1517 ms (client timeout 1705 ms). Trace:
I20260709 13:08:22.154238 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:22.154825 23260 rpcz_store.cc:269] 0709 13:08:20.615234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.615635 (+   401us) service_pool.cc:224] Handling call
0709 13:08:22.132026 (+1516391us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400680954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:22.132197 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953066880}
I20260709 13:08:21.984022 25851 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.247s
I20260709 13:08:22.065898 25694 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.133417 22503 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:22.068926 25566 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:22.134464 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.071070 25683 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:21.989010 25843 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:21.965370 25693 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.180928 22504 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:22.090029 25800 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:21.985144 25779 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:22.147454 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49094.2us
I20260709 13:08:22.147491 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.189721 22580 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:22.089298 25812 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:22.146567 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 51734.4us
I20260709 13:08:22.151008 22502 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:22.152019 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.089002 25834 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.202490 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.203157 22647 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:22.054055 25781 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.152793 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2900) took 1524 ms. Trace:
I20260709 13:08:22.123138 25707 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.206141 22573 rpcz_store.cc:276] 0709 13:08:20.628783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.628928 (+   145us) service_pool.cc:224] Handling call
0709 13:08:20.629221 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.632097 (+  2876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.632130 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.633190 (+  1060us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.642481 (+  9291us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:20.642521 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.642586 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.843001 (+1200415us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:22.140909 (+297908us) raft_consensus.cc:1685] finished
0709 13:08:22.140930 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.152730 (+ 11800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2519,"raft.queue_time_us":3391,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":13530880,"thread_start_us":8893,"threads_started":1,"wal-append.queue_time_us":196134}
I20260709 13:08:22.208036 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:22.131582 23258 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.156486 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.132323 25680 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.181353 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.135248 25780 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.141023 25682 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.141481 25501 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.140609 25785 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.089730 25695 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:22.137526 22571 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:22.155285 25690 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:22.153697 25578 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:22.196547 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:22.196059 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.191671 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:22.195649 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.197309 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.203966 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.231716 22645 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:22.137162 25500 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:22.240489 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48938.6us
I20260709 13:08:22.212211 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.242885 22647 raft_consensus.cc:2368] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
W20260709 13:08:22.221566 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81980.8us
I20260709 13:08:22.189231 25800 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.205184 22576 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:22.232030 22578 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.232990 22580 raft_consensus.cc:2410] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:22.233845 22646 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:22.156435 25822 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.211933 22572 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 2.
I20260709 13:08:22.266127 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.267184 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.267731 22572 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:22.269552 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.268556 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:22.271206 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.244807 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:22.248788 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:22.249235 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.272523 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.273486 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.273809 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:22.274475 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.274924 22580 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:22.275486 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:22.275815 22580 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.278694 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:22.279258 22647 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.282155 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:22.231505 25501 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.289170 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.228387 25690 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.231344 25855 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:22.220782 25798 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:08:22.311076 22572 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:22.264707 25800 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.289652 23259 raft_consensus.cc:2368] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8.
I20260709 13:08:22.265983 25621 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.278317 25695 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.322854 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.228456 25680 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:22.351186 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 156175us
I20260709 13:08:22.231776 25780 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.278879 25640 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:22.331983 22578 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:22.297009 25563 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:22.306459 25690 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.324609 25861 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:22.352088 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:22.351454 22646 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:22.372895 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:22.228505 25811 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.373792 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:22.327410 22571 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:22.231431 25785 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:22.375857 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.228149 25754 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.376214 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:22.377235 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 225601us
I20260709 13:08:22.378458 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.380908 22573 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.382566 22571 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:22.383771 22571 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:22.370791 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 246150us
I20260709 13:08:22.391674 22577 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:22.394490 22573 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:22.395488 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.401443 22580 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:22.402751 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:22.396173 22646 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:22.365592 25753 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.363775 25640 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.362876 22647 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:22.324007 25847 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.373334 25861 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.380260 25827 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:22.461588 23258 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:22.380276 25650 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.471099 25650 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.471532 25650 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.381069 25740 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:22.474828 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:22.395406 25727 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.475507 22578 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.475903 25727 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.396499 25683 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:22.478046 25727 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.478516 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.479162 22498 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:22.423555 25861 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:22.417685 25640 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.332888 25855 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.442239 25805 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.443014 25860 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:22.443712 25706 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.426857 25822 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.427156 25781 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.429384 25592 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:22.433106 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.445470 25780 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.435664 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.395888 25725 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:22.444262 25707 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.431561 25843 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:22.446446 25812 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:22.427767 25859 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:22.447197 25847 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.453588 25754 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.503883 25650 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.504282 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:22.505259 22575 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:22.506335 25650 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.455034 25624 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:22.457206 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.369720 25695 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.464388 25834 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:22.410329 25621 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.422173 25753 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:22.465791 25800 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.467053 25682 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.469508 25827 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:22.378720 25571 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:22.474947 25740 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:22.477706 25683 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.439533 25680 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.437724 25693 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.501590 25855 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.485591 25824 raft_consensus.cc:2764] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:22.494326 25805 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:22.495258 25706 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.523556 25725 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:22.581902 25695 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.583488 25800 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.569460 25753 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:22.586009 25706 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.525303 25621 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.589851 25802 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:22.605276 25720 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.855s	user 0.005s	sys 0.008s
I20260709 13:08:22.584534 25725 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.605602 25827 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.628021 25753 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.609493 25740 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.673292 25706 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.678623 25861 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:22.627076 25853 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.727s	user 0.000s	sys 0.011s
I20260709 13:08:22.681463 25853 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.687767 25861 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.690546 25853 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:22.483716 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64594.8us
W20260709 13:08:22.730331 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.470001 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:22.467816 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 157111us
I20260709 13:08:22.735677 22572 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:22.737064 22544 leader_election.cc:400] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8.
I20260709 13:08:22.737562 22544 leader_election.cc:403] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.491465 22578 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:22.518815 22577 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:22.746543 22579 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:22.734315 22505 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:08:22.747206 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.749197 22469 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:22.731508 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:22.484561 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:22.769085 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.770587 22500 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.775523 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:22.776885 23259 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:22.782824 25682 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.783486 25621 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.784916 25686 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:22.786031 25686 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.788121 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:22.784670 25720 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.789103 22498 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.799899 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:22.800120 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.800815 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:22.801370 22504 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:22.801611 22496 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:22.802809 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:22.805354 25720 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:19.811491 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:22.813776 25754 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:22.814445 25754 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.814971 25754 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:22.770638 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.002s	sys 0.006s
W20260709 13:08:22.841349 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.003s	sys 0.007s
I20260709 13:08:22.845393 25686 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.846539 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:22.848968 25571 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.849826 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:22.851351 25571 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.852979 25706 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.854151 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2100) took 1127 ms. Trace:
I20260709 13:08:22.854725 22652 rpcz_store.cc:276] 0709 13:08:21.726778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.728019 (+  1241us) service_pool.cc:224] Handling call
0709 13:08:22.853671 (+1125652us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b54001c89d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:22.853926 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194402560}
I20260709 13:08:22.857088 25722 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:22.858801 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.858350 25722 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:22.859480 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.003s
W20260709 13:08:22.859918 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.000s	sys 0.004s
I20260709 13:08:22.861274 25571 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:22.861428 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 579312us
I20260709 13:08:22.862241 22543 leader_election.cc:400] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:22.869678 22543 leader_election.cc:403] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.848645 23260 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:22.835670 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:22.815408 22400 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:22.899998 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75330.8us
I20260709 13:08:22.905515 25763 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:22.909253 25811 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.909916 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:22.910411 25811 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.905663 22500 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:22.909070 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 412719us
I20260709 13:08:22.911243 23258 raft_consensus.cc:2368] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8.
I20260709 13:08:22.896178 25720 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.896412 25722 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:22.920022 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.931589 25723 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:22.931927 25621 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:22.932421 25723 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:22.933950 25723 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.934942 25686 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.935774 25686 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.936905 25727 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:22.937752 25727 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.938136 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.938275 25686 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.938908 25686 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:22.931631 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 200725us
I20260709 13:08:22.938980 22499 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:22.948586 25727 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.949445 25831 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.950639 25720 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.951407 25646 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.930285 25763 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:22.954166 25694 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.959784 25706 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8.
I20260709 13:08:22.960668 25856 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:22.909159 25868 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:22.952471 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.965881 22577 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:22.967578 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.969173 25640 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.942932 25759 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:22.974716 25785 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:22.985355 25571 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.994441 25571 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:22.994558 22400 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 6 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.985383 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:22.996294 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.981122 25807 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:22.997785 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.997239 22400 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 5 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 6 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.998656 22502 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:22.982766 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2909) took 1053 ms. Trace:
I20260709 13:08:22.981880 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:22.999429 25856 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:22.986066 25732 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.001938 25732 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.002040 25571 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:23.002528 25877 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:22.989858 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:22.997960 25807 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.000087 22400 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 3 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 4 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.006630 22501 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.993002 22498 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:22.985791 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:22.980491 22504 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:22.999275 22579 rpcz_store.cc:276] 0709 13:08:21.929115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.978802 (+ 49687us) service_pool.cc:224] Handling call
0709 13:08:22.982442 (+1003640us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003ac5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:22.982667 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426200832}
I20260709 13:08:23.008785 22500 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:23.018812 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:22.991952 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:22.987100 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:23.032590 22646 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:23.034092 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52360.2us
I20260709 13:08:23.035410 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:22.988526 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:23.006865 25759 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:23.002183 25856 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:22.987859 25831 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.049012 22497 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:23.052155 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:23.053223 22496 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:23.061584 22650 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:23.045177 25727 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:23.082433 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.083194 25727 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.085170 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:23.085487 25727 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.086047 22578 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:23.086509 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.089116 25645 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:23.090020 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 146792us
I20260709 13:08:23.091842 22544 leader_election.cc:400] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8.
I20260709 13:08:23.092186 22544 leader_election.cc:403] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:23.093338 25856 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:23.095134 25690 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.011s
I20260709 13:08:23.095288 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2008) took 1181 ms. Trace:
I20260709 13:08:23.095705 25690 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.097092 25693 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.098094 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 2335) took 1115 ms. Trace:
I20260709 13:08:23.098485 22505 rpcz_store.cc:276] 0709 13:08:21.982360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.077822 (+ 95462us) service_pool.cc:224] Handling call
0709 13:08:23.097848 (+1020026us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400016154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:23.098021 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399040896}
I20260709 13:08:23.099002 25807 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.100191 25763 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.101923 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 1999) took 1191 ms. Trace:
I20260709 13:08:23.102352 22573 rpcz_store.cc:276] 0709 13:08:21.910708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.207783 (+297075us) service_pool.cc:224] Handling call
0709 13:08:23.101533 (+893750us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003cb4d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:23.101753 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396277120}
I20260709 13:08:23.104714 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:23.105605 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101701us
I20260709 13:08:23.106564 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:23.044600 25868 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:23.106880 22649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2075) took 3973 ms (client timeout 2085 ms). Trace:
I20260709 13:08:23.042258 25686 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:23.107479 22649 rpcz_store.cc:269] 0709 13:08:19.133424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.133662 (+   238us) service_pool.cc:224] Handling call
0709 13:08:23.106483 (+3972821us) spinlock_profiling.cc:243] Waited 2.83 s on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:23.106674 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6513786752}
I20260709 13:08:23.108055 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:23.109889 25686 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.111668 25621 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:23.112128 25621 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.112509 25621 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:23.115618 25680 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:23.117599 25856 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:23.118355 25856 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.118736 25856 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.116047 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2911) took 1182 ms. Trace:
I20260709 13:08:23.119279 22574 rpcz_store.cc:276] 0709 13:08:21.929774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.517820 (+588046us) service_pool.cc:224] Handling call
0709 13:08:22.518209 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.518630 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.518681 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.519264 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.903385 (+384121us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:22.977155 (+ 73770us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.982134 (+  4979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.982231 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.076321 (+ 94090us) raft_consensus.cc:1685] finished
0709 13:08:23.076347 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.111593 (+ 35246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34237,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":1359,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":3608,"thread_start_us":82279,"threads_started":1,"wal-append.queue_time_us":99281}
W20260709 13:08:23.106642 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71433.3us
I20260709 13:08:23.137141 22499 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:23.137924 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:23.138139 25788 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.139174 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2915) took 1208 ms. Trace:
I20260709 13:08:23.138867 25788 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.140722 25694 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:23.144588 25694 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:23.145061 25694 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:23.145175 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.095732 22576 rpcz_store.cc:276] 0709 13:08:21.913303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.087908 (+174605us) service_pool.cc:224] Handling call
0709 13:08:23.094938 (+1007030us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b540027abd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:23.095101 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176267648}
I20260709 13:08:23.127300 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.147446 23259 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:23.147868 25640 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.129045 25842 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.126063 25501 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:23.132557 25740 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.148651 25842 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.149482 25740 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.131402 25827 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.040251 25720 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.082593 25831 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.131476 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:23.143504 25759 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.116632 25680 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:23.133379 25556 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:23.137193 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 151559us
I20260709 13:08:23.162547 22650 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:23.167986 22501 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:23.180431 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:23.189261 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57957.4us
I20260709 13:08:23.190562 22654 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:23.195725 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.111732 25732 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:23.139577 22572 rpcz_store.cc:276] 0709 13:08:21.930997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.737259 (+806262us) service_pool.cc:224] Handling call
0709 13:08:22.738171 (+   912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.739038 (+   867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.739076 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.740024 (+   948us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.876759 (+136735us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:22.878070 (+  1311us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.890940 (+ 12870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.891044 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.138912 (+247868us) raft_consensus.cc:1685] finished
0709 13:08:23.138933 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.139095 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68136,"prepare.queue_time_us":622,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":91192,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":10340,"thread_start_us":136148,"threads_started":1,"wal-append.queue_time_us":172124}
I20260709 13:08:23.183720 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:23.205209 25500 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:23.207124 25659 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:23.207697 25659 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:23.208195 25659 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.173979 25680 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:23.235642 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 294805us
I20260709 13:08:23.237908 22646 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:23.231949 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.270265 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:23.273036 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:23.274289 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49986.2us
I20260709 13:08:23.275592 25824 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:23.276100 25824 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:23.276561 25824 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.225312 25827 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:23.293110 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79429us
W20260709 13:08:23.306965 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 77562.2us
I20260709 13:08:23.261118 25788 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.280517 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:23.260033 25754 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:23.335692 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 118560us
I20260709 13:08:23.349417 25870 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.361526 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:23.363561 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 103176us
I20260709 13:08:23.368976 25566 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:23.369733 25566 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.370347 25566 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.365115 25557 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:08:23.377125 25861 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:23.377892 25861 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.379634 25740 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.380232 25861 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.383134 22402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 314) took 7817 ms. Trace:
I20260709 13:08:23.385210 22400 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f reported cstate change: config changed from index 5 to 6, VOTER 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) evicted, no longer has a pending config: VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129), VOTER 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131), VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:23.387292 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2904) took 1459 ms. Trace:
I20260709 13:08:23.389304 25693 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8.
I20260709 13:08:23.393770 23258 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:23.398273 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:23.399665 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:23.400051 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:23.401252 22646 raft_consensus.cc:2410] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:23.403520 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2910) took 1474 ms. Trace:
I20260709 13:08:23.404903 22653 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:23.405382 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:23.405812 25785 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:23.406424 25785 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:23.407598 25785 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:23.409811 25694 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.410310 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.410948 23256 raft_consensus.cc:1813] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Handling vote request from an unknown peer 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:23.411677 23256 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:23.412294 25694 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.412995 25811 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.417867 25578 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.418471 25578 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.388124 22400 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 4 to 5, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 5 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.422271 25690 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:23.423318 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67971.3us
I20260709 13:08:23.423789 25804 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:23.424232 25804 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:23.424646 25804 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:23.426564 25886 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:23.429315 25720 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.430397 25779 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:23.432219 22571 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.048s	user 0.010s	sys 0.010s
I20260709 13:08:23.433424 23256 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:23.361931 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:23.434409 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81140us
W20260709 13:08:23.434988 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 103563us
I20260709 13:08:23.435427 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:23.388118 25827 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:23.442878 25575 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.443413 25575 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:23.443679 23258 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:23.443853 25575 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.444463 25578 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:23.435366 25714 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:23.452926 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:23.453323 25714 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:23.454133 25779 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.454835 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:23.455802 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:23.456511 25683 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:23.458514 25683 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:23.458982 25683 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:23.450026 25754 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.451380 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2097) took 1725 ms. Trace:
I20260709 13:08:23.457113 25706 raft_consensus.cc:2764] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:23.454315 25714 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.387749 22580 rpcz_store.cc:276] 0709 13:08:21.927333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.402200 (+474867us) service_pool.cc:224] Handling call
0709 13:08:22.402541 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:22.797606 (+395065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.797676 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:22.798645 (+   969us) log.cc:844] Serialized 52 byte log entry
0709 13:08:22.891334 (+ 92689us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:22.903576 (+ 12242us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.930707 (+ 27131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.947231 (+ 16524us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.386906 (+439675us) raft_consensus.cc:1685] finished
0709 13:08:23.386928 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.387119 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6139,"prepare.queue_time_us":9600,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":120225,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":38437,"spinlock_wait_cycles":1548544,"thread_start_us":481991,"threads_started":2,"wal-append.queue_time_us":518881}
I20260709 13:08:23.353472 25842 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.461234 22653 rpcz_store.cc:276] 0709 13:08:21.725796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.725900 (+   104us) service_pool.cc:224] Handling call
0709 13:08:21.726171 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.405348 (+1679177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.451088 (+ 45740us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:23.451301 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3812503936}
I20260709 13:08:23.488989 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.506098 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.507493 23262 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:23.510968 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.514310 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.515241 23262 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:23.496755 25621 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.519764 25621 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.383656 22402 rpcz_store.cc:276] 0709 13:08:15.565494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.565743 (+   249us) service_pool.cc:224] Handling call
0709 13:08:16.047943 (+482200us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b5400002490. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d70b2 00007fec2c150a89 00007fec2c0e8da6 00007fec2c0ba088 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc
0709 13:08:16.765019 (+717076us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b5400002490. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6e9c 00007fec231d70f6 00007fec2c150a89 00007fec2c0e8da6 00007fec2c0ba088 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc
0709 13:08:23.382835 (+6617816us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:17.643508 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:17.644085 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:17.644123 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:17.644141 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:17.644525 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:17.644610 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:17.644638 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:17.645000 (+   362us) tablet.cc:701] Row locks acquired
0709 13:08:17.645022 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:17.645158 (+   136us) write_op.cc:270] Start()
0709 13:08:17.645287 (+   129us) write_op.cc:276] Timestamp: P: 1783602497645121 usec, L: 0
0709 13:08:17.645307 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:17.792926 (+147619us) log.cc:844] Serialized 930 byte log entry
0709 13:08:18.128108 (+335182us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f6e28 00007fec29d31581 00007fec29d30d58 00007fec29d359f1 00007fec29d359a9 00007fec29d35939 00007fec29d35901 00007fec29d34b2d 000000000038f354 000000000038f199
0709 13:08:18.457808 (+329700us) op_driver.cc:464] REPLICATION: finished
0709 13:08:19.182836 (+725028us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec231f10ac 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec29d31ef0
0709 13:08:19.253076 (+ 70240us) write_op.cc:301] APPLY: starting
0709 13:08:19.253161 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:19.253272 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:19.253291 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:19.259214 (+  5923us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:19.259401 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:19.259447 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:19.259649 (+   202us) log.cc:844] Serialized 29 byte log entry
0709 13:08:19.357620 (+ 97971us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:19.389530 (+ 31910us) write_op.cc:454] Released schema lock
0709 13:08:19.396469 (+  6939us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:19.452195 (+ 55726us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:19.454959 (+  2764us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18443,"reported_tablets":10,"spinlock_wait_cycles":17827328,"child_traces":[["op",{"apply.queue_time_us":791284,"apply.run_cpu_time_us":2385,"apply.run_wall_time_us":173611,"num_ops":2,"prepare.queue_time_us":102462,"prepare.run_cpu_time_us":30295,"prepare.run_wall_time_us":484792,"raft.queue_time_us":323896,"raft.run_cpu_time_us":38504,"raft.run_wall_time_us":1048123,"replication_time_us":776477,"spinlock_wait_cycles":60396544,"thread_start_us":1356282,"threads_started":4,"wal-append.queue_time_us":186709,"wal-append.run_cpu_time_us":27553,"wal-append.run_wall_time_us":2275283}]]}
I20260709 13:08:23.525655 23256 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:23.525715 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57724.3us
I20260709 13:08:23.533371 22545 leader_election.cc:400] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:08:23.404001 22575 rpcz_store.cc:276] 0709 13:08:21.929413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.506130 (+576717us) service_pool.cc:224] Handling call
0709 13:08:22.506503 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.742583 (+236080us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:22.793162 (+ 50579us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.897658 (+104496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.897718 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:22.897780 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.402055 (+504275us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b180001ebe0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:08:23.403028 (+   973us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54001e5ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:23.403082 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.403280 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11217,"prepare.queue_time_us":50548,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":154,"raft.queue_time_us":8057,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":28911,"spinlock_wait_cycles":543130752,"thread_start_us":149129,"threads_started":2}
I20260709 13:08:23.475353 25694 raft_consensus.cc:2764] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:08:23.550711 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87381.3us
I20260709 13:08:23.550117 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:23.545964 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 109313us
W20260709 13:08:23.556001 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.564987 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:23.566931 25720 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.567690 25720 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.572463 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.574083 25720 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.578315 25683 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:23.581882 25881 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:23.586490 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:23.587821 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:23.589040 25500 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:23.589210 25578 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.589609 25500 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.589766 25578 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.590204 25500 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.590284 25578 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.562382 25659 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.595813 25659 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:23.593319 22571 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:23.572050 25804 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.595899 25870 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.602753 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:23.605628 23261 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:23.612394 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.619505 23260 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:23.600775 25683 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.611534 25707 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:23.627216 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2001) took 1702 ms. Trace:
I20260709 13:08:23.602324 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.554898 25856 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.631632 23257 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.632846 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:23.655146 23255 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.633987 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:23.634732 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.634954 25621 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:23.635398 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.637317 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.638799 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.639755 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.640728 25804 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.629849 22571 rpcz_store.cc:276] 0709 13:08:21.911313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.383388 (+472075us) service_pool.cc:224] Handling call
0709 13:08:22.383660 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.597390 (+1213730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.613821 (+ 16431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:23.588665 25680 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.650636 22504 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:08:23.658833 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47488.1us
I20260709 13:08:23.660992 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.658699 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.659565 22496 raft_consensus.cc:2410] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:23.660774 23263 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:23.598112 25824 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.661422 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.671237 22505 raft_consensus.cc:2368] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4.
I20260709 13:08:23.647152 25694 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:23.678511 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.685251 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.690560 22497 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:23.691316 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.695451 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.700598 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.701560 22498 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:23.702641 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:23.709426 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.710959 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.711964 22504 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:23.660845 25763 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:08:23.709314 25779 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:23.713714 25763 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:23.714193 25763 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:23.714685 25683 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:23.715273 25763 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.715561 25683 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.718510 25680 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.718607 25683 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.719569 22500 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:23.719966 25779 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.720780 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.720708 25779 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.721858 22500 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:23.722891 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:23.723728 22500 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:08:23.723765 25779 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.726503 22575 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:23.660333 25870 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.729707 25870 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.735872 22501 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:23.739063 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.769752 22575 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:23.772755 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.773167 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.773509 22578 raft_consensus.cc:2376] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7. Re-sending same reply.
I20260709 13:08:23.773959 22577 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.774704 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.769809 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.775285 22578 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:23.778417 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:23.779253 22501 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.781665 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:23.781976 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.757779 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.785369 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.732710 25870 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.749554 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.764690 25763 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.680877 25754 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
W20260709 13:08:23.808889 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.818813 22575 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:23.742564 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.790781 22503 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:23.712797 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.817981 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:23.817713 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 60138.8us
I20260709 13:08:23.789641 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.826583 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.827342 22579 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:23.825836 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.839380 22505 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:23.844238 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:23.836799 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:23.850389 22574 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:23.841017 22576 raft_consensus.cc:2376] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7. Re-sending same reply.
I20260709 13:08:23.868070 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.882296 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.882825 22505 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:23.828927 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:23.883917 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:23.884178 22580 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.886637 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.849159 22573 raft_consensus.cc:2376] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5. Re-sending same reply.
I20260709 13:08:23.883307 22571 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:23.883239 23261 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 3.
I20260709 13:08:23.886078 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.890710 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:23.895605 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:23.897190 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:23.900408 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:23.900506 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:23.902419 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65692us
I20260709 13:08:23.835171 25575 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.836095 25827 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:23.905457 22574 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:23.910734 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:23.911346 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.911523 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:23.870208 25870 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:23.913872 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.889889 25694 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:08:23.919579 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 227170us
I20260709 13:08:23.918327 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:23.921281 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:23.922994 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.917923 25856 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.924396 22501 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:23.917378 25824 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:23.925391 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.924731 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:23.943274 22499 raft_consensus.cc:2368] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10.
I20260709 13:08:23.943729 22573 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:23.932435 22497 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:23.945109 25732 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.916847 25578 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.945614 25732 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:23.932971 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 88656.4us
I20260709 13:08:23.947078 25578 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:23.947329 22497 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:23.947613 25732 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:23.933704 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.950629 22499 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:23.926851 22580 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:23.948797 22497 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:23.928543 22578 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:23.954159 22572 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:23.955116 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:23.955330 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:23.956588 22575 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:23.957830 25796 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:23.958446 25796 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.958951 25796 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:23.934885 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.961858 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.026s	sys 0.069s
I20260709 13:08:23.922171 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:23.962210 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.026s	sys 0.069s
I20260709 13:08:23.942271 25827 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:23.925731 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:23.925978 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:23.964600 22504 raft_consensus.cc:1813] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Handling vote request from an unknown peer 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:23.965183 22504 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:23.968161 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:23.968664 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:23.969403 22500 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:23.919358 25566 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.000s
I20260709 13:08:23.970220 22496 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:23.970940 25566 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:23.978958 25842 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:23.980561 25856 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.981513 25856 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:23.984715 22505 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.918902 22545 leader_election.cc:400] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4.
I20260709 13:08:23.992743 22545 leader_election.cc:403] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:23.963469 25827 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:23.999018 22496 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:24.011117 22577 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:24.012759 25707 raft_consensus.cc:2764] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:24.015161 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:24.027333 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108613us
I20260709 13:08:23.919642 23255 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
W20260709 13:08:24.031576 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 325626us
I20260709 13:08:24.034883 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:24.033823 25740 raft_consensus.cc:2764] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:24.040275 25707 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.027244 25759 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:23.931877 25500 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.056289 22499 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:24.069900 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.070739 22571 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
W20260709 13:08:24.074120 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 106128us
I20260709 13:08:24.086534 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.092489 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.093379 22578 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:24.094470 22572 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
W20260709 13:08:24.094590 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59800.5us
I20260709 13:08:24.092679 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.098050 25621 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.098789 25621 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.105640 22575 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:24.078270 25566 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:24.112915 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.112087 22580 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:24.101061 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:24.084942 25785 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.054448 22505 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:24.093631 25856 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:24.133386 22501 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:24.151180 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:24.152026 22649 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.152676 25707 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4.
I20260709 13:08:24.153918 22576 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:24.155213 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:24.156148 22647 raft_consensus.cc:2368] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10.
I20260709 13:08:24.156790 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.157425 22579 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.160689 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.161399 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.163082 25575 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:24.163874 25500 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:24.170079 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:24.170908 22647 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:24.129653 25796 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.174463 25621 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:24.168440 22571 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:24.178462 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.179343 22577 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.181234 22572 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:24.183894 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.195374 22579 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:24.196254 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.197223 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:24.197865 22505 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:24.198526 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47851.9us
I20260709 13:08:24.199340 22545 leader_election.cc:400] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:08:24.199651 22545 leader_election.cc:403] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:24.200138 22497 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:24.201828 22580 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:24.085389 25827 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.207116 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:24.208355 22499 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:24.203912 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:24.217326 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.229645 25707 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:08:24.229933 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:24.230955 22502 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:24.232223 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.233719 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.243399 22649 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:24.194144 25796 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:24.245074 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:24.257810 22503 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:24.233749 25896 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:08:24.282699 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.283390 22652 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:24.283030 22505 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:24.281749 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.285980 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:24.287612 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:24.288239 22504 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.281062 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.283792 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:24.289827 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:24.290849 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.295141 25732 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:24.244836 25500 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:08:24.302708 25732 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.303294 25732 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:24.304440 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56049.2us
I20260709 13:08:24.305629 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.258980 25694 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:24.306406 22578 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:24.294124 23258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.057s	sys 0.063s
I20260709 13:08:24.248332 25904 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:08:24.295435 25566 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.260138 25575 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:24.326025 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.295437 25759 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:24.259415 25788 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:24.346797 22577 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
W20260709 13:08:24.311831 23258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.057s	sys 0.064s
W20260709 13:08:24.332087 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 464096us
I20260709 13:08:24.342104 22576 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.309784 25785 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:24.322561 25714 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:24.343084 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 313256us
I20260709 13:08:24.330111 22571 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:08:24.352478 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 120352us
I20260709 13:08:24.377560 22578 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:24.364025 22504 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:24.355921 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:24.380712 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.325204 25796 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:24.393401 25557 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:24.364693 25575 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:08:24.393849 25557 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:24.403652 22647 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:24.405198 22503 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:24.402468 25557 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:24.409402 25905 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:08:24.343585 25759 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.410346 25759 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.412627 25557 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:24.347764 25566 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.419649 25566 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:24.426365 22576 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:24.427348 25714 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:24.348853 25904 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.429169 25904 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.431982 25904 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:24.385703 25902 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:24.386196 25785 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.387590 25592 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:24.388132 22545 leader_election.cc:400] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10.
I20260709 13:08:24.388226 25500 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:24.444643 22545 leader_election.cc:403] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:24.389065 25694 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:24.390194 25827 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:24.438563 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.432677 25904 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:24.445111 25500 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:24.450348 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62396.2us
I20260709 13:08:24.451983 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:24.449143 25754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.022s	sys 0.043s
W20260709 13:08:24.448639 25763 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.003s
I20260709 13:08:24.460892 25870 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:24.449365 25904 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.467453 25870 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.468171 25870 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:24.475711 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.453259 25707 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10.
I20260709 13:08:24.469399 22654 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:24.482239 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:24.454407 25592 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:24.455197 25906 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:24.457334 25754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.023s	sys 0.044s
I20260709 13:08:24.468756 25904 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:24.550386 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68287.9us
I20260709 13:08:24.551677 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:24.552927 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1225758460000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 13:08:24.509925 25621 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:24.548077 25914 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:24.562917 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 264274us
W20260709 13:08:24.567260 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0577758460000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:08:24.567531 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.569756 25785 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:24.560319 25707 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:08:24.571383 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:24.566042 25621 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.577195 25908 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:24.552699 25500 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:24.590451 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 203296us
I20260709 13:08:24.603149 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:24.592063 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:24.547683 25906 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.597376 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:24.586993 25916 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:24.604045 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 145537us
I20260709 13:08:24.611089 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:24.611459 22545 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.612013 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:24.612957 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.616974 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.619006 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:24.625398 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.605754 25785 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.637982 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:24.626305 22578 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:24.609341 25566 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:24.628008 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.650171 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.648739 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.603698 25763 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:24.660141 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.616418 25788 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:24.660930 22650 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:24.661017 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.603283 25907 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:24.665426 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.666339 22646 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:24.669911 25917 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:08:24.671645 25906 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:24.672443 25500 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.673743 22645 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:24.674889 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:24.662304 25922 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:24.676015 25707 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:24.677151 22577 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:24.679457 25659 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:24.679981 25659 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.681839 25759 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.684137 25759 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:24.664270 25785 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.687778 25785 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:24.688365 25785 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:24.689025 25566 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.690146 25566 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.692148 25763 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:24.663861 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:24.694056 23257 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:24.667755 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:24.666061 22571 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:24.709029 25754 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:24.709385 25911 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:08:24.709957 25922 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.711024 25922 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.711781 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 397) took 1213 ms. Trace:
W20260709 13:08:24.714995 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 103058us
I20260709 13:08:24.715282 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.718050 22571 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.663546 22578 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:24.721266 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:24.726128 22503 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:24.692795 25763 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.614442 25908 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.733451 25754 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:24.738708 25754 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.736829 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:24.731844 23259 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:24.619485 25592 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.665184 25919 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:24.718258 25788 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:24.764343 22571 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:24.743309 25759 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:08:24.748594 25908 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:24.729840 25926 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:24.749222 25575 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:24.731726 25659 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.737197 25763 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.758869 25732 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.742296 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:24.772135 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 159480us
I20260709 13:08:24.712342 23258 rpcz_store.cc:276] 0709 13:08:23.499206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.499595 (+   389us) service_pool.cc:224] Handling call
0709 13:08:23.500100 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.500784 (+   684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.501555 (+   771us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.502611 (+  1056us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.919796 (+417185us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec231f10ac 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b
0709 13:08:24.383940 (+464144us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:24.384337 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.384571 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.384665 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:24.711356 (+326691us) raft_consensus.cc:1685] finished
0709 13:08:24.711475 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.711681 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4446,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":4691,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":246,"spinlock_wait_cycles":79402880,"thread_start_us":850464,"threads_started":1,"wal-append.queue_time_us":954928}
W20260709 13:08:24.796133 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.760172 25707 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:24.767158 25919 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:24.807088 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 123467us
W20260709 13:08:24.816139 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73915.4us
I20260709 13:08:24.823696 22571 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:24.806300 25919 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.810982 25785 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:24.833184 25934 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:24.833455 25933 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.838702 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.841517 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.815001 25575 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.846366 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.850301 22571 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:24.851454 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.851894 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.852732 22575 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:24.853767 25941 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.855508 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:24.856184 22504 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:24.856390 25732 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:24.857162 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.857363 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.858150 22580 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:24.857606 25575 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.855508 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:24.859606 23257 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:24.860803 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:24.863535 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.855691 22578 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:24.864843 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.850078 25788 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.867393 22575 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:24.867602 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.868194 22578 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.872388 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:24.876034 22577 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:24.839226 25659 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:24.838691 25621 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:24.838227 25646 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.881820 22468 leader_election.cc:400] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10.
I20260709 13:08:24.883432 22468 leader_election.cc:403] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:24.854568 25941 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.887784 22575 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:24.845289 25931 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:24.889775 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:24.891844 22577 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:24.848624 25933 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.902848 22578 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
W20260709 13:08:24.903918 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78804.6us
I20260709 13:08:24.891158 25926 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:24.925022 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:24.884900 25907 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:24.880849 25870 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.842235 25785 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.906854 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:24.830184 25754 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.931133 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.948060 22647 raft_consensus.cc:2368] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8.
I20260709 13:08:24.932518 22577 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:24.939944 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.931576 25931 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.932726 25940 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:24.906240 25732 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:24.957392 22574 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:24.906742 25646 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:24.962141 25646 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:24.908661 25908 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:24.964833 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:24.963804 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 120501us
I20260709 13:08:24.924016 25922 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:24.970846 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.971685 22647 raft_consensus.cc:1813] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Handling vote request from an unknown peer 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:24.972476 22647 raft_consensus.cc:2410] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:24.936326 25907 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:24.973835 25926 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:24.981451 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:24.982439 25929 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:08:24.982873 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:24.982935 23227 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:24.981563 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:24.985443 22647 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:24.984019 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:24.935866 25906 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:08:25.032723 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:24.956889 25942 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10.
I20260709 13:08:24.959281 25621 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.034394 22654 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:24.983971 25933 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:24.931164 25930 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:25.034821 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:25.052035 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 68075.6us
I20260709 13:08:25.047155 25796 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:25.048477 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 59307.7us
I20260709 13:08:25.058218 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.058879 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:25.059197 22647 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:25.048228 25740 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:24.997814 25578 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:24.942413 25945 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:08:24.984187 25948 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:25.065022 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 125663us
W20260709 13:08:25.070936 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 164193us
I20260709 13:08:25.080451 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:24.983999 25763 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.081714 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:25.081218 22497 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:25.048359 25556 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:25.061601 25796 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:25.090607 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:25.085449 22505 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:25.102367 22498 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.085664 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.065667 25948 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.087857 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:25.104030 22499 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.087507 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.101440 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:25.106391 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.106680 22496 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:25.050961 25621 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:25.080798 25942 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:25.110339 22577 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:25.077628 25578 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:25.111768 22502 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:25.113433 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:25.089540 25732 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:24.985378 25940 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.119581 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.085271 25740 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:25.107285 25796 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.147150 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.130774 25912 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:08:25.133111 25947 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:25.136757 25802 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:25.137521 25943 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:25.218175 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.138151 25578 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.153244 25942 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:25.128851 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.053231 25907 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:25.159749 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46396.7us
I20260709 13:08:25.162576 25732 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:25.167811 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.108049 25955 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:25.125413 25909 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.518s	user 0.003s	sys 0.003s
I20260709 13:08:25.235877 22505 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:25.166762 22502 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:25.164526 25952 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:25.166828 25946 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:25.149932 25945 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:25.127246 25944 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.108357 25948 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:25.247315 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 192465us
I20260709 13:08:25.174222 25947 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.174455 25802 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.251396 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.235550 25714 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.217669 25943 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:25.232228 25942 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:25.160960 25740 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.284458 22498 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:25.240701 25952 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.246023 25907 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.290410 22654 raft_consensus.cc:2410] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:25.297133 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:25.273366 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 406693us
W20260709 13:08:25.298623 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.299052 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.250393 25955 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:25.268779 25947 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.272388 25802 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.320454 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.321676 22646 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
W20260709 13:08:25.313350 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 254552us
I20260709 13:08:25.114760 25931 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.277238 25785 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:25.287606 25941 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.295881 25952 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.334240 22647 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:25.358184 22571 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:25.288566 25942 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.300511 25906 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.354808 25842 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:25.335091 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.364995 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.393338 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.395478 22646 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
W20260709 13:08:25.402230 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 190640us
I20260709 13:08:25.275563 25945 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.303815 25714 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:25.413882 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.419595 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.415292 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.420800 22646 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
W20260709 13:08:25.417294 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 168972us
I20260709 13:08:25.422737 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:25.276011 25944 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.427639 22468 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:25.399472 25943 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.388728 25908 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:08:25.411650 25763 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:25.462755 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.456939 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.457330 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:25.460230 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.388092 25906 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.465022 22646 raft_consensus.cc:2368] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10.
W20260709 13:08:25.459985 22543 leader_election.cc:336] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.705s (SENT)
I20260709 13:08:25.360461 25732 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.472730 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:25.471855 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.474208 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.476146 25962 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:25.477108 25740 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.399201 25957 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:08:25.456820 25621 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:25.470638 25943 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.503259 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.506259 22646 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:25.492211 25707 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.499954 25940 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:25.523324 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63368.1us
W20260709 13:08:25.518168 25949 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:08:25.553179 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.533358 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.534349 25975 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:25.492079 25955 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.487784 25976 raft_consensus.cc:2764] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:25.543422 22499 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:25.570585 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:25.556118 22647 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:25.568252 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.505884 25621 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.571310 22502 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.506124 25962 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:25.574229 22650 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:25.576534 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.574786 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:25.577507 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 150034us
I20260709 13:08:25.578569 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:25.578272 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 143884us
W20260709 13:08:25.517203 25694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.009s	sys 0.010s
W20260709 13:08:25.585310 25694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.010s	sys 0.010s
I20260709 13:08:25.597383 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.585719 25870 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.605895 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.612771 22650 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:25.605885 25945 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:25.607197 25944 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:25.607725 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:25.608502 25962 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:25.609292 25977 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:25.619210 22505 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:25.573658 25975 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.594866 25959 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:25.601769 25694 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:25.631264 25714 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:25.635598 23255 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:25.636391 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 407) took 1028 ms. Trace:
W20260709 13:08:25.639835 25659 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.002s
I20260709 13:08:25.640559 22646 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:25.641466 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.643465 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 499) took 1072 ms. Trace:
I20260709 13:08:25.643919 23259 rpcz_store.cc:276] 0709 13:08:24.570923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.571083 (+   160us) service_pool.cc:224] Handling call
0709 13:08:25.643246 (+1072163us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b5400834d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:25.643386 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123437824}
I20260709 13:08:25.623867 25982 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:25.645503 25919 consensus_meta.cc:287] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.799s	user 0.006s	sys 0.005s
I20260709 13:08:25.645948 25919 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.611979 25976 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.642673 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.642652 25952 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.649322 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.657776 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:25.654563 23256 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:25.660207 25975 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:25.661027 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53394.1us
I20260709 13:08:25.661237 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.662653 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:25.659328 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45197.7us
I20260709 13:08:25.664634 22648 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:25.673022 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.673687 22647 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
W20260709 13:08:25.662534 25796 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.512s	user 0.002s	sys 0.008s
I20260709 13:08:25.656302 25933 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:25.679273 25978 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:25.681322 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.655557 25976 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.636744 23255 rpcz_store.cc:276] 0709 13:08:24.608167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.615713 (+  7546us) service_pool.cc:224] Handling call
0709 13:08:25.635165 (+1019452us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:25.635383 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.636104 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.636329 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120901376}
I20260709 13:08:25.682757 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.665330 25957 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.687248 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:25.671219 25870 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:25.677157 25975 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:25.709254 25975 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:25.709745 25975 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.714417 22502 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:25.718613 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.719913 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.719731 25948 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.720732 25694 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.724273 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.725479 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.726048 22652 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.730562 25802 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.736263 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:25.690827 22647 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:08:25.678229 25796 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.698765 25957 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.675462 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:25.741720 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 79174.1us
W20260709 13:08:25.744881 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.738313 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.746948 22646 raft_consensus.cc:2376] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6. Re-sending same reply.
I20260709 13:08:25.752046 22654 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:25.690032 25933 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.716570 25906 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:25.765738 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.766388 22647 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:25.725335 25948 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:25.771528 22505 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:25.778919 22647 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:25.773819 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 86645.8us
I20260709 13:08:25.772424 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:25.794363 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:25.761672 25944 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:25.800418 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:25.803756 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:25.770610 25983 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:25.765117 25968 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:25.802073 25785 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.797854 25557 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.780746 25802 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.755856 25947 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.797751 23257 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.807991 22543 leader_election.cc:400] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10.
I20260709 13:08:25.801285 25940 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.819700 22652 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:25.802736 25870 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:25.807435 25963 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:25.813305 25983 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:25.830870 22577 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:25.833071 25963 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:25.832001 25940 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.845461 25963 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.845360 25870 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:25.851958 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2941) took 1546 ms. Trace:
I20260709 13:08:25.833906 25919 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:25.822028 25557 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.854836 25952 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:25.855486 25983 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:25.856253 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2271) took 1045 ms. Trace:
I20260709 13:08:25.856667 22649 rpcz_store.cc:276] 0709 13:08:24.811280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.864555 (+ 53275us) service_pool.cc:224] Handling call
0709 13:08:25.856002 (+991447us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b540017f2d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:25.856166 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097373568}
I20260709 13:08:25.857658 25870 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.858170 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:25.858789 22649 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.808575 25941 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:08:25.862599 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.857969 25933 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.871017 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.852558 22572 rpcz_store.cc:276] 0709 13:08:24.305581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.312519 (+  6938us) service_pool.cc:224] Handling call
0709 13:08:24.330982 (+ 18463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.455844 (+124862us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:24.609866 (+154022us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.136617 (+526751us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b180039b7a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:08:25.723478 (+586861us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180039b7a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a
0709 13:08:25.770559 (+ 47081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.770641 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:25.770703 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.851098 (+ 80395us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b180039b7a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:08:25.851619 (+   521us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003ee9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:25.851661 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.851863 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31775,"prepare.queue_time_us":283274,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6531,"raft.queue_time_us":36387,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6080,"spinlock_wait_cycles":340817024,"thread_start_us":283252,"threads_started":2,"wal-append.queue_time_us":209033}
W20260709 13:08:25.872689 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 65798.7us
I20260709 13:08:25.874070 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:25.871745 22500 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:25.877619 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 410) took 1266 ms. Trace:
I20260709 13:08:25.886794 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2124) took 1035 ms. Trace:
I20260709 13:08:25.886873 23256 rpcz_store.cc:276] 0709 13:08:24.609139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.610709 (+  1570us) service_pool.cc:224] Handling call
0709 13:08:25.648930 (+1038221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.659953 (+ 11023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.844973 (+185020us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400834d50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:25.875704 (+ 30731us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136854784}
I20260709 13:08:25.888000 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 2945) took 1064 ms. Trace:
I20260709 13:08:25.887563 25557 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.880448 25976 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.877933 25942 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.889961 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:25.820631 25968 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:25.881255 25947 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.882651 25904 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.891481 25942 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:25.879158 25957 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:25.877455 25986 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:08:25.893990 25802 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:25.894340 25802 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:25.896704 25557 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:25.898054 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:25.895208 25802 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:25.879866 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.899333 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:25.900314 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:25.901652 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:25.902029 25962 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:25.902756 25981 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:25.884739 25940 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.903679 25962 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:25.903352 25981 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:25.888656 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.888402 22574 rpcz_store.cc:276] 0709 13:08:24.823305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.823465 (+   160us) service_pool.cc:224] Handling call
0709 13:08:25.887791 (+1064326us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000e6354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:25.887915 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268873984}
I20260709 13:08:25.905735 25981 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.907521 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.908166 22501 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:25.904430 25932 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.902410 25982 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:08:25.909880 25932 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:25.890583 22497 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.910393 25932 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.912664 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.881012 25952 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:25.914142 25952 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.915138 25932 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:25.916389 25952 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:25.890597 25796 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.892462 25968 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:25.917555 25936 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:25.942344 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:25.887328 22648 rpcz_store.cc:276] 0709 13:08:24.851623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.975645 (+124022us) service_pool.cc:224] Handling call
0709 13:08:25.886592 (+910947us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54001c7ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:25.886728 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407606528}
I20260709 13:08:25.909312 25566 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.943943 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:25.918555 25707 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.919143 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.919354 25975 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.877079 22544 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:25.879535 25990 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:25.921976 25802 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.922364 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.923162 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:25.924274 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.925184 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:25.961560 23255 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:25.962755 25919 raft_consensus.cc:2764] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:25.963307 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:25.963965 25919 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.926314 22497 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:25.964960 25578 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:25.965591 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.966718 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:25.966985 22497 pending_rounds.cc:85] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 5
I20260709 13:08:25.967298 22497 pending_rounds.cc:107] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:08:25.967383 22496 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:25.967628 22497 raft_consensus.cc:2889] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:25.884670 22649 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:25.968636 22496 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:25.961570 23260 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:25.964761 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:25.926816 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.928851 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54462.8us
W20260709 13:08:25.929701 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54341.7us
I20260709 13:08:25.902486 25983 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.935956 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:25.971830 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:25.934916 25933 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:08:25.943342 25926 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:25.975524 25926 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:25.976192 25983 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.977689 25926 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:25.978320 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:25.978730 23257 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:25.978938 23256 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.979168 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.979825 23260 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
W20260709 13:08:25.981400 25989 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:08:25.940615 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:25.914418 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:25.942991 22577 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.989092 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:25.955322 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 78290.1us
I20260709 13:08:25.906003 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.958964 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:25.959152 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:25.959468 25947 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:25.994922 25947 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:25.995334 25947 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:25.997257 25948 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:25.959798 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:26.000284 22573 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.001230 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:26.001858 22498 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.960026 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:25.965479 25920 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:25.912807 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:25.973101 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:26.014954 22649 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:25.967097 25945 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:25.974781 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:26.016232 22648 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.969434 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:25.985942 22654 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:25.987003 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:25.991618 22575 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:25.993276 22500 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:25.991073 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:25.988538 25930 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:26.010664 22577 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:26.005057 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:25.933771 25694 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:08:25.966755 25578 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.043452 22501 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:25.993464 25557 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:25.950045 25952 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:08:26.028728 25968 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.029260 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.040354 22498 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:26.020934 25941 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:26.051608 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46695.5us
I20260709 13:08:26.053361 22573 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:26.025552 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.060515 22577 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
W20260709 13:08:26.057368 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88011.4us
W20260709 13:08:26.057557 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 68546.7us
W20260709 13:08:26.057915 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 65321.7us
I20260709 13:08:26.062773 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.065510 22400 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 189) took 8492 ms. Trace:
W20260709 13:08:26.065728 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 74133us
I20260709 13:08:26.068032 22566 tablet_service.cc:1558] Processing DeleteTablet for tablet be7264d3053b44989c5504d296ea482b with delete_type TABLET_DATA_TOMBSTONED (TS 691cccbd0258483ebe19e1581674cc94 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41926
I20260709 13:08:26.070183 25802 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:26.072896 25707 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.078193 22544 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.079599 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.055336 22575 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:26.082037 25940 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.083076 25975 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:26.083137 25940 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.087383 25947 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:26.088647 22576 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:26.089932 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:26.090165 25944 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:26.090698 25944 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:26.091573 25944 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:26.087393 26001 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:08:26.042147 25948 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:26.094228 25948 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.094233 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.094700 25948 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:26.095103 22577 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:26.096149 25999 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.155s	user 0.003s	sys 0.000s
I20260709 13:08:26.097615 25927 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:26.050570 25557 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.050504 25659 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.099776 25557 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:26.100111 25659 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.102273 25659 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:26.102922 25940 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:26.103401 25940 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:26.051530 25796 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.109225 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49533.7us
W20260709 13:08:26.112268 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62358.4us
I20260709 13:08:26.113370 22572 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:26.107719 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45045us
I20260709 13:08:26.119227 25575 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:26.104931 25796 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.131435 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:26.066039 22400 rpcz_store.cc:276] 0709 13:08:17.573286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.573723 (+   437us) service_pool.cc:224] Handling call
0709 13:08:26.065416 (+8491693us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:24.257738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:24.391516 (+133778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:24.391647 (+   131us) write_op.cc:435] Acquired schema lock
0709 13:08:24.391665 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:24.392530 (+   865us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:24.392632 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:24.392665 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:24.393755 (+  1090us) tablet.cc:701] Row locks acquired
0709 13:08:24.393806 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:08:24.393967 (+   161us) write_op.cc:270] Start()
0709 13:08:24.394113 (+   146us) write_op.cc:276] Timestamp: P: 1783602504393905 usec, L: 0
0709 13:08:24.394151 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:08:24.394859 (+   708us) log.cc:844] Serialized 2470 byte log entry
0709 13:08:24.783687 (+388828us) op_driver.cc:464] REPLICATION: finished
0709 13:08:24.816908 (+ 33221us) write_op.cc:301] APPLY: starting
0709 13:08:24.836161 (+ 19253us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:24.886730 (+ 50569us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:24.924573 (+ 37843us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.130207 (+205634us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.130748 (+   541us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:08:25.130837 (+    89us) write_op.cc:312] APPLY: finished
0709 13:08:25.131277 (+   440us) log.cc:844] Serialized 53 byte log entry
0709 13:08:25.131509 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.131647 (+   138us) write_op.cc:454] Released schema lock
0709 13:08:25.131835 (+   188us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.639731 (+507896us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003f0b80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec29d31ef0 00007fec29d32489 00007fec29d3471a
0709 13:08:25.639850 (+   119us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.639878 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1804375,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":9306,"apply.run_cpu_time_us":5418,"apply.run_wall_time_us":322170,"num_ops":6,"prepare.queue_time_us":492434,"prepare.run_cpu_time_us":31729,"prepare.run_wall_time_us":465813,"raft.queue_time_us":88365,"raft.run_cpu_time_us":12067,"raft.run_wall_time_us":856993,"replication_time_us":389318,"spinlock_wait_cycles":25691776,"thread_start_us":723494,"threads_started":4,"wal-append.queue_time_us":297046}]]}
I20260709 13:08:26.125941 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.134438 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:26.135572 22501 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:26.136962 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:26.138082 22648 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:26.059412 25941 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.140586 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:26.142356 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:26.142741 22572 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:26.105208 25694 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:26.150900 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:26.056416 25963 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.153934 22496 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:26.162405 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.119325 25802 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:26.155696 22504 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:26.171058 22543 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.146499 25941 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:26.179504 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 266781us
I20260709 13:08:26.180182 22578 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:26.180393 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.104281 25940 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.174391 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.151973 25945 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:26.186514 25945 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:26.185745 25796 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:26.185510 25802 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.187075 25945 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:26.194507 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:26.195911 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83571.5us
I20260709 13:08:26.198251 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:26.177956 25707 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:26.211135 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.188109 25968 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.214072 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:26.217630 22543 leader_election.cc:400] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 4. Current term is 5.
I20260709 13:08:26.219497 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.187155 25963 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:26.210256 25940 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:26.230435 22543 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.213222 25926 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.223628 25694 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.215679 25707 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:26.239465 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57480.6us
I20260709 13:08:26.267113 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:26.281009 25981 raft_consensus.cc:2764] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:08:26.284526 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:26.236771 25955 raft_consensus.cc:2764] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:08:26.300479 22572 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:26.263092 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:26.305308 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:26.306594 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 187663us
I20260709 13:08:26.307590 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.308164 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:26.309206 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.311215 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.277921 25933 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:26.269846 25707 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.277273 25785 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:26.316766 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:26.270833 25947 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:26.320794 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:26.374842 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56622us
I20260709 13:08:26.270944 25952 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:08:26.407368 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 90736.4us
I20260709 13:08:26.410588 22401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 321) took 7715 ms. Trace:
W20260709 13:08:26.414523 26002 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.475s	user 0.002s	sys 0.000s
I20260709 13:08:26.313190 25957 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:08:26.406728 25785 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:26.372828 26004 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:26.424566 25556 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.427465 23256 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:26.304805 25796 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:26.373132 25981 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.406071 25575 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:26.430706 26009 tablet_replica.cc:333] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:08:26.434196 25920 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.435662 25659 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.410367 23257 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:08:26.439467 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 118815us
I20260709 13:08:26.439989 22653 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:26.483328 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:26.441584 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.438784 22401 rpcz_store.cc:276] 0709 13:08:18.463965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.464124 (+   159us) service_pool.cc:224] Handling call
0709 13:08:19.664305 (+1200181us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:08:26.174306 (+6510001us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3239901,"reported_tablets":4,"spinlock_wait_cycles":2166618496}
W20260709 13:08:26.408202 26003 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:08:26.456027 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 186013us
I20260709 13:08:26.432416 25578 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:08:26.372519 25842 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 13:08:26.407033 25975 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:26.320253 25942 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
W20260709 13:08:26.506404 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 101160us
W20260709 13:08:26.471807 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 207163us
I20260709 13:08:26.477653 25785 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.471011 25557 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.470450 25919 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:26.489677 26013 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:26.493127 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:26.520215 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:26.493502 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:26.473059 25575 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:26.510685 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:26.488780 25968 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:26.467700 25556 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.488281 25592 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:26.526365 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:26.527612 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:26.528247 22654 raft_consensus.cc:2376] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6. Re-sending same reply.
I20260709 13:08:26.530169 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:26.530419 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:26.530977 25575 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:26.532684 26015 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:26.533211 26015 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:26.533597 26015 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:26.533941 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:26.534994 25920 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:26.535414 26013 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:26.535117 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.536454 26013 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:26.537436 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44023.1us
I20260709 13:08:26.537639 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.538929 25942 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.539189 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:26.539541 25942 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.540287 25942 raft_consensus.cc:2764] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:08:26.540350 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:26.540721 25714 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:26.541966 25714 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:26.542344 25556 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:26.542399 25714 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:26.496345 25947 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:26.542846 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:26.543553 25714 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.494933 25948 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.531049 22646 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:26.547283 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:26.564328 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:26.535470 25920 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:26.526141 25968 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:26.550320 25955 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:26.621861 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.623633 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:26.557044 25975 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:26.645884 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 103099us
I20260709 13:08:26.558538 25919 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:26.648849 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:26.560381 25732 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:26.562819 25659 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.557789 25959 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:26.537776 25941 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:26.692974 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 184994us
W20260709 13:08:26.695075 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 71531us
W20260709 13:08:26.723070 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.691843 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:26.556617 25981 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:08:26.612814 25920 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.594087 25967 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:26.612190 25968 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:26.647604 25870 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.556918 26019 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 13:08:26.691512 25975 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.714207 25944 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.558199 26021 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.177s
I20260709 13:08:26.715051 25732 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:26.612584 25945 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.750391 22575 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:26.741638 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:26.717582 25959 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:26.733503 25955 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:26.749842 25975 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.801719 25948 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:26.802304 25945 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:26.802806 22580 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:26.805017 25796 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:26.768850 25959 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:26.806103 26025 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.797688 25919 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:26.769263 26008 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:08:26.819466 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.726683 25659 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:26.918829 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.919054 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.919818 22572 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:26.943552 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:26.946063 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:26.904779 25926 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.940385 25557 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:26.949582 22576 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:08:26.949141 25732 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:26.950469 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:26.954941 26000 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.770s	user 0.003s	sys 0.011s
W20260709 13:08:26.956110 26022 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 13:08:26.957123 25941 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:26.958949 26026 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:08:26.911024 26025 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:26.966382 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 555) took 1038 ms. Trace:
I20260709 13:08:26.967582 25659 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:26.932106 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.010871 22571 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:26.920783 25942 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.101939 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.103436 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:27.155682 22645 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:08:27.106549 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.157557 25981 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:27.158335 25981 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:27.107884 22653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 619) took 2461 ms (client timeout 2104 ms). Trace:
W20260709 13:08:27.161607 22653 rpcz_store.cc:269] 0709 13:08:24.646241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.646572 (+   331us) service_pool.cc:224] Handling call
0709 13:08:27.107601 (+2461029us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400412154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:27.107786 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3327793920}
I20260709 13:08:27.011155 25926 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:26.966445 25707 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:08:27.164211 25707 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.167049 25707 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.119133 25732 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:27.120131 22578 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:08:27.121810 22576 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:27.121235 22500 rpcz_store.cc:276] 0709 13:08:25.928381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.023652 (+ 95271us) service_pool.cc:224] Handling call
0709 13:08:26.046165 (+ 22513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.053106 (+  6941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.053143 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.053751 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.175114 (+121363us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:26.175362 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.175800 (+   438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.966068 (+790268us) raft_consensus.cc:1685] finished
0709 13:08:26.966100 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.966297 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8176,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":16033,"thread_start_us":119738,"threads_started":1,"wal-append.queue_time_us":229278}
I20260709 13:08:26.812577 25955 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:27.178027 22498 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:27.180383 25981 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.180698 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:27.182708 22502 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:27.184016 22503 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:27.185030 22505 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:27.177963 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:27.263782 22499 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:27.277009 22499 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:26.980336 25968 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.263572 25914 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.120522 25945 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:27.151949 25927 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.152248 25557 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:27.272784 25931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.087s	sys 0.139s
W20260709 13:08:27.291837 25931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.087s	sys 0.140s
I20260709 13:08:27.292498 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:27.281020 22499 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.295557 22499 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:27.306568 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:27.190156 25942 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.308617 22499 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:27.294076 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:27.312112 22500 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:27.309412 25975 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
W20260709 13:08:27.312335 25930 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.018s	sys 0.036s
I20260709 13:08:27.351578 22500 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:27.297019 25927 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.299778 25557 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.305920 25945 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:27.352512 25930 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.019s	sys 0.037s
I20260709 13:08:27.301059 25931 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:08:27.382576 26020 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.334995 25975 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.361301 25933 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:27.385924 26027 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 13:08:27.392313 25933 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:27.400810 25940 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.163s	user 0.009s	sys 0.002s
I20260709 13:08:27.390534 26020 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.359412 25955 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.401180 22504 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:27.391036 26009 raft_consensus.cc:2243] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.389747 26037 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.407500 22645 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:27.408633 25927 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:27.418617 26035 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:08:27.291123 25914 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.410049 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.421537 22578 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:27.422446 22579 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:27.401837 25926 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.402817 25694 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.406025 25941 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.430186 25557 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:27.430958 25945 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.431448 25968 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:27.431862 26031 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:08:27.432529 25942 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.448010 26025 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:27.456626 26009 raft_consensus.cc:2272] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:27.457711 25959 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:08:27.458298 25959 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:27.459410 25920 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.000s
I20260709 13:08:27.461998 25914 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:27.462812 26015 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.929s	user 0.012s	sys 0.000s
I20260709 13:08:27.463557 22577 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:27.459892 25920 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:27.456629 26039 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:27.453961 25941 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.444667 25694 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.475898 22648 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:27.423413 26037 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.485107 25968 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:27.496143 25968 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.498373 22571 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:27.498620 25968 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.465565 26015 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.499547 26020 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:27.504105 26040 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:08:27.473073 25959 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.506178 22576 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:27.508929 22576 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:27.500690 26015 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:27.486853 25941 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.488134 26025 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:27.511922 26025 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.514670 26025 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.521733 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:27.488997 25694 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:27.538302 22618 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.132:42571 timed out after 1.595s (SENT) [suppressed 21 similar messages]
I20260709 13:08:27.544499 26037 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:27.546061 25920 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:27.542002 25694 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:27.562002 25694 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:27.567801 25785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.014s	sys 0.017s
W20260709 13:08:27.568219 25785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.014s	sys 0.017s
I20260709 13:08:27.568989 25694 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.570205 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 536) took 1488 ms. Trace:
I20260709 13:08:27.570713 22575 rpcz_store.cc:276] 0709 13:08:26.083536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.083666 (+   130us) service_pool.cc:224] Handling call
0709 13:08:26.084003 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.767051 (+683048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.569862 (+802811us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54003c96d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:27.570108 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531514240}
I20260709 13:08:27.575865 25933 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:27.578758 26010 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.113s	user 0.000s	sys 0.030s
I20260709 13:08:27.586072 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 539) took 1480 ms. Trace:
I20260709 13:08:27.586624 22573 rpcz_store.cc:276] 0709 13:08:26.105555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.105694 (+   139us) service_pool.cc:224] Handling call
0709 13:08:26.106482 (+   788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.121141 (+ 14659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.121385 (+   244us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.127482 (+  6097us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.264117 (+136635us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:26.264155 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.264220 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.578036 (+1313816us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:27.581018 (+  2982us) raft_consensus.cc:1685] finished
0709 13:08:27.581048 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.585961 (+  4913us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4313,"raft.queue_time_us":2925,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":19070,"spinlock_wait_cycles":4729088,"thread_start_us":136222,"threads_started":1,"wal-append.queue_time_us":292594}
I20260709 13:08:27.596164 25959 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.597265 25959 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.600646 25959 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:27.616312 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 78052.8us
I20260709 13:08:27.603430 26009 ts_tablet_manager.cc:1916] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:27.617633 22453 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.005s	sys 0.052s
I20260709 13:08:27.626583 25933 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.626677 25575 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.628141 22502 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:27.623095 22453 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.006s	sys 0.053s
I20260709 13:08:27.635478 25914 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.646718 25914 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.632642 25912 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.640885 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:27.649343 25912 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.649580 23256 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
W20260709 13:08:27.659813 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.663280 26043 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:08:27.663564 25912 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.665191 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:27.665392 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.666003 22498 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:27.665910 22499 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:27.666821 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.667366 22499 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:27.669044 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:27.671185 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2315) took 1147 ms. Trace:
I20260709 13:08:27.669416 25914 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.669958 25955 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:27.665715 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.671548 22648 rpcz_store.cc:276] 0709 13:08:26.523709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.724258 (+200549us) service_pool.cc:224] Handling call
0709 13:08:27.670996 (+946738us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54002da0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:27.671132 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627121536}
I20260709 13:08:27.673034 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:27.683530 22502 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:27.681700 25968 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.708964 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:27.691188 25906 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.722883 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:27.723920 25936 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:27.724521 25936 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.727188 25936 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:27.728714 22579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 543) took 1586 ms (client timeout 1967 ms). Trace:
W20260709 13:08:27.729225 22579 rpcz_store.cc:269] 0709 13:08:26.141855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.142018 (+   163us) service_pool.cc:224] Handling call
0709 13:08:27.728530 (+1586512us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003cafd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:27.728651 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2904890240}
I20260709 13:08:27.731242 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 546) took 1556 ms. Trace:
I20260709 13:08:27.731789 22580 rpcz_store.cc:276] 0709 13:08:26.174934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.175326 (+   392us) service_pool.cc:224] Handling call
0709 13:08:26.175629 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.817865 (+642236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.730984 (+913119us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54003caad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:27.731176 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441941248}
I20260709 13:08:27.690866 25955 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.735764 25955 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.738179 25981 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.719314 25906 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.738902 25936 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:27.739255 25906 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.739574 25936 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.741868 25936 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.682665 25592 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:27.749902 22580 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:27.751914 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:27.752542 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62790.5us
I20260709 13:08:27.752908 22580 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:27.755726 26038 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:27.756345 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.756525 25986 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:27.756887 25967 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:27.757303 26037 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.757848 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:27.758098 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.757993 26037 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.758870 22579 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:27.760119 26037 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.760566 25936 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.760799 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.761085 25936 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.761437 22574 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:27.757392 25967 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.763444 25936 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.763861 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 417) took 1694 ms. Trace:
I20260709 13:08:27.753902 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:27.772805 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:27.764304 23259 rpcz_store.cc:276] 0709 13:08:26.069763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.069891 (+   128us) service_pool.cc:224] Handling call
0709 13:08:26.070274 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.130394 (+ 60120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.130435 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.131160 (+   725us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.546050 (+414890us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:26.553918 (+  7868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.763430 (+1209512us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b54007021d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:27.763483 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.763536 (+    53us) raft_consensus.cc:1685] finished
0709 13:08:27.763554 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.763800 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":647,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":137276288,"thread_start_us":383807,"threads_started":1,"wal-append.queue_time_us":594270}
I20260709 13:08:27.781118 25967 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.785218 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:27.788332 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.789213 22502 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:27.791006 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.791141 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:27.791940 22577 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:27.793640 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:27.801198 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:27.804082 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.806466 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:27.807049 22574 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:27.807459 25967 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.807394 26037 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:27.808956 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.802425 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:27.814273 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 95077.4us
I20260709 13:08:27.814611 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:27.815654 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.816274 22579 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:27.820367 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 97542.8us
I20260709 13:08:27.820580 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:27.821583 22499 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:27.822888 22502 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:27.823379 22502 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:27.832015 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:27.801636 25578 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:27.829840 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:27.852630 22651 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:27.852903 22499 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:27.797916 25963 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:27.850363 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:27.824404 22502 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.855085 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.855469 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:27.806015 26066 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:27.829871 25967 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:27.833745 26015 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:27.860985 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.825078 25936 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:27.849092 25968 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:08:27.849519 25802 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.814343 25933 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:08:27.871855 25694 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.814297 26017 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:08:27.875859 25556 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:27.860118 25981 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:27.851140 25947 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.878696 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.882244 22572 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:27.876996 25975 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:27.883083 25827 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.859347 25575 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:08:27.912686 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.913882 22498 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:27.889812 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:27.916409 22573 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:27.875574 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2311) took 1353 ms. Trace:
I20260709 13:08:27.862933 26038 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:27.892613 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.901463 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.859727 26066 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:27.902449 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47027us
I20260709 13:08:27.907179 25967 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:27.877790 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.908146 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.854028 25943 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:27.830597 25942 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 13:08:27.911020 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47498.3us
I20260709 13:08:27.861174 25732 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:27.887976 26032 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:27.857501 25920 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.925194 26066 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:27.918478 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:27.887250 25802 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.861554 25963 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:27.940001 26005 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.473s	user 0.013s	sys 0.010s
I20260709 13:08:27.941347 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 2941) took 2034 ms. Trace:
I20260709 13:08:27.941504 25963 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:27.917352 22651 rpcz_store.cc:276] 0709 13:08:26.522234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.523302 (+  1068us) service_pool.cc:224] Handling call
0709 13:08:27.875229 (+1351927us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400236c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:27.875513 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3039164800}
W20260709 13:08:27.903486 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70625.6us
I20260709 13:08:27.941802 22497 rpcz_store.cc:276] 0709 13:08:25.906568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.966513 (+ 59945us) service_pool.cc:224] Handling call
0709 13:08:25.966827 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.968191 (+  1364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.968218 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.968742 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.157862 (+189120us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:26.157936 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.158049 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.930899 (+1772850us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:27.941054 (+ 10155us) raft_consensus.cc:1685] finished
0709 13:08:27.941075 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.941270 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22652672,"thread_start_us":163392,"threads_started":1,"wal-append.queue_time_us":346430}
I20260709 13:08:27.943567 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:27.925093 22572 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:27.931591 25943 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:27.946127 25931 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.947119 25931 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.947481 25931 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.947832 25931 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.948015 25930 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:27.948532 25930 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:27.922128 22496 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:27.904628 26015 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:27.910380 25827 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.939029 25802 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.856907 25578 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.945884 25943 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.937991 25920 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.950090 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:27.978711 25732 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.979127 25732 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.979576 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:27.980506 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:27.920993 26038 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.981158 26038 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:27.983821 22653 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:27.983928 22574 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:27.984344 22653 pending_rounds.cc:85] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 5
I20260709 13:08:27.984586 22653 pending_rounds.cc:107] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:27.984910 22653 raft_consensus.cc:2889] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.961512 25556 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:27.913699 25947 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:27.949942 26032 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:27.912896 25948 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:08:27.960114 25827 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.972036 25955 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:28.005395 22650 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:08:27.987573 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:27.987458 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:28.008049 22645 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:27.929766 26074 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:27.979530 25732 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.904235 25694 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:27.990363 22646 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:27.997802 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:27.998663 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.017429 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:28.001124 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:28.005295 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 150912us
I20260709 13:08:28.018458 25947 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.019040 25556 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.019717 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.010056 26074 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:28.021754 26074 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.022264 25575 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:28.022986 26074 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:28.023146 26013 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.023573 26013 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:28.024992 25967 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.025589 25906 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.027334 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:28.002290 26032 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:28.028126 25906 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.029552 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:28.029949 25694 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.030151 25578 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.030731 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:27.977478 25943 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:28.031538 25907 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:27.999614 25975 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.015295 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:28.033409 23260 raft_consensus.cc:2376] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9. Re-sending same reply.
I20260709 13:08:28.033167 25975 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.033599 25907 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.018393 22648 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 4: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:28.025151 26015 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.034199 25907 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.035346 25975 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.036320 25907 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:28.006973 22647 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:28.037945 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:28.040477 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:28.041752 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:28.044909 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.048579 22650 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:28.052271 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 147315us
I20260709 13:08:27.949375 25930 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.056905 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:28.058161 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:28.061805 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:28.062026 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.059868 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.062909 22645 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:28.061250 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.063388 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.064477 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.065773 23260 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:28.030778 25578 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:28.073796 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:28.083456 23260 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.079612 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.085753 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:28.087334 22573 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:28.036913 25907 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:28.089438 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:28.090724 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:28.092988 22649 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:28.091274 22572 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:08:28.024405 26013 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.108357 23255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:08:28.109328 25802 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.090217 25578 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.092442 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:28.091777 25906 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.096727 25930 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:28.072340 26019 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:08:28.138350 22650 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:28.139878 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.139129 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:28.103067 25912 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:28.114738 26014 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.114588 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:28.119570 25578 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:28.137334 26037 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:28.131474 26076 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.212632 25906 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.236850 23259 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:08:28.241696 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.241588 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 102573us
I20260709 13:08:28.259023 22645 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:28.114914 26023 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:08:28.213881 26013 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.263063 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.265885 22650 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:28.118188 26064 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:08:28.266554 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.268244 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.274811 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:28.147523 25592 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:08:28.314188 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:28.314972 22503 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.315466 25694 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:28.260738 25914 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:28.277036 25927 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.259106 25947 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:28.321169 25947 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.323778 25947 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:28.285781 26081 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:08:28.289625 26080 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:08:28.299782 25906 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.271426 26009 ts_tablet_manager.cc:1929] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:08:28.306967 25802 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.270920 25983 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:28.307896 26077 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:28.240648 25827 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.328408 22571 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:28.330191 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:28.331539 22578 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:28.238636 25912 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.333196 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:28.355523 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:28.339973 23260 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:28.273185 25963 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.356389 22571 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.300503 26066 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.378878 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:28.261027 26076 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:28.405520 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 319844us
I20260709 13:08:28.391186 22503 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:08:28.407548 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:28.408190 23260 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:28.354035 26009 log.cc:1199] T be7264d3053b44989c5504d296ea482b P 691cccbd0258483ebe19e1581674cc94: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/wals/be7264d3053b44989c5504d296ea482b
I20260709 13:08:28.342504 26077 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:28.354892 25936 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:28.344187 25983 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.419864 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:28.425751 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 160767us
I20260709 13:08:28.378288 26019 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:28.377523 25906 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:08:28.429796 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:28.433477 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 158773us
I20260709 13:08:28.414095 25802 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.411711 23257 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 9. Ops: []
I20260709 13:08:28.433418 22571 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
W20260709 13:08:28.451227 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.431383 25986 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.380934 25963 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.434643 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.426574 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.454550 22648 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:28.451995 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.460088 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:28.463732 22651 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:28.467721 22572 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:28.457978 25870 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.474053 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.479394 22574 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:28.458616 26032 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.471925 25947 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:28.450911 25802 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.490545 25870 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:28.481195 26038 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:28.508700 25931 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.005s
I20260709 13:08:28.457211 26077 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.506454 25947 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:28.508971 26066 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:28.530045 25912 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:28.609128 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.520650 25827 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.527220 25732 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.609241 26093 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.528801 25931 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.670261 25796 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:28.670804 25796 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:08:28.671779 26098 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:08:28.671693 25796 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.673018 25959 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:28.673619 25959 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.675765 25959 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.696762 25963 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.621482 26076 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.699275 26038 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.700943 26009 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41926 (request call id 78) took 2635 ms. Trace:
I20260709 13:08:28.701503 26009 rpcz_store.cc:276] 0709 13:08:26.065707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.067742 (+  2035us) service_pool.cc:224] Handling call
0709 13:08:26.285879 (+218137us) ts_tablet_manager.cc:1151] Deleting tablet be7264d3053b44989c5504d296ea482b
0709 13:08:26.373644 (+ 87765us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:27.942209 (+1568565us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:28.262418 (+320209us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:28.700461 (+438043us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807697,"tablet-delete.queue_time_us":174714,"thread_start_us":137500,"threads_started":1}
I20260709 13:08:28.703714 25947 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.634830 25983 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.751963 25732 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:28.753690 26089 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:08:28.755014 26100 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:08:28.756528 26099 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:08:28.644711 26093 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.758728 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:28.761166 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:28.761556 26093 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:28.731072 26074 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.000s
I20260709 13:08:28.763967 26032 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.765620 25802 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:28.772753 22650 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:28.776803 22654 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:28.731948 25930 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:28.733246 25578 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.793973 25930 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.810105 25930 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.813620 25931 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:28.804831 26013 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.823500 26037 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.006s
I20260709 13:08:28.830528 25931 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:28.831367 25931 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.824007 25930 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:28.840168 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.839275 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:28.838459 22571 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:28.840116 25578 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:28.847714 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.851943 22651 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:28.849094 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.853674 22654 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:28.854220 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.855758 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.855805 22648 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:28.857638 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.859032 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.825740 26013 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.860170 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.861248 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.861936 25931 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.862185 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.835620 26037 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:28.855423 25930 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.866696 25930 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.853371 25870 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.867413 23255 raft_consensus.cc:606] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:28.867909 23255 raft_consensus.cc:614] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:28.842129 26015 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:28.869294 26015 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:28.869760 22651 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:28.871318 26015 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:28.863229 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.858398 22648 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:28.873605 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:28.877190 22648 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:28.879256 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:28.882858 25931 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:28.884020 25931 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:28.884389 25931 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:28.885285 25931 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.886866 25931 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:28.892114 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:28.893173 22574 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:28.897050 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.897363 26102 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:28.898222 26102 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:28.899410 26102 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.908140 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:28.902235 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:28.917352 26110 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:28.918057 26110 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:28.918452 26110 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.919417 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:28.917443 22387 catalog_manager.cc:5028] TS 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): tablet be7264d3053b44989c5504d296ea482b (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:28.916009 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.926036 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.923440 25870 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:28.927865 25947 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.929685 25870 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:28.932060 25870 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:28.933105 22574 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:28.933275 25933 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:28.922010 25948 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.935384 25920 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:28.938179 26110 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.940047 26013 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:28.940750 26110 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.947068 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:28.949527 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:28.950022 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:28.944108 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:28.944684 25933 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.956959 25919 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:28.957818 22647 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:28.957615 25919 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.959870 25919 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:28.960626 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:28.952163 25870 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:28.965396 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:28.952001 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:28.953678 25983 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:28.967255 26095 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:28.970999 25927 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:28.971369 25927 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:28.972165 25927 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:28.972466 25947 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.973497 25927 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.973987 25933 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:28.974711 23256 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:28.955070 25694 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:08:28.978273 25694 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:28.978652 25694 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:28.966884 25870 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:28.984033 25870 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:28.986291 22502 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:28.981973 23258 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:29.003043 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.003252 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:29.006084 26087 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.553s	user 0.003s	sys 0.007s
I20260709 13:08:29.017575 22502 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:08:29.018182 22502 pending_rounds.cc:85] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 6
I20260709 13:08:29.018489 22502 pending_rounds.cc:107] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:08:29.018815 22502 raft_consensus.cc:2889] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.985404 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:29.022806 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 2972) took 1213 ms. Trace:
I20260709 13:08:29.023370 22502 rpcz_store.cc:276] 0709 13:08:27.809143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.811068 (+  1925us) service_pool.cc:224] Handling call
0709 13:08:27.822739 (+ 11671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.985946 (+1163207us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b54000689a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26270a1d 00007fec262571a4 00007fec262d9447 00007fec262f1fe7 00007fec262f37de 00007fec262fdb49 00007fec262fe416 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419
0709 13:08:29.022424 (+ 36478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.022727 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123935616}
W20260709 13:08:29.028714 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.032546 22651 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:28.998612 26021 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:28.982717 25933 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:29.064931 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.025167 25927 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:29.086202 22651 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:29.113373 25927 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.114065 25927 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:29.088318 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.093719 25870 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.002560 25694 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.118165 25870 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:29.120031 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:29.120975 22651 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:29.121097 25933 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:29.101711 26114 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:08:29.102677 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 6f5719028ca945b2b6c1a1f140b05146: Illegal state: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:29.104167 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.105206 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.105307 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.132166 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2322) took 2034 ms. Trace:
I20260709 13:08:29.132608 22653 rpcz_store.cc:276] 0709 13:08:27.097805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.162988 (+ 65183us) service_pool.cc:224] Handling call
0709 13:08:27.877293 (+714305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.985701 (+108408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.131050 (+1145349us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400236c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:29.131985 (+   935us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400236c50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:29.132111 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885729280}
I20260709 13:08:29.133643 22544 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.134902 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.136027 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.137787 26095 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.037809 26021 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:29.146361 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:29.147305 22647 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.149449 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:29.150092 22653 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:29.139217 25983 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:29.152230 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:29.140995 25933 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:29.139727 25870 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.141999 26047 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.157652 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:29.160722 22650 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.161230 22651 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:29.158757 22648 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:29.169031 25981 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:29.169957 25981 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.173535 25981 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:29.175379 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.177709 22650 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:29.156222 26067 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.183516 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 45867.8us
I20260709 13:08:29.145541 25963 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:08:29.185140 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.197109 22647 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:08:29.182140 25947 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:08:29.197526 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 551) took 1325 ms. Trace:
I20260709 13:08:29.180471 26047 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.197991 22579 rpcz_store.cc:276] 0709 13:08:27.872475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.885669 (+ 13194us) service_pool.cc:224] Handling call
0709 13:08:27.886017 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.949653 (+ 63636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.949687 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:27.949728 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:27.949760 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.197274 (+1247514us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b54001e50d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:29.197323 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.197469 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145893632}
I20260709 13:08:29.188661 26067 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.201875 26067 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.202010 26077 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:29.203291 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:29.198226 25947 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:29.206970 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69498.2us
I20260709 13:08:29.181967 26021 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.208483 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:29.210335 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:29.194602 26102 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.211982 25870 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:29.214329 25983 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:29.206279 25947 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:29.215782 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 80dc0c7d4f9341eeb7472424613de2ce: Illegal state: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:29.222730 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:29.223371 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.223544 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:29.224143 22580 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:29.225033 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.217278 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.218771 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:29.220436 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:29.220492 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0833518700000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:08:29.226596 22502 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.227289 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:29.228147 22575 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:29.230167 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:29.230468 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.230195 26032 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.231621 26032 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.232008 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:29.232360 25870 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:29.233407 25870 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.233785 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.234889 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.236256 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.221662 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:29.237884 23256 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:29.238814 25557 raft_consensus.cc:2764] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:29.239523 26078 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:29.240448 26066 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:29.240830 26066 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:29.240998 26032 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:29.240952 25824 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:29.241771 26066 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.242733 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 421) took 1229 ms. Trace:
I20260709 13:08:29.242940 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.243177 23257 rpcz_store.cc:276] 0709 13:08:28.013293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.014199 (+   906us) service_pool.cc:224] Handling call
0709 13:08:28.017006 (+  2807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.451450 (+434444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.242465 (+791015us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54008e6054. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:29.242633 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830411648}
I20260709 13:08:29.211021 26120 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.244383 26120 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.240568 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.249740 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:29.228757 26021 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:29.245441 26092 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.737s	user 0.004s	sys 0.004s
I20260709 13:08:29.248955 26102 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.218146 25983 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.272416 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:29.273700 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.242957 26066 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:29.277015 22504 raft_consensus.cc:2410] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:29.278291 22503 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:29.259496 26032 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:29.291141 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.260667 25981 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.301841 22645 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:29.291394 22502 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
W20260709 13:08:29.292932 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.253492 25933 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.271845 26074 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.273178 25983 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.301196 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.288352 25943 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.261390 25556 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:08:29.319751 22580 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:29.324381 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:29.321210 22503 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:29.305212 26107 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:29.326284 22575 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:29.271569 25931 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:29.288479 25557 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:08:29.338824 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.343945 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:29.328609 26095 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.355232 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:29.314007 25933 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.314706 25981 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.318693 26074 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.314451 26032 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.365718 22573 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:29.304668 25947 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.328410 25943 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.348968 26107 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:29.359932 25740 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:29.345899 26016 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:29.357470 26120 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.377450 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:29.380225 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:29.381516 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:29.360801 26047 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:29.365027 26125 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:29.388115 26078 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.391870 26128 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:29.392436 26128 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.392932 26128 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.393123 26032 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:29.393728 26032 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.394229 26032 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.394500 25740 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:29.393564 25827 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:29.395813 25827 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:29.396173 25827 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:29.396298 26032 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.397135 25827 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.398484 25827 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.367527 26123 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.406522 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.403564 26032 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.416468 26032 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.425097 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:29.426200 26134 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:29.426882 25802 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:29.428557 26130 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.429198 26130 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.431540 26130 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.432089 26130 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:29.432539 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:29.388212 25557 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:29.388394 25824 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:29.411042 25947 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:29.415627 26123 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:29.442808 26121 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:29.446383 25967 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:29.449786 22646 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:08:29.453406 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 542758us
W20260709 13:08:29.457504 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.432533 26130 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:29.474730 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.419238 26125 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.475404 22496 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:29.439724 26102 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:29.448756 26133 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:08:29.474915 26126 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:08:29.494593 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.494732 22497 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:29.463027 25967 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:29.460670 25824 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:29.504786 22497 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:29.522890 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.512559 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.523993 22501 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:29.514029 26051 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:29.514613 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:29.533551 22504 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:29.515656 22500 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:08:29.534166 22500 pending_rounds.cc:85] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 5
I20260709 13:08:29.526034 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.534430 22500 pending_rounds.cc:107] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:08:29.534663 22500 raft_consensus.cc:2889] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.535174 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.535653 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:29.533942 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 63119.2us
I20260709 13:08:29.536235 22500 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:08:29.537212 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 128840us
I20260709 13:08:29.552989 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.540580 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:29.535815 22501 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:29.542326 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.545123 26128 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.551074 22505 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:29.559792 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.552155 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.562343 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.563055 22500 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
W20260709 13:08:29.564168 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.571412 22497 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:29.532722 26051 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:29.598326 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.469003 26107 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.499364 25557 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:08:29.582954 22580 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:29.552201 26129 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.584162 22578 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:29.588259 22504 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:29.612263 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:29.590663 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 246786us
I20260709 13:08:29.609653 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:29.613325 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:29.477553 26130 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.619429 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:29.619378 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.620976 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.602453 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.589391 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.622175 22503 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:29.614116 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.624488 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:29.614683 22504 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:29.563285 26032 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.621097 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.605479 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:29.557528 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.557505 25927 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.630869 22501 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:29.642141 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.643676 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.645469 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:29.608165 26074 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.609920 25933 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.650650 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:29.652135 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.653559 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:29.655851 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:29.661485 22503 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:29.656740 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.663003 26102 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:29.666208 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.667824 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.668320 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "384f494818f741d1bb257daeaab933f2"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:29.669199 22650 raft_consensus.cc:606] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:29.669291 25936 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:29.669740 22650 raft_consensus.cc:614] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:29.669997 25936 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:29.672691 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:29.659323 22571 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:29.675390 22498 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:29.675622 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:29.678539 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:29.679016 25963 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:29.679535 25963 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:29.679955 25963 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:29.623849 26126 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:29.612700 26047 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:29.694283 22575 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:29.549569 25824 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.629129 26131 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:29.681522 22579 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:29.681875 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:29.682852 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.683614 22578 raft_consensus.cc:2410] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:08:29.691902 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 138981us
I20260709 13:08:29.639981 26119 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:29.629288 25981 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:29.643589 26135 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.708457 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.718019 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:29.682332 25575 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:29.725488 26128 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.727187 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:29.728217 25964 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:29.723372 26102 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:29.730369 26136 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:08:29.731698 26132 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:08:29.804296 22574 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:29.681254 25952 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 13:08:29.733400 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 33d734b2b43a40138a8a0ee22b30d9ba: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:29.744392 26125 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:29.681062 25943 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:29.705502 26074 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:29.757083 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.705103 26138 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:29.624277 26129 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.796008 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:29.817589 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.818504 23264 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:29.809124 25964 consensus_queue.cc:1243] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:29.622138 25967 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.800230 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 2993) took 1472 ms. Trace:
I20260709 13:08:29.733464 26146 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:08:29.789189 26102 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:29.801770 26017 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:29.751693 25932 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:29.751260 25931 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:29.751853 25981 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.819789 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.822924 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:29.833714 22572 rpcz_store.cc:276] 0709 13:08:28.327369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.327482 (+   113us) service_pool.cc:224] Handling call
0709 13:08:28.328186 (+   704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.468190 (+140004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.799939 (+1331749us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003cb4d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:29.800155 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319665024}
I20260709 13:08:29.836695 25927 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.713585 26047 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.790402 22573 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:29.918562 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:29.834239 26123 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:29.837980 25566 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:29.844419 26077 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.004s
I20260709 13:08:29.750396 25575 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:29.919751 23264 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:29.845093 25694 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:29.751912 26135 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.842286 26102 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:29.918731 26074 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:29.840325 26067 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:29.938814 23259 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:29.918522 26110 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:29.916982 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.927762 26021 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.669s	user 0.012s	sys 0.000s
I20260709 13:08:29.930294 25566 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.940743 22573 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:29.935457 25575 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:29.972496 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:29.978994 22647 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:29.919510 25952 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:08:29.919252 25981 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.834817 26138 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.981598 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:29.983593 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.991845 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.951243 26074 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:29.961742 26094 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.724572 26051 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:29.974462 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.105554 23261 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:30.049307 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:30.344547 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:30.343998 22653 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:30.328963 22576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.013s
W20260709 13:08:30.346575 22576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.001s	sys 0.013s
W20260709 13:08:30.245770 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.081965 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 369823us
W20260709 13:08:29.994068 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 343462us
I20260709 13:08:30.351959 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.080720 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:30.354421 22503 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:30.356838 22500 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:30.350472 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:30.359933 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:29.973609 26110 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:29.978106 25566 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.371184 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:30.077601 26147 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.326s	user 0.000s	sys 0.003s
I20260709 13:08:30.169371 26017 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.157608 26158 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:08:30.107658 26168 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:30.410007 26153 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:30.389534 22653 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:30.383760 26051 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:30.410666 26153 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.390285 23255 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:30.393435 26164 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:30.411098 26153 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:30.396317 25932 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.072160 26122 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.763s	user 0.004s	sys 0.000s
I20260709 13:08:30.411686 25932 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.413895 25932 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:30.399391 26131 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:30.161985 26152 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:30.414798 23255 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:29.992945 26123 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.417330 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57490.9us
I20260709 13:08:30.417810 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:30.419094 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:30.403295 25936 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.002s
I20260709 13:08:29.993108 25927 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:30.408707 26138 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.409566 26017 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:29.981608 23257 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:30.048697 25931 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:30.397830 25981 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.422164 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.180655 26135 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.048452 26021 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:29.993409 26125 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:30.407296 25983 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.081s	user 0.011s	sys 0.000s
I20260709 13:08:30.423341 26164 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:30.380144 26110 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.366926 26128 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.434836 26131 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:30.382671 26094 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.439139 26017 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:30.423606 26047 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.443259 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:30.366029 26165 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:30.452117 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.028s	sys 0.056s
W20260709 13:08:30.468156 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.029s	sys 0.056s
W20260709 13:08:30.468504 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 616749us
I20260709 13:08:30.469178 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.442477 26138 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:30.470104 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.445869 26021 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:30.472071 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:30.429407 26123 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.479120 26123 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.432168 25936 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.480988 26164 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:30.481412 25936 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:30.485795 25963 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.805s	user 0.013s	sys 0.000s
I20260709 13:08:30.486521 25963 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.489873 25963 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:30.480995 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.459748 26130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.009s	sys 0.030s
I20260709 13:08:30.475739 26047 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.476475 25932 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:30.453660 26125 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.453825 25983 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.445134 25931 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.496312 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:30.496793 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:30.437093 25927 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.474668 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:30.476969 26013 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:30.434171 23255 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.556335 26131 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:30.560969 26021 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:30.550053 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.562556 25931 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.556602 25936 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.563416 25931 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.564043 25931 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.564365 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.466012 26128 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.567005 26128 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.540174 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 437) took 1272 ms. Trace:
I20260709 13:08:30.567878 23261 rpcz_store.cc:276] 0709 13:08:29.268127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.269410 (+  1283us) service_pool.cc:224] Handling call
0709 13:08:29.269732 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.345079 (+1075347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.539790 (+194711us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400719b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:30.540086 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868623232}
I20260709 13:08:30.458398 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 527) took 1023 ms. Trace:
W20260709 13:08:30.551499 25694 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 13:08:30.473603 25981 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:08:30.480144 25575 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:30.467708 25947 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.009s	user 0.012s	sys 0.001s
I20260709 13:08:30.561128 26131 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:30.573891 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 99290.6us
I20260709 13:08:30.590551 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:30.574272 22651 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:30.578994 22580 raft_consensus.cc:2410] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:30.579609 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.574604 22501 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:30.562455 26021 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:30.575325 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:30.593871 23261 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:30.597119 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.472395 26135 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:30.603176 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:30.563493 25936 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.474311 26017 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:30.607122 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:30.678289 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 71240.1us
I20260709 13:08:30.679277 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:30.574075 26127 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:30.608116 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:30.606233 26138 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:30.609493 25986 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:30.600069 26133 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.609902 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:30.611182 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.611840 25932 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:30.612967 26156 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:30.613410 26140 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:30.571527 23257 rpcz_store.cc:276] 0709 13:08:29.433777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.844812 (+411035us) service_pool.cc:224] Handling call
0709 13:08:29.933733 (+ 88921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.436029 (+502296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.453396 (+ 17367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:30.615556 26164 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:30.576268 26125 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.620776 25927 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.622589 25575 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:30.623911 26153 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.573312 25983 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.624444 25566 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:30.626657 26102 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.003s
I20260709 13:08:30.629590 22651 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:30.630720 26021 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:30.633657 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:30.644593 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2061) took 1423 ms. Trace:
W20260709 13:08:30.646718 23259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 514) took 1744 ms (client timeout 2095 ms). Trace:
W20260709 13:08:30.802053 23259 rpcz_store.cc:269] 0709 13:08:28.902645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.909380 (+  6735us) service_pool.cc:224] Handling call
0709 13:08:30.646448 (+1737068us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54006d2254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:30.646641 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341256576}
I20260709 13:08:30.652644 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2349) took 1041 ms. Trace:
I20260709 13:08:30.684996 22648 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
W20260709 13:08:30.688156 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.571303 23256 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:30.493510 26165 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:30.579587 26130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.009s	sys 0.031s
W20260709 13:08:30.729314 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 358186us
I20260709 13:08:30.756700 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2396) took 1209 ms. Trace:
I20260709 13:08:30.810181 22646 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:30.810400 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:30.803876 22647 rpcz_store.cc:276] 0709 13:08:29.610741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.610951 (+   210us) service_pool.cc:224] Handling call
0709 13:08:30.652424 (+1041473us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400168854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:30.652560 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824610048}
I20260709 13:08:30.651554 26129 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.684700 26127 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:30.751967 26151 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:30.752178 25947 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.755810 25981 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:30.754417 26108 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.757603 26146 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:30.759099 26133 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.789907 25932 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.622643 25802 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 13:08:30.793872 25931 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.793772 26110 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:30.758139 26156 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:30.765736 26138 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:30.819109 25981 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:30.795368 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.795941 25936 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.831880 25575 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.797912 26153 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.801972 22579 rpcz_store.cc:276] 0709 13:08:29.221480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.241643 (+ 20163us) service_pool.cc:224] Handling call
0709 13:08:29.241932 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.706806 (+464874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.644198 (+937392us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54003bc254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:30.644504 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010535168}
I20260709 13:08:30.807543 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:30.807690 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:30.858223 22648 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:30.808480 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:30.681210 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:30.859776 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 178649us
W20260709 13:08:30.861737 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53413.2us
I20260709 13:08:30.849224 26156 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:30.810055 22504 rpcz_store.cc:276] 0709 13:08:29.547123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.683981 (+136858us) service_pool.cc:224] Handling call
0709 13:08:29.716403 (+ 32422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.916090 (+199687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.916120 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.920993 (+  4873us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.147939 (+226946us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:30.148000 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.656786 (+508786us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540033ead4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:30.656848 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.664456 (+  7608us) raft_consensus.cc:1685] finished
0709 13:08:30.664477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.756610 (+ 92133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70393,"raft.queue_time_us":70594,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":14968,"spinlock_wait_cycles":296043904,"thread_start_us":186429,"threads_started":1,"wal-append.queue_time_us":517901}
I20260709 13:08:30.816736 22469 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:30.821738 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 339298us
I20260709 13:08:30.814031 25983 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:30.814510 26127 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:30.759454 25986 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.813900 26151 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:30.794672 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.801437 26102 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:30.849489 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 270985us
I20260709 13:08:30.859053 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.855655 22650 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:30.797539 22654 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:30.854564 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.817904 25947 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.863102 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:30.866598 26175 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:30.863961 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:30.865734 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 49126.6us
I20260709 13:08:30.853489 25981 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:30.863126 26146 raft_consensus.cc:2764] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:30.823699 26108 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.811971 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.870777 26130 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:30.884909 26123 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:30.910733 26130 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:30.886337 26128 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.911191 26130 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.887984 25936 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.870217 26165 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.912978 26178 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:08:30.914214 26178 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:30.914430 25986 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:30.878520 26021 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:30.916218 23258 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
W20260709 13:08:30.916414 26096 consensus_queue.cc:1175] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 5 status { last_received { term: 4 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:30.917091 25566 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:30.917580 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:30.917805 26175 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:30.918201 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.919369 23258 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:30.919039 26175 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.912340 25936 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.911405 26128 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.921783 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 622) took 1004 ms. Trace:
I20260709 13:08:30.921975 26164 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:30.891804 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:30.891013 25947 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.875511 26153 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:30.923152 26164 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:30.923417 25947 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:30.923614 26164 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:30.923950 25947 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:30.923545 26153 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.924444 25947 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:30.896716 26110 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:30.852646 26138 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.893396 25927 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:30.926584 25927 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.928038 26138 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.929208 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:30.931799 26074 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.932807 25936 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.924691 26164 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.933930 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:30.892827 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80922.6us
I20260709 13:08:30.861027 23257 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:30.893882 25870 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:30.896062 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 2981) took 1421 ms. Trace:
I20260709 13:08:30.896291 26013 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:30.896127 25694 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:30.897205 26133 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.861121 25575 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:30.897976 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:30.898113 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43651.2us
I20260709 13:08:30.939435 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:30.941112 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:30.942750 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:30.898505 23256 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:30.900720 25943 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:30.935390 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:30.907114 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3013) took 1302 ms (client timeout 1577 ms). Trace:
I20260709 13:08:30.909933 26108 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:30.874543 26151 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:30.921258 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:30.910951 26123 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.893657 26129 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:30.944689 22580 rpcz_store.cc:269] 0709 13:08:29.604963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.609325 (+  4362us) service_pool.cc:224] Handling call
0709 13:08:30.906916 (+1297591us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54003cbed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:30.907052 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220347776}
I20260709 13:08:30.892938 25963 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:30.922194 23263 rpcz_store.cc:276] 0709 13:08:29.917121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.920975 (+1003854us) service_pool.cc:224] Handling call
0709 13:08:30.921311 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.921478 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.921503 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.921539 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:30.921568 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.921616 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.921719 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:30.945662 22545 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:30.947201 22501 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:30.934581 26164 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:30.937374 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:30.938769 22504 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:30.898408 26102 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.954727 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:30.969200 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.936151 22502 rpcz_store.cc:276] 0709 13:08:29.475890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.476407 (+   517us) service_pool.cc:224] Handling call
0709 13:08:29.476815 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.625070 (+148255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.625115 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.640680 (+ 15565us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.398061 (+757381us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b1800055000. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:08:30.677257 (+279196us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:30.677312 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.677416 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.895707 (+218291us) raft_consensus.cc:1685] finished
0709 13:08:30.895727 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.895998 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2873,"raft.queue_time_us":167049,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":41744,"spinlock_wait_cycles":8115584,"thread_start_us":422777,"threads_started":2,"wal-append.queue_time_us":1195099}
I20260709 13:08:30.983125 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:30.983968 22580 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:30.985633 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:30.934831 25936 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:30.928771 25927 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.993949 26125 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:30.997315 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.993969 26138 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:30.998449 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:30.952294 25694 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:30.936913 26133 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.936024 25870 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.951160 26180 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:30.981547 26184 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:30.945866 25943 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:30.982528 25566 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:30.975652 26157 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.127s	user 0.008s	sys 0.010s
I20260709 13:08:31.007365 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.038111 22580 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:31.039135 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:31.014037 26133 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.039533 25981 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.040385 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.041316 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2397) took 1493 ms. Trace:
I20260709 13:08:31.041424 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 670) took 1603 ms. Trace:
I20260709 13:08:30.938457 25575 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:30.939019 26131 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.041992 26133 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:31.000116 25936 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.050237 25936 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:31.006556 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 69260.3us
I20260709 13:08:31.016145 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:30.981817 26110 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:30.975919 26015 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:31.053530 22571 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:31.014159 25870 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:31.011214 26129 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:31.014595 26102 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:31.006738 26074 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.999917 26021 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:31.006520 26163 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:31.024695 25566 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.027833 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.028501 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:31.028925 22577 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:31.031364 22573 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:31.030975 26130 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.032593 25943 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:30.935850 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:31.041821 22649 rpcz_store.cc:276] 0709 13:08:29.438489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.438658 (+   169us) service_pool.cc:224] Handling call
0709 13:08:29.439778 (+  1120us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:29.456789 (+ 17011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.456836 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:30.536787 (+1079951us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b2c0013e058. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:08:30.537549 (+   762us) log.cc:844] Serialized 52 byte log entry
0709 13:08:30.858874 (+321325us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:30.859215 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.859294 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.041151 (+181857us) raft_consensus.cc:1685] finished
0709 13:08:31.041171 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.041372 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3388,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":9156992,"thread_start_us":319542,"threads_started":1,"wal-append.queue_time_us":401590}
I20260709 13:08:31.041776 22497 rpcz_store.cc:276] 0709 13:08:29.547458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.681058 (+133600us) service_pool.cc:224] Handling call
0709 13:08:29.681417 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.702135 (+ 20718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.702173 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.709711 (+  7538us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.852123 (+142412us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:29.852172 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.852236 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.938633 (+1086397us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:31.040936 (+102303us) raft_consensus.cc:1685] finished
0709 13:08:31.040966 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.041255 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20321,"raft.queue_time_us":50989,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":2295040,"thread_start_us":141988,"threads_started":1,"wal-append.queue_time_us":138058}
I20260709 13:08:31.044268 26131 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.016579 26180 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:31.060086 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 74543us
W20260709 13:08:31.061631 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 186170us
I20260709 13:08:31.060099 23263 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
W20260709 13:08:31.066017 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 174277us
I20260709 13:08:31.164202 22578 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:31.177166 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:31.177878 22646 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:31.179585 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:31.180495 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:31.183033 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:31.183908 22649 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:31.154736 25575 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.035465 26123 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.155371 25927 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:31.160668 25963 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:31.197186 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:31.163160 26146 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:31.155324 26102 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:31.196225 22646 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:31.162465 26184 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.198824 25943 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.154928 26110 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:31.205031 22580 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:31.186370 26180 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:31.222745 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.229279 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.230829 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.231575 22499 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:31.233309 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.234833 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.161916 26129 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.237689 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.227679 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.239101 22502 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:31.215170 26102 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:31.214931 26178 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:31.203984 26163 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:31.263026 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:31.253571 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.255716 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.256430 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.264804 22571 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:31.265050 22579 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
W20260709 13:08:31.262694 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 278998us
I20260709 13:08:31.216584 26017 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:31.262755 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:31.265228 22574 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:31.199536 25575 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.309314 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.310493 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.272271 22573 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:31.291738 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2351) took 1325 ms. Trace:
I20260709 13:08:31.311532 22650 rpcz_store.cc:276] 0709 13:08:29.966157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.966386 (+   229us) service_pool.cc:224] Handling call
0709 13:08:29.966762 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.874797 (+908035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.291439 (+416642us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540017d254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:31.291649 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043795712}
I20260709 13:08:31.293895 22653 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:31.295291 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.312755 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.298905 25967 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:31.300269 25566 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:31.319840 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 528) took 1870 ms. Trace:
I20260709 13:08:31.322781 26127 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.301704 26153 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.305135 26138 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:31.324892 26138 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:31.325376 26138 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:31.325893 26127 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.202491 25927 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.306416 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.307895 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.308697 22646 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:31.213112 25963 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:31.314718 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.315253 22500 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:31.315073 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.315955 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:31.316736 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.312819 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:31.300571 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:31.260061 26178 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.232762 26110 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.217092 26146 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.320320 23264 rpcz_store.cc:276] 0709 13:08:29.449660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.950421 (+500761us) service_pool.cc:224] Handling call
0709 13:08:31.314390 (+1363969us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:31.319327 (+  4937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.319517 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.319544 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.319590 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:31.319621 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.319675 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.319779 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15338240}
I20260709 13:08:31.342592 22575 raft_consensus.cc:1813] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Handling vote request from an unknown peer 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:31.345484 22651 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:31.362443 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.369298 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.393766 22500 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:31.366796 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54048.5us
I20260709 13:08:31.387919 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.327800 25983 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:31.398120 22575 raft_consensus.cc:2410] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:31.216348 26184 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.399487 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.407783 22497 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:31.315039 25981 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.404906 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.405102 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:31.413954 22573 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 3.
I20260709 13:08:31.415982 22653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813ede727198414390a20d5845e75e07"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:31.416632 22653 raft_consensus.cc:606] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:31.419377 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.422353 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.423928 22572 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:31.422386 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.426890 22578 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:31.424681 22576 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:31.314275 26017 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.389498 26178 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:31.423152 22648 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:31.389271 26123 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:31.408277 26156 consensus_meta.cc:287] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.007s
I20260709 13:08:31.437865 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.441171 22500 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:31.450163 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.451145 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.452692 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.441498 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:31.456096 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:31.326427 26138 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:31.484303 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.484726 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 168825us
I20260709 13:08:31.447060 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:31.488344 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:31.458575 26194 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:31.459021 26197 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:31.421628 26153 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:31.449793 26123 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.461268 26193 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:08:31.461642 26127 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:31.461454 26156 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.463621 26125 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:31.464334 26094 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.270128 26163 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.450934 22575 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:31.489141 22497 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:31.509938 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.492496 22468 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:31.460126 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:31.511270 22500 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:31.491384 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:31.514408 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:31.515026 26164 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.001s
I20260709 13:08:31.515765 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.515626 25870 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.516356 22501 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:31.516453 22578 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:31.519034 22497 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:31.507759 26153 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:31.531004 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:31.520052 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101898us
W20260709 13:08:31.525071 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 138165us
I20260709 13:08:31.535362 26195 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:31.534794 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:31.525079 22497 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:31.539222 26195 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:31.539795 26195 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:31.540293 26195 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.540617 25983 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:31.542330 25983 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:31.542806 25983 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:31.543857 25983 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:31.505913 26123 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:31.532722 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.545300 22575 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:31.545387 25983 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.546271 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.546985 22575 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:31.547765 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.548834 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:31.533349 22496 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:31.553740 26123 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.555225 22575 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 8. Ops: []
I20260709 13:08:31.625841 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:31.558768 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:31.590670 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 104742us
I20260709 13:08:31.656517 22646 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:31.556667 22653 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:31.518220 26125 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:31.557307 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:31.662175 22650 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
W20260709 13:08:31.520550 26151 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.002s
I20260709 13:08:31.574059 22654 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:31.556522 26123 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.660269 22578 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:31.527680 26094 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.530418 25947 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.002s
I20260709 13:08:31.529927 25694 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:31.571574 25981 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.580678 26129 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.664052 26125 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:31.659592 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 121982us
I20260709 13:08:31.644047 25575 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:31.534680 26204 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:31.700757 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 71063.1us
I20260709 13:08:31.708771 22646 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:31.692955 26110 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:31.731943 22578 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:31.731475 25870 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.701972 25947 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.737566 25947 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:31.738358 25943 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
W20260709 13:08:31.738632 26202 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:08:31.704192 26094 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.713603 26204 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.742103 26204 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:31.744495 25936 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.006s
W20260709 13:08:31.746781 26199 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:08:31.591952 26153 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.773777 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 605) took 1201 ms. Trace:
I20260709 13:08:31.707984 25963 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.699694 26017 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:31.782809 26178 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:31.693744 26151 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:31.714661 26184 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.741490 26094 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:31.843828 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:32.173712 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 329980us
I20260709 13:08:32.175302 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:31.933393 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.067468 22503 rpcz_store.cc:276] 0709 13:08:30.572713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.575698 (+  2985us) service_pool.cc:224] Handling call
0709 13:08:30.576038 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.576413 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.576443 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.583107 (+  6664us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.482622 (+899515us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b18001d3020. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:08:31.625254 (+142632us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:31.625298 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.625369 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.773342 (+147973us) raft_consensus.cc:1685] finished
0709 13:08:31.773380 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.773689 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8642,"raft.queue_time_us":5057,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8538,"spinlock_wait_cycles":16806784,"thread_start_us":142426,"threads_started":1,"wal-append.queue_time_us":1134049}
W20260709 13:08:31.980551 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 119594us
I20260709 13:08:31.978418 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:31.977870 26209 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:08:31.734339 26146 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:32.066047 26212 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 13:08:32.154909 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:32.197259 22470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.010s	sys 0.044s
W20260709 13:08:32.199440 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.016s	sys 0.028s
W20260709 13:08:32.199826 23230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.013s	sys 0.056s
I20260709 13:08:32.170061 25740 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.203403 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.222291 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.240749 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.018s	sys 0.029s
W20260709 13:08:32.241318 23230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.015s	sys 0.057s
I20260709 13:08:32.247179 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3009) took 1025 ms. Trace:
I20260709 13:08:32.248018 22504 rpcz_store.cc:276] 0709 13:08:31.221505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.223908 (+  2403us) service_pool.cc:224] Handling call
0709 13:08:31.244356 (+ 20448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.244694 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.244730 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.248925 (+  4195us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.407763 (+158838us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:31.407807 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.407872 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.246963 (+839091us) raft_consensus.cc:1685] finished
0709 13:08:32.246982 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.247122 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":16926,"thread_start_us":158543,"threads_started":1,"wal-append.queue_time_us":257336}
W20260709 13:08:32.241112 22470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.012s	sys 0.044s
I20260709 13:08:32.152593 26129 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.790153 26195 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.067729 25936 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:32.276144 26102 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.009s	user 0.010s	sys 0.001s
I20260709 13:08:32.202107 25947 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:32.276650 26102 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.277388 25947 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.278043 25947 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:32.253350 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:32.222726 25870 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:32.243551 25740 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.257689 26211 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:32.244171 26156 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.068043 26207 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.175s
W20260709 13:08:32.272025 26204 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
W20260709 13:08:32.222460 25967 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.002s
I20260709 13:08:32.172596 25981 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:32.256438 26180 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.013s	user 0.009s	sys 0.001s
I20260709 13:08:32.201469 26206 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.205s
I20260709 13:08:32.204762 25963 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:08:32.297297 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.353911 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 100645us
W20260709 13:08:32.370899 22469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.016s	sys 0.038s
W20260709 13:08:32.283244 26125 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
W20260709 13:08:32.371554 22469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.016s	sys 0.038s
W20260709 13:08:32.373706 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 890326us
I20260709 13:08:32.371541 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:32.344203 26102 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.303061 26146 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.276728 25936 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.325407 26217 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:32.375780 26074 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.214s	user 0.012s	sys 0.000s
I20260709 13:08:32.377302 26125 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.386866 25740 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:32.387645 26125 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:32.383257 26146 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.348762 25981 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.391242 25981 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.294643 26129 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.392813 26146 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:32.385741 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:32.350054 26133 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.377727 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:32.373332 26156 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:32.351579 26180 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:32.433874 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62477.5us
I20260709 13:08:32.395640 26217 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:32.434614 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:32.434885 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:32.437932 22502 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:32.439424 22502 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:32.440627 26074 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:32.441361 26074 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.444092 26074 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.436081 22497 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:32.349756 26204 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.393971 26184 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.394104 26218 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:32.430051 25870 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:32.455127 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3036) took 1424 ms. Trace:
I20260709 13:08:32.431028 26133 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.452103 26178 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:32.429920 25947 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.450582 26184 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.447582 26151 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.453073 26225 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:32.453733 26204 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.453464 26218 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.436368 26156 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.454927 23258 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:32.455549 22647 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:32.455610 22580 rpcz_store.cc:276] 0709 13:08:31.030309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.040115 (+  9806us) service_pool.cc:224] Handling call
0709 13:08:32.454937 (+1414822us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003b3b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:32.455066 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377290496}
I20260709 13:08:32.436273 26207 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:32.484694 26129 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.436568 26222 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:32.459455 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 175626us
I20260709 13:08:32.462330 26225 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:32.461535 26125 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:32.483772 26217 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:32.458323 26228 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:32.498520 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:32.487505 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:32.486009 25947 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.509840 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:32.511699 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:32.512117 22500 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:32.470894 26204 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:08:32.485152 26207 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.509585 26223 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:32.524528 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:32.525473 22497 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.535661 22497 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:32.538417 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:32.461396 26227 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:32.485679 26218 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:32.584165 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 135356us
I20260709 13:08:32.540983 26180 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.543702 26207 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.544225 26125 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:32.545689 26222 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.558730 22500 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:32.579399 26228 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:32.581166 26239 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:32.582665 26204 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:32.539749 25870 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.587903 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:32.592368 26225 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:32.593719 26230 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:32.594720 26222 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.597152 26125 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.600764 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:32.586126 26227 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:32.606137 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86770us
I20260709 13:08:32.601964 26156 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:32.601884 26225 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:32.609862 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:32.609072 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:32.602113 26204 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:32.617400 26222 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:32.617568 26227 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:32.614233 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:32.620761 26204 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.622311 26204 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:32.625958 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:32.628425 23255 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:32.618196 26130 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:32.618491 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.144174 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.544s (SENT) [suppressed 5 similar messages]
W20260709 13:08:32.896642 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.726016 26232 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:33.150386 26232 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:32.723752 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.830541 26125 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.642901 26239 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.516s
I20260709 13:08:33.158135 26125 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:32.643206 26222 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:32.989257 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.160567 26222 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:32.893879 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.183485 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 573660us
I20260709 13:08:33.184808 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:33.257620 26240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.010s	sys 0.036s
W20260709 13:08:33.261436 26240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.010s	sys 0.037s
I20260709 13:08:33.296597 26125 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:32.697329 26130 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.331347 26130 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.334632 26130 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:33.335422 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.014s	sys 0.060s
W20260709 13:08:33.350157 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.014s	sys 0.060s
W20260709 13:08:33.351013 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 741803us
I20260709 13:08:33.352280 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:33.336133 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 151480us
I20260709 13:08:32.829734 25740 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:33.160753 26173 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 2.546s	user 0.012s	sys 0.029s
I20260709 13:08:33.161063 26222 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.789953 26156 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:32.789149 26233 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:33.169117 25870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.018s	sys 0.033s
W20260709 13:08:33.167071 26243 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 13:08:33.356642 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:32.643450 26105 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:32.676131 26178 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:32.829975 26227 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.370464 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:33.361737 26237 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:08:33.335873 26180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.009s	sys 0.064s
W20260709 13:08:33.368732 26225 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.000s
I20260709 13:08:33.366370 26130 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.373749 25870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.018s	sys 0.033s
I20260709 13:08:32.644876 26228 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.367954 25740 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:33.376343 26238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.025s	sys 0.048s
I20260709 13:08:33.385375 26105 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.388459 26253 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.390681 26180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.009s	sys 0.074s
I20260709 13:08:33.387351 26227 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:33.373574 26156 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.400028 26130 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.387115 26236 raft_consensus.cc:2764] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:33.374012 26233 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.403505 26246 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:33.391273 26021 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:33.415172 26156 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.410143 26131 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:33.412075 26227 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:33.425129 25796 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:33.406349 26238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.025s	sys 0.049s
I20260709 13:08:33.431666 26246 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:33.415688 26130 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.440642 26246 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.403167 26016 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:33.427700 26233 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:33.444093 26016 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:33.426239 26105 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.406252 26253 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.452770 26021 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:33.453213 26016 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.455049 26016 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:33.384305 26232 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.400537 26249 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:33.407977 26204 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.000s
I20260709 13:08:33.424328 26222 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.458051 26253 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.458086 26222 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:33.330415 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 185985us
I20260709 13:08:33.514005 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2075) took 2205 ms. Trace:
W20260709 13:08:33.401723 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45228.6us
I20260709 13:08:33.541159 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3032) took 2512 ms. Trace:
I20260709 13:08:33.541828 22576 rpcz_store.cc:276] 0709 13:08:31.028409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.029212 (+   803us) service_pool.cc:224] Handling call
0709 13:08:31.029484 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.427566 (+398082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.540520 (+2112954us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54003ca0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:33.540935 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908344704}
I20260709 13:08:33.524050 22575 rpcz_store.cc:276] 0709 13:08:31.308656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.550105 (+241449us) service_pool.cc:224] Handling call
0709 13:08:31.550413 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.555610 (+  5197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.512258 (+1956648us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b5400256f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:33.513553 (+  1295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10635520}
I20260709 13:08:33.558619 26259 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.560168 26259 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.564239 26259 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.565078 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:33.405344 23255 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.776s	user 0.009s	sys 0.001s
I20260709 13:08:33.569738 23255 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:08:33.570317 23255 pending_rounds.cc:85] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 6
I20260709 13:08:33.570664 23255 pending_rounds.cc:107] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:08:33.571201 23255 raft_consensus.cc:2889] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.571311 22646 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.572700 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 530) took 3887 ms. Trace:
I20260709 13:08:33.412081 25592 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:33.574014 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:33.575589 25592 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.578207 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 614) took 2683 ms. Trace:
I20260709 13:08:33.578759 22505 rpcz_store.cc:276] 0709 13:08:30.894891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.896880 (+  1989us) service_pool.cc:224] Handling call
0709 13:08:30.897230 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.907867 (+ 10637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.907897 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.908333 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.065386 (+157053us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:31.065433 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.577174 (+2511741us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540030cad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:33.577300 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.577430 (+   130us) raft_consensus.cc:1685] finished
0709 13:08:33.577448 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.577909 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13933,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":23562496,"thread_start_us":156257,"threads_started":1,"wal-append.queue_time_us":116511,"wal-append.run_cpu_time_us":1816,"wal-append.run_wall_time_us":1001823}
I20260709 13:08:33.580711 25592 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.581358 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3006) took 3611 ms. Trace:
I20260709 13:08:33.436008 25740 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:33.585709 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.585788 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:33.587596 23258 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:33.587791 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:33.588721 23263 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:08:33.589282 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3011) took 2367 ms (client timeout 2368 ms). Trace:
I20260709 13:08:33.590065 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:33.590802 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:33.591015 23264 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:33.587868 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:33.636238 22648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2364) took 2459 ms (client timeout 2289 ms). Trace:
W20260709 13:08:33.638669 22648 rpcz_store.cc:269] 0709 13:08:31.176377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.176782 (+   405us) service_pool.cc:224] Handling call
0709 13:08:33.635605 (+2458823us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400169254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:33.635906 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556390656}
I20260709 13:08:33.641314 26021 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.644124 26130 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:33.644562 26156 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:33.645495 26130 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.645622 26156 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.573464 23255 rpcz_store.cc:276] 0709 13:08:29.685107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.389771 (+704664us) service_pool.cc:224] Handling call
0709 13:08:30.390133 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.628161 (+2238028us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b58004ceed0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262570aa 00007fec262d9447 00007fec262f1fe7 00007fec262f37de 00007fec262fdb49 00007fec262fe416 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4
0709 13:08:33.572107 (+943946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.572520 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053392128}
W20260709 13:08:33.599099 22647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 680) took 2338 ms (client timeout 1999 ms). Trace:
I20260709 13:08:33.601044 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 681) took 2339 ms. Trace:
I20260709 13:08:33.601677 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:33.589913 22501 rpcz_store.cc:269] 0709 13:08:31.221995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.222170 (+   175us) service_pool.cc:224] Handling call
0709 13:08:33.588854 (+2366684us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540007ce54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:33.589060 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639298944}
I20260709 13:08:33.610512 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:33.662459 26222 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:33.974917 26222 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:33.975569 26222 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:33.666468 26228 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:33.978264 26228 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:33.978828 26228 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:33.667192 26197 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.667492 26253 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:33.670622 26259 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:33.671833 26233 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.981464 26197 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.981698 26259 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.982268 26233 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.984823 26259 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:33.985870 26233 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.672693 26227 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.672941 22574 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:08:33.612884 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 2.07388e+06us
I20260709 13:08:33.690378 26232 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:34.181717 26232 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.183974 25927 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.184222 26232 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:33.628348 22618 connection.cc:256] RPC call timeout handler was delayed by -1.3123976250000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 13:08:33.690555 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.283365 22648 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:33.628588 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.333600 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.335199 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.336220 22649 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:33.654034 22651 rpcz_store.cc:276] 0709 13:08:31.260981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.261082 (+   101us) service_pool.cc:224] Handling call
0709 13:08:31.261376 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.390705 (+129329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.600222 (+2209517us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b5400325d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:33.600684 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192561536}
I20260709 13:08:33.624578 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:33.653681 22647 rpcz_store.cc:269] 0709 13:08:31.260681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.262820 (+  2139us) service_pool.cc:224] Handling call
0709 13:08:33.598497 (+2335677us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002daad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:33.598769 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740564864}
W20260709 13:08:33.655401 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 284840us
I20260709 13:08:33.616547 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:33.576519 23227 leader_election.cc:336] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.705s (SENT)
I20260709 13:08:34.408474 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:33.665545 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:33.655614 23263 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
W20260709 13:08:33.630961 25827 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:08:33.700119 26066 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.418045 26066 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.421156 26216 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.421847 26216 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.705121 26130 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:33.663647 26156 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:33.931610 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.933099 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.434994 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:33.986941 26227 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.972631 22500 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:33.981698 26253 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:33.984807 26197 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:33.980509 26228 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:33.987900 26222 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.440933 26227 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.021015 22652 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 8. Ops: []
I20260709 13:08:34.027092 26013 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:34.441154 26130 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:34.441527 26253 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.441715 26013 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:34.441917 26130 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.442569 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.443399 22652 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:34.444465 26130 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:34.032513 25986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.741s	user 0.007s	sys 0.039s
W20260709 13:08:34.445796 25986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.155s	user 0.007s	sys 0.040s
I20260709 13:08:34.034672 26032 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:34.446914 26032 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:34.448014 26032 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.449249 26032 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.039116 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:34.049695 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.055037 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:34.061401 26128 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.064020 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:34.099545 26184 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:34.102540 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.456099 25566 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.456387 22578 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:34.456557 22617 connection.cc:256] RPC call timeout handler was delayed by -1.2260121770000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 13:08:34.457192 22617 connection.cc:256] RPC call timeout handler was delayed by -1.1945121770000924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 13:08:34.103453 26195 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:33.581902 22498 rpcz_store.cc:276] 0709 13:08:29.969714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.972804 (+  3090us) service_pool.cc:224] Handling call
0709 13:08:29.973252 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.086905 (+113653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.093433 (+  6528us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.103516 (+ 10083us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.753268 (+649752us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:30.754938 (+  1670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.580505 (+2825567us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b54001b9754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:33.580592 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.580678 (+    86us) raft_consensus.cc:1685] finished
0709 13:08:33.580692 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.581120 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8297,"raft.queue_time_us":8778,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11439,"spinlock_wait_cycles":225279232,"thread_start_us":379676,"threads_started":1,"wal-append.queue_time_us":642573,"wal-append.run_cpu_time_us":1925,"wal-append.run_wall_time_us":1023970}
I20260709 13:08:34.457628 26219 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:34.458524 26219 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.129726 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:34.459915 22573 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.461050 26066 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:34.461179 26177 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.461958 26177 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:34.130766 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.463043 22579 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:34.137530 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.143440 26188 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 2.849s	user 0.008s	sys 0.036s
I20260709 13:08:34.147442 26164 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:34.156675 22504 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:34.159351 26165 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:34.166787 22501 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:34.169346 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:33.597604 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:34.167181 26108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.879s	user 0.004s	sys 0.032s
W20260709 13:08:34.487807 26108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.200s	user 0.005s	sys 0.032s
I20260709 13:08:34.488111 22573 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:08:34.193038 26047 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.580s	user 0.023s	sys 0.034s
I20260709 13:08:34.488526 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:34.488919 26047 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.876s	user 0.023s	sys 0.035s
I20260709 13:08:34.205127 22646 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:08:34.205708 26187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.929s	user 0.031s	sys 0.028s
I20260709 13:08:34.230798 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:34.237929 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:33.591728 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 609) took 2943 ms. Trace:
W20260709 13:08:34.252041 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet ea7bfa694a734e68806da48189a7e004: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:34.271605 26133 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.276371 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:34.491509 22497 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:33.674257 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:34.284775 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.302031 26163 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.322507 22572 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:08:34.493847 22572 pending_rounds.cc:85] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 4
I20260709 13:08:34.494001 22571 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:34.494190 22572 pending_rounds.cc:107] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:08:34.493664 26013 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.494539 22572 raft_consensus.cc:2889] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.495008 22648 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:34.329638 22401 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 5, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 5 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:34.382496 26138 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.360143 25914 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.365675 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:34.384852 25952 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.381393 26175 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:34.399518 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.400604 26017 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.497790 22401 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 8, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:34.401152 26223 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:34.498888 26175 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:34.499380 26223 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.500248 22501 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:34.500059 26175 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.500823 22577 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:34.501647 26175 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.502046 26223 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.354079 26077 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:34.502931 26077 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.503366 25952 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.402324 26015 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.505076 25914 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.505402 26015 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.503624 26222 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.406594 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.508322 26015 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:34.403044 26016 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.618191 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.425364 23261 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:34.511188 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:34.512670 23261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 531) took 3933 ms (client timeout 1591 ms). Trace:
I20260709 13:08:34.511304 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:34.513245 23261 rpcz_store.cc:269] 0709 13:08:30.579022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.610943 (+ 31921us) service_pool.cc:224] Handling call
0709 13:08:34.512377 (+3901434us) spinlock_profiling.cc:243] Waited 3.67 s on lock 0x7b54006d2ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:34.512563 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8439202688}
I20260709 13:08:34.513756 22650 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:34.513980 25952 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.515727 26177 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:34.515795 26077 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.509274 22654 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:34.401216 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.431589 26216 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.182041 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:34.522145 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 340273us
I20260709 13:08:34.435900 22502 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
W20260709 13:08:34.030645 22469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.011s	sys 0.020s
W20260709 13:08:34.457568 22617 connection.cc:256] RPC call timeout handler was delayed by -1.0660969550000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:08:34.524045 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.415360 25827 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.455572 22580 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:34.456998 25566 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.545770 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.546640 22650 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:34.546938 25566 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:34.477648 22544 connection.cc:256] RPC call timeout handler was delayed by -1.5366145099999358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:08:34.547737 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.468464 26267 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:34.482028 22505 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:34.481873 26201 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.482841 26239 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:34.483592 26128 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:34.480162 26195 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.483328 26164 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.485502 26165 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.486925 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:34.489332 22645 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:34.471130 26219 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.493188 22576 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:34.491930 22496 rpcz_store.cc:276] 0709 13:08:30.625277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.625759 (+   482us) service_pool.cc:224] Handling call
0709 13:08:30.626044 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.549450 (+923406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.568110 (+2018660us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54001b7e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:33.568803 (+   693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086053120}
W20260709 13:08:34.495306 22619 connection.cc:256] RPC call timeout handler was delayed by -1.0604183469999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2368s for a response
I20260709 13:08:34.498073 26017 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.401599 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.502290 26228 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:34.492250 26187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.214s	user 0.031s	sys 0.028s
I20260709 13:08:34.505738 22501 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:34.509280 26016 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:34.412189 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 835852us
I20260709 13:08:34.519686 22651 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:34.463316 22652 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
W20260709 13:08:34.532336 22469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.454s	user 0.012s	sys 0.020s
I20260709 13:08:34.532733 26163 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:34.533236 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:34.536192 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:34.536648 26013 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.536342 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.556403 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.500053 22401 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 6 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:34.558773 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.508421 25914 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.561339 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:34.585712 22646 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:34.568637 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.571462 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.559058 26267 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.588037 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.588613 22572 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:34.598122 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:34.559890 26175 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.594367 22648 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:34.597108 22504 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.597996 22651 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:34.602200 22580 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:34.603190 26066 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:34.603693 26066 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:34.603420 26175 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.604846 26077 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:34.605345 26077 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:34.605770 26077 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.605973 26175 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.606583 26219 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.608018 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:34.611533 26267 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.613054 22650 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.613229 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:34.613541 26017 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:34.613870 22497 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:34.615535 26164 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.616340 22649 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.617452 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.619352 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.607354 22401 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 7, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.600594 26128 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.620797 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.554100 26239 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.632133 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.632246 25914 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:34.633455 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.634037 26239 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.623687 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:34.621745 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 98667.4us
I20260709 13:08:34.621713 26130 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.629859 22401 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 5 to 8, VOTER 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) evicted. New cstate: current_term: 8 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:34.606668 22645 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.622689 26016 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.635584 22497 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:34.600893 22647 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:34.634948 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.644179 22654 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:34.646972 22651 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:34.644690 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:34.648630 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.649557 22650 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:34.654692 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.655356 22654 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:34.656487 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.653573 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:34.666306 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 300970us
I20260709 13:08:34.667547 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:34.565778 26201 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.690546 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.670006 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.661913 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 623) took 4478 ms. Trace:
I20260709 13:08:34.667327 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:34.660481 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.672449 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.672889 22576 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:34.672890 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.658208 26130 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.676048 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:34.701076 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:34.702742 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:34.677469 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.705020 22646 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:34.679401 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.682169 22651 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:34.682922 26066 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.657588 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:34.685982 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.687803 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 151766us
I20260709 13:08:34.688007 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.689177 26165 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:34.689790 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57460.2us
I20260709 13:08:34.586659 26195 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.698907 22652 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:34.700029 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.700342 22496 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:34.677202 22401 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 2 to 3, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.705986 22504 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:34.654560 26233 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:34.654958 26227 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:34.697265 22649 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:34.711547 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.707670 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:34.724097 22650 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:34.700439 26201 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:34.717360 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.718775 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:34.725626 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.723305 26175 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.721288 26133 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:34.721931 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.728019 22651 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:34.727367 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.722074 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:34.729287 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.692276 23260 rpcz_store.cc:276] 0709 13:08:30.183527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.280694 (+1097167us) service_pool.cc:224] Handling call
0709 13:08:34.514525 (+3233831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.585620 (+ 71095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.585650 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:34.594135 (+  8485us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:34.643888 (+ 49753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.650348 (+  6460us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.661605 (+ 11257us) spinlock_profiling.cc:243] Waited 3.23 s on lock 0x7b54006d2ed0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:34.661728 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65409,"raft.queue_time_us":70846,"spinlock_wait_cycles":7442990208}
I20260709 13:08:34.733292 26133 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.733840 26133 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.734355 22647 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
W20260709 13:08:34.734797 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67786.5us
I20260709 13:08:34.735591 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.736187 26017 raft_consensus.cc:2764] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:34.737198 26216 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.737120 22401 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 7, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.739508 22401 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 8, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.741001 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.741714 26195 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:34.742120 26128 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.742277 22579 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:34.742941 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.743446 26197 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.743943 26233 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:34.744813 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.764544 22648 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:34.745035 22503 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:34.728489 26227 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.746086 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.746677 26108 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:34.709616 26163 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:34.751304 26125 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.752009 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 114498us
I20260709 13:08:34.753486 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.724840 22645 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:34.776932 22649 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:08:34.777343 22649 pending_rounds.cc:85] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 3
I20260709 13:08:34.759490 22646 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:34.739439 26017 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:08:34.766579 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 121182us
I20260709 13:08:34.715273 23258 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:34.760787 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:34.767436 22651 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:34.778416 22652 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:34.777576 22649 pending_rounds.cc:107] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:08:34.779722 22649 raft_consensus.cc:2889] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.764884 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:34.781687 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:34.785902 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.789655 22646 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:34.794665 22654 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:34.772073 26227 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.796973 22648 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:34.785120 26133 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.799738 22649 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:34.789258 25914 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:34.801196 22649 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:34.801472 25914 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.802119 25914 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:34.802728 26130 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.804443 22649 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:34.804960 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080034c380 after lost signal to thread 21393
W20260709 13:08:34.806102 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08002cffe0 after lost signal to thread 22437
I20260709 13:08:34.806391 26077 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:34.807440 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5080 after lost signal to thread 22529
I20260709 13:08:34.807329 25952 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:34.808054 25952 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:34.807658 25592 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.808188 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.809217 25952 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.811224 26128 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:34.811403 22544 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:34.811806 26128 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.812309 26128 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:34.809227 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.813637 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.813707 26195 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:34.815155 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.815760 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.816531 26130 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:34.796386 26219 raft_consensus.cc:2764] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:34.817062 26130 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:34.817521 26130 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.817617 25592 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:34.818135 25592 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:34.819152 26163 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:34.819628 26163 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.819766 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.820032 26163 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.821276 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.821346 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.822082 23261 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:34.822151 23262 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:34.823107 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:34.823192 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:34.823882 23262 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.825526 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:34.826428 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.819161 25592 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.828912 25592 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.829669 26233 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.825747 23264 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:34.784539 25827 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:34.833029 26133 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:34.832199 26128 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.782814 26125 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.835162 23263 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:34.836303 26077 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:34.813835 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111268us
I20260709 13:08:34.827849 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.839038 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.840415 26064 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:34.840975 26064 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:34.841745 25986 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:34.842133 22499 raft_consensus.cc:2410] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:34.828465 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:34.841909 26064 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:34.843307 22499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 2411) took 3540 ms (client timeout 2983 ms). Trace:
W20260709 13:08:34.843751 22499 rpcz_store.cc:269] 0709 13:08:31.303242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.307656 (+  4414us) service_pool.cc:224] Handling call
0709 13:08:34.843069 (+3535413us) spinlock_profiling.cc:243] Waited 3.5 s on lock 0x7b54001d97d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:34.843237 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8047601536}
I20260709 13:08:34.844821 25827 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:34.845022 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 59712.9us
I20260709 13:08:34.845504 25827 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.845762 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:34.807816 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080038e9e0 after lost signal to thread 22530
I20260709 13:08:34.842191 25986 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:34.857708 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 81798.2us
W20260709 13:08:34.861017 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800375360 after lost signal to thread 22604
W20260709 13:08:34.862761 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080037d220 after lost signal to thread 22605
W20260709 13:08:34.863929 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800326620 after lost signal to thread 22678
W20260709 13:08:34.864256 22434 debug-util.cc:398] Leaking SignalData structure 0x7b080006fc40 after lost signal to thread 22679
W20260709 13:08:34.865805 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4c20 after lost signal to thread 23288
I20260709 13:08:34.866449 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:34.862396 25986 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.862210 26077 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:34.874631 26125 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.876111 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:34.876528 22653 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:34.877235 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:34.881150 25983 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:34.881951 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2160) took 1266 ms. Trace:
I20260709 13:08:34.882335 22653 rpcz_store.cc:276] 0709 13:08:33.622642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.623778 (+  1136us) service_pool.cc:224] Handling call
0709 13:08:34.881740 (+1257962us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400237654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:34.881875 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098445696}
I20260709 13:08:34.880779 25827 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.861994 26066 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.882898 25986 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:34.885492 25827 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.887322 25986 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:34.889716 22401 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 8, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.865505 26239 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:08:34.892163 26175 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:34.891718 22401 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.893187 25927 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:34.893577 25927 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:34.893965 25927 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:34.894152 23262 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:34.893730 22401 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.894960 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.843281 26064 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:34.905649 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54871.4us
I20260709 13:08:34.912227 26239 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:34.912712 26239 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:34.913664 23256 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:34.913836 26239 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.914791 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:34.915212 26239 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.915815 26195 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:34.915985 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:34.916298 26195 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.916756 26195 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.917014 26216 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:34.921166 25983 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:34.921690 25983 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:34.922600 25983 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.925340 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:34.930270 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63887.9us
I20260709 13:08:34.930686 26197 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:34.931114 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:34.931439 26197 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:34.931999 26267 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:34.932456 26267 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:34.933122 25566 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:34.933560 25566 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:34.932925 26197 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:34.935587 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:34.936408 26219 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:34.934001 25566 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:34.937023 26219 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.937583 26219 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.932966 26267 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.940145 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.941805 26216 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.942356 26216 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.942330 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.943439 23263 raft_consensus.cc:2368] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10.
I20260709 13:08:34.944365 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.945068 23260 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:34.936475 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:34.919370 22401 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 7, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.955037 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.946545 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:34.959599 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:34.967847 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 90737.9us
I20260709 13:08:34.971026 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.971995 22651 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.973623 22504 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:34.974262 22504 pending_rounds.cc:85] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 5
I20260709 13:08:34.974594 22504 pending_rounds.cc:107] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:34.974956 22504 raft_consensus.cc:2889] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:34.975548 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.972301 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:34.953503 26175 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:34.981593 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:34.981783 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:34.960435 26201 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:34.983578 22496 raft_consensus.cc:2410] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:34.987938 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:34.994860 22401 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 7, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.964682 26016 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.999171 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.005412 22499 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:35.006557 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.036511 23263 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:08:35.010725 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49365.2us
I20260709 13:08:35.015851 23256 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:35.017503 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.018170 26015 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.018910 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.022115 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.025032 22650 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:35.062620 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.032107 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.029561 26175 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.047197 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:34.956198 25914 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.068202 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.068785 23264 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.069072 25914 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:35.069165 26013 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.069360 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.049625 22503 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:35.058537 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.070617 22505 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.986584 26201 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.063848 23261 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:35.065884 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.080003 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.080538 22401 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 2 to 3, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 3 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.110553 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.122332 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.122608 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:35.123286 23259 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:08:35.126050 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55056.4us
W20260709 13:08:35.157207 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 196887us
I20260709 13:08:35.175122 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.181267 23259 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:35.182399 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51796.8us
I20260709 13:08:35.192188 23259 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:08:35.197036 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 132960us
I20260709 13:08:35.109778 26201 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:35.205308 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:35.206509 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 76860.1us
I20260709 13:08:35.198825 22504 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:35.069707 26013 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:35.052241 26016 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.208129 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:35.209978 23264 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
W20260709 13:08:35.212375 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.214165 22401 catalog_manager.cc:5697] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 4, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 4 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.078325 23257 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:35.211452 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.216698 22651 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:35.129792 26208 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:35.216838 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 346070us
W20260709 13:08:35.224191 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.236275 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:35.117552 26015 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.245297 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:35.244580 22401 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 2 to 3, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:35.244604 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.212617 26013 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:35.254586 26276 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.125s	user 0.007s	sys 0.003s
I20260709 13:08:35.134315 26187 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:08:35.244262 25827 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.211468 26233 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:35.286128 26077 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:35.242250 26128 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.200132 26163 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:35.291548 22468 leader_election.cc:336] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.544s (SENT)
I20260709 13:08:35.292613 22401 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 11, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:35.300199 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65154.7us
I20260709 13:08:35.300683 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:35.286485 26047 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:35.307821 26077 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:35.333045 26165 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:35.340591 26208 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.341208 26208 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:35.356472 23261 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
W20260709 13:08:35.351270 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60942.6us
I20260709 13:08:35.357803 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:35.360276 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 162087us
I20260709 13:08:35.361620 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.361668 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.371256 22650 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:35.376418 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.306838 22401 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 11, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.304803 26290 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:08:35.377256 22650 raft_consensus.cc:2376] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7. Re-sending same reply.
I20260709 13:08:35.375097 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:35.379279 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 114310us
I20260709 13:08:35.349910 26017 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:35.380573 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 157925us
W20260709 13:08:35.384330 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 128646us
I20260709 13:08:35.377588 26108 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.393989 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.397431 22650 raft_consensus.cc:2376] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11. Re-sending same reply.
W20260709 13:08:35.397447 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 327240us
W20260709 13:08:35.410733 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.396760 22401 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.383378 26017 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.391521 26221 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:35.421126 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119474us
I20260709 13:08:35.423476 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.420233 22401 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 6, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:35.431257 26289 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:08:35.431813 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.432003 26294 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:08:35.432457 22572 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:35.437189 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.438140 22577 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:35.438630 25592 consensus_meta.cc:287] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.003s
W20260709 13:08:35.443066 26239 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.001s
I20260709 13:08:35.443710 26313 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:35.444487 26313 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.431068 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:35.443833 25566 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.005s
I20260709 13:08:35.418867 26016 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:35.420549 26017 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.449656 23263 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:35.447432 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.440599 22503 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:35.447607 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.459317 22573 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:35.460557 22505 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:35.457644 26015 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:35.463591 26219 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.001s
I20260709 13:08:35.464591 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.466225 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.467051 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.476594 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.477526 22577 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:35.446944 26313 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:35.449087 25983 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.446801 26208 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.511933 26208 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:35.428793 26077 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.493974 26163 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.513579 26013 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.516104 26013 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.516503 22649 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:35.519555 26227 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.004s
I20260709 13:08:35.519469 26295 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:35.521008 26295 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:35.496565 26216 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.553s	user 0.004s	sys 0.010s
I20260709 13:08:35.521910 26295 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.460986 25566 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.504233 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:35.524552 25566 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.499859 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.505451 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:35.532091 22573 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
W20260709 13:08:35.532631 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 142039us
I20260709 13:08:35.468809 26219 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.533931 22654 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:35.534922 26219 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.533466 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:35.535691 26219 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:35.537000 22618 leader_election.cc:400] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10.
I20260709 13:08:35.537533 22618 leader_election.cc:403] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:35.504220 25927 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.014s
W20260709 13:08:35.509305 26195 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.592s	user 0.015s	sys 0.000s
I20260709 13:08:35.538381 25927 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.493999 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:35.491284 26267 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.010s
W20260709 13:08:35.540045 26130 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.722s	user 0.014s	sys 0.006s
I20260709 13:08:35.540347 26267 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.541021 25983 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.542994 26267 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.529389 22650 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:35.545047 22648 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:35.546200 25983 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:35.520543 26227 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:35.548142 25827 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:35.549124 25592 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:35.549407 25827 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:35.550242 25592 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:35.550454 25827 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:35.550707 25592 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:35.550943 25827 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:35.551298 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.551913 22654 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:35.551796 25592 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.525913 26221 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:35.555349 26221 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:35.555400 25592 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.556345 26221 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.540494 26130 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.537626 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:35.497787 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.559819 22577 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:35.538472 26195 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.538763 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:35.556957 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 141214us
I20260709 13:08:35.521867 26216 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.530548 26295 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.561069 22654 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:35.576797 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:35.559105 23258 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.016s
I20260709 13:08:35.594460 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:35.597359 22573 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:35.599017 22501 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:35.601138 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 64384.5us
W20260709 13:08:35.603224 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96996.3us
I20260709 13:08:35.603287 22502 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:35.602919 26314 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10.
I20260709 13:08:35.605611 26306 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:35.606623 26306 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:35.607075 26130 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.607672 26306 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.610241 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.612319 22579 raft_consensus.cc:2393] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:35.616600 23263 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:35.561514 25952 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.560603 26219 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:35.627182 22573 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:35.630604 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:35.634341 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.636758 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:35.637465 22576 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:35.597010 23258 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:35.595065 26108 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:08:35.640930 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.642385 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:35.643682 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.551935 25827 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.649035 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.648017 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.650947 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.647713 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.653820 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.654385 26222 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:35.657469 26222 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.657917 26222 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.658095 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:35.659099 26291 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:35.659451 26133 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:35.659596 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.662164 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.655543 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.669770 22652 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:35.656157 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.654943 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.658222 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:35.664278 25827 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:35.671797 22654 raft_consensus.cc:606] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:35.672178 22654 raft_consensus.cc:614] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:35.673164 22647 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:35.673445 26015 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:35.675539 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 44983.9us
I20260709 13:08:35.675741 25927 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:35.675688 26195 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:35.676419 26228 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.677068 26228 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.678958 25952 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:35.679148 26228 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:35.679425 25952 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:35.639700 26314 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:35.680449 25952 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.681320 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.681890 25952 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.683028 26219 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.683975 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.685241 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.668088 26133 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:35.681802 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.686825 22651 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:35.634187 26267 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.665040 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.688494 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:35.693703 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.695372 22502 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:35.634649 26227 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:35.618270 26017 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.625952 26201 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:35.694751 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46634.7us
W20260709 13:08:35.698228 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 58178.9us
I20260709 13:08:35.699699 22576 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:35.709889 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.706143 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.657997 26216 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:35.717303 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.693320 26047 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.717370 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.721494 22579 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:35.720186 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:35.718356 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:35.718145 22651 raft_consensus.cc:2376] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7. Re-sending same reply.
I20260709 13:08:35.746444 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.725535 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:35.697646 26304 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.754398 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.755074 22649 raft_consensus.cc:2376] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6. Re-sending same reply.
W20260709 13:08:35.755942 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67997us
I20260709 13:08:35.756994 26047 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.757462 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:35.755319 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:35.759075 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.759569 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:35.759972 22651 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:35.763832 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44830.3us
I20260709 13:08:35.695770 26187 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:35.770694 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.771920 22647 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:35.695657 26177 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:08:35.779994 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.781112 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.697340 26267 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.784503 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.785140 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:35.785357 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.783836 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.783875 22571 raft_consensus.cc:2410] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:08:35.788728 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 63287.1us
I20260709 13:08:35.789820 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:35.784590 22573 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:35.794641 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:35.800071 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:35.801582 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.802947 22544 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:35.806048 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.767684 25983 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.811568 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.777539 26227 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.777555 26216 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:35.813700 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.813859 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.819620 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.820355 22650 raft_consensus.cc:2368] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8.
I20260709 13:08:35.793684 26016 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:35.827203 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 127705us
I20260709 13:08:35.829107 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:35.834013 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.833614 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.799734 26292 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:35.836135 22654 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:35.838129 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:35.839161 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.840637 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.834812 22653 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:35.843075 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.779692 26133 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:35.806874 26128 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:35.847316 26128 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:35.847523 26267 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:35.847724 26128 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:35.796083 26293 raft_consensus.cc:2764] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:35.850250 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.849977 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:35.763816 26304 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:35.815793 26165 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:35.822580 26221 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:35.824206 26290 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:35.863271 26290 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.863703 26290 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.865505 26317 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:35.867085 26320 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:08:35.857254 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.869115 22504 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.858368 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.858701 22651 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:35.859478 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.859797 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.860209 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.882117 22503 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:35.860414 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.882833 22500 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:35.860797 26305 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:35.861052 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.861446 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.862739 26227 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:35.868535 22468 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.560s (SENT)
I20260709 13:08:35.839566 26017 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:35.858616 22653 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:35.871347 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:35.833504 26016 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.870288 25827 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.873337 26047 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:35.856307 26165 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.878175 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:35.878234 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.878975 26197 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:35.919097 22654 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:35.879838 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.880422 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:35.826509 26208 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.916764 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.797559 26130 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:08:35.886922 22504 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:35.889603 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.899012 22653 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:35.898877 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.852432 26228 raft_consensus.cc:2764] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:35.901129 22645 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:08:35.901168 22468 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.560s (SENT)
I20260709 13:08:35.903353 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.903998 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.871944 26221 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.904850 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.906302 22571 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:35.908092 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:35.856622 26292 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:35.922245 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:35.938649 22652 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:35.926462 22647 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:35.903123 26016 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.940690 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.902042 26267 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.941428 22648 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:35.941699 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.942077 22501 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:35.937433 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:35.944509 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.952054 22649 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.945223 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.947090 22496 raft_consensus.cc:2368] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:35.954247 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.954463 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.954998 22652 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.955538 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.920373 26165 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.920287 26227 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:35.960994 22502 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:35.919243 26197 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:35.979031 23263 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:35.966269 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:35.904033 26125 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:08:35.966776 22573 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:35.982044 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:35.941730 26221 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:35.967197 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:36.031618 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 110345us
I20260709 13:08:35.911149 26222 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:36.034196 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69797.2us
I20260709 13:08:35.984808 22649 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:36.036900 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:36.038069 26312 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.046465 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:35.964838 26047 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.051594 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:36.058760 22653 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:36.065604 22652 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:36.067176 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:36.090221 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44051.9us
I20260709 13:08:36.092682 22649 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:36.092046 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:36.095980 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:36.105190 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:35.955224 26195 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:08:36.107725 22650 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:36.111915 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:36.115607 22497 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:36.033957 26317 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.124712 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:36.049052 26216 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:36.121798 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:35.941767 26128 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.101472 26208 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:36.135860 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.136718 22579 raft_consensus.cc:2368] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10.
I20260709 13:08:35.979914 26267 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:36.137355 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 94144.1us
I20260709 13:08:36.143604 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:36.147060 22653 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:36.148110 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:36.158427 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.160768 22654 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:36.133239 26216 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:36.162009 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:36.132316 26332 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:36.168648 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:36.170099 22579 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:36.152297 26307 consensus_queue.cc:1175] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
I20260709 13:08:36.170750 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:36.172497 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 271334us
W20260709 13:08:36.175927 26325 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:36.188596 26216 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.191026 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:36.176206 26267 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:36.192827 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:36.178184 26323 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:08:36.156682 26303 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:36.193848 22498 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 4: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:36.194656 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:36.195515 22498 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:36.195509 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:36.196810 26319 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.381s	user 0.002s	sys 0.000s
I20260709 13:08:36.200503 23260 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:36.127749 26317 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.207410 26317 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:36.208374 26333 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:36.153450 25927 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:08:36.178848 26322 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:08:36.161155 26128 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:36.179109 26284 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:36.160992 26177 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:08:36.180770 26222 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:36.103523 26312 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.185423 22500 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:36.186249 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:36.145054 26197 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.187458 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.192068 22504 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:36.232230 22504 pending_rounds.cc:85] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 2
I20260709 13:08:36.232513 22504 pending_rounds.cc:107] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:36.192761 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:36.233497 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47354.2us
I20260709 13:08:36.193192 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:36.177222 26328 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:08:36.210937 22578 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:36.242427 22501 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:36.210501 26314 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:36.241997 25827 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:36.171912 26130 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:36.252897 26130 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:36.212898 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 445) took 1395 ms. Trace:
I20260709 13:08:36.213819 26290 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.214574 26015 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:36.184376 26175 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:36.222426 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.222723 22503 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:36.227957 22572 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
W20260709 13:08:36.226372 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82904.6us
I20260709 13:08:36.265715 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.266105 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:36.267534 22500 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:36.269198 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:36.232749 22504 raft_consensus.cc:2889] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.234295 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:36.240502 26197 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.240908 26228 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.230432 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:36.212493 26337 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.290699 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:36.291517 22499 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.249934 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.244257 26314 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.226240 26304 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:36.230854 22502 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:36.272403 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:36.310029 22498 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:36.160714 26227 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.151258 26292 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.264360 26015 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:36.298100 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67757us
W20260709 13:08:36.298282 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 64081.4us
I20260709 13:08:36.298336 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.290793 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:36.309204 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.317584 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:36.317492 22578 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:36.249435 25927 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.313212 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:36.315321 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.330487 22572 raft_consensus.cc:2368] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:08:36.311113 22505 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:36.331749 26317 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:36.337601 26015 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.338910 26195 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.345644 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:36.363057 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45548.1us
I20260709 13:08:36.309628 26314 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.346312 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.392688 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:36.265056 23258 rpcz_store.cc:276] 0709 13:08:34.817727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.828176 (+ 10449us) service_pool.cc:224] Handling call
0709 13:08:36.212687 (+1384511us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400600254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:36.212795 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391654656}
W20260709 13:08:36.377532 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.313069 26047 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:36.388298 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 75214.1us
I20260709 13:08:36.398833 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.399534 22580 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:36.324913 26331 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.317188 26222 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:36.326057 26312 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:36.383785 22499 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
W20260709 13:08:36.383963 22468 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.579s (SENT)
I20260709 13:08:36.404953 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.314338 25983 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:36.419466 22653 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:36.326285 26339 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:36.412750 22652 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:36.403098 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:36.343575 25927 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:36.427578 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43680.8us
I20260709 13:08:36.427947 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:36.428527 22468 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.579s (SENT)
I20260709 13:08:36.391830 26305 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:36.435557 22580 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:36.403275 26317 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:36.417716 26295 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.002s
I20260709 13:08:36.430737 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.325127 26335 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.202s
I20260709 13:08:36.425226 26292 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:36.432646 22647 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:36.394758 26267 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.440171 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.472069 22572 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:36.441648 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.442749 26339 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:36.426091 25983 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.405069 25952 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.434319 26309 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:08:36.461170 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.481415 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.429297 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:36.459400 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:36.463337 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55956.1us
I20260709 13:08:36.309280 26337 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.459334 22618 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:36.470314 22579 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:36.473374 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:36.693580 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 234395us
I20260709 13:08:36.694056 22572 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:36.474203 25927 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:36.435230 26312 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:36.558570 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86811us
I20260709 13:08:36.579841 26339 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:36.525316 22580 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:36.471529 26307 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.527043 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 98559.9us
W20260709 13:08:36.711827 22468 leader_election.cc:336] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.584s (SENT)
I20260709 13:08:36.712383 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:36.415721 26331 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.510689 25952 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.518155 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.627463 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:36.651204 26201 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:36.512568 26335 consensus_queue.cc:1243] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:36.463333 26222 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:36.738476 22496 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:36.738854 26222 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.681399 22649 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:36.741194 25952 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:36.625211 26344 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:08:36.650849 26345 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:36.555284 26317 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:36.626403 26347 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:08:36.570776 26290 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:36.519158 26334 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.510933 26221 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.563162 23258 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:36.555997 26343 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:36.679878 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:36.674417 26016 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.003s
I20260709 13:08:36.587265 22576 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:36.695654 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:36.474495 26333 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.704170 26312 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.710531 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:36.714990 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 194858us
I20260709 13:08:36.778908 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:36.718833 22578 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:36.726598 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.780638 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.718217 26307 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.737187 26335 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.764183 22572 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
W20260709 13:08:36.729990 26219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.019s	sys 0.016s
W20260709 13:08:36.772822 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 289161us
I20260709 13:08:36.744975 26337 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:36.775656 25566 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:36.777200 26223 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:36.700032 26309 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:36.786314 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.804051 22572 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:36.790081 23257 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:36.790954 26201 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:36.791508 26333 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:36.792986 26346 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 13:08:36.794459 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:36.775591 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 80050.2us
I20260709 13:08:36.796303 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.796504 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.777060 26016 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.827025 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:36.802999 25566 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:36.798933 26128 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
I20260709 13:08:36.845590 26290 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.846026 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:36.846951 26339 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:36.803782 26293 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:36.847882 26339 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:36.848289 26339 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:36.800212 26223 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.809091 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.821513 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.856662 22572 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:36.823886 26327 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.036s	user 0.005s	sys 0.000s
I20260709 13:08:36.824198 23258 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:36.828823 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:36.857611 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:36.830251 26165 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.845s	user 0.007s	sys 0.006s
I20260709 13:08:36.830173 25566 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.832412 26221 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:36.834344 26307 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:36.835134 26333 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:36.836897 26312 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:36.837618 22646 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:36.838316 26016 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:36.839339 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:36.839362 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 127589us
I20260709 13:08:36.814510 26309 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:36.847213 26290 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:36.797267 26219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.019s	sys 0.016s
I20260709 13:08:36.805462 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.845432 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.849298 26339 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.863538 26201 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:36.845433 26337 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:36.864320 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:36.865247 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:36.865499 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:36.909343 22501 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.909448 22503 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:36.909600 22652 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.867594 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.910842 22572 raft_consensus.cc:2368] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8.
I20260709 13:08:36.911602 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:36.911885 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.858381 26223 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.878569 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:36.914849 22500 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:36.879166 22468 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.618s (SENT)
I20260709 13:08:36.915370 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:36.800637 26187 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:08:36.877489 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:36.860752 26332 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.651s	user 0.014s	sys 0.000s
I20260709 13:08:36.869984 26165 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:36.888025 22653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc46eb991824d25bde40d1001e04798"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:36.891580 26309 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.893314 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.897294 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:36.918486 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 78833bb30a8347f19e5f2696aacc31e1: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:36.918597 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:36.925624 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:36.926577 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 47444us
I20260709 13:08:36.927189 26357 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:36.896169 26290 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:36.908104 26197 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.618s	user 0.014s	sys 0.000s
W20260709 13:08:36.912678 26047 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.002s
I20260709 13:08:36.929136 26339 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.956986 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:37.016438 22468 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.620s (SENT)
I20260709 13:08:36.962652 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2193) took 1311 ms. Trace:
W20260709 13:08:37.017262 22468 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.620s (SENT)
I20260709 13:08:36.961725 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:36.932266 22652 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
W20260709 13:08:36.969501 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.020234 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:36.993398 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.021471 22503 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:36.932021 22500 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:36.947397 22579 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:37.017781 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:36.932521 22653 raft_consensus.cc:606] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.024379 22653 raft_consensus.cc:614] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:37.024216 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:37.017408 22645 rpcz_store.cc:276] 0709 13:08:35.651360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.664747 (+ 13387us) service_pool.cc:224] Handling call
0709 13:08:36.962421 (+1297674us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400237654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:36.962576 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473765120}
I20260709 13:08:37.028977 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.029667 22501 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:37.033205 22498 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:37.033161 22504 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:37.033996 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:37.038930 22500 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.034500 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:36.972194 26314 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.008s
W20260709 13:08:36.988140 26346 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:08:37.050489 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:37.062080 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.063268 22578 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:37.055095 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.064462 22571 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:37.042620 26307 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.065821 26307 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.960492 26015 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.031785 26047 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:36.960258 26165 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:36.919174 26201 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:36.929579 26219 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.083745 26356 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:08:37.084018 26219 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:36.972584 25983 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.086035 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 477) took 1162 ms. Trace:
I20260709 13:08:37.086494 23261 rpcz_store.cc:276] 0709 13:08:35.923381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.923563 (+   182us) service_pool.cc:224] Handling call
0709 13:08:35.944718 (+ 21155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.187008 (+242290us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:36.242715 (+ 55707us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.750041 (+507326us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.768698 (+ 18657us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.768892 (+   194us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:36.768933 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.769007 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.987857 (+218850us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b240033ae98. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324d09d 00007fec25e7f10e 00007fec25e9688c 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221
0709 13:08:37.085711 (+ 97854us) raft_consensus.cc:1685] finished
0709 13:08:37.085821 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.085952 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4010,"prepare.queue_time_us":44767,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4479,"raft.queue_time_us":94451,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":14533,"spinlock_wait_cycles":33985920,"thread_start_us":732460,"threads_started":3,"wal-append.queue_time_us":312239}
I20260709 13:08:36.978080 23258 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:36.972718 26353 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:37.062433 22505 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.051383 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:36.937872 26332 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:36.974884 26331 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:37.074838 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.027519 26290 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:37.026927 26337 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.119556 23263 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:37.031369 26333 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.031044 26227 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:37.137041 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.081307 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.074009 26314 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.082894 26201 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.106943 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.108912 26353 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.112648 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:37.147027 25566 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:37.059531 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:37.132707 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2400) took 1233 ms. Trace:
I20260709 13:08:37.134645 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.133841 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.150183 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:37.135517 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 118272us
I20260709 13:08:37.147470 25566 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:37.150408 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.150455 22572 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:37.150916 25566 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:37.151278 22503 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:37.151751 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.152346 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.153826 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 615) took 1013 ms. Trace:
I20260709 13:08:37.148010 22654 rpcz_store.cc:276] 0709 13:08:35.899739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.935323 (+ 35584us) service_pool.cc:224] Handling call
0709 13:08:37.132452 (+1197129us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003f0a54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.132625 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469927296}
I20260709 13:08:37.156392 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.159508 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.161193 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:37.154192 22572 rpcz_store.cc:276] 0709 13:08:36.140908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.152710 (+1011802us) service_pool.cc:224] Handling call
0709 13:08:37.153155 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.153515 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.153540 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:37.153582 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:37.153612 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.153671 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.153777 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:37.160614 25566 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.166126 22503 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:37.170514 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:37.164738 26227 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:37.172775 25566 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:37.171129 22649 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:37.199258 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2398) took 1269 ms. Trace:
I20260709 13:08:37.217753 22650 rpcz_store.cc:276] 0709 13:08:35.899065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.899204 (+   139us) service_pool.cc:224] Handling call
0709 13:08:35.899559 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.121751 (+222192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.168374 (+1046623us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540017d9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:37.168597 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478072576}
I20260709 13:08:37.218374 22505 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:37.190060 22571 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:37.208300 22573 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:37.172348 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:37.225865 22575 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:37.228902 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.204844 22500 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:37.174680 22578 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:37.231175 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 617) took 1011 ms. Trace:
W20260709 13:08:37.231686 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61712us
I20260709 13:08:37.231909 25566 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:37.162949 26187 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:37.232765 25566 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:37.240093 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:37.243844 22498 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:37.245757 22572 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:37.233111 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 60841.4us
I20260709 13:08:37.195772 26017 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.231570 22578 rpcz_store.cc:276] 0709 13:08:36.219453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.156352 (+936899us) service_pool.cc:224] Handling call
0709 13:08:37.174288 (+ 17936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.230875 (+ 56587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.231119 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:37.239553 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.247092 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:37.171967 26363 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:37.155887 26353 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.252071 25566 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.182986 26370 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:37.265014 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:37.245257 26219 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.265661 26352 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.266181 25927 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:37.272302 26314 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:37.274747 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:37.277313 26227 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.246992 26295 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:37.279794 26133 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.163475 26337 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:37.314986 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.247287 26307 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.313325 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:37.331614 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 180571us
W20260709 13:08:37.333209 22468 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.809s (SENT)
I20260709 13:08:37.268683 25983 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.333705 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.302260 26016 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.341220 26016 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.343807 26016 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.345064 26331 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:37.346771 22468 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.864s (SENT)
I20260709 13:08:37.349537 26332 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.349977 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.351128 26331 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.353119 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.355780 26331 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.357714 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.360176 26331 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:37.282637 26352 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.361030 26331 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:37.362159 26331 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.366285 26352 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.350485 26332 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.309516 26295 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.368848 26295 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.370720 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3071) took 1492 ms. Trace:
I20260709 13:08:37.372829 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.331140 26370 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:37.251564 26187 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.307777 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.257403 26017 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.395298 22499 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:37.397094 22578 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:08:37.420476 23259 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:37.380075 26165 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:37.422175 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 114517us
I20260709 13:08:37.371299 22574 rpcz_store.cc:276] 0709 13:08:35.878686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.881146 (+  2460us) service_pool.cc:224] Handling call
0709 13:08:35.906471 (+ 25325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.910758 (+  4287us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:35.935067 (+ 24309us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.931454 (+996387us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18001edfc0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:08:37.251504 (+320050us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.251973 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:08:37.252104 (+   131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:37.252332 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:08:37.255055 (+  2723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.255130 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.370458 (+115328us) raft_consensus.cc:1685] finished
0709 13:08:37.370488 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.370649 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6274,"prepare.queue_time_us":40247,"prepare.run_cpu_time_us":197,"prepare.run_wall_time_us":46428,"raft.queue_time_us":15665,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":22905,"spinlock_wait_cycles":25432064,"thread_start_us":319790,"threads_started":1,"wal-append.queue_time_us":1393012}
W20260709 13:08:37.424537 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54323.5us
I20260709 13:08:37.429018 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.431895 26017 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.433470 26370 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.436697 22649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:37.437659 22649 raft_consensus.cc:606] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.438143 22649 raft_consensus.cc:614] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:37.421831 26307 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:37.449841 26307 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:37.452309 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3058) took 1732 ms (client timeout 2023 ms). Trace:
I20260709 13:08:37.449846 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:37.453630 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3078) took 1241 ms. Trace:
I20260709 13:08:37.460405 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.454416 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2209) took 1642 ms. Trace:
I20260709 13:08:37.470284 22580 rpcz_store.cc:276] 0709 13:08:36.212349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.441386 (+229037us) service_pool.cc:224] Handling call
0709 13:08:37.453396 (+1012010us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b54003f4b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.453569 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119133056}
I20260709 13:08:37.455044 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2409) took 1053 ms. Trace:
I20260709 13:08:37.469758 22574 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.472013 22468 leader_election.cc:400] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8.
I20260709 13:08:37.472466 22468 leader_election.cc:403] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:08:37.452754 22576 rpcz_store.cc:269] 0709 13:08:35.719774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.719904 (+   130us) service_pool.cc:224] Handling call
0709 13:08:37.452086 (+1732182us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54003ee9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.452210 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737522560}
I20260709 13:08:37.471603 22651 rpcz_store.cc:276] 0709 13:08:36.401257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.415528 (+ 14271us) service_pool.cc:224] Handling call
0709 13:08:36.439401 (+ 23873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.742394 (+302993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.742443 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.743398 (+   955us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.753560 (+ 10162us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:36.753603 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.454639 (+701036us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54002f8854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:37.454693 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.454743 (+    50us) raft_consensus.cc:1685] finished
0709 13:08:37.454757 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.454977 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22779,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":12419,"spinlock_wait_cycles":652486400,"thread_start_us":9718,"threads_started":1,"wal-append.queue_time_us":10229}
W20260709 13:08:37.473606 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44295.3us
I20260709 13:08:37.470650 22646 rpcz_store.cc:276] 0709 13:08:35.811692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.819024 (+  7332us) service_pool.cc:224] Handling call
0709 13:08:37.454056 (+1635032us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.454202 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290546432}
W20260709 13:08:37.478165 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 231180us
I20260709 13:08:37.478945 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.479696 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2447) took 1281 ms. Trace:
I20260709 13:08:37.422461 26306 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.419533 26317 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:37.426210 26016 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.488133 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.488360 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.480219 22502 rpcz_store.cc:276] 0709 13:08:36.191900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.191972 (+    72us) service_pool.cc:224] Handling call
0709 13:08:36.230496 (+ 38524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.299461 (+ 68965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.473459 (+1173998us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b540042a4d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.473604 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87862144}
I20260709 13:08:37.475591 26330 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:37.477219 26333 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.492353 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:37.488231 26223 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.005s
I20260709 13:08:37.503191 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:37.490293 26306 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.491667 26227 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:37.519152 26367 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.522500 22545 leader_election.cc:400] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:37.522941 22545 leader_election.cc:403] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.488986 26332 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.525717 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:37.479198 26017 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:37.533557 25983 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:37.534111 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:37.534844 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:37.535048 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.535488 23260 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:37.520612 26331 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:37.523546 26307 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.493810 26317 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.547032 26317 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.547159 26017 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:37.547701 26017 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:37.548569 26017 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.550846 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.551733 22578 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:37.539466 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:37.555079 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2086) took 1520 ms. Trace:
I20260709 13:08:37.555099 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.556095 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.558223 22651 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:37.560407 23260 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:37.555739 22573 rpcz_store.cc:276] 0709 13:08:36.034953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.035089 (+   136us) service_pool.cc:224] Handling call
0709 13:08:37.554861 (+1519772us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54003c82d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.555005 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2182704512}
I20260709 13:08:37.563423 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.564105 22654 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:37.568363 22647 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:37.567978 26353 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:37.569985 23259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 476) took 1712 ms (client timeout 2138 ms). Trace:
W20260709 13:08:37.570528 23259 rpcz_store.cc:269] 0709 13:08:35.858024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.858160 (+   136us) service_pool.cc:224] Handling call
0709 13:08:37.569762 (+1711602us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540035d754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.569911 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3490419456}
I20260709 13:08:37.522785 26223 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.571950 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:37.571357 22498 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:37.538987 26330 raft_consensus.cc:2764] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:08:37.581836 22502 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:37.609275 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:37.572580 23258 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:37.576488 26357 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8.
I20260709 13:08:37.617441 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.618327 22653 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:37.593245 25914 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.621785 22652 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:37.549813 26017 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:37.620133 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65180.3us
I20260709 13:08:37.618571 26307 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:37.618937 26352 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.621441 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:37.630199 22647 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:37.562290 26208 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.584821 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:37.625697 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.630502 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.639256 22578 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:37.632017 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:37.656186 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71510.5us
I20260709 13:08:37.659931 22651 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:37.619477 26133 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:37.618939 26331 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:37.631323 26339 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.600s	user 0.023s	sys 0.007s
I20260709 13:08:37.663388 22648 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:37.664304 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.630008 26219 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.669261 26290 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.002s
I20260709 13:08:37.669517 22577 raft_consensus.cc:2410] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:37.669754 26290 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.672417 26290 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.630239 26223 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:37.679584 26379 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:08:37.674820 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51327us
I20260709 13:08:37.676345 22579 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:37.680676 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47591.7us
W20260709 13:08:37.682466 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 146553us
I20260709 13:08:37.684013 22572 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:37.628836 25914 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.683590 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:37.638139 26352 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.681260 26339 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:37.680070 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 556) took 1053 ms. Trace:
I20260709 13:08:37.682838 26331 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:37.662993 26208 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.686285 26221 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:37.674015 26133 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.696295 22572 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:37.711530 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.711658 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.714463 26208 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.706676 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 471) took 1869 ms. Trace:
I20260709 13:08:37.680573 26219 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.727633 26353 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:37.728307 26219 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.690814 26165 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.729519 26165 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.693800 26108 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:37.730674 26108 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.724095 26339 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.724162 26389 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:37.724388 26331 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.694132 26332 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:37.723237 23256 rpcz_store.cc:276] 0709 13:08:35.837525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.848413 (+ 10888us) service_pool.cc:224] Handling call
0709 13:08:35.859424 (+ 11011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.120644 (+261220us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:36.169263 (+ 48619us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.345349 (+176086us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.445023 (+ 99674us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.475573 (+ 30550us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:36.523542 (+ 47969us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.546975 (+ 23433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.688143 (+1141168us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400680954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:37.690555 (+  2412us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.690699 (+   144us) raft_consensus.cc:1685] finished
0709 13:08:37.692016 (+  1317us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.700892 (+  8876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17027,"prepare.queue_time_us":20059,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":79250,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":23156,"spinlock_wait_cycles":392299904,"thread_start_us":49815,"threads_started":1,"wal-append.queue_time_us":225286}
I20260709 13:08:37.737308 22574 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:37.738003 22572 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.739019 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.739773 26108 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.741146 25914 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.741786 26221 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:37.742142 26330 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.742996 26330 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:37.726240 26133 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.742522 26130 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.744357 26130 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.742785 26221 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.743582 26330 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:37.725836 26352 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.749850 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.750512 26389 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.766599 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.769730 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.755592 26197 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:37.781386 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.782769 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.752946 26187 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.768343 26339 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.786537 26333 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.768704 26389 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.700536 23257 rpcz_store.cc:276] 0709 13:08:36.627019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.627153 (+   134us) service_pool.cc:224] Handling call
0709 13:08:37.679816 (+1052663us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b54006d1854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.679994 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133811584}
I20260709 13:08:37.771742 26195 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:37.800906 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 82602.5us
I20260709 13:08:37.780361 26290 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.813517 22572 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:37.815572 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.817066 26307 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.817461 25983 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:37.819921 25983 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.824644 25983 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:37.824920 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.825928 26317 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:37.826387 26317 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:37.826483 26339 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:37.827273 26317 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.827998 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.828333 26317 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.829247 26339 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.832818 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.834025 25983 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.835456 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:37.836491 25927 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.836959 25927 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.837298 25927 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.807791 26330 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.840807 26330 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.842274 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.843343 26128 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.845454 25927 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.847918 22503 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:37.847497 26389 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.848598 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.807538 26378 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:37.882758 26378 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:37.883145 26378 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:37.883287 26389 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.883744 26337 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.884121 22499 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:37.771942 26295 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.885608 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2439) took 1785 ms. Trace:
I20260709 13:08:37.886683 26295 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:37.886135 22496 rpcz_store.cc:276] 0709 13:08:36.100402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.102455 (+  2053us) service_pool.cc:224] Handling call
0709 13:08:36.266567 (+164112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.739111 (+472544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.961377 (+222266us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540039a8d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:37.885299 (+923922us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540039a8d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.885527 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412465920}
I20260709 13:08:37.884027 26378 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.888959 26378 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.854710 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:37.857398 25952 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:37.858060 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet a4afa4eec9774883a53b37419c20bbf4: Illegal state: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:37.891609 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.860157 26290 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.867422 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:37.897962 22498 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:37.898100 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 216688us
I20260709 13:08:37.869270 22502 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:37.870949 22504 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:08:37.875067 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 163608us
I20260709 13:08:37.875979 26047 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.900219 26047 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:37.900959 26064 consensus_queue.cc:1175] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" responder_term: 13 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: [12.10-12.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:37.902591 26047 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.903901 26306 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:37.879523 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 220664us
I20260709 13:08:37.904634 26389 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.905572 26389 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:37.905874 26389 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:37.853857 22497 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:37.907085 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2441) took 1740 ms. Trace:
I20260709 13:08:37.906701 26389 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.907473 22497 rpcz_store.cc:276] 0709 13:08:36.166564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.166927 (+   363us) service_pool.cc:224] Handling call
0709 13:08:36.167320 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.906341 (+1739021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.906885 (+   544us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400016154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:37.907032 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3877907328}
I20260709 13:08:37.895044 26228 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:37.910344 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:37.895191 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:37.911033 22652 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:37.913095 26342 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:37.896471 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3085) took 1077 ms. Trace:
I20260709 13:08:37.914623 22577 rpcz_store.cc:276] 0709 13:08:36.819393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.860539 (+ 41146us) service_pool.cc:224] Handling call
0709 13:08:37.892842 (+1032303us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54003b2c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:37.896400 (+  3558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692930944}
I20260709 13:08:37.896943 26309 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:37.915616 26309 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.915977 26309 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.916108 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:37.917625 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.919809 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:37.920885 26228 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.921277 26228 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:37.921670 26228 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.922114 26305 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:37.922883 26305 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.923394 26305 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.926014 26219 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:37.926923 26219 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:37.927278 26219 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:37.934235 26397 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.934787 26397 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.934891 26223 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:37.903923 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.935271 25952 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:37.937475 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:37.938462 26223 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:37.938998 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.939694 22654 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:37.940626 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.940900 26013 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:37.942785 26292 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.943178 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.943344 26292 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:37.944114 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.944589 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.915045 26342 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.945953 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.935214 26397 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.946981 22646 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:37.939006 26223 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:37.948146 26223 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:37.948582 26292 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:37.908046 26389 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.945252 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.950241 22651 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:37.899257 26017 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:37.928140 26219 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:37.955664 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.957376 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:37.958168 22576 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:37.960649 22571 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:08:37.961189 22571 pending_rounds.cc:85] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 4
I20260709 13:08:37.961434 22571 pending_rounds.cc:107] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:08:37.961649 22571 raft_consensus.cc:2889] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.961683 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:37.963380 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.963967 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:37.964557 22575 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.968096 25927 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:37.968997 26383 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.434s	user 0.005s	sys 0.000s
I20260709 13:08:37.969630 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.971683 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:37.972445 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:37.973749 22497 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.973834 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:37.974218 25983 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:37.974689 25983 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.975116 25983 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:37.975193 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:37.975907 23256 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:37.973297 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:37.977274 23259 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:37.974480 23263 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.982800 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:37.983227 22652 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:37.983412 22505 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:37.984134 22468 connection.cc:256] RPC call timeout handler was delayed by -1.4453226629999563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:08:37.984567 22468 connection.cc:256] RPC call timeout handler was delayed by -1.4056935879999628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:08:37.985008 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44374.4us
I20260709 13:08:37.985162 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:37.986024 22571 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:37.986346 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:37.986608 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:37.987115 22502 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:37.994202 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:37.995462 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:37.996296 23260 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:37.986989 22499 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
W20260709 13:08:37.998785 22468 leader_election.cc:336] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.851s (SENT)
I20260709 13:08:37.999254 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:37.987968 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43737.2us
I20260709 13:08:38.013200 22499 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:38.014207 22468 leader_election.cc:336] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.933s (SENT)
I20260709 13:08:38.014698 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.014762 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:38.016379 26391 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:38.016772 26064 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:38.002838 26017 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:38.016836 22649 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:38.013463 26330 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:38.020248 26017 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.021306 26339 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:38.023525 26165 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.012766 25592 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:38.019320 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2403) took 2098 ms. Trace:
I20260709 13:08:38.025151 25983 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:38.023865 22468 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.021s (SENT)
I20260709 13:08:38.026425 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:37.932632 26309 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.028319 26357 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:38.029492 22468 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.053s (SENT)
I20260709 13:08:38.029901 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:38.029970 26309 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:38.030640 22652 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:38.031455 25983 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:38.032300 26357 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:38.025789 22648 rpcz_store.cc:276] 0709 13:08:35.920898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.961842 (+ 40944us) service_pool.cc:224] Handling call
0709 13:08:37.455719 (+1493877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.664118 (+208399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.997906 (+333788us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:38.019127 (+ 21221us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400324e50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:38.019247 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3911920768}
W20260709 13:08:38.033470 22468 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.054s (SENT)
I20260709 13:08:38.034040 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.033514 22647 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:38.035835 22498 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:38.038033 23263 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:38.042162 22505 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
W20260709 13:08:38.048144 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62427.7us
I20260709 13:08:38.050078 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:38.050877 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.050819 22504 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:38.051698 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:38.052174 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.052503 23258 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:38.054481 22575 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:38.056077 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:38.056587 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.057303 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:38.057663 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.058112 22503 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.054962 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:38.054672 22497 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:08:38.062584 22468 leader_election.cc:336] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.071s (SENT)
I20260709 13:08:38.067113 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:38.067828 22648 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:38.067602 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66365.1us
I20260709 13:08:38.067147 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:38.069327 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.067230 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.062994 26357 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:37.985822 26305 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.077646 26305 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:38.080295 22468 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.100s (SENT)
I20260709 13:08:38.080516 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:38.080791 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.081334 22647 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:38.081869 22468 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.204s (SENT)
W20260709 13:08:38.083839 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1803626999999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 13:08:38.085515 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1641627000000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 13:08:38.085985 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.086047 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.086522 26293 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:38.086376 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1227626999999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:08:38.088881 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1190800159999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.263s for a response
I20260709 13:08:38.089151 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:38.089736 22645 raft_consensus.cc:1813] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Handling vote request from an unknown peer 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:38.090337 22645 raft_consensus.cc:2368] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
I20260709 13:08:38.091390 23258 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:38.071403 22496 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:38.093173 22651 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:38.085031 26165 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:38.093536 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.093729 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.094695 26165 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:38.096498 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47561.6us
I20260709 13:08:38.084569 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:38.086711 22498 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 4.
I20260709 13:08:38.097338 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.092559 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:38.098546 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.099386 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.099123 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.099766 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.100462 25566 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:38.100694 22503 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:38.062655 22505 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:38.089895 22646 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:38.098753 22645 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:38.084235 26378 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.111045 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:38.109112 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.117367 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:38.118304 22576 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.122233 22502 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:38.111522 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.127169 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.129263 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:38.133013 22647 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:38.140297 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.106009 26295 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:38.149521 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.130146 26267 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:38.110262 26064 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:38.155373 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:38.151578 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:38.154794 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:38.157667 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:38.108783 25983 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:38.159766 22645 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:38.124643 26227 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.128175 26165 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.144927 26352 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.107913 26378 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:38.124853 26016 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:38.124112 26330 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:38.124254 26398 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:38.108382 26396 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.180169 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:38.138234 25986 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:38.212296 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:38.161736 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:38.194700 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:38.221203 23262 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:08:38.225337 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45282.8us
W20260709 13:08:38.227526 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 100436us
I20260709 13:08:38.160418 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.200338 22576 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:38.155068 26223 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.233942 26223 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:38.234870 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 240733us
I20260709 13:08:38.151739 26394 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:38.161842 26389 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:38.162063 26047 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.208647 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:38.151543 26339 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:08:38.238592 26047 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:38.240007 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57663us
I20260709 13:08:38.241247 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:38.241983 26047 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:38.191013 22645 raft_consensus.cc:1217] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-5.3]   Dedup: 5.3->[]
W20260709 13:08:38.233345 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73024.6us
I20260709 13:08:38.237100 26130 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.242998 26047 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:38.243248 22645 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:38.148932 26317 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:08:38.243705 26047 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.244136 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:38.244449 26047 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:38.238098 26223 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:38.246837 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:38.248139 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 104157us
I20260709 13:08:38.248920 26390 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:38.249470 26390 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.250267 26390 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.206468 25983 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:38.209875 26267 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:38.216998 26221 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:38.164832 26397 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.265836 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:38.222777 25986 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.204650 26128 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:08:38.204959 26165 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:38.227532 26016 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:38.296777 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55503.2us
I20260709 13:08:38.208992 26352 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.301138 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:38.303023 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:38.304072 22579 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:38.307670 22577 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:08:38.308410 22577 pending_rounds.cc:85] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 8
I20260709 13:08:38.308887 22577 pending_rounds.cc:107] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:08:38.309324 22577 raft_consensus.cc:2889] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:38.306299 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:38.266400 26221 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.322867 26221 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:38.328953 25952 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:38.329576 25952 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.330014 25952 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.332136 25983 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.332691 26390 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.334012 26378 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:38.335192 26390 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:38.335714 26165 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:38.329246 26047 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.269064 25986 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:38.338192 26047 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:38.277626 25927 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.297372 26228 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.315407 26337 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:38.342351 26337 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:38.343916 26228 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:38.343492 26337 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:38.314739 23255 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:38.345928 22649 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:38.269114 26360 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:38.348722 26360 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:38.349639 26267 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:38.349951 26360 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.352087 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:38.352705 22654 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:38.354977 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.355255 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.355949 23258 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:38.358708 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:38.264227 26398 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:38.272217 26312 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:38.316706 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 72664.4us
I20260709 13:08:38.318029 26016 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:38.319332 26406 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:08:38.320245 26404 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:38.320690 22647 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:38.364840 22579 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:38.383859 22654 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
W20260709 13:08:38.365576 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 122496us
I20260709 13:08:38.374255 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:38.386201 22645 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.386811 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:38.377564 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:38.336750 26397 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:38.391261 22649 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:08:38.391760 22649 pending_rounds.cc:85] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 6
I20260709 13:08:38.392020 22649 pending_rounds.cc:107] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:08:38.392280 22649 raft_consensus.cc:2889] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:38.400530 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 174450us
I20260709 13:08:38.401089 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:38.402448 22645 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
W20260709 13:08:38.400108 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 241357us
I20260709 13:08:38.404199 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.405689 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.407238 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:38.408946 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.409555 22500 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:38.413017 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:38.413913 22501 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.415077 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:38.415813 22504 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.419621 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.421239 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:38.373757 26312 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:38.425542 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:38.390964 26352 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:38.438611 22501 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:08:38.444972 26353 raft_consensus.cc:2764] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:38.433508 26394 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.452417 26394 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.441084 26317 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:38.439424 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:38.376631 26195 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:08:38.406747 26397 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.420555 26398 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:38.395182 26228 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:38.450616 22648 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:38.455389 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:38.433094 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:38.420830 26292 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.477350 22654 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:38.420805 26201 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:08:38.511588 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:38.486971 22648 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:38.455708 26367 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:38.517482 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.518496 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.519959 22499 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:38.521688 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.536986 22497 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:38.472910 26398 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:38.529237 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 103816us
I20260709 13:08:38.538173 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:38.502177 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 111710us
I20260709 13:08:38.522908 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:38.543478 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:38.467774 26227 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:08:38.469642 26293 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:08:38.473338 26339 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:08:38.474123 26290 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:08:38.548583 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.543748 22505 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:38.544462 22504 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:38.565408 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:38.483485 25592 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:08:38.543550 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.478852 26397 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.529060 26128 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:38.546701 26398 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:38.547835 26352 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.579272 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.601312 22505 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:38.536128 26410 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:38.562332 26367 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:38.483126 26414 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:08:38.511629 26312 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:38.685232 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.569679 26411 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:38.540025 26419 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:08:38.581776 26305 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:08:38.662988 25983 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:38.699942 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 156464us
I20260709 13:08:38.675782 26433 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:38.709383 25986 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:38.738889 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 159702us
W20260709 13:08:38.713881 26418 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:08:38.710445 26424 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:08:38.776588 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 228596us
W20260709 13:08:38.793468 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.794420 26420 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:08:38.795150 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55404.9us
I20260709 13:08:38.796775 26432 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:38.797255 26432 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.797729 26432 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:38.799502 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 85984.4us
I20260709 13:08:38.807485 26436 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:38.813139 26367 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:38.731482 26290 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:38.817441 26290 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:38.818578 26290 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:38.755026 25914 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:38.738376 26433 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:38.839007 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.820457 26064 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.002s
W20260709 13:08:38.854003 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 310576us
W20260709 13:08:38.839066 26221 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.006s
W20260709 13:08:38.853010 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75420.9us
I20260709 13:08:38.738375 25983 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:08:38.895557 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:38.896404 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:38.899493 22573 raft_consensus.cc:1813] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Handling vote request from an unknown peer 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:38.899971 22573 raft_consensus.cc:2368] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
I20260709 13:08:38.896973 22579 raft_consensus.cc:1217] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Deduplicated request from leader. Original: 3.2->[5.3-5.3]   Dedup: 5.3->[]
I20260709 13:08:38.808668 25952 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:38.901500 22579 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:38.843369 26433 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:38.902037 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:38.906543 22571 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:38.902201 22577 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:38.904464 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 498804us
I20260709 13:08:38.905459 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:38.908922 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:38.904066 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 107906us
I20260709 13:08:38.911226 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:38.911473 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:38.915350 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:38.855281 26064 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:38.855262 25914 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:38.920182 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:38.808668 26432 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.926327 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:38.927632 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:38.932663 23264 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:38.707269 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:38.941852 26442 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:08:38.947582 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:38.948323 22501 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:08:38.951205 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.924378 26187 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.924499 26411 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:38.940505 26352 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:38.904496 26221 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:38.924099 26130 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.990041 22501 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:38.939985 25986 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:38.998909 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.006681 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:39.010185 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 90791.1us
I20260709 13:08:39.014303 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:39.014955 22654 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:38.987475 26397 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:38.999480 26295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.014s	sys 0.018s
I20260709 13:08:39.017931 26443 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.030303 22501 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:39.030824 26432 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:39.024389 22468 leader_election.cc:400] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
I20260709 13:08:39.037343 22468 leader_election.cc:403] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:39.037894 25952 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:39.038543 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:39.020296 23264 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:39.047197 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:39.048807 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:39.050141 22571 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:39.050873 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:39.051112 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:39.052668 22579 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:39.062426 26221 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:39.017856 26434 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 13:08:39.019888 26352 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:39.063720 26290 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:39.064601 26290 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:39.064473 26352 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:39.065516 26290 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:39.066745 26290 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.070075 26216 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.995436 26411 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:39.074801 26411 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:39.076989 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 734) took 1094 ms. Trace:
I20260709 13:08:39.077598 22651 rpcz_store.cc:276] 0709 13:08:37.982308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.982470 (+   162us) service_pool.cc:224] Handling call
0709 13:08:38.092950 (+110480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.093587 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.076680 (+983093us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b5400169250. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:39.076906 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187373312}
I20260709 13:08:39.023077 25914 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:39.040738 23257 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:39.083880 23255 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:39.087541 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:39.089330 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:39.044977 26295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.015s	sys 0.019s
I20260709 13:08:39.085654 26443 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.020361 26398 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:39.104607 26290 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:39.110711 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:39.111547 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:39.116467 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:41.360214 22574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2144) took 2316 ms (client timeout 1559 ms). Trace:
I20260709 13:08:41.360531 22651 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.233076 22654 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:39.113989 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:40.175298 23229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.012s	sys 0.008s
I20260709 13:08:39.252275 26108 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.494234 26108 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:39.121997 26219 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.229435 26295 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:39.178467 26332 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:39.181375 26357 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.596841 26357 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.597682 22650 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:41.599802 26357 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:41.600246 22650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 729) took 3661 ms (client timeout 2043 ms). Trace:
I20260709 13:08:40.245570 26337 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:39.091777 26394 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:41.610786 26394 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.611274 26394 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.251739 26398 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:39.192653 26387 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.605s	user 0.002s	sys 0.001s
I20260709 13:08:39.228443 26433 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.635883 26433 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:39.118871 26426 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.521s	user 0.004s	sys 0.005s
I20260709 13:08:39.555182 26443 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
W20260709 13:08:41.187332 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.102s	user 0.009s	sys 0.037s
I20260709 13:08:41.202260 26415 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:41.210995 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.163s	user 0.015s	sys 0.041s
I20260709 13:08:41.211916 26471 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.645264 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3109) took 3532 ms. Trace:
W20260709 13:08:41.213523 23264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 493) took 3056 ms (client timeout 3060 ms). Trace:
W20260709 13:08:41.645876 23264 rpcz_store.cc:269] 0709 13:08:38.157236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.157454 (+   218us) service_pool.cc:224] Handling call
0709 13:08:41.213300 (+3055846us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54007a2454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:41.213451 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780882304}
I20260709 13:08:41.220480 26472 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.645306 26415 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:41.647434 26472 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.648463 26415 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.224083 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2440) took 2685 ms. Trace:
W20260709 13:08:41.241482 22499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.251s	user 0.017s	sys 0.016s
W20260709 13:08:41.649925 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.662s	user 0.017s	sys 0.016s
I20260709 13:08:41.249285 26474 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.254173 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb940 after lost signal to thread 21390
W20260709 13:08:41.650950 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb4a0 after lost signal to thread 21393
W20260709 13:08:41.652014 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08002eae40 after lost signal to thread 22437
W20260709 13:08:41.652298 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08002eafe0 after lost signal to thread 22449
W20260709 13:08:41.653560 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb920 after lost signal to thread 22529
W20260709 13:08:41.653877 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb900 after lost signal to thread 22530
W20260709 13:08:41.654729 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd7e0 after lost signal to thread 22604
W20260709 13:08:41.654996 23285 debug-util.cc:398] Leaking SignalData structure 0x7b080026e4a0 after lost signal to thread 22605
W20260709 13:08:41.265165 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.270594 22498 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.284s	user 0.049s	sys 0.024s
I20260709 13:08:41.273502 26290 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.284138 26448 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.285305 26434 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.291231 26307 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.292328 26128 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:41.291785 26458 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.297000 25983 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.297873 22497 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.292s	user 0.008s	sys 0.023s
I20260709 13:08:41.306689 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 563) took 3256 ms. Trace:
I20260709 13:08:41.306751 26476 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.307147 26475 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:41.320170 22653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 732) took 3378 ms (client timeout 1635 ms). Trace:
W20260709 13:08:41.668416 22653 rpcz_store.cc:269] 0709 13:08:37.942177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.945706 (+  3529us) service_pool.cc:224] Handling call
0709 13:08:41.319811 (+3374105us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400411c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:41.320053 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527878912}
W20260709 13:08:41.326367 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 691) took 2366 ms (client timeout 2652 ms). Trace:
I20260709 13:08:41.337182 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 654) took 2981 ms. Trace:
I20260709 13:08:41.320209 26480 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.332626 26478 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.681921 26478 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.672636 23255 rpcz_store.cc:276] 0709 13:08:38.355778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.376545 (+ 20767us) service_pool.cc:224] Handling call
0709 13:08:39.083596 (+707051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.084454 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.336917 (+2252463us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b5400836650. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:41.337107 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525295360}
I20260709 13:08:41.684393 26478 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.342010 26481 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.685253 26481 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.685596 26443 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:41.686735 26443 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:41.336012 26479 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.358367 26442 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.360813 22574 rpcz_store.cc:269] 0709 13:08:39.043574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.043749 (+   175us) service_pool.cc:224] Handling call
0709 13:08:41.360136 (+2316387us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:41.371526 22654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 742) took 2373 ms (client timeout 1529 ms). Trace:
W20260709 13:08:41.688123 22654 rpcz_store.cc:269] 0709 13:08:38.997820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.998184 (+   364us) service_pool.cc:224] Handling call
0709 13:08:41.371443 (+2373259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:41.380208 23227 connection.cc:256] RPC call timeout handler was delayed by -2.0031374829999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 13:08:41.380780 26391 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.362430 26485 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.382436 22651 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:08:41.694061 22651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 747) took 2594 ms (client timeout 1939 ms). Trace:
W20260709 13:08:41.694448 22651 rpcz_store.cc:269] 0709 13:08:39.100092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.116149 (+ 16057us) service_pool.cc:224] Handling call
0709 13:08:41.693975 (+2577826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:41.386718 26197 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.388121 26449 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.369954 26484 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.392427 26489 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:41.394133 26466 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 2.012s	user 0.000s	sys 0.016s
I20260709 13:08:41.395670 26490 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.397619 26491 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.430575 26492 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.432179 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 497) took 2424 ms. Trace:
I20260709 13:08:41.704988 23261 rpcz_store.cc:276] 0709 13:08:39.008201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.008416 (+   215us) service_pool.cc:224] Handling call
0709 13:08:39.019522 (+ 11106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.021944 (+  2422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.021974 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.356608 (+2334634us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b2c000129d8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:08:41.357072 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.413734 (+ 56662us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:41.413771 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.413838 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.431725 (+ 17887us) raft_consensus.cc:1685] finished
0709 13:08:41.431756 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.432086 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2049,"raft.queue_time_us":9249,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":3209984,"thread_start_us":42463,"threads_started":1,"wal-append.queue_time_us":68049}
I20260709 13:08:41.693217 26064 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.694887 26306 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.696259 26433 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:41.710188 22571 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:41.710570 22571 pending_rounds.cc:85] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 7
I20260709 13:08:41.710783 22571 pending_rounds.cc:107] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:41.701879 26449 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.711050 22571 raft_consensus.cc:2889] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.712306 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:41.452297 26495 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.712786 26449 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.474512 26376 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:41.481101 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 2.5432e+06us
I20260709 13:08:41.491895 22646 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:41.492506 23229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.472s	user 0.013s	sys 0.009s
I20260709 13:08:41.478813 26494 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.502040 26410 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:41.502249 26493 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.506364 25592 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.511111 26195 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.521864 26312 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:41.706812 26490 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.540678 26496 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:41.525372 26367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.709s	user 0.023s	sys 0.010s
W20260709 13:08:41.722662 26367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.906s	user 0.023s	sys 0.011s
I20260709 13:08:41.722465 26195 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.723799 26490 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.673373 26476 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.724119 26394 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.697638 26442 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.724975 25592 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.567509 22490 tablet_service.cc:1558] Processing DeleteTablet for tablet b09d79da74a54c84ab38db5f54cacc35 with delete_type TABLET_DATA_TOMBSTONED (TS 6ca917eaada84bf38a5daae9f8ffa066 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:59516
I20260709 13:08:41.576709 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:41.726300 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.726708 26442 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:41.581512 22401 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 309) took 14845 ms (client timeout 15000 ms). Trace:
I20260709 13:08:41.726990 23261 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:41.727111 25592 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.582293 26482 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.722478 26496 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.577780 26501 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.728271 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:41.728706 26501 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.717006 26306 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.729857 26496 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.730458 26496 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:41.730360 26493 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.730984 26501 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:41.585438 22544 connection.cc:256] RPC call timeout handler was delayed by -1.1606164930001341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:08:41.694278 26479 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.734736 26479 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:41.734944 22544 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.132:42571 timed out after 1.999s (SENT) [suppressed 71 similar messages]
I20260709 13:08:41.585110 25927 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.707108 26491 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.586519 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.587600 26339 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.735693 25927 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.736253 26339 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.697467 26391 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.738025 25927 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.583935 26378 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.738337 26339 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.590194 26108 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.739032 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:41.738682 26378 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.593552 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 629) took 3236 ms. Trace:
I20260709 13:08:41.739714 22572 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:41.741279 23257 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:41.741809 26476 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:41.600770 22650 rpcz_store.cc:269] 0709 13:08:37.938604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.940341 (+  1737us) service_pool.cc:224] Handling call
0709 13:08:41.600038 (+3659697us) spinlock_profiling.cc:243] Waited 3.66 s on lock 0x7b54000fd2d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:41.600169 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8408774016}
I20260709 13:08:41.731046 26306 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.600566 26357 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.719115 26494 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.746516 26357 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.748302 26483 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.630966 23256 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:41.716651 26353 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:41.632897 26500 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
I20260709 13:08:41.748900 26483 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.749517 26353 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.750761 26357 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.645679 22575 rpcz_store.cc:276] 0709 13:08:38.113144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.113547 (+   403us) service_pool.cc:224] Handling call
0709 13:08:38.147276 (+ 33729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.230609 (+ 83333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.230675 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.231616 (+   941us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.392434 (+160818us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:38.392545 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.392762 (+   217us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.117885 (+725123us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:41.644949 (+2527064us) raft_consensus.cc:1685] finished
0709 13:08:41.644972 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.645202 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5119,"raft.queue_time_us":55395,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6908,"spinlock_wait_cycles":9789184,"thread_start_us":237495,"threads_started":2,"wal-append.queue_time_us":278698}
I20260709 13:08:41.753397 26478 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:41.221189 22502 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.275s	user 0.047s	sys 0.044s
I20260709 13:08:41.754132 26478 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:41.755373 22502 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.809s	user 0.047s	sys 0.044s
I20260709 13:08:41.755949 26507 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:41.659901 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 743) took 2660 ms. Trace:
I20260709 13:08:41.756578 26370 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.756559 26507 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.757414 26370 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:41.758136 22618 connection.cc:256] RPC call timeout handler was delayed by -2.0142124399999375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:08:41.757149 22645 rpcz_store.cc:276] 0709 13:08:38.999411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.068107 (+ 68696us) service_pool.cc:224] Handling call
0709 13:08:39.068524 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.068769 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:39.069151 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.659199 (+2590048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.659279 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:41.659578 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.659675 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.659837 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2545836,"prepare.queue_time_us":4040,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":2607245,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":43773,"threads_started":1}
I20260709 13:08:41.649474 22649 rpcz_store.cc:276] 0709 13:08:38.538853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.539033 (+   180us) service_pool.cc:224] Handling call
0709 13:08:38.539392 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.549052 (+  9660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.549097 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.554599 (+  5502us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.223363 (+2668764us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18004b5b00. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1
0709 13:08:41.223557 (+   194us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:41.223602 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.223682 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.223745 (+    63us) raft_consensus.cc:1685] finished
0709 13:08:41.223764 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.224013 (+   249us) inbound_call.cc:177] Queueing success response
0709 13:08:41.226841 (+  2828us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4800190158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
Metrics: {"raft.queue_time_us":134917,"raft.run_cpu_time_us":25820,"raft.run_wall_time_us":2536817,"spinlock_wait_cycles":34749568,"thread_start_us":7799,"threads_started":1,"wal-append.queue_time_us":131386,"wal-append.run_cpu_time_us":2300,"wal-append.run_wall_time_us":1016629}
I20260709 13:08:41.649760 26415 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:41.664603 22498 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.678s	user 0.050s	sys 0.025s
I20260709 13:08:41.759886 26370 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:41.665740 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.618s	user 0.015s	sys 0.042s
I20260709 13:08:41.760380 26370 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.760478 26017 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:41.767387 26017 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:41.662850 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08003f39a0 after lost signal to thread 22678
W20260709 13:08:41.769197 23285 debug-util.cc:398] Leaking SignalData structure 0x7b0800353e20 after lost signal to thread 22679
W20260709 13:08:41.770437 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08001956c0 after lost signal to thread 23288
W20260709 13:08:41.770744 23285 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca900 after lost signal to thread 23289
I20260709 13:08:41.770834 26017 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.718001 26433 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.738622 26391 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:41.727278 22401 rpcz_store.cc:269] 0709 13:08:26.792971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.903388 (+110417us) service_pool.cc:224] Handling call
0709 13:08:41.581426 (+14678038us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:35.873001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:35.873920 (+   919us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:35.873992 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:08:35.874038 (+    46us) tablet.cc:662] Decoding operations
0709 13:08:35.899779 (+ 25741us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:35.924792 (+ 25013us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:35.924841 (+    49us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:08:36.341914 (+417073us) tablet.cc:701] Row locks acquired
0709 13:08:36.341967 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:08:36.342206 (+   239us) write_op.cc:270] Start()
0709 13:08:36.342373 (+   167us) write_op.cc:276] Timestamp: P: 1783602516342118 usec, L: 0
0709 13:08:36.342410 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.343338 (+   928us) log.cc:844] Serialized 7934 byte log entry
0709 13:08:36.979182 (+635844us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b54003a2b20. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26270dbe 00007fec2627b930 00007fec2627b8d8 00007fec2627b858 00007fec2627b813 00007fec2627aa9c 00007fec2c166626 00007fec2c160dd8 00007fec262b77cb 00007fec262ba2c0
0709 13:08:37.038215 (+ 59033us) op_driver.cc:464] REPLICATION: finished
0709 13:08:37.266982 (+228767us) write_op.cc:301] APPLY: starting
0709 13:08:37.267094 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:37.267553 (+   459us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:37.267595 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:37.270522 (+  2927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:37.271009 (+   487us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:08:37.304050 (+ 33041us) write_op.cc:312] APPLY: finished
0709 13:08:37.445214 (+141164us) log.cc:844] Serialized 139 byte log entry
0709 13:08:37.445577 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.445778 (+   201us) write_op.cc:454] Released schema lock
0709 13:08:37.445872 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:37.489737 (+ 43865us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.491219 (+  1482us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13779,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":185711,"apply.run_cpu_time_us":6397,"apply.run_wall_time_us":221347,"num_ops":20,"prepare.queue_time_us":188905,"prepare.run_cpu_time_us":43343,"prepare.run_wall_time_us":892673,"raft.queue_time_us":58197,"raft.run_cpu_time_us":24318,"raft.run_wall_time_us":127773,"replication_time_us":695630,"spinlock_wait_cycles":102370048,"thread_start_us":639196,"threads_started":4,"wal-append.queue_time_us":239270,"wal-append.run_cpu_time_us":16293,"wal-append.run_wall_time_us":1871914}]]}
I20260709 13:08:41.773490 26433 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.672175 26434 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.673092 26475 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.668146 26128 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.645702 26471 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.668264 25983 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.668334 26458 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.665159 23263 rpcz_store.cc:276] 0709 13:08:38.050256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.053820 (+  3564us) service_pool.cc:224] Handling call
0709 13:08:38.095232 (+ 41412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:38.095618 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.095657 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:38.096291 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 13:08:38.235445 (+139154us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:38.393382 (+157937us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.217310 (+2823928us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800341020. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287
0709 13:08:41.241095 (+ 23785us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.306223 (+ 65128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.306300 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.306445 (+   145us) raft_consensus.cc:1685] finished
0709 13:08:41.306461 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.306625 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11472,"prepare.queue_time_us":324501,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":3315,"raft.queue_time_us":88227,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":50524,"spinlock_wait_cycles":36349312,"thread_start_us":471061,"threads_started":5,"wal-append.queue_time_us":531708,"wal-append.run_cpu_time_us":3839,"wal-append.run_wall_time_us":1163333}
I20260709 13:08:41.660748 26290 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.662317 26448 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.676648 26498 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.660589 26474 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.797210 26458 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.748615 26494 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.797844 26474 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.677662 26472 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.678943 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:41.681253 22497 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.675s	user 0.009s	sys 0.023s
I20260709 13:08:41.681859 26480 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:41.358899 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2148) took 2312 ms (client timeout 1928 ms). Trace:
W20260709 13:08:41.803182 22580 rpcz_store.cc:269] 0709 13:08:39.046178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.046291 (+   113us) service_pool.cc:224] Handling call
0709 13:08:41.358746 (+2312455us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:41.689491 23227 connection.cc:256] RPC call timeout handler was delayed by -1.6359374829999069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:08:41.806867 23227 connection.cc:256] RPC call timeout handler was delayed by -1.0080201939999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:08:41.687119 26443 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:41.809329 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.809644 26443 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.703991 26130 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:41.693725 26398 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.811218 26443 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:41.811050 26398 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.813788 26398 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.450649 26497 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.815191 26497 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.703950 26481 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.709688 26492 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:41.714912 22646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 744) took 2632 ms (client timeout 1778 ms). Trace:
W20260709 13:08:41.818308 22646 rpcz_store.cc:269] 0709 13:08:39.082799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.092157 (+  9358us) service_pool.cc:224] Handling call
0709 13:08:41.714829 (+2622672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:41.819871 26492 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.497056 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3131) took 2684 ms. Trace:
I20260709 13:08:41.820377 26514 tablet_replica.cc:333] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
W20260709 13:08:41.714890 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 2.70599e+06us
I20260709 13:08:41.713158 26495 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.821121 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.821575 26514 raft_consensus.cc:2243] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.822064 23263 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:41.822283 22575 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:41.822381 26514 pending_rounds.cc:70] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 2 pending ops.
I20260709 13:08:41.822789 26514 pending_rounds.cc:77] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7305635807875928064 op_type: NO_OP noop_request { }
I20260709 13:08:41.818511 26497 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.823632 26514 raft_consensus.cc:2889] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:41.824190 26514 pending_rounds.cc:77] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 7 index: 6 } timestamp: 7305635801048301568 op_type: NO_OP noop_request { }
I20260709 13:08:41.824669 26433 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:41.824941 22469 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:41.825338 26433 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.826476 22575 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:41.826673 26492 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:41.827211 26492 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.827612 26492 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.827808 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 690) took 2880 ms. Trace:
I20260709 13:08:41.828490 22498 rpcz_store.cc:276] 0709 13:08:38.947774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.949843 (+  2069us) service_pool.cc:224] Handling call
0709 13:08:38.950114 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.950308 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:41.759907 (+2809599us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.827466 (+ 67559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.827520 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:41.827571 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.827647 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.827750 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86518,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":2840151,"threads_started":2,"wal-append.queue_time_us":66076}
I20260709 13:08:41.829324 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.833029 26391 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.833673 26391 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.835903 26391 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.836793 26487 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.837453 26487 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.824777 26514 raft_consensus.cc:2889] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:41.821570 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:41.841109 26514 raft_consensus.cc:2272] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.841223 26471 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.843384 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.820559 22505 rpcz_store.cc:276] 0709 13:08:38.812174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.812317 (+   143us) service_pool.cc:224] Handling call
0709 13:08:38.812626 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.813010 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:38.906635 (+ 93625us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.006280 (+ 99645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.020605 (+ 14325us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.021581 (+   976us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:39.021634 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.021724 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.496729 (+2475005us) raft_consensus.cc:1685] finished
0709 13:08:41.496755 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.496980 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223348,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":5078,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":8863,"thread_start_us":174053,"threads_started":2,"wal-append.queue_time_us":270280,"wal-append.run_cpu_time_us":2289,"wal-append.run_wall_time_us":1002318}
I20260709 13:08:41.846439 22571 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.720981 22574 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:41.697762 26485 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.714067 26064 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.783844 26228 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.553619 22402 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 7 to 9, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 9 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:41.705852 26489 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.735114 26394 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.739903 22576 rpcz_store.cc:276] 0709 13:08:38.357149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.359931 (+  2782us) service_pool.cc:224] Handling call
0709 13:08:38.360372 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.380784 (+ 20412us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:38.420439 (+ 39655us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.557070 (+3136631us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b1800450dc0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:08:41.576829 (+ 19759us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.579722 (+  2893us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.579842 (+   120us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.579899 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.580032 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.593095 (+ 13063us) raft_consensus.cc:1685] finished
0709 13:08:41.593251 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.593458 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43458,"prepare.queue_time_us":25895,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":6019,"raft.queue_time_us":14338,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":13794,"spinlock_wait_cycles":7563648,"thread_start_us":19376,"threads_started":1,"wal-append.queue_time_us":3146252}
I20260709 13:08:41.886130 22402 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:41.890527 22576 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:41.595028 26295 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.591624 26414 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.742769 26293 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.708649 26484 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.700825 26197 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:41.743520 22619 connection.cc:256] RPC call timeout handler was delayed by -2.0869821590000583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:08:41.605311 26425 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 2.841s	user 0.027s	sys 0.008s
I20260709 13:08:41.744073 26309 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.716085 26376 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.730952 26496 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:41.717600 26410 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:41.758596 22618 connection.cc:256] RPC call timeout handler was delayed by -1.7838124400000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 13:08:41.938697 22498 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:41.940316 26484 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:41.760666 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 2.71338e+06us
I20260709 13:08:41.941561 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:41.942657 26394 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:41.943405 22468 leader_election.cc:400] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
W20260709 13:08:41.670123 22501 rpcz_store.cc:269] 0709 13:08:38.960294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.006337 (+ 46043us) service_pool.cc:224] Handling call
0709 13:08:41.326048 (+2319711us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54000f8554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:41.326253 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51727232}
I20260709 13:08:41.761016 26427 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.761121 25566 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.760988 26370 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:41.661759 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.576s	user 0.009s	sys 0.037s
I20260709 13:08:41.763206 26337 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.969717 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:41.765110 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:41.943248 26394 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:41.973382 26458 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.973634 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.765993 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.974558 26512 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:41.766130 26491 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.766556 23261 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:41.766731 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:41.771538 23285 debug-util.cc:398] Leaking SignalData structure 0x7b0800380a60 after lost signal to thread 26352
I20260709 13:08:41.665541 26307 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.756489 26478 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.784849 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 741) took 2787 ms. Trace:
I20260709 13:08:41.784813 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.947844 26128 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.724686 26195 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.782976 26378 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.779357 26353 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:41.786831 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2470) took 2865 ms. Trace:
W20260709 13:08:41.788018 22617 connection.cc:256] RPC call timeout handler was delayed by -1.6702387689999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:08:41.935972 26497 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.935617 26494 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.728058 26482 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.795120 26483 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.795852 26290 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.732713 26493 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.810245 22645 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:08:41.993144 26448 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.993634 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.994887 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.996354 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.719383 22577 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:41.851068 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.851159 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.849409 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:41.857851 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:41.998106 22645 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
W20260709 13:08:41.998692 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.998952 22505 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:41.851725 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:41.878898 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 143979us
I20260709 13:08:41.880322 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.880797 26475 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.881104 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.798738 26498 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:41.885918 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.794421 26017 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:41.902999 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:41.902510 22402 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 8, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:41.828192 26433 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:41.910563 22619 connection.cc:256] RPC call timeout handler was delayed by -1.4089388040000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:08:41.851854 26442 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.884142 26064 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.009305 22402 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:42.009960 22619 connection.cc:256] RPC call timeout handler was delayed by -1.2622388040000487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 13:08:42.010146 26442 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:42.010656 22619 connection.cc:256] RPC call timeout handler was delayed by -1.2442388040000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 13:08:42.011119 22619 connection.cc:256] RPC call timeout handler was delayed by -1.0615388040000653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:08:42.011054 22402 catalog_manager.cc:5697] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 2 to 4, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 4 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.823676 26495 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.013592 26442 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.013052 22402 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:42.014480 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:41.909411 26514 ts_tablet_manager.cc:1916] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:41.888821 26397 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.015041 22402 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:42.015595 26397 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.885062 26306 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:41.924508 22574 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:41.931519 22503 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:42.017230 22402 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 9, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 9 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:42.018178 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.018885 22402 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:42.019675 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:41.907233 26414 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.759222 26507 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:41.945859 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:41.963308 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:41.957954 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:41.901129 26389 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:41.966706 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.967132 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:41.964902 25566 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.921320 26267 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.763690 26317 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.910303 26219 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.884101 26492 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.036751 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.937963 26496 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:41.901079 26228 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.721542 26449 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:41.981851 22499 rpcz_store.cc:276] 0709 13:08:38.921793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.922264 (+   471us) service_pool.cc:224] Handling call
0709 13:08:38.922739 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.925035 (+  2296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.925085 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.925721 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.392897 (+2467176us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:41.650340 (+257443us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.703226 (+ 52886us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.703819 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.704023 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.777657 (+ 73634us) raft_consensus.cc:1685] finished
0709 13:08:41.786526 (+  8869us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.786749 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9134,"prepare.queue_time_us":25212,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":1460,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":4114,"spinlock_wait_cycles":323095808,"thread_start_us":2714716,"threads_started":2,"wal-append.queue_time_us":430972}
I20260709 13:08:41.983383 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2473) took 3042 ms. Trace:
I20260709 13:08:41.981776 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:41.985960 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2471) took 3061 ms. Trace:
I20260709 13:08:42.071532 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:41.980095 26337 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.987279 23257 raft_consensus.cc:2368] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
W20260709 13:08:41.987757 26517 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:08:42.098276 26480 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.098556 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2472) took 3166 ms. Trace:
I20260709 13:08:42.099038 22502 rpcz_store.cc:276] 0709 13:08:38.931753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.931919 (+   166us) service_pool.cc:224] Handling call
0709 13:08:38.932290 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.755778 (+2823488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.755807 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.756295 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.897720 (+141425us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:41.897765 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.897849 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.098357 (+200508us) raft_consensus.cc:1685] finished
0709 13:08:42.098377 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.098499 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14518,"raft.queue_time_us":45921,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":8783,"thread_start_us":2950426,"threads_started":2,"wal-append.queue_time_us":161041}
I20260709 13:08:42.100286 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:41.988101 26489 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.907784 26293 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:41.999200 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.101879 26423 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:42.002651 26485 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.003098 26370 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:41.936659 26309 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:41.972786 26487 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.070681 26442 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.005275 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.005604 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.112447 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:41.974448 26394 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.020251 22402 catalog_manager.cc:5697] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 3 to 5, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 5 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.021744 23258 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:08:42.020292 22503 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:08:42.027357 22649 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:42.027838 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:42.030443 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 85612.2us
I20260709 13:08:42.119207 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:42.118868 22402 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 7 to 9, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 9 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:41.985291 23255 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:42.119692 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:42.033385 22501 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:41.993947 26376 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:41.983083 26512 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:42.028460 26495 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:08:41.977674 22648 rpcz_store.cc:276] 0709 13:08:38.997427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.998068 (+   641us) service_pool.cc:224] Handling call
0709 13:08:39.018331 (+ 20263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.694245 (+2675914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.694276 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.717038 (+ 22762us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b2c0013e058. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:08:41.718000 (+   962us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.780787 (+ 62787us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.780845 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.780970 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.782635 (+  1665us) raft_consensus.cc:1685] finished
0709 13:08:41.782664 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.784778 (+  2114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2643775,"raft.queue_time_us":2658234,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":19034496,"thread_start_us":94157,"threads_started":2,"wal-append.queue_time_us":62856}
I20260709 13:08:42.038688 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.142938 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:42.038618 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.041796 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.044081 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:41.989259 26497 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.048161 26219 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.063217 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.036154 26306 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:42.062532 26488 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:42.008888 26332 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.081619 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.041800 26267 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.073585 22500 rpcz_store.cc:276] 0709 13:08:38.940697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.941072 (+   375us) service_pool.cc:224] Handling call
0709 13:08:38.981874 (+ 40802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.019735 (+ 37861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.019855 (+   120us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.027447 (+  7592us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.968952 (+2941505us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:41.969033 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.977158 (+  8125us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b5400107f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:41.977228 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.977289 (+    61us) raft_consensus.cc:1685] finished
0709 13:08:41.977306 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.983326 (+  6020us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1098,"raft.queue_time_us":1262,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5207,"spinlock_wait_cycles":83485440,"thread_start_us":2883274,"threads_started":1,"wal-append.queue_time_us":460331,"wal-append.run_cpu_time_us":2511,"wal-append.run_wall_time_us":1010127}
I20260709 13:08:42.091578 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.092592 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.168828 22579 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:42.086549 25566 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.005462 26419 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:08:42.094142 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.187124 23264 raft_consensus.cc:2410] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:42.096484 22504 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:41.989480 26494 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.100927 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.102231 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.156534 25983 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:42.103196 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77484.7us
W20260709 13:08:42.108974 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 87326.1us
I20260709 13:08:42.110155 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.005406 22653 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:42.006829 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.151717 26485 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:42.116364 22651 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:42.025059 26017 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.037317 26290 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:08:42.120635 22402 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } }
I20260709 13:08:42.246519 22649 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:42.247759 22402 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:42.130201 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:42.130425 22469 leader_election.cc:400] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:08:42.131494 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:42.250277 22469 leader_election.cc:403] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:42.126286 26442 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.033816 26389 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.036623 26317 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.135311 22498 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:42.255903 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.256155 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.256793 22579 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:42.136706 26228 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.126392 26016 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:42.137600 26208 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.138167 26337 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.138374 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.275151 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.139070 26197 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.139216 26307 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.140162 26293 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:42.282801 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.144774 22571 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 5.
I20260709 13:08:42.149243 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.140983 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.150377 26309 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.150655 26489 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.971662 26427 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:42.152848 22468 connection.cc:256] RPC call timeout handler was delayed by -1.6816484900000432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:08:42.285683 22468 connection.cc:256] RPC call timeout handler was delayed by -1.5520484900000611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 13:08:42.158154 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.156688 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.159489 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:42.156968 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.286514 22574 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:42.071383 22497 rpcz_store.cc:276] 0709 13:08:38.924632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.924784 (+   152us) service_pool.cc:224] Handling call
0709 13:08:38.925105 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.925421 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.925449 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.925881 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.989646 (+ 63765us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:41.799420 (+2809774us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.984907 (+185487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.984987 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.985025 (+    38us) raft_consensus.cc:1685] finished
0709 13:08:41.985035 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.985163 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47443,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":21446,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":41551,"thread_start_us":3028127,"threads_started":3,"wal-append.queue_time_us":532063,"wal-append.run_cpu_time_us":2985,"wal-append.run_wall_time_us":1011856}
I20260709 13:08:42.132488 26487 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:42.152009 26515 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:42.297344 26521 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:08:42.165592 26492 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.132915 26108 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.298135 26219 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.166227 26488 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:42.138392 26498 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.093674 26449 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.299731 26489 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.188390 22572 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:08:42.188633 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.301286 23259 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:42.038990 26475 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.112157 26483 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:08:42.199916 26496 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.186221 26376 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.152508 26480 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:42.205457 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.206158 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.247289 26485 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.199959 26514 ts_tablet_manager.cc:1929] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:08:42.218405 26414 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.234920 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.316087 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:42.114128 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 132432us
I20260709 13:08:42.238631 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.158280 26493 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.239643 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.320262 22499 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:42.213340 26306 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.240790 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:42.029644 26410 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.250469 22503 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.251616 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:42.252108 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 401837us
W20260709 13:08:42.252617 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 122429us
I20260709 13:08:42.212625 26434 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.254616 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.315635 26497 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.319618 26480 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.327142 26017 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:42.328363 26494 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.297386 26515 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.332451 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.333355 22505 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:42.337011 22578 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:42.257041 22498 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:42.258363 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:42.267831 22653 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:42.268029 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:42.268286 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.269353 26223 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:42.342729 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.272028 22647 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:42.273873 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.275691 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.186553 26332 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.140297 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.284751 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:42.286221 22468 connection.cc:256] RPC call timeout handler was delayed by -1.3495484900000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 13:08:42.301795 26449 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.287690 22579 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:42.287647 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.253671 26292 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:08:42.248229 26438 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:42.292733 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.296331 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.154500 26471 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.298367 26108 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.126927 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:42.302520 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 143106us
I20260709 13:08:42.303231 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.302522 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.305567 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.207988 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:42.311693 22500 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:42.314179 22502 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:42.282258 26016 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:42.307221 26498 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.307075 26337 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.353113 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:42.714504 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.714974 26489 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:42.715209 22468 connection.cc:256] RPC call timeout handler was delayed by -1.3495484900000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 13:08:42.715567 22468 connection.cc:256] RPC call timeout handler was delayed by -1.2235484899999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:08:42.498821 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.716338 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:42.343631 22498 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:42.717651 22497 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:42.458272 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:42.491040 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.720233 22573 raft_consensus.cc:2410] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:08:42.720525 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 338805us
W20260709 13:08:42.720984 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 480236us
I20260709 13:08:42.721870 22575 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:42.354357 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.458531 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:42.723516 23258 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.390690 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.680138 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:42.380416 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.725378 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:42.726055 22505 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:08:42.382334 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 124075us
I20260709 13:08:42.310796 26197 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.738840 22505 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:42.727926 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.626921 22503 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:42.729537 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.756520 22497 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:42.459314 26353 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:42.311288 26376 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:42.326169 26482 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:42.494004 26415 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 13:08:42.465116 26514 log.cc:1199] T b09d79da74a54c84ab38db5f54cacc35 P 6ca917eaada84bf38a5daae9f8ffa066: Deleting WAL directory at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/wals/b09d79da74a54c84ab38db5f54cacc35
I20260709 13:08:42.748745 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.750258 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.751883 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.328682 26480 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.457345 26391 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:42.462406 26485 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.754354 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:42.732955 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.789608 22498 raft_consensus.cc:2410] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:42.722903 22647 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:42.792179 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.757825 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.758845 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.792889 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:42.793843 22500 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:42.794009 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.760161 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.679730 26427 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.720124 26108 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.735190 26471 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.766208 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.734894 26489 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.351848 26493 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.834679 26493 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.836807 23256 raft_consensus.cc:2410] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:42.817252 26485 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:42.547513 26515 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.769707 22502 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:42.778983 23258 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:42.838487 22504 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:42.738184 26197 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.737818 26475 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:42.760962 26370 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:08:42.785661 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:42.785560 22579 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:42.795228 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:42.802107 22572 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:42.761564 26481 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 5. Current term is 6.
I20260709 13:08:42.735383 25592 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:08:42.805344 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51087.5us
I20260709 13:08:42.771068 26376 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.769650 26353 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:42.768056 23257 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:42.761938 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.816646 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.735839 26337 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.731283 26267 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.816937 26309 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:42.790416 26391 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:42.805550 26480 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:08:42.808955 26496 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:42.826536 26332 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.737578 26498 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.826573 26471 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.827971 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:42.842073 25566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.048s	sys 0.056s
W20260709 13:08:42.902406 25566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.048s	sys 0.056s
I20260709 13:08:42.781972 26508 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.568s
I20260709 13:08:42.844815 26197 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.849479 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.903725 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:42.849550 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 64028.9us
I20260709 13:08:42.861160 26353 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.863404 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:42.870012 22469 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:42.895018 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.851570 26515 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:42.914069 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 44259.5us
I20260709 13:08:42.905346 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:42.857257 22402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.030s	sys 0.023s
W20260709 13:08:42.915210 22402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.030s	sys 0.023s
I20260709 13:08:42.906517 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.856943 26427 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.904289 22574 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
W20260709 13:08:42.892660 26047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.021s	sys 0.025s
W20260709 13:08:42.910542 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47249.3us
I20260709 13:08:42.911399 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.915865 22575 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:42.900892 26391 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.922688 22544 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:42.917830 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:42.924432 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.925397 22502 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:42.842398 26016 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:42.917376 26047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.022s	sys 0.025s
I20260709 13:08:42.929832 26267 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:42.937376 26267 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.937810 26267 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.938578 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.940793 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.941723 26317 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.942384 26317 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:42.942435 26397 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:42.930279 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:42.929698 22501 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:42.934784 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:42.945318 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:42.932531 26332 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:42.951076 26397 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:42.951503 26397 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:42.951547 26512 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:42.930514 26514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59516 (request call id 96) took 1369 ms. Trace:
I20260709 13:08:42.952469 26397 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:42.953230 26514 rpcz_store.cc:276] 0709 13:08:41.561545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.566202 (+  4657us) service_pool.cc:224] Handling call
0709 13:08:41.819951 (+253749us) ts_tablet_manager.cc:1151] Deleting tablet b09d79da74a54c84ab38db5f54cacc35
0709 13:08:41.820054 (+   103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:42.166048 (+345994us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:42.199804 (+ 33756us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:42.930433 (+730629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3608,"tablet-delete.queue_time_us":93777,"thread_start_us":99089,"threads_started":1}
I20260709 13:08:42.931474 26228 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.955262 22389 catalog_manager.cc:5028] TS 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): tablet b09d79da74a54c84ab38db5f54cacc35 (table test-workload [id=2646b0dde47f4fce81117d088ff28920]) successfully deleted
I20260709 13:08:42.955245 26228 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:42.943447 26507 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:42.956750 26488 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:42.957201 26507 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:42.957757 26507 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:42.960074 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 633) took 1227 ms. Trace:
I20260709 13:08:42.960505 22576 rpcz_store.cc:276] 0709 13:08:41.732885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.892686 (+159801us) service_pool.cc:224] Handling call
0709 13:08:41.893533 (+   847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.302804 (+409271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.302834 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.302874 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:42.302910 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.959827 (+656917us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54001e50d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:42.959886 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.960016 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940775168}
I20260709 13:08:42.961614 26498 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.920590 26471 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:42.967386 26471 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:42.967617 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 722045us
I20260709 13:08:42.934607 26337 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:42.968580 26471 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:42.955403 26443 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.144s	user 0.014s	sys 0.000s
W20260709 13:08:42.970403 22618 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0328fc7e60424283b5d1ea734bd5136a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:42.970623 22496 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:08:42.970860 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 651784us
I20260709 13:08:42.972301 26195 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.984915 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.985852 22498 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:42.997701 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 694) took 1071 ms. Trace:
I20260709 13:08:42.998719 22496 rpcz_store.cc:276] 0709 13:08:41.902592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.902740 (+   148us) service_pool.cc:224] Handling call
0709 13:08:42.974047 (+1071307us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54003fb954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:42.974214 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211852032}
I20260709 13:08:42.927430 26448 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.004252 22575 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:43.005403 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:43.007189 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 284365us
I20260709 13:08:42.957322 26228 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:43.009331 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.011021 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:42.976197 26515 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:42.997681 26108 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.025602 26108 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:43.027237 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3130) took 1316 ms. Trace:
I20260709 13:08:43.022531 26515 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:43.027962 26515 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.027765 22571 rpcz_store.cc:276] 0709 13:08:41.711265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.712064 (+   799us) service_pool.cc:224] Handling call
0709 13:08:43.027069 (+1315005us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54003acad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:43.027176 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307132672}
I20260709 13:08:42.922381 26427 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.042001 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.042943 22500 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:43.038793 26208 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.968530 26197 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:43.063215 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.078972 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.079970 22504 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:08:43.049216 26208 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.072486 22577 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:43.077854 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.082512 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.092780 23258 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:43.092780 22500 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:43.097342 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.099746 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.102560 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:43.103848 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:43.098291 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 277034us
I20260709 13:08:43.113922 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.116178 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.116384 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.117410 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.117856 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.118461 22653 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:43.118639 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.119333 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.120078 22653 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:43.130044 26337 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:43.130730 26337 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:43.131433 26337 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:43.130623 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 206299us
I20260709 13:08:43.132838 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:43.137732 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:43.140919 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 2487) took 1041 ms. Trace:
I20260709 13:08:43.140165 26195 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:43.160951 22499 rpcz_store.cc:276] 0709 13:08:42.099145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.100035 (+   890us) service_pool.cc:224] Handling call
0709 13:08:43.140757 (+1040722us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001db0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:43.140846 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504086272}
I20260709 13:08:43.051419 26267 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:43.148316 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.151628 23260 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:43.151208 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:43.148140 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 247329us
I20260709 13:08:43.152160 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.157455 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:43.163736 23261 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:43.158465 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:43.164474 22650 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:43.162892 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:43.177075 26317 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:43.177582 26317 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.177999 26317 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:43.178217 26534 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:43.179713 26482 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:43.169775 26539 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:43.181926 26427 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:43.179535 26507 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.186568 26442 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:43.186970 26507 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:43.191754 23261 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:43.192911 22572 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:43.151204 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.193302 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:43.202946 26542 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:43.203037 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:43.166471 26195 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:43.212263 22505 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:43.212594 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.213348 22497 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:43.213856 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:43.215294 22496 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:43.220557 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:43.221506 26542 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:43.223016 26542 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.214532 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.225085 22496 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:43.230468 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:43.232889 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 193893us
I20260709 13:08:43.234632 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.231318 22499 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:43.235847 22503 raft_consensus.cc:2410] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:43.236738 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.237659 22499 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:43.237844 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.240435 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.242738 22502 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:43.242959 22504 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:43.244272 22501 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:43.204098 26498 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:43.246584 22645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1abd591408b04d32a9049743f1e89547"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:43.247342 22645 raft_consensus.cc:606] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:43.248847 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.250735 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:43.253360 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.254120 22647 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:43.217355 26195 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.214915 26309 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:43.229387 26482 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:43.259308 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.260591 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.257956 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:43.262638 22651 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:43.228089 26442 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:43.263629 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:43.265390 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.266263 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:43.267832 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.268481 26267 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:43.253125 26448 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:43.252602 26498 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:43.276829 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.335176 25592 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.278249 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:43.272899 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.335572 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:43.255637 26449 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.285600 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.286274 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.286743 22651 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:43.287523 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.283914 22503 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:43.261588 26482 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:43.291857 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 172892us
I20260709 13:08:43.334661 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:43.276320 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:43.276252 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 143562us
I20260709 13:08:43.275344 26197 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:43.339931 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:43.340422 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:43.272605 26549 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:43.342483 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.352613 22645 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:43.358186 25592 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:43.363816 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:43.365660 22499 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:08:43.366098 22499 pending_rounds.cc:85] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 3
I20260709 13:08:43.366335 22499 pending_rounds.cc:107] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:08:43.366621 22499 raft_consensus.cc:2889] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.377205 26443 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:43.377772 26443 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:43.378149 26443 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.346797 26498 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:43.385484 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.339174 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:43.365103 26108 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:43.349416 26482 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.407857 25592 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.391413 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:43.413671 25592 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.393796 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:43.356752 26228 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.365531 26561 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:43.382246 26551 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:43.428870 26394 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:43.432891 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 159376us
I20260709 13:08:43.433588 25592 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:43.430580 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:43.410082 26108 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:43.381752 26445 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:08:43.409598 26016 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:43.446645 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:43.541247 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 110969us
I20260709 13:08:43.696826 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:43.381172 26475 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:08:43.440596 25592 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:43.698089 25592 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:43.698563 25592 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.467456 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:43.532555 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.434258 26228 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.568805 26442 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:43.700021 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 232632us
I20260709 13:08:43.700315 26442 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.410264 26309 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.701010 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:43.701781 26228 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:43.702411 22545 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:43.620002 26353 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.698s	user 0.008s	sys 0.000s
W20260709 13:08:43.631956 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2162) took 1472 ms (client timeout 1739 ms). Trace:
W20260709 13:08:43.703830 22577 rpcz_store.cc:269] 0709 13:08:42.159418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.302223 (+142805us) service_pool.cc:224] Handling call
0709 13:08:43.631704 (+1329481us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003c82d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:43.631864 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794926976}
I20260709 13:08:43.705080 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:43.705731 22577 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.432685 26551 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:43.575593 26558 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:08:43.425469 26197 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:43.469170 26563 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:43.549610 26512 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:08:43.787286 25592 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.791812 25592 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:43.669345 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.793248 23263 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:08:43.661044 26337 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
W20260709 13:08:43.672236 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 331893us
I20260709 13:08:43.812809 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:43.724299 26016 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:43.813306 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:43.662832 26564 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:08:43.534588 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86008.9us
I20260709 13:08:43.814194 26016 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:43.815062 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3151) took 1047 ms. Trace:
I20260709 13:08:43.815927 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:43.533635 26488 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.817116 26488 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.819178 26488 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:43.819893 26488 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.820688 26223 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:43.440897 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 151368us
I20260709 13:08:43.574875 22645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:43.822731 22645 raft_consensus.cc:606] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:43.823089 22645 raft_consensus.cc:614] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.686614 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.622150 26389 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:43.670421 26391 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.006s
I20260709 13:08:43.824394 26391 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.826706 26391 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:43.704551 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:43.411787 26427 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:08:43.812943 26337 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.535660 26108 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.830299 26337 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:43.833864 23257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 576) took 1730 ms (client timeout 1622 ms). Trace:
W20260709 13:08:43.834347 23257 rpcz_store.cc:269] 0709 13:08:42.103479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.105557 (+  2078us) service_pool.cc:224] Handling call
0709 13:08:43.833661 (+1728104us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54007a2454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:43.833773 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077617536}
I20260709 13:08:43.835650 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:43.681783 26515 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.006s
I20260709 13:08:43.666647 23259 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:43.700765 26442 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:43.690006 26376 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.009s
I20260709 13:08:43.786895 26572 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.798672 26397 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:43.801481 26569 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:08:43.802258 26553 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:08:43.724984 26551 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.804553 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:43.840293 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.986138 23259 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:43.815550 22574 rpcz_store.cc:276] 0709 13:08:42.767559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.141535 (+373976us) service_pool.cc:224] Handling call
0709 13:08:43.154624 (+ 13089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.155059 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.155097 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.155627 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.277601 (+121974us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:43.277647 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.277744 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.814880 (+537136us) raft_consensus.cc:1685] finished
0709 13:08:43.814896 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.815000 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11551,"raft.queue_time_us":4768,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8556,"thread_start_us":121612,"threads_started":1,"wal-append.queue_time_us":270506}
I20260709 13:08:43.816805 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:43.850340 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:43.850849 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.667078 26317 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.853271 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:43.857625 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:43.836848 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:43.870656 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 166187us
I20260709 13:08:43.724730 26197 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:43.871717 26337 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.724438 26353 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:43.704790 26471 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:43.872452 26376 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:43.725986 26571 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:43.905831 26549 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:43.811865 26443 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:43.914083 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 91998.1us
W20260709 13:08:43.725307 26566 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
W20260709 13:08:43.980001 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 138645us
I20260709 13:08:43.800659 26448 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:44.059135 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:43.991148 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 174403us
I20260709 13:08:44.018648 26571 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:43.711122 26414 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:43.914338 26483 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:44.000903 26208 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.000s
I20260709 13:08:43.866061 26228 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:43.914721 26563 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.022074 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:43.915467 26572 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:43.971256 26438 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:08:44.014853 26197 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:43.866607 26515 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:43.981868 26550 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.156s
I20260709 13:08:44.054618 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:44.011495 26547 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:44.174685 22646 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:44.007989 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.177075 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:44.080001 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:44.072475 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:44.017124 23257 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:44.065336 26448 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.181109 22654 raft_consensus.cc:2410] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:08:44.182338 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127808us
W20260709 13:08:44.091028 26524 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.827s	user 0.000s	sys 0.016s
I20260709 13:08:44.185436 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:44.190246 23264 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 3.
I20260709 13:08:44.191416 23263 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 13:08:44.108064 26449 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.000s
I20260709 13:08:44.191748 23263 pending_rounds.cc:85] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 8
W20260709 13:08:44.086112 26195 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.002s
I20260709 13:08:44.071165 26571 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.079733 26410 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:44.086884 26526 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.516s	user 0.005s	sys 0.000s
I20260709 13:08:44.189747 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:44.084625 26559 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:08:44.192035 23263 pending_rounds.cc:107] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:44.102077 26376 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.187459 26332 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:44.070685 26414 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:44.238873 26332 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.239257 26563 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.239517 26332 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.116947 26108 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.090543 26353 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:44.180423 26572 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.245021 23264 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:44.176149 26228 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.245817 26228 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.067296 26574 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 13:08:44.207399 26515 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.213124 26488 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:44.214525 26017 raft_consensus.cc:993] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:44.250602 26488 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:44.250837 26017 raft_consensus.cc:1081] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:44.214958 26443 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.198850 26195 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.251515 26488 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.252969 26488 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.253263 26195 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.087734 26549 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.186367 26208 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.259353 26208 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:44.219054 26551 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.226953 26442 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:44.229996 26498 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.000s
I20260709 13:08:44.197503 26449 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:44.231001 26317 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:44.234470 26482 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.001s
I20260709 13:08:44.237480 26547 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:44.238965 26414 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.206410 26471 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:44.265534 26547 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:44.268183 26471 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.261888 26572 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.272964 26332 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.274986 26572 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.275168 26332 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:44.271708 26571 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.268996 26547 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.277704 26547 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:44.278766 26571 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.278590 26471 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.267586 26482 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.282310 26471 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.262190 26498 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.286731 26498 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.288415 26442 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.289886 26551 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.003839 22499 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:44.322844 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.017s	sys 0.028s
W20260709 13:08:44.324834 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.017s	sys 0.028s
I20260709 13:08:44.326349 22575 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:43.803436 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:44.327703 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 630870us
I20260709 13:08:43.913918 22392 maintenance_manager.cc:419] P b97e77c8afed466a990720a609bf1968: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033347
I20260709 13:08:44.330837 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3157) took 1050 ms. Trace:
W20260709 13:08:43.987646 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 137381us
W20260709 13:08:44.329304 22572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.022s	sys 0.024s
W20260709 13:08:44.337698 22572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.023s	sys 0.024s
I20260709 13:08:44.337705 22580 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
W20260709 13:08:43.977010 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 323171us
I20260709 13:08:44.343950 22578 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:44.007349 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.066442 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:44.347348 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 285805us
I20260709 13:08:44.350757 22574 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:08:44.351455 22577 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.012s
I20260709 13:08:44.351719 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3160) took 1237 ms. Trace:
I20260709 13:08:44.352058 22577 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:44.352524 22469 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:44.354089 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:44.355784 22647 raft_consensus.cc:2376] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7. Re-sending same reply.
W20260709 13:08:44.356164 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.357913 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:44.352304 22574 rpcz_store.cc:276] 0709 13:08:43.114733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.018495 (+903762us) service_pool.cc:224] Handling call
0709 13:08:44.349780 (+331285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.351304 (+  1524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.351597 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.360394 22649 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:44.196632 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:44.369587 23259 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:44.078037 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 573) took 2037 ms. Trace:
I20260709 13:08:44.371421 23260 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:44.371088 23256 rpcz_store.cc:276] 0709 13:08:42.040955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.043634 (+  2679us) service_pool.cc:224] Handling call
0709 13:08:44.077720 (+2034086us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b540047f9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:44.077941 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132732672}
I20260709 13:08:44.205818 23263 raft_consensus.cc:2889] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.374500 26108 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.377270 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:44.377478 26488 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:44.378301 26488 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.377449 26017 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:44.378826 26488 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.379099 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:44.371565 23255 raft_consensus.cc:2368] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12.
I20260709 13:08:44.329311 22500 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:44.377363 26378 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.370296 23257 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:44.340433 22579 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:44.385354 26547 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.328099 22576 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.386430 26547 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.379032 26017 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.388808 26017 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.351465 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:44.321470 22504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.028s	sys 0.044s
W20260709 13:08:44.347584 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 340153us
I20260709 13:08:44.384366 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:44.399037 23257 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:44.399796 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.331324 22502 rpcz_store.cc:276] 0709 13:08:43.280266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.280549 (+   283us) service_pool.cc:224] Handling call
0709 13:08:43.281095 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.281532 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.281572 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.282155 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.695845 (+413690us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:43.713632 (+ 17787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.713924 (+   292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.330047 (+616123us) raft_consensus.cc:1685] finished
0709 13:08:44.330100 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.330518 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6929,"thread_start_us":342486,"threads_started":1,"wal-append.queue_time_us":676693}
I20260709 13:08:44.391517 22645 raft_consensus.cc:2376] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6. Re-sending same reply.
I20260709 13:08:44.403420 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.404491 26547 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.404667 23263 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:44.409471 22504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.030s	sys 0.045s
I20260709 13:08:44.412483 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3161) took 1183 ms. Trace:
I20260709 13:08:44.414863 22574 rpcz_store.cc:276] 0709 13:08:43.218793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.381255 (+1162462us) service_pool.cc:224] Handling call
0709 13:08:44.381789 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.382242 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.382273 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.382331 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:44.402326 (+ 19995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.402404 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.402500 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.414090 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3166) took 1167 ms. Trace:
I20260709 13:08:44.423589 22577 rpcz_store.cc:276] 0709 13:08:43.235038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.704773 (+469735us) service_pool.cc:224] Handling call
0709 13:08:44.398247 (+693474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.428846 26471 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:44.429786 26471 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.436262 26471 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.417582 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:44.440073 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:44.418931 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3159) took 1300 ms. Trace:
I20260709 13:08:44.446022 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3148) took 2130 ms. Trace:
I20260709 13:08:44.446687 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:44.447801 26443 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:44.448480 26443 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.449018 26443 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.449397 26481 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:44.451552 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:44.441327 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3163) took 1003 ms. Trace:
I20260709 13:08:44.453276 22647 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:44.454612 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:44.422417 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.473958 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:44.290197 26448 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.475098 22647 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.462778 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.452847 26471 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:44.441007 22572 rpcz_store.cc:276] 0709 13:08:43.114414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.814888 (+700474us) service_pool.cc:224] Handling call
0709 13:08:43.815122 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.815342 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:43.816004 (+   662us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.339096 (+523092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.339266 (+   170us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:44.339429 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.392229 (+ 52800us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.414520 (+ 22291us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":270,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":57759,"thread_start_us":522165,"threads_started":1,"wal-append.queue_time_us":357479}
I20260709 13:08:44.496484 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.499136 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.501130 26442 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:44.501298 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.502992 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.503911 23256 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.505445 23257 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:44.507287 23257 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:44.514257 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 65514.2us
I20260709 13:08:44.515460 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.517302 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:44.519225 26572 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:44.519820 26572 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.520015 26591 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:44.520212 26572 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.519218 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:44.523211 26449 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:44.523849 26449 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.446728 22571 rpcz_store.cc:276] 0709 13:08:42.315059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.028988 (+713929us) service_pool.cc:224] Handling call
0709 13:08:43.029294 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.029514 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:43.251431 (+221917us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.413792 (+1162361us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b1800311e00. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287
0709 13:08:44.445161 (+ 31369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.445290 (+   129us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:44.445442 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.445554 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.445808 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11751,"prepare.queue_time_us":2706,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":43863,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":22271,"spinlock_wait_cycles":11785344,"thread_start_us":379943,"threads_started":3,"wal-append.queue_time_us":558012}
I20260709 13:08:44.524269 26449 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:44.525669 22571 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:44.526440 26482 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:44.528218 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 116511us
I20260709 13:08:44.529567 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:44.532943 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.533849 22503 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.534929 26498 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:44.535362 26498 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:44.535804 26498 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.520748 26591 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.544638 22576 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:08:44.564818 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 224604us
I20260709 13:08:44.551615 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.554279 26571 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:44.557114 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3165) took 1331 ms (client timeout 1675 ms). Trace:
I20260709 13:08:44.557293 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3162) took 1335 ms. Trace:
I20260709 13:08:44.558604 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3138) took 2250 ms. Trace:
I20260709 13:08:44.560755 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:44.561864 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.562409 26481 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.568087 22646 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:44.563952 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:44.455104 22504 rpcz_store.cc:276] 0709 13:08:43.419498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.421055 (+  1557us) service_pool.cc:224] Handling call
0709 13:08:43.464029 (+ 42974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.464253 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:43.465304 (+  1051us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.416464 (+951160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.416606 (+   142us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:44.416752 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.418439 (+  1687us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.422825 (+  4386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":758,"prepare.queue_time_us":1320,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":7559,"raft.queue_time_us":37083,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":13933,"thread_start_us":944342,"threads_started":2,"wal-append.queue_time_us":341097}
I20260709 13:08:44.566208 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:44.548853 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.565294 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:44.532585 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.583458 22579 rpcz_store.cc:276] 0709 13:08:42.308086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.941780 (+633694us) service_pool.cc:224] Handling call
0709 13:08:42.942055 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.385236 (+1443181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.558232 (+172996us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003cc8d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:44.558512 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3214121728}
I20260709 13:08:44.562595 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:44.582038 22575 rpcz_store.cc:269] 0709 13:08:43.225794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.257259 (+ 31465us) service_pool.cc:224] Handling call
0709 13:08:44.556818 (+1299559us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000e6d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:44.557027 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274925312}
I20260709 13:08:44.582860 23263 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:08:44.591813 22499 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:44.602090 22647 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:44.583076 22573 rpcz_store.cc:276] 0709 13:08:43.221614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.409076 (+1187462us) service_pool.cc:224] Handling call
0709 13:08:44.411730 (+  2654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.416380 (+  4650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.416438 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.417324 (+   886us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.452604 (+ 35280us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:44.452654 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.452729 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.556937 (+104208us) raft_consensus.cc:1685] finished
0709 13:08:44.556953 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.557105 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12503,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":174,"thread_start_us":34773,"threads_started":1,"wal-append.queue_time_us":124566}
W20260709 13:08:44.607092 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78697.9us
I20260709 13:08:44.610008 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.614887 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.615993 22648 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 3.
I20260709 13:08:44.618065 26448 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.618429 26591 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.619714 23256 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:44.621140 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 584) took 1537 ms. Trace:
W20260709 13:08:44.622357 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73686us
I20260709 13:08:44.616057 22577 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:44.614439 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.616202 22653 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:44.567595 26017 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.632586 22650 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:44.629158 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:44.634809 26016 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:44.639246 22571 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:08:44.653090 22573 raft_consensus.cc:2368] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13.
I20260709 13:08:44.647053 22645 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:08:44.645953 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 113478us
W20260709 13:08:44.641129 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 71963.6us
I20260709 13:08:44.623380 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.658022 26378 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:08:44.665251 22579 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:44.665544 22575 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:44.670662 26228 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.681231 26571 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:44.681521 26488 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.684090 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.684751 26017 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.687551 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.688896 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3163) took 1465 ms. Trace:
I20260709 13:08:44.621829 23258 rpcz_store.cc:276] 0709 13:08:43.095744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.095927 (+   183us) service_pool.cc:224] Handling call
0709 13:08:43.634555 (+538628us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:43.634746 (+   191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.635067 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.635095 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.635556 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.620040 (+984484us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b18002685a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1
0709 13:08:44.620466 (+   426us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:44.620524 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.620638 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.620712 (+    74us) raft_consensus.cc:1685] finished
0709 13:08:44.620729 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.620918 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55997,"raft.queue_time_us":91472,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":136597,"spinlock_wait_cycles":107492480,"thread_start_us":265901,"threads_started":1,"wal-append.queue_time_us":441889}
I20260709 13:08:44.689881 26601 ts_tablet_manager.cc:933] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.693547 26591 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.695117 26488 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.697062 22576 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:44.698297 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:44.698959 22576 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.700129 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.677583 23257 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:44.641520 26471 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:44.702538 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2442) took 2765 ms. Trace:
I20260709 13:08:44.702693 26471 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:44.703217 26471 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.704813 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:44.677948 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47336.7us
W20260709 13:08:44.705369 26197 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.522s	user 0.000s	sys 0.014s
I20260709 13:08:44.708223 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.708849 26443 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.702347 26571 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:44.705418 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 82200.1us
I20260709 13:08:44.690574 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:44.703058 22652 rpcz_store.cc:276] 0709 13:08:41.937009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.937131 (+   122us) service_pool.cc:224] Handling call
0709 13:08:41.939823 (+  2692us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.310671 (+370848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.310701 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:42.313534 (+  2833us) log.cc:844] Serialized 52 byte log entry
0709 13:08:43.849144 (+1535610us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18001bdea0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:08:44.053989 (+204845us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:44.054037 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.701841 (+647804us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400325354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:44.701934 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.702010 (+    76us) raft_consensus.cc:1685] finished
0709 13:08:44.702028 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.702318 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1131,"raft.queue_time_us":254,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6383,"spinlock_wait_cycles":837845632,"thread_start_us":194431,"threads_started":1,"wal-append.queue_time_us":1864490}
I20260709 13:08:44.689363 22574 rpcz_store.cc:276] 0709 13:08:43.222954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.428917 (+1205963us) service_pool.cc:224] Handling call
0709 13:08:44.429430 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.432296 (+  2866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.432325 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.432894 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.486384 (+ 53490us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:44.488363 (+  1979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.488462 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.688594 (+200132us) raft_consensus.cc:1685] finished
0709 13:08:44.688622 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.688797 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1753,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":295,"thread_start_us":52862,"threads_started":1,"wal-append.queue_time_us":247609}
I20260709 13:08:44.711818 26443 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.728633 26414 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.731539 22579 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.748960 26591 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:44.750739 26414 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.640254 26449 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.732577 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:44.733718 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:44.736449 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:44.741321 26562 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:44.743703 26228 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:44.688675 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:44.745173 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57747.5us
I20260709 13:08:44.747859 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.705982 26197 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.760723 22503 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:44.728698 26208 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:44.772508 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:44.780526 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 51218.8us
I20260709 13:08:44.780720 22579 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
W20260709 13:08:44.782303 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 93839.9us
I20260709 13:08:44.780186 26389 raft_consensus.cc:2764] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:08:44.787987 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54574.2us
I20260709 13:08:44.789122 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.790906 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:44.791761 26488 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:44.792690 26488 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:44.792487 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.775455 26442 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:44.801234 26017 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:44.815061 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:44.812068 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64360.5us
I20260709 13:08:44.815128 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 511) took 1067 ms. Trace:
I20260709 13:08:44.779301 26562 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:44.822094 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:44.827025 26549 raft_consensus.cc:2764] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:44.827163 23227 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.829232 26539 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:44.829149 26332 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:44.809835 26498 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.828313 26540 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:44.832881 26540 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:44.833412 26540 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:44.834285 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:44.834702 26540 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.835345 26442 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:44.837450 26540 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.837579 22543 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.818960 23264 rpcz_store.cc:276] 0709 13:08:43.686828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.248117 (+561289us) service_pool.cc:224] Handling call
0709 13:08:44.248426 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.248631 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:44.495075 (+246444us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.609868 (+114793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.613323 (+  3455us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:44.661178 (+ 47855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.715303 (+ 54125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.753169 (+ 37866us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215366,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":115,"raft.queue_time_us":3988,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":17915,"spinlock_wait_cycles":32925568,"thread_start_us":330562,"threads_started":2,"wal-append.queue_time_us":219824}
I20260709 13:08:44.840847 26228 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.841061 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 588) took 1739 ms. Trace:
I20260709 13:08:44.841162 26551 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.854840 26228 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:44.840224 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:44.842561 26016 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:44.855491 26228 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.844497 26498 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.848317 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:44.800845 26443 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:44.854919 23262 rpcz_store.cc:276] 0709 13:08:43.101498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.144231 (+ 42733us) service_pool.cc:224] Handling call
0709 13:08:44.440254 (+1296023us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:44.440664 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:44.445544 (+  4880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.445592 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:44.446670 (+  1078us) log.cc:844] Serialized 52 byte log entry
0709 13:08:44.493813 (+ 47143us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:44.513354 (+ 19541us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.525286 (+ 11932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.525362 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.840502 (+315140us) raft_consensus.cc:1685] finished
0709 13:08:44.840632 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.840833 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11648,"prepare.queue_time_us":35429,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":13807,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":331,"spinlock_wait_cycles":6575360,"thread_start_us":42854,"threads_started":1,"wal-append.queue_time_us":326267}
I20260709 13:08:44.870745 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.872006 26317 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.873641 26449 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.817408 26017 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.878954 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.892655 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:44.880970 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 69129.9us
I20260709 13:08:44.902899 23259 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:44.865576 22576 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:44.868140 26442 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:44.883688 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3144) took 2573 ms. Trace:
I20260709 13:08:44.883771 26197 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:44.884027 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.891403 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.868191 26591 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:44.892976 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.892781 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.904186 22578 rpcz_store.cc:276] 0709 13:08:42.309866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.958505 (+648639us) service_pool.cc:224] Handling call
0709 13:08:42.958812 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.344618 (+1385806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.883344 (+538726us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54003ee9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:44.883616 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184016768}
I20260709 13:08:44.894032 26562 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:44.909478 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 117114us
W20260709 13:08:44.899652 23255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 591) took 1625 ms (client timeout 1733 ms). Trace:
I20260709 13:08:44.911123 22498 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:44.900440 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52323.4us
I20260709 13:08:44.882623 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:44.904814 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.907773 22496 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:44.893697 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.829335 26208 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:08:44.902120 26017 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.912289 22579 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:44.920449 22575 raft_consensus.cc:2368] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:08:44.771847 26572 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:44.925446 22505 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.927292 22497 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.927984 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:44.929330 22544 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:44.930516 26498 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:44.931036 26498 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:44.931948 26498 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.933235 26317 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:44.933450 22503 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.933869 26317 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:44.935051 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.934863 26317 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:44.935796 22500 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:44.938289 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54416.3us
I20260709 13:08:44.910817 26306 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:44.945897 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.921142 26449 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:44.951416 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:44.952442 22578 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:44.958021 22496 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:44.982275 22498 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:44.988899 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:44.993510 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:44.911013 23255 rpcz_store.cc:269] 0709 13:08:43.274523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.279411 (+  4888us) service_pool.cc:224] Handling call
0709 13:08:44.899244 (+1619833us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54005c3ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:44.899501 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210631936}
W20260709 13:08:44.996955 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 47848.6us
I20260709 13:08:45.008046 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:45.008522 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61807.9us
I20260709 13:08:45.009629 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:45.013172 22575 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:45.015327 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:45.017385 22504 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:44.988523 26306 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:44.954175 26540 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:44.973820 26378 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:08:45.022123 26549 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.014743 26591 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:45.025185 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:44.986730 26601 tablet_copy_client.cc:323] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:08:45.042964 26549 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:45.051115 26571 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:45.078536 22653 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:45.080679 22650 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:45.082523 22652 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:45.083009 22652 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:45.087011 26608 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.354s	user 0.003s	sys 0.001s
I20260709 13:08:45.084074 22652 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.061800 26389 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:45.096712 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 87262.7us
I20260709 13:08:45.068410 26549 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:45.099071 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 73966.4us
I20260709 13:08:45.059300 26539 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:45.021777 26540 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:45.094801 26389 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.116467 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:45.100809 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:45.126138 22503 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:08:45.149770 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 309625us
W20260709 13:08:45.150923 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 213057us
I20260709 13:08:45.129256 26572 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:45.127492 26389 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.144699 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:45.153614 22652 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.103793 26471 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.161839 22578 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:08:45.163340 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:45.172443 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.176162 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 827227us
W20260709 13:08:45.180387 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56209.3us
I20260709 13:08:45.193890 22497 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:45.195364 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:45.196095 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66339.5us
W20260709 13:08:45.212529 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 252570us
I20260709 13:08:45.195781 26539 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:45.228442 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:45.233484 26569 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:08:45.237771 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:45.210142 26414 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:45.154072 26306 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:45.238919 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 101764us
W20260709 13:08:45.243268 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 66100.2us
I20260709 13:08:45.249148 22652 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:08:45.249573 22652 pending_rounds.cc:85] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 6
I20260709 13:08:45.244526 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:45.196219 26540 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.237489 26016 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:45.250725 22652 pending_rounds.cc:107] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:08:45.258499 22503 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:45.257212 22652 raft_consensus.cc:2889] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.260182 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:45.260612 26471 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:45.265681 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:45.266023 26017 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.269164 26622 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:45.277647 22500 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:45.280831 26619 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.281105 26620 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:45.252274 26539 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:45.256914 26016 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.331759 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:45.287549 22543 connection.cc:256] RPC call timeout handler was delayed by -1.7342241359999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:08:45.256376 26208 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:45.294615 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73720.9us
W20260709 13:08:45.305460 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 88882.1us
I20260709 13:08:45.309129 22503 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:45.310245 26591 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.312947 26621 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:45.313410 26540 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.314249 26547 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:45.315625 26629 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:08:45.321815 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:45.322067 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 499) took 1656 ms. Trace:
I20260709 13:08:45.323551 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:45.327819 22505 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:45.347676 22500 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:45.367030 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106996us
I20260709 13:08:45.374502 22502 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.322908 26488 raft_consensus.cc:2764] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:45.306735 26622 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:45.382306 23260 rpcz_store.cc:276] 0709 13:08:43.665496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.665645 (+   149us) service_pool.cc:224] Handling call
0709 13:08:43.666943 (+  1298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.372100 (+705157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.321778 (+949678us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b540035d754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:45.322011 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613859200}
I20260709 13:08:45.390435 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:45.334746 26016 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.334542 26208 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:45.398207 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 160926us
I20260709 13:08:45.398465 26619 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:45.401051 26017 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:45.401212 26637 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:45.401805 26637 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:45.402427 26017 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:45.402976 26637 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:45.406126 26228 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.001s
I20260709 13:08:45.406627 26228 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.381711 26621 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:45.416906 22504 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.409451 26208 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.427384 22575 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:45.368737 26539 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.416494 26228 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:45.433559 22571 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:45.436033 22500 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:45.421896 26306 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:45.452715 26625 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:45.453712 26625 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.454293 26389 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:45.455224 26610 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.720s	user 0.000s	sys 0.003s
I20260709 13:08:45.457197 22496 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:45.458259 26632 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:08:45.428282 26549 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.452484 26622 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:45.464936 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 134474us
I20260709 13:08:45.467252 22575 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:45.470309 23227 leader_election.cc:400] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13.
I20260709 13:08:45.471017 23227 leader_election.cc:403] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.456722 26389 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:45.456724 26625 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:45.484051 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:45.486191 22571 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:45.487653 22579 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:45.488763 22576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1abd591408b04d32a9049743f1e89547"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:08:45.491493 22576 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.491596 23258 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:45.491930 22576 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.492564 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 671) took 1697 ms. Trace:
I20260709 13:08:45.492967 23259 rpcz_store.cc:276] 0709 13:08:43.794790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.370988 (+576198us) service_pool.cc:224] Handling call
0709 13:08:44.901839 (+530851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.903791 (+  1952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.492338 (+588547us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54005c3ad0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:45.492504 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218403072}
I20260709 13:08:45.495572 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:45.497167 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 85128.3us
I20260709 13:08:45.489270 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:45.498893 22468 leader_election.cc:400] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:08:45.499552 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:45.501122 26642 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:45.502581 26017 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:45.491606 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.505113 26591 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:45.504711 26621 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:08:45.506659 26621 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.489835 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:45.512776 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.513290 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.467895 26619 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:45.516023 22504 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:45.478734 26622 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.505795 26591 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.519618 22576 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.517972 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:45.528841 22575 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:45.526790 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:45.532438 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92475us
I20260709 13:08:45.514540 26619 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:45.534265 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:45.534647 26619 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.536101 26619 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:45.541453 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3140) took 3232 ms (client timeout 2048 ms). Trace:
W20260709 13:08:45.541903 22580 rpcz_store.cc:269] 0709 13:08:42.308785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.827611 (+518826us) service_pool.cc:224] Handling call
0709 13:08:45.541181 (+2713570us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003bc254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:45.541352 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3300011264}
I20260709 13:08:45.543541 22571 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:45.526901 26108 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13.
I20260709 13:08:45.545439 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:45.546868 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.547441 26197 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.547765 26631 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:45.548378 26631 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:45.549356 26631 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.548385 26414 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:45.553208 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.553455 26414 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:45.553606 22617 connection.cc:256] RPC call timeout handler was delayed by -1.2485598349999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 13:08:45.555843 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:45.556694 22654 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:45.547780 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.558182 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:45.560103 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.558969 26419 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:45.561167 26419 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:45.561273 26642 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.562095 26572 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:45.562760 26572 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:45.562920 26498 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:45.563547 26498 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:45.563763 26572 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.564628 26498 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.565366 22650 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:45.566220 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:45.566510 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.566776 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:45.567096 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.567406 22652 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:45.567754 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.570593 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:45.570927 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.571296 22650 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:45.572496 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:45.572834 22651 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:45.563577 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:45.574496 26389 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:08:45.576598 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.580036 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:45.576539 26389 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:45.561581 26419 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.586555 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:45.582196 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:45.557343 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 767) took 1204 ms. Trace:
I20260709 13:08:45.583390 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:45.584656 26551 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.585274 22545 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:45.591418 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78462.6us
I20260709 13:08:45.578655 26638 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:45.581492 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.590226 23258 raft_consensus.cc:2368] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12.
I20260709 13:08:45.515412 26625 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.597209 23257 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.598482 22501 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:45.590585 22645 rpcz_store.cc:276] 0709 13:08:44.402019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.414617 (+ 12598us) service_pool.cc:224] Handling call
0709 13:08:44.458074 (+ 43457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.658328 (+200254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.557048 (+898720us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54001c7fd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:45.557264 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433806592}
I20260709 13:08:45.607322 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:45.608062 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.609272 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:45.606709 22576 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:45.610751 23262 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:45.611985 26332 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:45.612931 26488 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:45.613612 26488 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.614441 26378 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:45.615772 26488 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:45.612794 26332 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:45.628754 26591 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:45.601570 26481 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.641589 26539 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:45.589900 26389 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:45.643185 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.646464 26562 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:45.598274 26638 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:45.677310 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.677982 26638 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.678498 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.679024 26638 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.679668 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.645061 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:45.645959 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:45.647527 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.643996 26551 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:45.656320 22544 leader_election.cc:400] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12.
I20260709 13:08:45.658895 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:45.685225 22544 leader_election.cc:403] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.664955 26228 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:45.664891 22502 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:45.669441 26414 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.670485 26016 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.671909 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.672643 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.673152 26549 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:45.673262 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.673486 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.673833 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.674237 26389 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.621968 26108 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:45.674885 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:45.714056 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 57926.3us
I20260709 13:08:45.654385 26448 raft_consensus.cc:2764] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:08:45.676020 23258 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:45.585683 26547 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:08:45.617832 26197 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:45.683893 22500 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:08:45.706197 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 122939us
I20260709 13:08:45.672581 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.680806 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.685422 22496 raft_consensus.cc:2376] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14. Re-sending same reply.
I20260709 13:08:45.696954 22651 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:45.700748 22647 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:45.714417 22646 raft_consensus.cc:2410] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:45.676515 26481 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.720075 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.677320 26562 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:45.731264 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:45.704671 26645 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:45.729353 26481 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:45.617417 26625 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.699182 26571 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:45.734319 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:45.704460 26442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.025s
I20260709 13:08:45.735670 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.732020 23262 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:45.689575 26378 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:08:45.748889 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.734954 23257 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:08:45.739084 26442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.025s
I20260709 13:08:45.753106 22469 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:45.706041 26619 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:45.734243 26482 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12.
I20260709 13:08:45.764148 22645 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:08:45.731740 26108 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:08:45.770098 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.770864 26591 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.771133 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:45.715432 26306 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:45.786718 22649 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:45.787814 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:45.760088 26571 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:45.799079 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.768371 26481 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:45.767737 26539 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:45.771620 26591 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.804276 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:45.806766 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89628.1us
I20260709 13:08:45.784629 26488 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:45.741039 26562 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:45.831714 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 133270us
I20260709 13:08:45.802448 26481 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.853713 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:45.817306 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 204856us
I20260709 13:08:45.820333 26389 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.862427 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.818488 26448 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:45.857957 26562 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.896607 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:45.861040 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 177649us
W20260709 13:08:45.907109 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44802.6us
I20260709 13:08:45.905222 26549 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:45.909502 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:45.909876 26549 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:45.910877 26549 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.912094 26549 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:45.912956 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:45.915979 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:45.916711 22576 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:45.828608 26644 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:45.918500 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:45.813912 26539 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:45.859454 26481 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.923942 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:45.924933 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:45.932080 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 127851us
I20260709 13:08:45.932732 22580 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:45.916664 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:45.933646 22502 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.893914 22399 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.894426 26482 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:45.891500 26197 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:45.929816 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:45.922864 26317 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:45.940033 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43557us
I20260709 13:08:45.936233 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:45.938238 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129180us
I20260709 13:08:45.830646 26419 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.923890 26488 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:45.925561 26448 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:45.998123 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:45.991552 26471 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.996337 22502 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:45.988108 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:46.003793 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 64488.7us
I20260709 13:08:46.008924 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:46.010093 22577 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:45.945749 26016 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:46.022049 22654 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:46.025331 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87827.4us
I20260709 13:08:46.027302 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.005290 26414 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:45.999554 26644 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:46.041085 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:46.041740 22647 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:46.042979 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:46.044809 22653 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:46.046221 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:46.047251 22653 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:46.029287 26660 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.054577 22645 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.930955 26571 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:45.939523 26108 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:46.070822 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.057183 26197 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.034444 26625 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.052603 26498 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:46.031095 26471 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:46.085646 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58433.2us
I20260709 13:08:46.085767 22649 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:46.088554 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.091529 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.033222 26646 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.261s
I20260709 13:08:46.058773 26016 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:46.035583 26648 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.271s
W20260709 13:08:46.110675 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 101921us
I20260709 13:08:46.082028 26652 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.089468 26660 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:46.121681 26658 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:46.122157 26660 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:46.093366 26498 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:46.123301 26660 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.125492 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.089203 26317 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:46.135355 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.151901 22580 raft_consensus.cc:2410] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:46.108318 26488 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:46.105427 26625 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:46.113299 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.095777 26619 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:46.129647 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:46.159130 22650 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
W20260709 13:08:46.110219 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69205.4us
I20260709 13:08:46.125105 26665 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:46.167977 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:46.179809 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 50269.8us
I20260709 13:08:46.125154 26591 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.124346 26498 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:46.183591 26638 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.502s	user 0.029s	sys 0.009s
I20260709 13:08:46.174520 26659 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:46.177137 26625 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:46.228523 26631 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:46.229125 26625 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.177623 26644 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.230482 26317 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:46.203296 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 186818us
W20260709 13:08:46.201759 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 70564.6us
I20260709 13:08:46.090150 26448 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.167960 26652 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.215808 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:46.217305 26651 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.286s	user 0.001s	sys 0.001s
W20260709 13:08:46.219576 26671 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:08:46.220065 26647 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:08:46.220476 26670 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:46.221722 26539 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.224326 26488 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:46.226388 26471 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.226702 26419 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:46.226964 26619 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:46.229341 26631 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.182183 26482 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:46.256464 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:46.195878 26678 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:46.259240 26208 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.004s
I20260709 13:08:46.199295 26591 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:46.274039 22500 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:46.269757 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 437036us
I20260709 13:08:46.279752 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:46.298664 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:46.282495 26656 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:08:46.282898 26655 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:08:46.211022 26659 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:46.258018 26642 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.290308 26620 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:46.291508 26512 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:46.294999 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 306968us
I20260709 13:08:46.269107 26670 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:46.281530 26652 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:46.306151 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:46.307723 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 258781us
I20260709 13:08:46.316370 22664 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 0328fc7e60424283b5d1ea734bd5136a from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:08:46.317891 26512 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:46.330427 26419 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:46.331000 26419 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:46.331430 26419 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.331511 26512 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.333668 26512 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:46.346666 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:46.349960 22500 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:46.350025 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:46.352240 22653 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 4: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:46.297009 26539 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:46.309844 26620 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:46.325210 26670 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:46.368750 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 81133.8us
W20260709 13:08:46.367789 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 165211us
I20260709 13:08:46.384305 22496 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:46.343779 26488 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.389086 26680 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:46.389894 26680 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.391567 22647 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:46.391206 26620 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.391950 22647 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:46.309978 26591 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.298538 26208 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.392843 22647 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:46.413350 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50396.9us
W20260709 13:08:46.416680 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.392735 26620 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.430344 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:46.431471 23260 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:46.396297 26471 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.358184 22664 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 0328fc7e60424283b5d1ea734bd5136a from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-0328fc7e60424283b5d1ea734bd5136a
I20260709 13:08:46.380960 26678 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:46.417825 26681 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:46.395975 26591 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.409253 26680 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:46.444594 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 61561.1us
I20260709 13:08:46.396414 26674 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.515790 26677 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:46.445652 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:46.516536 23256 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:46.516481 26677 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.517931 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:46.518697 22577 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:08:46.519037 26677 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:46.446122 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45016.2us
W20260709 13:08:46.428897 26389 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.002s
I20260709 13:08:46.520831 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:46.521121 26666 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.521340 26661 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:46.521677 26666 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.521979 26661 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.415737 26668 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.240s
I20260709 13:08:46.524281 26661 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:46.433903 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 135316us
I20260709 13:08:46.527163 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:46.527870 22497 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:46.528383 23261 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 4: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:46.529718 22498 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:08:46.531453 22504 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:46.445740 22647 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.433344 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:46.512236 22580 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:46.513691 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:46.601353 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:46.525537 22505 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 8. Ops: []
I20260709 13:08:46.603216 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:46.605530 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.444307 26108 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.601497 22576 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:46.511621 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:46.608884 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:46.432245 26619 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:08:46.625090 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:46.610026 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:46.627481 22499 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:46.632207 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:46.527875 26683 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:08:46.664405 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 144252us
I20260709 13:08:46.664603 22652 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:08:46.665097 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:46.671643 22652 pending_rounds.cc:85] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 6
I20260709 13:08:46.525772 26668 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:46.666024 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 232764us
I20260709 13:08:46.666416 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:46.534001 26663 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.671003 22505 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:46.681025 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:46.714471 22576 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:46.681983 26678 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.668836 22573 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
W20260709 13:08:46.685762 26481 consensus_meta.cc:287] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.005s
I20260709 13:08:46.686784 26687 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:46.680505 26697 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:46.688807 26108 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.686808 22499 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:08:46.613130 26681 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.692708 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:46.694813 26644 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:46.671554 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:46.671913 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:46.735509 22497 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.709182 26591 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.666616 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:46.625562 26389 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:46.720666 22647 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:46.449746 26471 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.568852 26666 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:46.523047 26625 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:46.726516 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 104551us
I20260709 13:08:46.746486 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:46.725302 26488 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:46.672595 22652 pending_rounds.cc:107] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:08:46.732817 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:46.703063 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.724257 26668 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:46.742240 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 75758.7us
I20260709 13:08:46.724880 26652 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.754287 22505 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:08:46.754588 26652 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.755414 26668 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.755842 22505 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:46.721463 26674 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:46.701783 26680 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:46.722335 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:46.750267 22499 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:46.725574 26687 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:46.757242 26674 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.758678 26687 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.760061 26687 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.760926 26674 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.763288 26674 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:46.762497 26652 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:46.761739 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58794us
I20260709 13:08:46.765604 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:46.766945 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:46.767985 26652 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:46.769157 26652 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:46.769858 26652 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:46.770792 26652 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:46.771181 26652 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:46.772022 26652 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.778172 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.779531 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.780673 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.781955 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.533071 26482 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:46.785828 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.792804 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44193.8us
I20260709 13:08:46.797710 22652 raft_consensus.cc:2917] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 13:08:46.798316 22652 raft_consensus.cc:2889] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.798580 22499 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:46.735203 26644 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:46.726384 26481 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.825780 26644 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.801010 26449 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.827014 22501 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:46.827313 26449 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:46.828490 26449 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.830021 26449 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.833389 22504 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:46.801457 26108 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:46.802945 26681 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:46.803244 26625 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.803661 26512 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.804955 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:46.883978 22502 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:46.730026 26663 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.805203 26488 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.805905 26652 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:46.860054 23257 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.001s
W20260709 13:08:46.809010 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 71564.8us
I20260709 13:08:46.809738 26208 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:46.810122 26471 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:46.810732 26674 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:46.784854 26633 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:08:46.816473 26682 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:46.712608 26659 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.746951 26591 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:46.745941 26389 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:46.817791 26705 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:46.977705 26389 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:46.818109 26694 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 13:08:46.819701 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:46.820299 22647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:46.979344 22647 raft_consensus.cc:606] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:46.820178 26712 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:46.980993 26682 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.982511 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:46.886694 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.983757 26682 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:46.806900 26664 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.648s	user 0.000s	sys 0.002s
I20260709 13:08:46.890590 22497 raft_consensus.cc:2410] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:46.838411 26481 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:46.993079 22505 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:46.901434 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 119563us
W20260709 13:08:46.861158 26549 consensus_meta.cc:287] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.949s	user 0.012s	sys 0.002s
I20260709 13:08:46.830866 26419 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:46.883735 26625 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:46.911252 22579 raft_consensus.cc:2410] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:46.833537 26668 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 13:08:46.952279 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.954316 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46870.4us
I20260709 13:08:46.957329 26488 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:46.892963 23257 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:46.969542 26659 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:46.977039 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37474 (request call id 17) took 8653 ms. Trace:
W20260709 13:08:46.822301 26562 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.900s	user 0.011s	sys 0.000s
I20260709 13:08:46.982683 26663 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:46.985234 23262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.020s	sys 0.020s
I20260709 13:08:46.857038 26716 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:46.986156 22575 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:46.972492 26591 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.000718 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:47.002285 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:47.009711 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.032495 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:47.035459 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.010278 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 604) took 1352 ms. Trace:
I20260709 13:08:46.992118 26208 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:47.015655 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:47.015215 22652 rpcz_store.cc:276] 0709 13:08:38.300719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.300922 (+   203us) service_pool.cc:224] Handling call
0709 13:08:38.531332 (+230410us) log.cc:844] Serialized 513 byte log entry
0709 13:08:41.373543 (+2842211us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b180001b820. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:08:41.478516 (+104973us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b180001b820. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec26254b0b 00007fec262d9b63 00007fec26301752 00007fec2b2c1d29
0709 13:08:46.950888 (+5472372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2963962,"raft.queue_time_us":2728766,"raft.run_cpu_time_us":6789,"raft.run_wall_time_us":108085,"spinlock_wait_cycles":9858176,"thread_start_us":352849,"threads_started":1,"wal-append.queue_time_us":453391,"wal-append.run_cpu_time_us":2480,"wal-append.run_wall_time_us":1030703}
I20260709 13:08:47.039636 26208 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:08:47.018777 23262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.020s	sys 0.020s
I20260709 13:08:47.015206 26687 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:47.020561 26716 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:47.027230 26419 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:47.036173 26662 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.045957 26716 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.046249 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:47.038690 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.045414 26687 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:47.047881 22503 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:47.039816 26591 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:47.049029 26687 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.051158 22652 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:47.051489 26687 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:47.052574 26670 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.004s
I20260709 13:08:47.019218 26572 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:47.037086 23259 rpcz_store.cc:276] 0709 13:08:45.657811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.658045 (+   234us) service_pool.cc:224] Handling call
0709 13:08:45.659929 (+  1884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:45.684186 (+ 24257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:45.684217 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:45.717062 (+ 32845us) log.cc:844] Serialized 26 byte log entry
0709 13:08:45.983583 (+266521us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:45.983629 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.983712 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:46.806237 (+822525us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:47.003623 (+197386us) raft_consensus.cc:1685] finished
0709 13:08:47.003647 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.010204 (+  6557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23895,"raft.queue_time_us":24387,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":11911,"spinlock_wait_cycles":16232320,"thread_start_us":184168,"threads_started":1,"wal-append.queue_time_us":347189}
I20260709 13:08:47.045689 26208 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:47.013401 26620 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.006s
I20260709 13:08:47.052829 22652 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:47.059409 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 43856.9us
I20260709 13:08:47.048916 26488 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.053066 26684 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.046331 26662 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:47.059880 26619 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.032660 26017 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.063809 22497 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:47.063856 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:47.078325 22504 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:47.088750 22651 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:47.089308 26662 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.088654 26663 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:47.090780 26663 consensus_queue.cc:1243] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:47.092474 26662 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.022151 26682 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:47.088212 22502 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:47.060352 26625 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.057780 26482 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.096158 26663 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:47.105087 26684 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:47.105696 26625 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.106849 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.106060 26684 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.109162 26625 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.113677 26682 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:47.116367 26684 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.117698 26498 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:47.118158 26498 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:47.119081 26498 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:47.115316 26649 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.933s	user 0.000s	sys 0.001s
I20260709 13:08:47.116274 26678 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:47.120855 26498 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:47.129827 26621 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:47.130365 26621 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:47.108564 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:47.131258 26621 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.132309 26621 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:47.134654 26657 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.952s	user 0.001s	sys 0.001s
I20260709 13:08:47.084002 26488 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.136658 22504 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
W20260709 13:08:47.147703 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 48128.8us
I20260709 13:08:47.148581 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:47.150460 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:47.150947 22580 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:47.136096 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.150466 22504 pending_rounds.cc:85] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 6
I20260709 13:08:47.154106 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:47.154398 22504 pending_rounds.cc:107] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:08:47.154871 22504 raft_consensus.cc:2889] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.154896 22577 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:47.096879 26208 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.173362 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:47.174088 22577 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:47.174865 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:47.179584 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:47.180989 23264 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:47.061105 26670 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:47.149282 26682 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:47.182176 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:47.088025 26619 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.158437 26488 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.183046 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.183372 26652 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:47.186950 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 0328fc7e60424283b5d1ea734bd5136a: Aborted: Op aborted by new leader
I20260709 13:08:47.187521 26625 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.179034 26663 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.185518 22571 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:47.178221 26681 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.184722 26684 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:47.205282 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.207756 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:47.209582 22605 heartbeater.cc:646] Failed to heartbeat to 127.20.227.190:45599 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.227.190:45599 timed out after 15.000s (SENT)
I20260709 13:08:47.194741 26625 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.210021 26498 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.210794 26498 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.212137 26625 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.208626 22652 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:47.214066 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.214676 22652 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:08:47.215551 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.204962 26681 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.217648 26389 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.219110 26681 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.220028 26389 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.222122 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.222797 22653 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:47.223361 22502 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:47.223675 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.224453 22653 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:47.192844 26682 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.225416 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:47.226456 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.227043 26682 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.227255 22653 raft_consensus.cc:2410] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:47.228266 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.228416 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:47.219161 22650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2479) took 1547 ms (client timeout 1623 ms). Trace:
I20260709 13:08:47.198127 26663 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:47.229307 22650 rpcz_store.cc:269] 0709 13:08:45.672197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.672327 (+   130us) service_pool.cc:224] Handling call
0709 13:08:47.218926 (+1546599us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400325854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:47.219062 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704639360}
I20260709 13:08:47.230198 26690 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:47.190455 26714 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:47.230667 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.231256 22650 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:47.231451 26663 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.232161 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.232287 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 680) took 1659 ms. Trace:
I20260709 13:08:47.232697 23260 rpcz_store.cc:276] 0709 13:08:45.572387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.585954 (+ 13567us) service_pool.cc:224] Handling call
0709 13:08:45.618987 (+ 33033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:46.448652 (+829665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.232083 (+783431us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54007a30d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:47.232227 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868105472}
I20260709 13:08:47.233461 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:47.234165 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:47.234731 22577 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.236958 26488 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.238194 22497 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:47.239346 26619 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:47.217774 26498 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.201508 26678 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:47.230674 26690 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:47.240563 26690 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.240373 26678 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.241588 26670 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:47.242668 26572 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:47.243206 26572 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:47.242697 26678 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.179428 26716 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.246704 26716 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.248283 26448 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:47.248996 26448 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.251159 26448 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.252126 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:47.252578 22572 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:47.217803 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.253805 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:47.254501 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:47.253698 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.255430 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:47.255530 22645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:47.256137 22645 raft_consensus.cc:606] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:47.256834 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:47.257434 26691 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:08:47.257519 22652 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:47.229490 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:47.252766 22574 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:47.259634 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:47.260150 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:47.280303 26722 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:47.283131 22652 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:47.284209 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.279663 26704 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.286623 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.280452 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.244100 26572 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.288070 22577 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:08:47.289336 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:47.289376 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.290915 22652 pending_rounds.cc:85] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 7
I20260709 13:08:47.291309 26488 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.291325 22652 pending_rounds.cc:107] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:08:47.259986 23260 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:47.277364 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:47.265625 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2498) took 1282 ms. Trace:
I20260709 13:08:47.292721 22652 raft_consensus.cc:2889] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.293706 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.296617 22502 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:47.294346 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:47.297559 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:47.298753 22574 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:47.298328 26682 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:47.299875 26682 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:47.300275 26682 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:47.294960 22648 rpcz_store.cc:276] 0709 13:08:45.983613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.997868 (+ 14255us) service_pool.cc:224] Handling call
0709 13:08:46.019176 (+ 21308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.062596 (+ 43420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.062630 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.080212 (+ 17582us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.193342 (+113130us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:46.246569 (+ 53227us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.246857 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.246980 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.138294 (+891314us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b18003c5da0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:08:47.232917 (+ 94623us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b4800190158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:08:47.265353 (+ 32436us) raft_consensus.cc:1685] finished
0709 13:08:47.265383 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.265542 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85998,"prepare.queue_time_us":52969,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":66990,"raft.run_cpu_time_us":4077,"raft.run_wall_time_us":1158168,"spinlock_wait_cycles":28151424,"thread_start_us":78414,"threads_started":1,"wal-append.queue_time_us":955534}
I20260709 13:08:47.298715 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:47.309406 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.311010 26684 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:47.279486 26540 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:47.312916 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:47.314056 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:47.315613 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:47.261698 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:47.293083 26591 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:47.343508 26591 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:47.324743 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:47.326090 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:47.343968 26591 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.344349 26591 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.344995 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:47.346104 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:47.346622 22645 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.301370 26663 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:47.349251 26663 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.349663 26663 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:47.329399 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.330261 26667 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.333837 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:47.334597 22572 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:47.332188 26681 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:47.330312 26687 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:08:47.373728 26690 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.438457 26488 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:47.439065 26488 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.441444 26488 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.442394 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.444111 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.445540 22500 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:47.445936 22645 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
W20260709 13:08:47.333214 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 71568.8us
I20260709 13:08:47.352800 26591 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.440541 26690 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.363699 22572 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 6. Current term is 8. Ops: []
W20260709 13:08:47.353760 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.354652 26719 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:47.364739 26667 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:47.366875 23259 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:47.370395 22577 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:47.327251 26662 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:08:47.373282 26449 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:47.330293 26695 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:47.374645 26644 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.380249 22578 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:47.382516 22573 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:47.385524 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.385434 22574 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:47.388610 26686 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.451016 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:47.394038 22576 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:47.400599 26645 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 8 is higher.
I20260709 13:08:47.403499 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:47.404111 26725 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 13:08:47.404315 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.404417 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.404824 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.406018 22501 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:47.474913 22496 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:47.476692 22499 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:47.477262 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:47.406765 26631 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:47.409013 26692 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.839s	user 0.000s	sys 0.002s
I20260709 13:08:47.414036 22503 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:47.418555 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:47.419567 22399 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 7 to 10, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.428196 26670 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:47.428702 26716 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:47.429307 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:47.433518 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.435506 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:47.436851 26672 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.915s	user 0.002s	sys 0.001s
I20260709 13:08:47.438045 26623 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.437587 26663 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.450433 26591 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:47.362807 26681 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:47.448567 22645 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:47.452347 22572 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:47.452795 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.517462 22505 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
W20260709 13:08:47.453114 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.453840 22579 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:47.456000 22577 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:47.482506 26306 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.481393 26686 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:47.449770 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:47.482718 26108 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:47.534451 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 84748.6us
I20260709 13:08:47.359726 23227 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:47.480636 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:47.531883 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.434356 26682 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.484850 22654 raft_consensus.cc:606] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:47.453630 26719 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:47.499500 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.499723 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.543198 23259 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:47.499861 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.500145 26654 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.500996 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:47.502910 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.502830 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:47.502787 22498 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:47.454669 26667 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.509284 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.510962 26623 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:47.500669 26712 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:47.585660 22503 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:08:47.586036 22503 pending_rounds.cc:85] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 10
I20260709 13:08:47.585896 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.586342 22503 pending_rounds.cc:107] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:47.586668 22503 raft_consensus.cc:2889] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.455159 26449 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:47.390044 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2504) took 1048 ms. Trace:
I20260709 13:08:47.482124 22504 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:47.515074 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.524595 22497 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:47.578148 22399 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:08:47.538161 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:47.543620 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 183969us
I20260709 13:08:47.446745 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:47.550335 22499 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:47.603835 22500 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:47.454247 26488 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:08:47.456671 26662 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:08:47.565187 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.573298 22645 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:47.509982 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.515522 26631 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:08:47.514683 26670 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.481626 26442 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:08:47.512120 26646 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:08:47.575249 26710 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:47.585263 26663 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.587944 22503 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:47.486557 26498 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:47.592046 22502 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:47.576429 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73688.3us
I20260709 13:08:47.579145 22505 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:47.578681 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:47.596619 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.579106 22402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 315) took 14058 ms (client timeout 15000 ms). Trace:
W20260709 13:08:47.597506 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.598330 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.581286 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.589270 22651 rpcz_store.cc:276] 0709 13:08:46.341646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.417097 (+ 75451us) service_pool.cc:224] Handling call
0709 13:08:46.450297 (+ 33200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.089229 (+638932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.389653 (+300424us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:47.389955 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467448192}
I20260709 13:08:47.513118 26716 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.604909 22571 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:47.606107 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2487) took 1930 ms. Trace:
I20260709 13:08:47.552397 26306 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.514582 26228 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:08:47.584580 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:47.614342 26488 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:47.614032 26681 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.581030 26685 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:47.590317 26482 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.587659 26449 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.615819 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.694844 23263 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:47.666657 22646 rpcz_store.cc:276] 0709 13:08:45.675466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.725126 (+ 49660us) service_pool.cc:224] Handling call
0709 13:08:45.738975 (+ 13849us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:46.166881 (+427906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.166913 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:46.167391 (+   478us) log.cc:844] Serialized 52 byte log entry
0709 13:08:46.299833 (+132442us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:46.409712 (+109879us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.443395 (+ 33683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.443492 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.408581 (+965089us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b24001df528. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324d09d 00007fec25e7f10e 00007fec25e9688c 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221
0709 13:08:47.588101 (+179520us) raft_consensus.cc:1685] finished
0709 13:08:47.605805 (+ 17704us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.606018 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178298,"prepare.queue_time_us":377597,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":218082,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":34054,"spinlock_wait_cycles":27062144,"thread_start_us":582305,"threads_started":3,"wal-append.queue_time_us":206731}
I20260709 13:08:47.616336 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:47.612648 23257 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:47.617274 22498 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:47.515107 26645 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:08:47.520581 26619 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:08:47.619179 22469 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:47.618727 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 80679.3us
W20260709 13:08:47.712105 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 93005.8us
I20260709 13:08:47.534271 26666 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:08:47.599723 26684 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:47.574339 26667 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:47.610345 22499 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:47.567548 26108 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.675042 22575 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:47.605401 26591 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.678797 22496 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:47.609097 26448 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:08:47.648667 26389 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:47.655459 26704 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.654552 26710 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:47.691556 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 112956us
I20260709 13:08:48.150283 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:47.611546 26638 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:08:47.588590 26654 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:47.643416 26712 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:08:47.689203 26685 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.582604 26719 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:47.701099 26306 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:47.701288 26449 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:47.704766 22650 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:08:47.661384 22402 rpcz_store.cc:269] 0709 13:08:33.521220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.591665 (+ 70445us) service_pool.cc:224] Handling call
0709 13:08:47.578853 (+13987188us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:43.038012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:43.038611 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:43.038652 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:08:43.038670 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:43.171332 (+132662us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:43.196846 (+ 25514us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:43.196904 (+    58us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:08:43.541368 (+344464us) tablet.cc:701] Row locks acquired
0709 13:08:43.549095 (+  7727us) write_op.cc:260] PREPARE: finished
0709 13:08:43.605850 (+ 56755us) write_op.cc:270] Start()
0709 13:08:43.613259 (+  7409us) write_op.cc:276] Timestamp: P: 1783602523602020 usec, L: 0
0709 13:08:43.636673 (+ 23414us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.788584 (+151911us) log.cc:844] Serialized 5198 byte log entry
0709 13:08:44.399585 (+611001us) op_driver.cc:464] REPLICATION: finished
0709 13:08:44.731176 (+331591us) write_op.cc:301] APPLY: starting
0709 13:08:44.731339 (+   163us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:44.775721 (+ 44382us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:44.799217 (+ 23496us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:44.896002 (+ 96785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:44.896461 (+   459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:08:44.896545 (+    84us) write_op.cc:312] APPLY: finished
0709 13:08:44.897341 (+   796us) log.cc:844] Serialized 95 byte log entry
0709 13:08:44.897723 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.898126 (+   403us) write_op.cc:454] Released schema lock
0709 13:08:44.898226 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:44.898839 (+   613us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.898879 (+    40us) write_op.cc:454] Released schema lock
0709 13:08:45.453848 (+554969us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f832a 00007fec2627df14 00007fec2627dec3 00007fec2627de38 00007fec2627ddf3 00007fec2627d0dc 00007fec262a6e16 00007fec2628ecbb 00007fec2627939d 00007fec2627cd75
Metrics: {"mutex_wait_us":186980,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":259318,"apply.run_cpu_time_us":8515,"apply.run_wall_time_us":183798,"num_ops":13,"prepare.queue_time_us":717047,"prepare.run_cpu_time_us":20167,"prepare.run_wall_time_us":945441,"raft.queue_time_us":164156,"raft.run_cpu_time_us":25912,"raft.run_wall_time_us":1185732,"replication_time_us":749908,"spinlock_wait_cycles":298240896,"thread_start_us":1109990,"threads_started":4,"wal-append.queue_time_us":312205,"wal-append.run_cpu_time_us":55396,"wal-append.run_wall_time_us":1798224}]]}
I20260709 13:08:47.715229 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:47.680470 26488 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:47.742231 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:47.740485 26625 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:47.985143 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 377618us
I20260709 13:08:48.036536 26645 consensus_queue.cc:1243] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:48.040036 26662 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:48.045073 26619 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.047720 26208 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:48.048426 26682 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.035475 22646 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:48.049875 22399 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 7 to 8, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 8 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:08:47.830324 22652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.037s
I20260709 13:08:48.052068 22469 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:48.074544 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 410427us
I20260709 13:08:48.218214 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:48.036357 26670 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:48.069625 26644 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.003s
I20260709 13:08:48.036360 26667 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:48.103288 26378 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.013s	sys 0.032s
I20260709 13:08:48.073895 26498 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:48.116670 26736 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:08:48.141316 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:48.146616 22573 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:48.147359 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:48.144016 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:48.241782 22399 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.154440 26660 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.155059 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.160208 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 671485us
W20260709 13:08:48.242187 26378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.013s	sys 0.033s
I20260709 13:08:48.241146 26667 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:48.170799 26685 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:48.149150 26591 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:48.219923 22652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.005s	sys 0.049s
I20260709 13:08:48.165920 26704 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.218219 26619 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.227658 26716 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.231264 26741 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:48.240290 22647 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:48.244419 22579 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:48.149556 26389 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:48.246958 26498 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.250274 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:48.274196 26448 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.260978 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:48.180322 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:48.221293 26622 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.262200 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 120972us
I20260709 13:08:48.274389 26743 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:48.268965 23261 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.026s	sys 0.041s
I20260709 13:08:48.166028 26710 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:48.301179 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50965.7us
I20260709 13:08:48.324790 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:48.199878 26662 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.185967 26625 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.222298 26208 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.247516 26488 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.296953 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2512) took 1096 ms. Trace:
I20260709 13:08:48.295291 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2510) took 1136 ms. Trace:
I20260709 13:08:48.343773 22652 rpcz_store.cc:276] 0709 13:08:47.158888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.290020 (+131132us) service_pool.cc:224] Handling call
0709 13:08:47.290377 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:47.300124 (+  9747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.300154 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:47.300741 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 13:08:47.439987 (+139246us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4800190158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:08:48.286447 (+846460us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:48.286504 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.286594 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.286650 (+    56us) raft_consensus.cc:1685] finished
0709 13:08:48.286667 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.295201 (+  8534us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":2249,"raft.run_wall_time_us":140190,"spinlock_wait_cycles":5367552,"thread_start_us":985197,"threads_started":1,"wal-append.queue_time_us":745053}
I20260709 13:08:48.325922 22497 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:48.324923 23261 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.029s	sys 0.042s
I20260709 13:08:48.343273 22648 rpcz_store.cc:276] 0709 13:08:47.200448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.354462 (+154014us) service_pool.cc:224] Handling call
0709 13:08:47.354834 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.355265 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.355303 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.355806 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.037080 (+681274us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:48.037134 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.037230 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.296734 (+259504us) raft_consensus.cc:1685] finished
0709 13:08:48.296757 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.296900 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1234,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":389236,"threads_started":1,"wal-append.queue_time_us":693205}
I20260709 13:08:48.297775 26389 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:48.354409 22579 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:48.300297 26712 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:48.324811 22544 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:48.333256 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.361336 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.333660 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 618493us
I20260709 13:08:48.297971 26741 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:48.284217 26660 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.300732 22503 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:48.301558 26716 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:48.363574 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:48.329519 26742 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:48.363996 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.343598 26625 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:48.327076 26646 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.331153 26442 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:48.300899 26682 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:08:48.394233 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3201) took 1108 ms. Trace:
I20260709 13:08:48.390762 22664 tablet_copy_source_session.cc:215] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:48.331827 26622 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.405267 22575 rpcz_store.cc:276] 0709 13:08:47.285560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.399755 (+114195us) service_pool.cc:224] Handling call
0709 13:08:47.400087 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.140797 (+740710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.393880 (+253083us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540027abd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:48.394142 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631805184}
I20260709 13:08:48.345293 26448 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:08:48.403308 26732 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:08:48.359378 26306 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:08:48.384635 26716 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.384641 26742 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:48.452157 22497 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:48.406625 26654 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.410779 26743 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:48.484678 22664 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:37482 (request call id 779) took 2169 ms. Trace:
I20260709 13:08:48.482343 26742 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.413532 26712 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:08:48.406747 26631 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:08:48.409106 26646 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.485148 22664 rpcz_store.cc:276] 0709 13:08:46.315012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.316047 (+  1035us) service_pool.cc:224] Handling call
0709 13:08:47.583425 (+1267378us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400237154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec263053f7 00007fec2b29b036 00007fec2b2a4a3e 00007fec22b6827b 00007fec2b2a49ba 00007fec2b29facc 00007fec2b29ac7b 00007fec2b28f8d1 00007fec2a3434b4 00007fec2a343442
0709 13:08:48.390611 (+807186us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400237154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2b29b1bb 00007fec2b2a4a3e 00007fec22b6827b 00007fec2b2a49ba 00007fec2b29facc 00007fec2b29ac7b 00007fec2b28f8d1 00007fec2a3434b4 00007fec2a343442
0709 13:08:48.484569 (+ 93958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274901120}
I20260709 13:08:48.493784 26619 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:48.494871 26646 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:48.495643 26758 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.496165 26758 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.480553 26752 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:48.497869 26591 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.498582 26591 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.499233 26591 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.477378 26741 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:48.481982 26750 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.505798 26750 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:48.507613 26750 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:48.479027 26716 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:48.509048 26208 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.510169 26712 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:48.510689 26712 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:48.511780 26712 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.498658 26758 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.518049 26660 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.508169 26750 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:48.519598 26750 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:48.528898 26716 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.531688 26716 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:48.533735 26662 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:48.476632 26663 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.557207 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 229402us
I20260709 13:08:48.558434 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:08:48.559147 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 215801us
I20260709 13:08:48.552379 26752 consensus_queue.cc:1243] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:48.572688 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2554) took 1135 ms. Trace:
I20260709 13:08:48.572113 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:48.552062 26716 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.574900 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:48.579219 22500 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:48.577643 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:48.573850 22503 rpcz_store.cc:276] 0709 13:08:47.436936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.669854 (+232918us) service_pool.cc:224] Handling call
0709 13:08:47.670200 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.380965 (+710765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.572465 (+191500us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540042b3d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:48.572631 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449146240}
I20260709 13:08:48.560144 26712 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:48.581981 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 218461us
I20260709 13:08:48.553295 26663 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:48.589679 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.592512 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 540492us
W20260709 13:08:48.601410 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 276673us
I20260709 13:08:48.605417 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:48.608577 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:48.610364 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:48.581137 26682 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:48.632933 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:48.589392 26681 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:08:48.582940 26716 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.632576 26682 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.613170 26752 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:48.581583 26571 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:48.631525 26758 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.698792 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 618) took 1082 ms. Trace:
I20260709 13:08:48.584844 26743 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:08:48.635785 26751 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:48.697187 26498 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:48.694356 26306 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.680609 26763 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.718451 23264 rpcz_store.cc:276] 0709 13:08:47.616050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.644025 (+ 27975us) service_pool.cc:224] Handling call
0709 13:08:47.644431 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.644699 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:48.060839 (+416140us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.698085 (+637246us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.698335 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.698388 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:48.698464 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.698554 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.698719 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11537,"prepare.queue_time_us":77601,"prepare.run_cpu_time_us":11129,"prepare.run_wall_time_us":279727,"raft.queue_time_us":120703,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":939246,"threads_started":3,"wal-append.queue_time_us":358165}
I20260709 13:08:48.701540 26682 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:48.701663 26591 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:48.737932 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 127687us
W20260709 13:08:48.743126 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 114980us
I20260709 13:08:48.744233 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:48.745441 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:48.747073 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.719184 26378 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.752405 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:48.753434 22505 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:48.757948 22505 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:48.727368 26498 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:48.767630 22505 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:48.738085 26755 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:48.769271 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:48.713358 26752 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.741850 26761 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.743168 26646 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:48.718063 26758 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:48.778477 26759 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:08:48.779284 26765 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:48.784068 26770 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:48.786755 26757 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:08:48.790341 26762 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:08:48.790508 26760 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:08:48.771521 26498 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:48.799361 26685 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.002s
W20260709 13:08:48.801489 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.737274 26767 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:08:48.739884 26306 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:48.794523 26667 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.001s
W20260709 13:08:48.814150 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 181318us
I20260709 13:08:48.771873 26755 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.849850 26591 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.850438 26591 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.852505 26591 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.741607 26751 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.815919 26660 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:48.835428 26743 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:48.843695 26678 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.869779 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:48.843333 26685 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.871785 26678 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.870460 22501 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:48.877396 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:48.846966 26755 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:48.878180 22501 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:48.882787 26777 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:48.883291 26777 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:48.885061 26685 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.862869 26754 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.842182 26378 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:48.866186 26686 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.884106 26777 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.788806 26761 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.905162 26646 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:48.905737 26646 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:48.887734 26663 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.909241 26686 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:48.891655 26743 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:48.901603 26716 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.894279 26754 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.921684 26767 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:48.924273 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 2547) took 1511 ms. Trace:
I20260709 13:08:48.924732 26777 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:48.926129 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2506) took 2583 ms. Trace:
I20260709 13:08:48.926254 26306 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.925529 26752 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:48.926842 26449 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.748s	user 0.012s	sys 0.002s
W20260709 13:08:48.927490 26710 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.003s
I20260709 13:08:48.927627 26758 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:48.914321 26791 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:48.950479 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48413.5us
I20260709 13:08:48.955196 22496 rpcz_store.cc:276] 0709 13:08:47.412632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.499175 (+ 86543us) service_pool.cc:224] Handling call
0709 13:08:48.924018 (+1424843us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400108454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:48.924159 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312016128}
I20260709 13:08:48.927572 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:48.958971 26767 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:48.958088 22647 rpcz_store.cc:276] 0709 13:08:46.342274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.983495 (+641221us) service_pool.cc:224] Handling call
0709 13:08:46.983807 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.295453 (+1311646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.925844 (+630391us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:48.926039 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888765184}
I20260709 13:08:48.951865 26591 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.975239 26767 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:48.974748 26591 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:48.977818 26754 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:48.962179 26781 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
I20260709 13:08:48.973212 23255 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:48.977931 26591 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.967633 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:48.984280 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 613) took 1399 ms. Trace:
I20260709 13:08:48.984987 23255 rpcz_store.cc:276] 0709 13:08:47.585093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.609015 (+ 23922us) service_pool.cc:224] Handling call
0709 13:08:48.927449 (+1318434us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6eee 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:08:48.984206 (+ 56757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12785920}
I20260709 13:08:48.986375 26108 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.988049 26761 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.984313 26767 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:48.993429 26767 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.993589 26751 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:48.993841 26767 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:48.960704 26678 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.001469 26678 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:49.002164 26678 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.002981 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.003871 22496 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:49.004005 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38438 (request call id 48) took 1647 ms. Trace:
I20260709 13:08:49.004395 22654 rpcz_store.cc:276] 0709 13:08:47.356979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.418382 (+ 61403us) service_pool.cc:224] Handling call
0709 13:08:49.003614 (+1585232us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b540037daa0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26278520 00007fec262f5652 00007fec2b2c360a 00007fec248497d4 00007fec24849762 00007fec24849691 00007fec2484960c 00007fec248488c2 00007fec2463648c 00007fec246358c6
0709 13:08:49.003860 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174259968}
I20260709 13:08:49.004911 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:48.999356 26751 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.005625 22496 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:08:49.005827 26751 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.006760 22496 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:49.007932 26751 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:48.955569 26625 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.010s
I20260709 13:08:48.961984 26789 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:08:49.016780 26389 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.008s
I20260709 13:08:48.966459 26710 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.023087 26631 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:49.030299 26695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.008s	sys 0.013s
I20260709 13:08:49.046921 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.047881 22579 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:49.051748 26660 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:49.036414 26791 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.055382 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.056551 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:49.045522 26695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.008s	sys 0.013s
I20260709 13:08:49.083235 26754 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:49.020210 26625 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.092832 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.041553 26449 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:49.030375 26389 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.105561 22497 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:49.057760 26660 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.053311 26631 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.113914 22501 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:49.094398 26754 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:49.115686 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.116300 22499 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:49.116832 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.108482 26449 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.124377 26646 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.125725 26449 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.127249 26389 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.128360 26646 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.132061 26488 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.134626 26208 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:49.135118 26208 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:49.136018 26208 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.137401 26208 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:49.134691 26742 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.003s
I20260709 13:08:49.139593 26741 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.139302 26742 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.139992 26625 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.083582 26791 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.141486 22573 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:49.142671 26791 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:49.143703 26790 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.128s	user 0.000s	sys 0.003s
I20260709 13:08:49.144176 26631 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.145506 26687 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:49.146036 26687 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:49.146046 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.033505 26743 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.116916 26754 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.156378 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.152371 26684 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:49.161684 26712 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:08:49.161835 26755 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.166684 26682 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.167830 26498 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.169718 26684 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.180336 26695 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:49.184643 26695 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.186826 26695 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.196961 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:49.197950 23260 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.198135 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:49.199326 22496 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:49.163282 26687 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:49.207369 23227 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.583s (SENT) [suppressed 9 similar messages]
I20260709 13:08:49.208817 26591 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.208667 26389 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.209429 26591 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.209949 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:49.209849 26389 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.210701 26761 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.211165 26761 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.211640 26591 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.211915 26389 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.212271 26591 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:49.216645 26591 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:49.217274 26591 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.219808 26678 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:49.223711 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 88d0b8c255a14106a3b00b5476896b2c: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:49.227061 22645 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:49.227625 22645 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:49.228468 22645 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.229647 22645 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.234469 26767 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.236939 22645 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:08:49.237557 26228 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:08:49.237725 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.239533 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2511) took 2080 ms. Trace:
I20260709 13:08:49.240231 26228 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.242874 26710 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:49.213114 26774 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.290s	user 0.004s	sys 0.000s
I20260709 13:08:49.213267 26761 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.206507 26625 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.206195 26670 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:49.214236 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:49.245023 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2521) took 1973 ms. Trace:
I20260709 13:08:49.246798 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.246814 22645 rpcz_store.cc:276] 0709 13:08:47.271688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.645555 (+373867us) service_pool.cc:224] Handling call
0709 13:08:47.645919 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.226915 (+1580996us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400368e20. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26272dc0 00007fec262fd1c0 00007fec262fe231 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c
0709 13:08:49.237353 (+ 10438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.244961 (+  7608us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170554624}
I20260709 13:08:49.247644 22497 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:49.249133 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:49.240084 22653 rpcz_store.cc:276] 0709 13:08:47.159675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.290506 (+130831us) service_pool.cc:224] Handling call
0709 13:08:47.290793 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.291151 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:47.291765 (+   614us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.051761 (+759996us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.903141 (+851380us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b18003f2a40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1
0709 13:08:48.953760 (+ 50619us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b18003f2a40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:08:48.973061 (+ 19301us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b18003f2a40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219
0709 13:08:49.230677 (+257616us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b18003f2a40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:08:49.232705 (+  2028us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b18003f2a40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:08:49.232926 (+   221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.233573 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.233829 (+   256us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:49.239100 (+  5271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.239205 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.239258 (+    53us) raft_consensus.cc:1685] finished
0709 13:08:49.239281 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.239453 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1176936,"prepare.queue_time_us":5943,"prepare.run_cpu_time_us":11609,"prepare.run_wall_time_us":47717,"raft.queue_time_us":1199951,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":17481,"spinlock_wait_cycles":194224256,"thread_start_us":449341,"threads_started":1,"wal-append.queue_time_us":752116}
I20260709 13:08:49.246148 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:49.266031 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51887us
I20260709 13:08:49.266206 22503 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.266814 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:49.273797 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.281594 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.282320 22501 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:49.283622 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:49.284642 22501 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:49.285218 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.265085 26670 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.287420 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.288043 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.288694 22497 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.289072 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.289628 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.291082 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.294459 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.295555 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.300331 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.301007 22580 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:49.301303 22498 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:49.300375 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.313869 22503 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:49.288478 26488 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:49.303489 26662 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.331696 26488 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:49.332183 26670 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.332122 26662 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.333926 26622 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:49.334568 26662 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.335739 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:49.244194 26228 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.337116 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:49.337267 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.337828 26228 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.338317 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:49.294123 26389 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.282132 26625 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.294714 26619 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:49.341825 26619 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.342309 26660 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.316982 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 780) took 3001 ms. Trace:
I20260709 13:08:49.344190 26619 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.343226 22649 rpcz_store.cc:276] 0709 13:08:46.315491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.321145 (+  5654us) service_pool.cc:224] Handling call
0709 13:08:46.346906 (+ 25761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.410057 (+ 63151us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:47.413587 (+1003530us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18000498a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec263150bf 00007fec26315038
0709 13:08:48.140048 (+726461us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.288854 (+1148806us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.302833 (+ 13979us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.303178 (+   345us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:49.303229 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.303330 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.316642 (+ 13312us) raft_consensus.cc:1685] finished
0709 13:08:49.316746 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.316912 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":825544,"prepare.queue_time_us":267554,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":858365,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8292,"spinlock_wait_cycles":3300224,"thread_start_us":656104,"threads_started":2,"wal-append.queue_time_us":433418}
I20260709 13:08:49.319119 26684 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.332201 26488 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.346958 26684 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.320024 26704 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:49.267150 26763 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.347951 26763 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.305586 26659 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.335840 26687 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:49.351971 23264 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:49.342761 26625 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.349355 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.227573 26591 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.350055 22577 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:49.350270 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:49.342319 22497 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
W20260709 13:08:49.353924 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.353801 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:49.262398 26767 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.329309 23260 raft_consensus.cc:2410] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:08:49.360746 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.364852 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 9e7684e99fff4bc297f8fbf170e45ddb: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:49.368624 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:49.365463 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.359195 23261 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
I20260709 13:08:49.370539 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 687) took 1891 ms. Trace:
I20260709 13:08:49.367138 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.371410 22575 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:49.371358 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.371503 23260 rpcz_store.cc:276] 0709 13:08:47.479571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.479757 (+   186us) service_pool.cc:224] Handling call
0709 13:08:47.674595 (+194838us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:08:48.690753 (+1016158us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6eee 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:08:49.196775 (+506022us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6f8c 00007fec231d6ef6 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:08:49.370471 (+173696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20979584}
W20260709 13:08:49.373615 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.368448 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:49.306490 26498 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.344185 26682 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.380203 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.381134 22578 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:49.355607 26750 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:49.386703 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.387385 23260 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:49.355788 26775 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:49.358366 26448 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:49.394726 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.368075 26684 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:49.392763 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:49.399058 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 191695us
I20260709 13:08:49.402338 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.402966 22580 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.393635 26775 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:49.377948 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.406996 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.408138 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.411679 22578 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:49.409621 26775 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.393455 26688 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:49.365099 26687 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.389953 26750 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:49.393755 26670 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:49.423430 22575 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:49.423273 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:49.392134 26743 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:49.433107 23261 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.433298 26743 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.433768 26743 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.382609 26317 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:49.437419 22580 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:49.438041 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.412693 26684 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:49.439848 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.396879 26766 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:49.442337 22580 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:49.423182 26688 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:49.453312 26688 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.454407 26688 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.425784 26751 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:49.393743 26623 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.444545 23257 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:49.461546 26572 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.461966 26623 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:49.449564 26802 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:08:49.449997 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.450475 26601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0328fc7e60424283b5d1ea734bd5136a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:49.450697 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.451121 26763 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.451221 26687 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.476804 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.477140 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.452219 26660 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.396728 26786 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:49.431825 26750 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.449265 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.405815 26448 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.456300 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 790) took 1793 ms. Trace:
I20260709 13:08:49.498597 22646 rpcz_store.cc:276] 0709 13:08:47.662974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.223956 (+560982us) service_pool.cc:224] Handling call
0709 13:08:48.224397 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.242558 (+1018161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.242593 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.243078 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.427369 (+184291us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:49.427412 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.427476 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.456101 (+ 28625us) raft_consensus.cc:1685] finished
0709 13:08:49.456121 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.456242 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":999189,"raft.queue_time_us":1048025,"spinlock_wait_cycles":66978176,"thread_start_us":183865,"threads_started":1,"wal-append.queue_time_us":209125}
I20260709 13:08:49.460008 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.437522 26761 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.460330 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.502354 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.502915 22580 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:49.503310 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:49.504268 26809 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:08:49.504660 26646 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:49.505115 26646 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:49.505486 26646 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:49.509069 26678 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:49.509505 26678 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.509826 26678 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:49.511215 26796 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.509s	user 0.005s	sys 0.000s
I20260709 13:08:49.511874 26775 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.470340 23261 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:08:49.473616 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.518115 26591 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.475399 22574 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.521075 22469 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.522239 22469 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:49.522405 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.523257 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:49.523721 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:49.436969 26695 consensus_queue.cc:1059] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:49.524931 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:49.525298 26751 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:49.525718 26751 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:49.526183 26751 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:49.438676 26754 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.528343 26754 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.525007 26695 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:49.529577 26695 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:49.525787 23255 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:49.502131 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:49.530206 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.533516 23264 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:49.533864 22574 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:49.532897 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.501294 22579 raft_consensus.cc:2393] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:49.525074 26670 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:49.536130 26631 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:49.536598 26631 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:49.537067 26631 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.537385 23257 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:49.538765 26448 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.539033 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.539903 23256 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:49.543294 26488 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.544847 22505 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:49.547817 26488 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:49.535400 26591 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:49.549801 26591 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:49.550940 26591 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.554236 26695 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.554934 26755 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:49.555660 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51230.9us
I20260709 13:08:49.555753 26695 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.557255 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:49.557801 22503 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.557832 26742 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.559087 26743 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.561177 22576 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:49.571447 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.571101 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:49.578595 22505 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.584234 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.576771 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.592080 22496 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:49.597621 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:49.600504 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.605991 23227 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:49.605616 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.608974 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:49.609829 22499 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:49.595854 26488 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.459066 26684 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.617048 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:49.617684 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 336038us
I20260709 13:08:49.619226 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.617717 23264 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 4.
I20260709 13:08:49.620615 22503 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:49.621611 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.622546 22574 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.625227 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.612279 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.601655 26761 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:49.631589 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.632380 23261 raft_consensus.cc:2368] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11.
I20260709 13:08:49.626561 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:49.627138 22497 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:49.633275 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.633857 22576 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:49.627417 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.47712e+06us
I20260709 13:08:49.634977 22503 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:49.636938 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:49.624038 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.615566 26687 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:49.637830 26742 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.642271 26710 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:49.642670 26710 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.643013 26710 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:49.644333 22499 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:49.637795 26662 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:49.645748 26806 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:49.645325 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.646929 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.647336 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.659427 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:49.619750 26670 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:49.647361 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:49.679582 23260 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
W20260709 13:08:49.661077 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.619547 26638 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.686074 22574 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:49.686551 22505 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:49.691687 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.636231 26761 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.688963 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 792) took 2025 ms. Trace:
W20260709 13:08:49.693212 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 57817us
I20260709 13:08:49.701478 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:49.701937 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54656.2us
I20260709 13:08:49.703243 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:49.693486 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:49.693588 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 81352.2us
I20260709 13:08:49.639240 26488 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:49.695652 22645 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:49.692191 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:49.686610 26799 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:49.680958 26766 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:49.728091 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.679657 26687 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:49.703655 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.705045 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.706493 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.722832 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.722995 22654 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:49.625946 26758 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 13:08:49.731644 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 98686.7us
I20260709 13:08:49.733536 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.734522 22652 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:08:49.735954 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:49.741468 22647 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.646279 26806 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.691035 26670 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.740521 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.743939 22653 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:49.730610 22649 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:49.748900 22576 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:49.755090 26670 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:49.700167 26623 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:49.759418 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55916.4us
W20260709 13:08:49.762629 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 59466.5us
I20260709 13:08:49.723732 26761 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.766897 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.727691 26681 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.700555 26805 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:49.705789 26667 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:49.769125 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.729910 26712 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:49.772621 22654 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:49.728091 26488 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:49.776680 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.786484 22653 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:49.779393 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:49.759603 26389 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:49.748215 26820 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:49.699836 26747 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:08:49.770625 26622 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.813367 22647 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:49.773573 26666 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.737782 26778 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:49.794487 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.774562 26662 consensus_queue.cc:1243] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:08:49.797961 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 104561us
I20260709 13:08:49.774021 26681 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.759523 26645 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:08:49.817287 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 113749us
I20260709 13:08:49.796029 26389 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.771508 26623 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:49.830739 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51881us
I20260709 13:08:49.833757 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:49.833578 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:49.792256 26488 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:49.845101 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.812824 26660 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:49.785324 26498 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:49.815929 26644 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.812951 26712 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:49.812768 26766 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:49.845014 22647 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
W20260709 13:08:49.813090 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 46101.9us
I20260709 13:08:49.858176 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.829567 26767 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:49.853286 22504 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:49.834748 26681 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:49.859318 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.859447 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:49.859752 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.866631 22574 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.835750 26619 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.869805 26619 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:49.871255 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:49.871892 26619 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
W20260709 13:08:49.872414 26813 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:08:49.785706 26805 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.826534 26666 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.792919 26667 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.844022 26787 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:49.822576 26622 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.875874 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.840476 26389 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.886865 22574 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:49.892447 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.893738 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:49.894863 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:49.898573 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:49.877928 26818 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:08:49.867712 26660 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:49.902959 22653 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:49.836663 26687 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.904775 26678 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:49.881990 26619 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:49.884326 26498 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:49.911720 26828 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:49.912058 26631 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:49.914602 22576 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:49.915359 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:49.868285 26743 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:49.956396 22647 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:08:49.885643 26814 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:08:49.917965 22649 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:08:49.929628 26645 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:49.884320 26448 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:49.939961 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68784.1us
W20260709 13:08:49.969198 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 137996us
I20260709 13:08:49.899958 26786 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.885416 26787 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:49.900979 26317 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:49.894838 26767 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:49.936967 26819 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:08:49.875710 26719 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:08:49.957038 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64699.3us
I20260709 13:08:49.916018 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:49.915426 26646 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:49.933619 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.969363 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:50.004308 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:49.970948 22618 leader_election.cc:400] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11.
I20260709 13:08:49.960525 26789 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:50.009716 22618 leader_election.cc:403] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:50.010076 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.971617 26448 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:49.959633 26800 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:49.974414 26712 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.035995 26631 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.037204 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:49.993458 22647 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:49.908668 26666 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.011307 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:50.012522 22500 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:50.014257 26667 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:50.043056 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 180013us
I20260709 13:08:50.001145 26806 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.010843 23256 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:50.045370 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 117770us
I20260709 13:08:50.050513 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:50.051237 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.009491 26645 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:50.045394 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:50.018793 26448 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:50.060889 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:50.061401 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:49.965241 26766 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.006843 26317 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:50.057367 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.058043 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:50.074227 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70026.9us
I20260709 13:08:50.062427 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:50.054270 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 78481.4us
I20260709 13:08:50.081507 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.094275 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:49.979321 26786 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.048276 26795 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:50.108948 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.109109 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47759.4us
I20260709 13:08:50.062489 26829 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.110157 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:50.074905 26667 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11.
I20260709 13:08:50.062701 26686 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:50.077337 26591 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:50.130445 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 159623us
I20260709 13:08:50.079253 26623 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.075531 26789 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:50.109486 26750 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 13:08:50.095902 26208 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.140245 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:50.130429 23255 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:50.015384 26660 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.062119 26659 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:08:50.133476 26820 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:50.055173 26666 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:08:50.133066 26646 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.138623 26758 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:50.139793 26828 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:50.171301 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:50.165006 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83589us
I20260709 13:08:50.055924 26498 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.150015 26591 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:50.130901 26795 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.161998 26622 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.114622 26767 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.164790 26686 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:50.171408 26623 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.159171 26208 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.204893 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.157613 26750 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.101161 26787 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.170249 26791 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:50.173098 26820 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:50.181529 26678 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.159307 26831 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:08:50.179692 26758 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:50.210914 26572 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.749s	user 0.006s	sys 0.006s
I20260709 13:08:50.184177 26667 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:50.193109 26659 consensus_queue.cc:1243] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:50.221063 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.243536 22647 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.184084 26317 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.224629 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.225582 22652 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:50.172957 26805 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.225260 26591 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.228351 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.166256 26844 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:08:50.181139 26763 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:50.202111 26828 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.202322 26686 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.254143 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:50.210906 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 115821us
I20260709 13:08:50.214830 26666 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.261343 26666 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.261814 26666 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.261436 26820 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.265070 26758 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.242401 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.227161 26622 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:50.246688 22652 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:50.254143 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.268651 22648 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
W20260709 13:08:50.271106 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 210285us
I20260709 13:08:50.241928 26663 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.215924 26623 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.282444 22652 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.239384 26667 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:50.283156 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.250411 26787 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.306084 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.313735 22652 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:50.261483 26839 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:08:50.246309 26849 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.303910 26670 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.003s
I20260709 13:08:50.281805 26622 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.353394 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.354080 22648 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:50.315667 26667 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:50.361449 22647 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:08:50.363051 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.284854 26572 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:08:50.355446 26622 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:50.321767 26663 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.355681 26670 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.238102 26789 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.370601 26795 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.287384 26828 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.370811 26389 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.368645 22571 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:50.375770 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.279600 26763 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:50.378286 26686 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.379113 26208 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.379796 26828 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.379937 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.482729 22502 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:08:50.373255 26857 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:50.381115 26845 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:08:50.381929 26623 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:50.438678 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52382.9us
I20260709 13:08:50.444793 26854 raft_consensus.cc:993] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:50.445822 26666 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.357125 26855 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:50.448674 26695 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.892s	user 0.014s	sys 0.005s
W20260709 13:08:50.450173 26710 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.002s
W20260709 13:08:50.433936 26848 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:08:50.453780 26816 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.746s	user 0.000s	sys 0.004s
I20260709 13:08:50.459169 23256 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:50.460522 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.462023 26847 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.356674 26849 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:50.467850 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.469182 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.381790 26750 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.361462 26841 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.556113 26841 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.474838 22652 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:50.479005 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.484064 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:50.488440 26208 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:50.490341 26775 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.493304 26389 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.494904 26670 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.496163 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:50.494939 23264 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:50.386219 26448 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:50.497224 26853 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.135s	user 0.007s	sys 0.000s
I20260709 13:08:50.499186 26622 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:50.492774 26488 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.001s
I20260709 13:08:50.588456 26488 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.589151 22469 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:50.589967 26681 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.720s	user 0.004s	sys 0.007s
I20260709 13:08:50.590324 26670 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:50.563172 26208 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.590507 26681 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.592039 22574 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:50.592715 26208 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.593590 22575 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:50.594940 26448 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.521251 22650 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:50.501775 26751 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.975s	user 0.010s	sys 0.003s
I20260709 13:08:50.532383 22653 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:50.479611 26763 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:50.522707 26855 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.533486 26710 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.579504 26755 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:50.540073 26663 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.497740 26857 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.546166 22504 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:50.596477 26751 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.287647 26719 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:08:50.558540 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74563.8us
W20260709 13:08:50.616359 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.569657 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.569728 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.617172 22648 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.590608 26488 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.573494 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.626124 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.579877 26695 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:50.575531 26688 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:08:50.583575 22579 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:49.700757 22651 rpcz_store.cc:276] 0709 13:08:47.663617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.225281 (+561664us) service_pool.cc:224] Handling call
0709 13:08:48.225644 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:49.242429 (+1016785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.242463 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:49.243081 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 13:08:49.384389 (+141308us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:49.398951 (+ 14562us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.688518 (+289567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.688611 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.688668 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:49.688689 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.688875 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1605752,"prepare.queue_time_us":20093,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1355681,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":33853,"thread_start_us":140913,"threads_started":1,"wal-append.queue_time_us":141225}
I20260709 13:08:50.595029 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.633118 22574 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:50.614367 26857 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.634423 22496 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:50.594825 26681 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.534421 26861 raft_consensus.cc:1081] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Signalling peer 691cccbd0258483ebe19e1581674cc94 to start an election
I20260709 13:08:50.610652 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.556432 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:50.614706 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 331658us
I20260709 13:08:50.572579 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.618350 22652 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:50.643191 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.604561 26622 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.557513 26847 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.612365 26755 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.630441 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.584321 26775 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:50.663897 26623 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.632346 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:50.507128 26667 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.667395 26806 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.678901 26806 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.680114 26667 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.634536 22574 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:50.664117 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:50.681326 22648 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:08:50.682229 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.628065 26719 consensus_queue.cc:1243] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:50.683043 26778 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:50.683344 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.677838 26623 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:50.684602 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.669319 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.685748 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.686079 22651 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:50.686439 26623 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.680953 26755 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:50.687021 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.687299 26775 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:50.688102 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.687853 26775 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.689215 22504 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 10. Ops: [8.5-8.5]
I20260709 13:08:50.690323 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.691304 26775 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.691630 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.686877 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.693807 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:50.695551 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.699961 26855 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.701047 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:50.701704 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.708209 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:50.709134 23261 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:50.683504 26778 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:50.712173 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.628258 26695 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:50.685262 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.724655 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.726799 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.715781 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:50.718436 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.728076 22498 raft_consensus.cc:2368] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11.
I20260709 13:08:50.719173 26442 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:50.720341 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.721529 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:50.729503 23259 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.734954 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.737213 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.738201 22503 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:50.739387 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.744331 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.745785 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.750865 26442 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.751622 23255 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:50.753260 26442 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.753574 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:50.755239 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.756067 22499 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:50.756443 22503 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:50.759279 22503 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:50.756805 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.757009 22502 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:50.763592 22503 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:50.717708 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.771626 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.774887 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.778072 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.778065 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.779911 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:50.780416 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:50.781090 22579 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:50.778838 22577 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
W20260709 13:08:50.755136 26761 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.966s	user 0.008s	sys 0.005s
I20260709 13:08:50.787289 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:50.713578 26778 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:50.795503 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.798022 22652 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:50.772960 26866 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:50.768591 26747 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:50.755627 26622 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:50.768922 26855 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:50.773957 26764 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:50.823863 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.824023 22504 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:50.776798 26306 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:50.840842 26764 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:50.841478 26764 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:50.842374 26764 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.842705 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.843564 22647 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:50.845767 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.846588 22650 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:08:50.847064 26841 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.847556 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.847450 26778 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.848325 22650 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:50.813148 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:50.826380 26863 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:50.850337 26778 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.813724 26866 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:50.907867 26866 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:50.908213 26749 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:08:50.836268 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.835681 26855 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.852362 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.784171 26755 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.801067 26854 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:08:50.836316 26747 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:50.923610 26747 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.835239 26622 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:50.925381 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.832247 26306 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:50.850121 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.926923 22648 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 5: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:50.862402 22654 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:50.857370 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.890916 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:50.929451 22502 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:50.870237 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:50.829635 26787 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:08:50.946138 23259 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:50.947975 26786 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.948151 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:50.913831 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:50.913980 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.918991 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:50.922516 26755 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.807982 26761 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:50.930662 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:50.927453 22654 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:50.931980 26849 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:50.933236 26855 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.934031 26710 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:50.935153 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:50.836695 26695 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:50.935333 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 65204.5us
I20260709 13:08:50.965132 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:50.936003 26591 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:50.936549 26751 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.937299 26638 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:50.970907 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:50.940004 26834 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.888s	user 0.001s	sys 0.000s
I20260709 13:08:50.941191 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.950968 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:50.936581 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.943506 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:50.912303 23255 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:50.944960 26622 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:50.957370 22498 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:50.960744 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:50.968242 26820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.065s	sys 0.147s
I20260709 13:08:50.963981 23263 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:08:50.928833 26306 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:50.969512 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.937290 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.970433 26855 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.975205 23258 raft_consensus.cc:2368] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8.
I20260709 13:08:50.905339 26863 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:50.957599 26688 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:50.981330 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:50.981931 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.083724 22647 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:50.972723 26638 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:50.979375 26695 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:51.084606 22499 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:51.085175 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115781us
I20260709 13:08:51.086490 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:51.087232 22647 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:51.093035 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:50.948570 26847 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:51.124718 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 130462us
W20260709 13:08:51.021322 26571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.013s
I20260709 13:08:50.991103 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:50.992461 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:51.132004 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 139670us
I20260709 13:08:50.970139 26591 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:51.001427 22469 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:08:51.137760 22469 leader_election.cc:403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:51.001452 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:51.004034 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:50.963917 22654 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.082809 26863 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.943416 22650 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
W20260709 13:08:51.045656 26820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.066s	sys 0.148s
W20260709 13:08:50.987247 22645 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.008s
I20260709 13:08:51.046953 26659 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:51.087652 26829 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:51.087031 26833 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:51.166806 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:51.207849 22648 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:08:51.134830 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 354971us
I20260709 13:08:51.176323 22619 leader_election.cc:400] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11.
W20260709 13:08:51.186583 22645 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.011s	sys 0.008s
W20260709 13:08:51.131352 26571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.006s	sys 0.013s
W20260709 13:08:51.199766 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 198563us
I20260709 13:08:51.199983 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:51.201882 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 197979us
I20260709 13:08:51.130323 26751 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:51.125765 26688 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:51.140702 26591 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.243902 22572 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:51.207070 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:51.138265 26378 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:51.199209 26855 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:51.202198 26719 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.218777 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.166188 26847 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.193884 26622 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:08:51.085359 26667 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:08:51.279337 26667 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:51.279845 26667 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:51.280841 26667 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.282253 26667 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.214063 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.289461 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:08:51.289994 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75998us
I20260709 13:08:51.291126 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.291262 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:51.194670 26843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.008s	sys 0.024s
W20260709 13:08:51.293550 26843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.008s	sys 0.024s
W20260709 13:08:51.294445 26856 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.851s	user 0.006s	sys 0.003s
I20260709 13:08:51.294831 26761 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:51.296208 26854 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:51.223189 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:08:51.297842 26755 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:51.298113 26666 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:51.298446 26755 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:51.298691 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.299450 26755 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.299909 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:51.293596 26870 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:08:51.301162 26869 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:08:51.301574 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 78459.5us
I20260709 13:08:51.297170 26854 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:51.168957 26317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.007s	sys 0.015s
W20260709 13:08:51.302846 26317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.007s	sys 0.016s
W20260709 13:08:51.303164 26872 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:08:51.244207 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.202732 26704 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.304733 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.304945 26704 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.307231 26704 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:51.308576 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:51.185797 26786 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.223475 26741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.009s
W20260709 13:08:51.310539 26741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.011s	sys 0.009s
I20260709 13:08:51.212381 26835 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.311702 26660 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:51.312134 26660 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.312460 26660 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:51.261613 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:51.313433 22576 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:51.217907 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.315394 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.218336 26864 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:51.265704 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:51.214849 22652 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:08:51.194396 26228 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:08:51.255141 26378 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:51.244477 26638 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.237614 26710 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.297628 26833 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:51.302003 26805 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:51.302881 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:51.360047 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57239.7us
I20260709 13:08:51.310374 26786 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:51.221043 26712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.061s	sys 0.088s
I20260709 13:08:51.316795 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2293) took 1103 ms. Trace:
I20260709 13:08:51.321206 22499 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:51.321609 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:51.241696 22504 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:51.325449 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:51.484678 22572 raft_consensus.cc:2410] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:51.253579 22647 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:51.325901 22580 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:51.485250 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2547) took 1026 ms. Trace:
I20260709 13:08:51.325523 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.485587 22647 rpcz_store.cc:276] 0709 13:08:50.459028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.084803 (+625775us) service_pool.cc:224] Handling call
0709 13:08:51.485196 (+400393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.486068 22576 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:51.331730 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.335307 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.487418 22497 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:51.341033 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:51.432775 26857 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.000s
I20260709 13:08:51.489372 26857 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.433581 26763 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:51.490686 26763 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:51.494616 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 173117us
I20260709 13:08:51.495720 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:51.420154 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:51.365154 26710 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.428113 26833 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:51.426955 26719 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.406265 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:51.514719 22651 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:51.316613 26847 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.330158 26378 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.415059 26638 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.367372 22652 rpcz_store.cc:276] 0709 13:08:50.213112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.138943 (+925831us) service_pool.cc:224] Handling call
0709 13:08:51.316711 (+177768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.523134 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:51.524080 22652 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:08:51.401459 22391 thread.cc:641] dir /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.076s	sys 0.155s
I20260709 13:08:51.433482 22502 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:51.420079 26854 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:51.542120 26854 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:51.385526 26767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.019s	sys 0.040s
W20260709 13:08:51.543058 26767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.023s	sys 0.044s
I20260709 13:08:51.359658 26805 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:51.544369 26805 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.384843 26786 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:51.327364 26751 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:51.545949 26751 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.547243 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.548429 26751 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:51.378299 26787 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:51.330291 26619 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:51.330467 26659 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.396307 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:51.266568 26855 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.555823 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:51.459774 26498 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:51.402725 26688 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:51.590584 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 194360us
I20260709 13:08:51.593189 26681 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:51.593677 26681 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.594012 26681 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:51.378746 26712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.061s	sys 0.088s
I20260709 13:08:51.383345 22575 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:51.402809 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:51.597379 22500 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:51.509335 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:51.601202 22647 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.509104 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.604811 22580 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:51.512660 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:51.609577 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 97045.4us
I20260709 13:08:51.611863 26623 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.516544 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.612232 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.525626 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:51.635596 22652 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:51.493613 26866 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.585s	user 0.001s	sys 0.011s
I20260709 13:08:51.639014 26866 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.641883 26866 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:51.526904 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:51.642930 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 116141us
I20260709 13:08:51.533955 26488 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.645239 26488 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.647796 26488 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:51.534938 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:51.520222 26749 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.649380 22572 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 4.
I20260709 13:08:51.649482 26749 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.650858 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:51.652273 22572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:08:51.537225 26662 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:51.653759 26662 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:51.654963 26662 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.656265 26662 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:51.538064 26875 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:08:51.565280 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.551608 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.657481 22497 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:51.657929 22578 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:51.658587 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.659024 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.659266 22497 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:51.660266 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:51.550011 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:51.661118 26866 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:51.661592 26866 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.661669 22649 raft_consensus.cc:2410] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:51.661991 26866 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.662252 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2297) took 1412 ms. Trace:
I20260709 13:08:51.662721 22649 rpcz_store.cc:276] 0709 13:08:50.250061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.549667 (+1299606us) service_pool.cc:224] Handling call
0709 13:08:51.662182 (+112515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.663786 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:51.664458 22649 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:51.553479 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2222) took 2105 ms. Trace:
I20260709 13:08:51.548754 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.665390 26623 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.665038 22571 rpcz_store.cc:276] 0709 13:08:49.448245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.449715 (+  1470us) service_pool.cc:224] Handling call
0709 13:08:51.553188 (+2103473us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54003f5054. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:51.553410 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070436096}
I20260709 13:08:51.666272 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.666940 22574 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:51.583473 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:51.669174 22497 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:51.459802 23262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.001s	sys 0.048s
I20260709 13:08:51.613436 26622 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:51.617055 22498 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:51.670344 23262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.002s	sys 0.048s
I20260709 13:08:51.671278 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.671610 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.671787 26828 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:51.672053 22497 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:08:51.480288 26789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.016s	sys 0.044s
W20260709 13:08:51.672756 26789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.017s	sys 0.044s
I20260709 13:08:51.673566 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.675158 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:51.618602 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:51.676433 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57915.2us
I20260709 13:08:51.677804 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:51.613739 26228 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:51.668753 22574 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:51.679355 26741 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:51.660558 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:51.680239 26741 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.686241 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:51.668607 26442 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.670354 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.672179 22498 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 4.
W20260709 13:08:51.755672 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69538.2us
I20260709 13:08:51.614244 26751 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:51.758527 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88246.8us
I20260709 13:08:51.757292 22498 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:51.652500 26749 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:51.688050 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:51.514704 26864 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.516414 26833 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:51.552699 26863 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.522058 26719 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.555414 26857 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:51.582150 26619 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:51.520430 26844 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.558038 26854 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:51.556164 26763 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:51.806648 26854 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:51.559980 22391 thread.cc:608] dir /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.080s	sys 0.155s
I20260709 13:08:51.652777 22572 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.813218 22572 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:51.741334 22653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2526) took 1536 ms (client timeout 1792 ms). Trace:
W20260709 13:08:51.816262 22653 rpcz_store.cc:269] 0709 13:08:50.204469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.204600 (+   131us) service_pool.cc:224] Handling call
0709 13:08:51.741069 (+1536469us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400394254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:51.741247 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245507456}
I20260709 13:08:51.817821 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:51.818545 22653 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:51.669216 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57082.4us
I20260709 13:08:51.821033 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.822438 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:51.823395 26864 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:51.823762 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.824265 26864 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:51.757071 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.825094 26864 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:51.825003 26667 consensus_queue.cc:1175] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:08:51.825990 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 68972.1us
I20260709 13:08:51.827312 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.630441 22647 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
W20260709 13:08:51.829510 26695 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.000s
I20260709 13:08:51.830440 22647 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:51.830962 22646 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:51.831076 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2533) took 1624 ms. Trace:
W20260709 13:08:51.831715 26835 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:08:51.831939 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2536) took 1624 ms. Trace:
I20260709 13:08:51.832216 26835 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:08:51.582038 26787 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:51.854596 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:51.765607 22498 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:51.735647 26767 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:51.743974 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:51.761704 26789 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:51.805366 26619 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.724161 26847 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:51.856542 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.855365 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:51.831662 22647 rpcz_store.cc:276] 0709 13:08:50.206466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.829755 (+1623289us) service_pool.cc:224] Handling call
0709 13:08:51.830073 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.830835 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.831022 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.832538 22646 rpcz_store.cc:276] 0709 13:08:50.207313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.830386 (+1623073us) service_pool.cc:224] Handling call
0709 13:08:51.830729 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.831654 (+   925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.831874 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.734831 26855 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:51.859171 22652 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:51.860221 22500 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:08:51.859171 22580 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:51.873098 22498 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:51.911824 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:51.730844 26498 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:51.916733 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.921906 22500 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:08:51.869091 26787 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.938766 22505 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:51.918773 22652 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:51.763624 26751 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:51.916450 22653 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:51.871578 26695 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:51.869480 26806 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:51.985437 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:51.957749 26766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.042s	sys 0.059s
I20260709 13:08:51.920984 26749 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.921203 26754 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:51.930744 26789 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:51.925714 22646 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:52.031884 22646 pending_rounds.cc:85] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 5
I20260709 13:08:52.032193 22646 pending_rounds.cc:107] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:51.933437 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 706) took 1242 ms. Trace:
W20260709 13:08:51.949527 26571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.025s	sys 0.070s
W20260709 13:08:51.959870 26660 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.002s
W20260709 13:08:51.986624 22645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.023s	sys 0.029s
W20260709 13:08:51.908463 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53212.6us
I20260709 13:08:51.989053 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2287) took 1777 ms. Trace:
I20260709 13:08:52.070319 22652 rpcz_store.cc:276] 0709 13:08:50.211867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.912738 (+1700871us) service_pool.cc:224] Handling call
0709 13:08:51.913084 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.988660 (+ 75576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.988993 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:52.029623 26591 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.001s
I20260709 13:08:52.072273 22652 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:52.026449 22653 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:52.073262 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2300) took 1811 ms. Trace:
I20260709 13:08:52.073580 22653 rpcz_store.cc:276] 0709 13:08:50.261667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.994180 (+1732513us) service_pool.cc:224] Handling call
0709 13:08:51.994687 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.073000 (+ 78313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.073209 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.074692 22653 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:52.075192 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2541) took 1795 ms. Trace:
I20260709 13:08:52.075455 22653 rpcz_store.cc:276] 0709 13:08:50.279899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.074262 (+1794363us) service_pool.cc:224] Handling call
0709 13:08:52.074536 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.074991 (+   455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.075147 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:52.019110 22651 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.000s
I20260709 13:08:52.076633 22651 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
W20260709 13:08:51.991092 26766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.042s	sys 0.059s
I20260709 13:08:52.014302 26695 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:08:52.030424 22468 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.008s	sys 0.012s
I20260709 13:08:51.924327 26833 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:52.020850 22572 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:52.084956 22468 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.008s	sys 0.012s
W20260709 13:08:52.010147 22496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 770) took 2388 ms (client timeout 1677 ms). Trace:
W20260709 13:08:52.085328 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 687591us
W20260709 13:08:52.085662 22496 rpcz_store.cc:269] 0709 13:08:49.608170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.609971 (+  1801us) service_pool.cc:224] Handling call
0709 13:08:51.995980 (+2386009us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400108454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:51.996146 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319139200}
I20260709 13:08:52.005926 26863 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.032449 22646 raft_consensus.cc:2889] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:52.032755 22654 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.989737 26825 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:52.063750 22649 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
W20260709 13:08:52.032766 22469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.026s	sys 0.076s
W20260709 13:08:52.091277 22469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.027s	sys 0.076s
W20260709 13:08:52.070072 22645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.023s	sys 0.030s
I20260709 13:08:52.078944 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:52.092554 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:52.092950 22469 leader_election.cc:400] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8.
I20260709 13:08:52.093494 22469 leader_election.cc:403] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:52.080272 22653 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:52.053498 26832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.010s	sys 0.019s
W20260709 13:08:52.065544 23229 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.011s	sys 0.012s
W20260709 13:08:52.095098 23229 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.011s	sys 0.012s
W20260709 13:08:52.095618 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 714517us
W20260709 13:08:52.052634 26755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.011s
I20260709 13:08:52.099622 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2537) took 1892 ms. Trace:
I20260709 13:08:52.100062 22646 rpcz_store.cc:276] 0709 13:08:50.207612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.907172 (+1699560us) service_pool.cc:224] Handling call
0709 13:08:51.907486 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.099328 (+191842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.099544 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.101806 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2549) took 1634 ms. Trace:
I20260709 13:08:52.102341 22653 rpcz_store.cc:276] 0709 13:08:50.459614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.079794 (+1620180us) service_pool.cc:224] Handling call
0709 13:08:52.080099 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.094202 (+ 14103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.094452 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:52.065794 26571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.026s	sys 0.071s
I20260709 13:08:52.100838 22579 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:52.100132 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2305) took 1818 ms. Trace:
I20260709 13:08:52.104743 22652 rpcz_store.cc:276] 0709 13:08:50.263039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.071386 (+1808347us) service_pool.cc:224] Handling call
0709 13:08:52.071818 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.072837 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.081152 (+  8315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.105994 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:52.106698 26681 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:08:52.107353 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.107141 26681 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:52.110730 26681 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.054672 23257 rpcz_store.cc:276] 0709 13:08:50.690814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.690982 (+   168us) service_pool.cc:224] Handling call
0709 13:08:51.743823 (+1052841us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:08:51.933345 (+189522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38148352}
I20260709 13:08:52.116983 26712 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:52.117738 26712 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:52.118744 26881 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:52.120173 26749 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:52.090304 26623 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.121331 26623 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.122364 22651 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:52.122833 26741 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.065150 26838 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.123778 26838 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.125476 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:52.126178 26838 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.126324 22572 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.118667 26719 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:52.128801 26695 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:52.130491 26378 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.003s
I20260709 13:08:52.130965 26378 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.132340 22573 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:52.034082 26754 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:52.133803 26751 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.134410 26719 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.134011 26754 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.134951 26719 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.135622 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:52.136392 22648 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:52.067732 26789 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:52.137132 26789 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.118674 26712 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.137923 26789 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.140337 26498 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:52.138583 26877 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:08:52.133862 26749 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:52.149289 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 637) took 1441 ms. Trace:
I20260709 13:08:52.102553 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.163866 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:52.164721 22498 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:52.163178 23262 rpcz_store.cc:276] 0709 13:08:50.707686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.709123 (+  1437us) service_pool.cc:224] Handling call
0709 13:08:50.709408 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.709826 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.709861 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:50.710332 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.671450 (+961118us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:51.671506 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.671607 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.148946 (+477339us) raft_consensus.cc:1685] finished
0709 13:08:52.148975 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.149203 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3765,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":878020,"threads_started":1,"wal-append.queue_time_us":1174457}
W20260709 13:08:52.166145 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 73388.2us
I20260709 13:08:52.169950 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:52.144065 26306 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.046s	user 0.005s	sys 0.010s
I20260709 13:08:52.180418 26306 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.181957 23261 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:52.184100 22503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.012s	sys 0.023s
I20260709 13:08:52.162701 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.189244 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.190515 22653 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:08:52.081367 26764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.009s	sys 0.018s
W20260709 13:08:52.101542 26832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.010s	sys 0.019s
I20260709 13:08:52.186331 22646 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
W20260709 13:08:52.101677 26755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.008s	sys 0.012s
I20260709 13:08:52.191814 26855 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:52.142292 26638 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 13:08:52.209141 22648 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:08:52.193363 22503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.012s	sys 0.023s
I20260709 13:08:52.194918 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.197155 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.228318 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.229375 22646 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:52.198666 26835 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.229781 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:52.231457 22653 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.101034 26740 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:52.232565 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.233472 22576 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:52.230321 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.194186 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:52.234120 22646 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:08:52.234217 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50328.2us
I20260709 13:08:52.234974 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:52.235131 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:52.235743 22648 raft_consensus.cc:2376] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13. Re-sending same reply.
I20260709 13:08:52.198546 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:52.189153 26751 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:52.228430 26747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.007s	sys 0.024s
I20260709 13:08:52.140779 26789 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:52.191265 26764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.009s	sys 0.019s
I20260709 13:08:52.249655 22580 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 15. Ops: []
W20260709 13:08:52.252307 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 58167.3us
I20260709 13:08:52.084224 26591 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:52.259461 26442 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.233196 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:52.262176 26619 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:52.266068 26864 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:52.082072 26660 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.276428 26488 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:52.267737 22571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.012s	sys 0.031s
I20260709 13:08:52.267974 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:52.268052 22654 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:52.326303 22571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.032s
I20260709 13:08:52.326746 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2525) took 2122 ms. Trace:
I20260709 13:08:52.327121 22654 rpcz_store.cc:276] 0709 13:08:50.204137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.208986 (+  4849us) service_pool.cc:224] Handling call
0709 13:08:50.209345 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.862285 (+652940us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b5400367520. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26272dc0 00007fec262fd1c0 00007fec262fe231 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c
0709 13:08:52.000131 (+1137846us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400367520. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26270a1d 00007fec262571a4 00007fec262d9447 00007fec262f1fe7 00007fec262f37de 00007fec262fdb49 00007fec262fe416 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419
0709 13:08:52.326472 (+326341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.326689 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388822272}
I20260709 13:08:52.248478 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.165827 26749 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:52.227691 26884 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.282425 22653 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:08:52.291934 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:52.341430 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49574.2us
I20260709 13:08:52.199242 26843 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:52.192966 26849 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:08:52.268364 26835 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.234009 26855 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:52.324123 22544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.019s	sys 0.030s
W20260709 13:08:52.361693 22544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.019s	sys 0.030s
I20260709 13:08:52.321620 26378 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.267130 22652 raft_consensus.cc:2410] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:52.236197 26832 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:52.274091 26747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.009s	sys 0.030s
I20260709 13:08:52.329412 22648 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:52.328685 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.332690 26660 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:52.293550 26758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.832s	user 0.017s	sys 0.023s
I20260709 13:08:52.324344 22497 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:52.339784 26836 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:52.321669 26591 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.323716 23257 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:52.334782 26488 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:52.389952 22654 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
W20260709 13:08:52.389370 22499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.025s	sys 0.016s
W20260709 13:08:52.414891 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.025s	sys 0.016s
W20260709 13:08:52.391186 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 534688us
I20260709 13:08:52.401579 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.415148 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.346745 26638 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.361054 23256 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:52.362191 26885 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:52.374353 26806 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.416112 22648 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:52.416119 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:52.416525 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:52.449365 22654 raft_consensus.cc:2410] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:52.417488 26488 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.419842 26638 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.420939 26306 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.421123 26749 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:52.422065 26866 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.000s
I20260709 13:08:52.423113 26828 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:52.404558 26758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.939s	user 0.017s	sys 0.023s
I20260709 13:08:52.357839 26884 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:52.382902 26719 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.383128 26843 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.440827 26855 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.441454 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3226) took 1235 ms. Trace:
I20260709 13:08:52.478446 22575 rpcz_store.cc:276] 0709 13:08:51.205957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.206714 (+   757us) service_pool.cc:224] Handling call
0709 13:08:52.441272 (+1234558us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003f4b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:52.441393 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319097728}
W20260709 13:08:52.440634 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.363031 26228 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:08:52.403026 26767 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:52.402554 26832 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.448925 26885 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.470377 22501 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:52.466609 26619 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:52.455909 26901 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:52.465904 26828 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:52.461866 26787 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.006s
I20260709 13:08:52.523947 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 787) took 1131 ms. Trace:
I20260709 13:08:52.453670 26806 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.526692 22646 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:08:52.517760 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.519057 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.528563 22646 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:52.529696 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2555) took 2051 ms. Trace:
I20260709 13:08:52.530267 22646 rpcz_store.cc:276] 0709 13:08:50.478272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.527766 (+2049494us) service_pool.cc:224] Handling call
0709 13:08:52.528284 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.529332 (+  1048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.529638 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.532886 22646 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:52.524470 22505 rpcz_store.cc:276] 0709 13:08:51.392619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.392800 (+   181us) service_pool.cc:224] Handling call
0709 13:08:52.519903 (+1127103us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54001a8454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:52.523881 (+  3978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863489920}
I20260709 13:08:52.474545 26758 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.536929 23258 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:52.494794 26622 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:52.493816 26749 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:52.535284 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2557) took 2032 ms. Trace:
I20260709 13:08:52.499639 26764 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.546869 22646 rpcz_store.cc:276] 0709 13:08:50.503257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.532052 (+2028795us) service_pool.cc:224] Handling call
0709 13:08:52.532442 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.534954 (+  2512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.535216 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.554842 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3230) took 1337 ms. Trace:
I20260709 13:08:52.551609 26767 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.553829 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:52.467687 26866 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.555274 22573 rpcz_store.cc:276] 0709 13:08:51.217606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.217719 (+   113us) service_pool.cc:224] Handling call
0709 13:08:51.218011 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.133109 (+915098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.554615 (+421506us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54003caad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:52.554786 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102343936}
I20260709 13:08:52.555333 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:52.556545 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 818) took 1191 ms. Trace:
I20260709 13:08:52.558219 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:52.558420 22496 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:52.560485 22503 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:52.500365 26881 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:52.559019 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:52.564172 26896 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:52.564263 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:52.561376 22646 rpcz_store.cc:276] 0709 13:08:51.365403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.555666 (+1190263us) service_pool.cc:224] Handling call
0709 13:08:52.556029 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.556223 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.556254 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.556298 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:52.556346 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.556402 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.556492 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.502561 26885 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.565619 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:52.568022 23258 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 5: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:52.525135 26825 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:52.503901 26740 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:08:52.572064 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 819) took 1206 ms. Trace:
W20260709 13:08:52.573884 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.594563 22646 rpcz_store.cc:276] 0709 13:08:51.365655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.568673 (+1203018us) service_pool.cc:224] Handling call
0709 13:08:52.569969 (+  1296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.571597 (+  1628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.571642 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.571700 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:52.571770 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.571850 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.571992 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1045,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":127}
I20260709 13:08:52.577342 26619 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.549290 26601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46820 (request call id 517) took 8705 ms. Trace:
I20260709 13:08:52.601737 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:52.603708 23262 raft_consensus.cc:2368] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9.
I20260709 13:08:52.536489 26787 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:52.606202 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56756.1us
I20260709 13:08:52.605163 22646 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:52.550585 26758 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.590816 26825 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.545917 26622 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:52.549094 26905 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:52.595378 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:52.578303 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2532) took 2372 ms. Trace:
I20260709 13:08:52.609022 26378 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:52.608106 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:52.612010 22646 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:52.616582 22650 rpcz_store.cc:276] 0709 13:08:50.206174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.552345 (+1346171us) service_pool.cc:224] Handling call
0709 13:08:51.580792 (+ 28447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.581322 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.581364 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.693345 (+111981us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.247958 (+554613us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.247999 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.248071 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.578022 (+329951us) raft_consensus.cc:1685] finished
0709 13:08:52.578041 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.578225 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":137991,"thread_start_us":480913,"threads_started":1,"wal-append.queue_time_us":744102}
I20260709 13:08:52.562714 26764 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.632144 23259 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:52.588639 26885 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:52.611199 26751 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8.
I20260709 13:08:52.593703 26906 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:08:52.648459 26873 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.659s	user 0.000s	sys 0.002s
I20260709 13:08:52.649109 26638 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.604115 26838 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:52.650389 26758 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.613384 26835 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.653169 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:52.654855 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2599) took 1122 ms. Trace:
I20260709 13:08:52.655946 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3233) took 1418 ms. Trace:
I20260709 13:08:52.655388 22504 rpcz_store.cc:276] 0709 13:08:51.531954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.532069 (+   115us) service_pool.cc:224] Handling call
0709 13:08:51.701415 (+169346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.745642 (+ 44227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.745685 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.745739 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:51.745789 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.654550 (+908761us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54001b9254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:52.654611 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.654777 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101149056}
I20260709 13:08:52.656616 22579 rpcz_store.cc:276] 0709 13:08:51.237842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.238154 (+   312us) service_pool.cc:224] Handling call
0709 13:08:51.238457 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.108789 (+870332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.655522 (+546733us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54003ca0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:52.655888 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982842624}
I20260709 13:08:52.601673 26619 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:52.668576 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.639847 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:52.638505 22618 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:52.641511 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:52.639454 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 297116us
I20260709 13:08:52.674155 22500 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:52.672931 22505 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:52.683259 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:52.672358 26754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.025s
I20260709 13:08:52.689983 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:52.634634 26442 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:52.693063 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2238) took 1343 ms. Trace:
I20260709 13:08:52.698005 22571 rpcz_store.cc:276] 0709 13:08:51.350047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.667927 (+317880us) service_pool.cc:224] Handling call
0709 13:08:51.668205 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.668418 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:52.335189 (+666771us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.692670 (+357481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.692727 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:52.692779 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.692847 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.693004 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16085,"prepare.queue_time_us":569269,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2500,"thread_start_us":998845,"threads_started":2}
W20260709 13:08:52.700344 22468 leader_election.cc:336] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.614s (SENT)
I20260709 13:08:52.701282 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:52.631922 26488 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.639062 26903 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:52.732069 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:52.735509 22504 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:52.737880 22468 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.637s (SENT)
I20260709 13:08:52.738555 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:52.740041 22468 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.703s (SENT)
W20260709 13:08:52.692559 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52821.1us
I20260709 13:08:52.706399 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:52.707242 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2597) took 1176 ms. Trace:
W20260709 13:08:52.750382 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 60490.6us
I20260709 13:08:52.639176 26228 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:08:52.746377 22499 rpcz_store.cc:276] 0709 13:08:51.531223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.531429 (+   206us) service_pool.cc:224] Handling call
0709 13:08:51.531866 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:51.532357 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.532435 (+    78us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:51.566955 (+ 34520us) log.cc:844] Serialized 52 byte log entry
0709 13:08:52.415376 (+848421us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.695284 (+279908us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.706651 (+ 11367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.706738 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.706800 (+    62us) raft_consensus.cc:1685] finished
0709 13:08:52.706810 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.707104 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36884,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":13931,"thread_start_us":1092609,"threads_started":2,"wal-append.queue_time_us":952660}
I20260709 13:08:52.638960 26901 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:08:52.643651 26881 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.641386 26741 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:08:52.728914 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:52.638811 26789 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:08:52.697295 26317 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:52.746229 23258 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:52.791131 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.845774 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.804054 22579 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:52.810372 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.811779 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.812676 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:52.810231 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.694522 26849 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:52.696213 26754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.011s	sys 0.025s
I20260709 13:08:52.697687 26442 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:52.689186 26898 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:52.822659 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.700491 26906 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.742137 26903 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:52.845173 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116429us
I20260709 13:08:52.840425 23255 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:52.695369 26751 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
W20260709 13:08:52.844704 26897 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:08:52.863068 26488 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.598824 26601 rpcz_store.cc:276] 0709 13:08:43.832628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.373589 (+540961us) service_pool.cc:224] Handling call
0709 13:08:44.691893 (+318304us) ts_tablet_manager.cc:934] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
0709 13:08:49.410172 (+4718279us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:50.328104 (+917932us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:50.360450 (+ 32346us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:50.855989 (+495539us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:50.856355 (+   366us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:52.502322 (+1645967us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:52.534217 (+ 31895us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":65038,"tablet-copy.queue_time_us":315232,"thread_start_us":323374,"threads_started":2}
I20260709 13:08:52.866632 26619 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:52.874244 26908 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 13:08:52.882186 22578 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:52.903362 26906 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:52.884634 26666 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:52.887260 26885 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.890887 26832 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.892374 26787 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.893864 26909 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:52.745071 26914 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:52.841326 26905 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:08:52.897852 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 702952us
W20260709 13:08:52.902680 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.026s	sys 0.068s
W20260709 13:08:52.970842 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.026s	sys 0.069s
I20260709 13:08:52.971660 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:52.690393 26835 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.153s
I20260709 13:08:52.810662 26920 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:52.913616 22504 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:52.817323 26884 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.817680 26843 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.919399 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2550) took 2459 ms. Trace:
I20260709 13:08:52.920914 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.981369 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:52.742508 26855 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.899399 26806 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:52.908667 26903 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:52.936558 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:52.985731 22578 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:52.911142 26866 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:52.916178 26758 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.949900 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2553) took 2489 ms. Trace:
I20260709 13:08:52.988269 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2540) took 2742 ms. Trace:
I20260709 13:08:52.952325 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:52.989255 22498 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:52.954607 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 705) took 2275 ms. Trace:
I20260709 13:08:52.988746 22647 rpcz_store.cc:276] 0709 13:08:50.245848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.914654 (+1668806us) service_pool.cc:224] Handling call
0709 13:08:51.925251 (+ 10597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.989579 (+ 64328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.989610 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.998822 (+  9212us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.377542 (+378720us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:52.377608 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.377723 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.988060 (+610337us) raft_consensus.cc:1685] finished
0709 13:08:52.988082 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.988214 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19938,"raft.queue_time_us":20302,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9866,"thread_start_us":308197,"threads_started":1,"wal-append.queue_time_us":529443}
I20260709 13:08:52.990164 23264 rpcz_store.cc:276] 0709 13:08:50.680017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.680295 (+   278us) service_pool.cc:224] Handling call
0709 13:08:52.424490 (+1744195us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:52.424809 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.425327 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.425369 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.426050 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.706564 (+280514us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:52.706607 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.706954 (+   347us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.954278 (+247324us) raft_consensus.cc:1685] finished
0709 13:08:52.954298 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.954515 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1792,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"spinlock_wait_cycles":33939840,"thread_start_us":279978,"threads_started":1,"wal-append.queue_time_us":502308}
I20260709 13:08:52.956260 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2552) took 2495 ms. Trace:
I20260709 13:08:52.935678 26906 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.957783 26601 tablet_copy_client.cc:806] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.956377 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2606) took 1361 ms. Trace:
W20260709 13:08:52.959834 23257 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.001s
I20260709 13:08:52.999739 22497 rpcz_store.cc:276] 0709 13:08:51.595135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.688186 (+ 93051us) service_pool.cc:224] Handling call
0709 13:08:51.688477 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.400113 (+711636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.956128 (+556015us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54001923d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:52.956299 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461944064}
I20260709 13:08:52.965708 26710 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:52.966514 22391 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.417s	user 0.058s	sys 0.076s
I20260709 13:08:52.971340 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:52.934569 26666 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:52.979353 26915 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:52.708284 26622 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:52.980800 22649 rpcz_store.cc:276] 0709 13:08:50.459896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.090976 (+1631080us) service_pool.cc:224] Handling call
0709 13:08:52.183631 (+ 92655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.183839 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:52.476077 (+292238us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.918961 (+442884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.919027 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:52.919095 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.919172 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.919327 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":468374,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":4358,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5874,"thread_start_us":734361,"threads_started":2,"wal-append.queue_time_us":489097}
I20260709 13:08:53.008530 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:52.986722 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:52.991484 22654 rpcz_store.cc:276] 0709 13:08:50.460431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.453662 (+1993231us) service_pool.cc:224] Handling call
0709 13:08:52.454076 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.454520 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.454560 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.455126 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.697593 (+242467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:52.697651 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.697736 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.956040 (+258304us) raft_consensus.cc:1685] finished
0709 13:08:52.956059 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.956198 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10210,"raft.queue_time_us":1407,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3148,"thread_start_us":242115,"threads_started":1,"wal-append.queue_time_us":499353}
I20260709 13:08:52.984918 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:53.009968 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:52.984359 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:52.988361 22648 rpcz_store.cc:276] 0709 13:08:50.460688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.454752 (+1994064us) service_pool.cc:224] Handling call
0709 13:08:52.455136 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.455531 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.455570 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.466316 (+ 10746us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.905855 (+439539us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.905904 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.905977 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.949590 (+ 43613us) raft_consensus.cc:1685] finished
0709 13:08:52.949624 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.949823 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15760,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":24059,"thread_start_us":382075,"threads_started":1,"wal-append.queue_time_us":453192}
I20260709 13:08:53.011884 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:52.967314 26909 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.987879 26885 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:52.994897 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.001634 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.002298 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.005856 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.013032 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.020335 22572 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:52.976594 26905 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.000536 26922 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:53.014819 22580 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:53.015448 26601 tablet_copy_client.cc:670] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:53.024787 22497 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:53.029958 22497 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:53.020577 22648 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.020948 22504 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:53.023196 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:52.999029 26764 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.024442 26843 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:53.025025 26806 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.025250 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.031373 22580 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:53.031821 22654 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.025888 26849 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.026307 26914 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:53.028395 26905 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.034857 22498 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:53.036300 22580 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:53.050630 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:53.051225 26904 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.548s	user 0.001s	sys 0.001s
I20260709 13:08:53.051968 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.053215 26907 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:53.053503 26914 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:53.053653 26907 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:53.053960 26914 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:52.982139 26442 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.054984 26442 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:53.054795 26914 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.056034 26914 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.024123 26909 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.057262 26806 consensus_queue.cc:1243] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:52.999322 26758 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.005056 23257 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:53.059715 26758 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.059890 26755 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.036144 26622 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.023864 26787 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:53.063484 26787 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:53.064774 26787 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.067271 26666 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.068435 26666 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.072570 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2546) took 2613 ms. Trace:
I20260709 13:08:53.073062 22651 rpcz_store.cc:276] 0709 13:08:50.458735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.077404 (+1618669us) service_pool.cc:224] Handling call
0709 13:08:52.090467 (+ 13063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.122760 (+ 32293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.071079 (+948319us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5400325854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.072347 (+  1268us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5400325850. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:53.072501 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102071424}
I20260709 13:08:53.037578 22497 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.074221 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.074402 22497 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.074787 22651 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.077651 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.036739 26849 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:53.081655 26849 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.081928 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2600) took 1549 ms. Trace:
I20260709 13:08:53.082481 22502 rpcz_store.cc:276] 0709 13:08:51.532270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.541493 (+  9223us) service_pool.cc:224] Handling call
0709 13:08:51.541817 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.560186 (+ 18369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.560217 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.560263 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:51.560300 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.081607 (+1521307us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b540033efd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.081674 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.081845 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41693440}
I20260709 13:08:53.022015 26885 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:53.090168 26907 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.099905 22654 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:53.105259 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.106065 22654 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:53.049156 22572 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:53.036377 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:53.105511 26828 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.006s
I20260709 13:08:53.109622 22572 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:53.094702 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 640) took 2184 ms. Trace:
I20260709 13:08:53.110530 23261 rpcz_store.cc:276] 0709 13:08:50.909961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.910172 (+   211us) service_pool.cc:224] Handling call
0709 13:08:50.910798 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.182480 (+1271682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.094434 (+911954us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54006d1854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.094632 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2922777856}
I20260709 13:08:53.096104 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.111469 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.111977 22571 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:53.098322 26861 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:53.112929 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:53.029359 26917 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:08:53.043694 22648 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:53.113580 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:53.121738 22497 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:53.122324 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:53.041131 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.114408 22579 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 10. Ops: []
W20260709 13:08:53.124222 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.099973 26907 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.106666 22580 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:53.113086 26861 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:08:53.129360 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.109717 26828 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.139194 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:53.139334 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.140751 22654 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:08:53.144598 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:53.144948 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.145422 22651 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:53.147812 22468 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:08:53.147997 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.149154 22651 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.149003 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:53.150799 26806 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:53.134516 26758 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.151469 26806 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:53.142593 26843 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:53.152661 26843 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.153118 26843 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.153549 26751 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.146124 26920 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:53.152714 26806 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.157017 26855 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.165789 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 699) took 1613 ms. Trace:
I20260709 13:08:53.166734 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2530) took 2961 ms. Trace:
I20260709 13:08:53.167147 22645 rpcz_store.cc:276] 0709 13:08:50.205619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.205725 (+   106us) service_pool.cc:224] Handling call
0709 13:08:50.206018 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.315160 (+109142us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:51.209968 (+894808us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.091955 (+881987us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.092012 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:52.092065 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.166514 (+1074449us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400236c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.166559 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.166680 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5633,"prepare.queue_time_us":41560,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":7460,"raft.queue_time_us":21451,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":250298112,"thread_start_us":1764947,"threads_started":2,"wal-append.queue_time_us":1033788}
I20260709 13:08:53.171779 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2325) took 1070 ms. Trace:
I20260709 13:08:53.126893 26901 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:53.173672 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 711) took 1005 ms. Trace:
I20260709 13:08:53.174072 26901 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.175310 22648 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:53.177126 26866 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.177464 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3199) took 2488 ms. Trace:
I20260709 13:08:53.177644 26866 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.177824 22501 rpcz_store.cc:276] 0709 13:08:50.688541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.693043 (+  4502us) service_pool.cc:224] Handling call
0709 13:08:50.693331 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.500104 (+1806773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.177199 (+677095us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54001aa254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.177372 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4086319488}
I20260709 13:08:53.179734 26866 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:53.181084 22469 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:53.166250 22574 rpcz_store.cc:276] 0709 13:08:51.552811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.679224 (+126413us) service_pool.cc:224] Handling call
0709 13:08:51.679559 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.946648 (+267089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.946694 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.946751 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:51.946807 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.165569 (+1218762us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54003bd154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.165613 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.165730 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613626240}
I20260709 13:08:53.172185 22646 rpcz_store.cc:276] 0709 13:08:52.101503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.633719 (+532216us) service_pool.cc:224] Handling call
0709 13:08:52.638412 (+  4693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.918522 (+280110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.918567 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.918628 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.918686 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.171555 (+252869us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54002bff54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.171600 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.171722 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3138,"raft.queue_time_us":3526,"spinlock_wait_cycles":644671616}
I20260709 13:08:53.183806 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.184568 22645 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:53.166479 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:53.176538 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.185635 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:53.132351 26498 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:53.186993 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.188160 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:53.188927 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:53.179798 26695 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.193928 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:53.186101 26832 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.201177 26695 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.185945 26751 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:53.202188 26751 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:53.189538 22651 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:53.188953 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:53.208060 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:53.208297 22648 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:53.209357 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.210457 23260 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:53.210716 23264 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:53.211288 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:53.212494 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:53.213536 23264 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:53.214179 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:53.208153 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:53.210453 26758 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.221304 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:53.222242 26835 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:53.222415 23257 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:53.222689 26835 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:53.223074 26835 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.223402 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:53.225387 26920 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:53.225932 26901 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.221729 26591 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:53.228168 26591 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:53.229163 26591 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.232906 22645 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:53.226084 26920 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:53.191366 26855 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:53.202533 26864 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:53.204110 26695 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.244385 26906 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.202574 26751 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.249241 26864 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:53.262215 26864 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.267544 26843 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.270125 22578 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.174082 23255 rpcz_store.cc:276] 0709 13:08:52.168552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.183215 (+ 14663us) service_pool.cc:224] Handling call
0709 13:08:52.191967 (+  8752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.918319 (+726352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.173432 (+255113us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54007021d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.173611 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274245376}
I20260709 13:08:53.275274 26828 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.256697 26488 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:53.280819 22654 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:53.206996 26498 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.284528 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2551) took 2824 ms. Trace:
I20260709 13:08:53.287463 22652 rpcz_store.cc:276] 0709 13:08:50.460184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.450297 (+1990113us) service_pool.cc:224] Handling call
0709 13:08:52.450661 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.451135 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.451179 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.460319 (+  9140us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.092717 (+632398us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b18002824c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:08:53.184705 (+ 91988us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.184741 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.184957 (+   216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.284177 (+ 99220us) raft_consensus.cc:1685] finished
0709 13:08:53.284204 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.284454 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8735,"raft.queue_time_us":3088,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2717,"spinlock_wait_cycles":3771264,"thread_start_us":91800,"threads_started":1,"wal-append.queue_time_us":782893}
I20260709 13:08:53.255169 26855 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:53.299125 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37474 (request call id 18) took 3091 ms. Trace:
I20260709 13:08:53.300621 22654 rpcz_store.cc:276] 0709 13:08:50.208131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.290268 (+3082137us) service_pool.cc:224] Handling call
0709 13:08:53.299049 (+  8781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.256822 26758 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:53.290942 26864 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:53.210850 26861 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.323408 26844 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.324100 26844 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.326683 26903 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.328428 22573 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:53.328493 26843 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.330205 22649 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:53.331233 26498 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.333748 26317 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:53.334286 26317 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:53.337074 26378 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.338450 26932 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:53.339458 26787 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:53.340279 26740 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:53.345191 26662 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:53.346016 26662 consensus_queue.cc:1243] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:53.346417 26906 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.346626 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.347358 22501 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:53.349006 22502 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:53.350713 26849 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.341161 26903 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.353500 26855 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.354131 26909 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.356427 26623 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.362375 22505 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:53.362299 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:53.366261 22498 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:53.326828 26844 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:53.363629 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.364070 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.340751 26740 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:53.373711 26740 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.338923 26932 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:53.375036 26740 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.374760 26885 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.340078 26787 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.377686 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:53.378310 22502 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:53.379607 22505 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:53.386250 22505 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:53.366150 26920 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:53.379009 26861 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.364691 26591 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:53.356772 26909 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.323776 22391 maintenance_manager.cc:643] P b97e77c8afed466a990720a609bf1968: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.992s	user 0.334s	sys 0.271s Metrics: {"bytes_written":30494,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":1380593,"dirs.run_cpu_time_us":413,"dirs.run_wall_time_us":6079,"drs_written":1,"lbm_read_time_us":728,"lbm_reads_lt_1ms":4,"lbm_write_time_us":89073,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":29400320,"thread_start_us":1728123,"threads_started":2,"update_count":18,"wal-append.queue_time_us":410677}
I20260709 13:08:53.365216 26884 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:53.364619 26758 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:53.392436 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:53.399223 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 146420us
I20260709 13:08:53.400484 22502 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:53.401233 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:53.402299 22502 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:53.402393 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:53.404008 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.412350 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.413100 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.414189 22502 raft_consensus.cc:2393] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:53.368484 26751 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.392973 26849 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:53.419873 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.420611 22574 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:53.369935 26835 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.418349 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.418615 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.421800 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.423921 22654 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:53.422991 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.400961 26885 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:53.424690 22580 raft_consensus.cc:2376] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10. Re-sending same reply.
I20260709 13:08:53.427731 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.430711 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:53.431591 22652 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:53.413434 26488 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:53.426553 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:53.504914 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.552201 22572 raft_consensus.cc:2410] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:08:53.554085 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:53.556380 22498 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:53.412560 26943 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:53.397173 26591 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.561992 22652 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:53.577481 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.400527 26884 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.405397 26758 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:53.636335 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.637719 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:53.626523 26938 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:08:53.644730 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:53.656404 22501 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 5: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:53.656598 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:53.657652 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:53.628044 26488 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.679015 22392 maintenance_manager.cc:419] P b97e77c8afed466a990720a609bf1968: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11114 bytes on disk
W20260709 13:08:53.684079 26940 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260709 13:08:53.684185 26695 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:53.640837 26741 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:08:53.675699 26660 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:53.689512 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:53.689827 26660 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:53.690186 22501 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:53.690745 26660 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.663141 26866 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:53.692544 26866 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.692931 26866 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:53.694170 26751 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.696717 26787 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:53.703275 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.705562 23264 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:53.707803 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:53.709178 22580 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:53.713508 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.714323 22577 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.715413 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.716209 22572 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
W20260709 13:08:53.722597 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 0328fc7e60424283b5d1ea734bd5136a: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:53.725186 26663 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:53.726419 26663 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:53.726610 26939 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:08:53.726850 26663 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:53.727787 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:53.729837 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.730721 22501 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:53.422632 26932 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.653271 26378 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:53.746359 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.734454 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:53.678730 26488 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.751782 26591 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.754294 26488 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.727815 26663 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.759636 26663 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:53.759747 26881 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:53.761860 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.745198 26828 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:08:53.766603 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.768642 26835 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:53.627291 26920 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:53.774024 26907 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:08:53.751847 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.776188 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.733575 22391 maintenance_manager.cc:643] P b97e77c8afed466a990720a609bf1968: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.053s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":485,"lbm_reads_lt_1ms":4}
W20260709 13:08:53.777999 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.778416 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 44612.4us
W20260709 13:08:53.779022 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.779507 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.780782 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.781062 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.781685 22573 raft_consensus.cc:2368] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:08:53.780366 26749 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:53.784061 26749 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.786412 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.787317 22573 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:08:53.789673 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:53.728754 23255 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:53.805207 22577 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:53.807580 22573 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:53.811122 22573 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:53.808805 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:53.812160 22504 raft_consensus.cc:2368] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:08:53.813359 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:53.814170 22504 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:08:53.816278 22504 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:53.818080 22504 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 10. Ops: [8.8-8.8]
I20260709 13:08:53.819749 22504 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:53.820765 22573 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.823870 22499 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:53.825987 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.827657 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.754343 26758 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.786067 26644 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.837229 22580 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:08:53.839665 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:53.803754 26864 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:53.854876 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.890782 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:53.895090 26864 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:53.903491 26864 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:53.843568 26644 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.909789 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 544) took 3243 ms. Trace:
I20260709 13:08:53.910386 23256 rpcz_store.cc:276] 0709 13:08:50.666144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.667253 (+  1109us) service_pool.cc:224] Handling call
0709 13:08:51.296440 (+629187us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:51.296677 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.419611 (+1122934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.909485 (+1489874us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006d2254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:53.909712 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441655552}
I20260709 13:08:53.911453 26644 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.913578 26903 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:53.921089 26688 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:53.921736 26861 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:08:53.927203 26747 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:53.927757 26747 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:53.932207 26855 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.932843 26855 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.934090 22646 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:53.928846 26747 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:53.959173 26855 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:53.842424 26749 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:53.983392 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 343313us
W20260709 13:08:54.014751 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 312485us
I20260709 13:08:54.022135 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2571) took 1344 ms. Trace:
I20260709 13:08:54.022758 22646 rpcz_store.cc:276] 0709 13:08:52.677563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.183079 (+505516us) service_pool.cc:224] Handling call
0709 13:08:53.183362 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.934505 (+751143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.021807 (+ 87302us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54002990d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:54.022054 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699679488}
W20260709 13:08:54.033277 26317 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.004s
I20260709 13:08:54.032994 26710 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:54.033715 26317 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:54.034024 26787 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:54.034622 26787 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:54.035523 26787 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.035969 26317 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:54.036680 26787 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.039110 26866 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.024506 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:54.045812 22646 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:54.045723 26884 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:54.047188 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:54.047952 22646 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:54.064517 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.075860 23256 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:54.079465 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:54.081966 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 422521us
I20260709 13:08:54.085234 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.044636 26787 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.090466 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.012s	sys 0.005s
W20260709 13:08:54.092517 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.012s	sys 0.005s
I20260709 13:08:54.092576 23264 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:54.094257 22646 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:54.094966 26849 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.095551 26755 raft_consensus.cc:2764] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:54.097533 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.097235 26849 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:54.098404 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 665590us
I20260709 13:08:54.099107 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.099817 26919 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.100237 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.100582 26849 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:54.101058 26666 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.101425 26849 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.101739 26666 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:54.103086 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:54.096396 26758 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:54.105846 26758 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:54.105944 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:54.106284 26758 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:54.107520 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.108289 22576 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:54.108031 26758 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:54.106245 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.109573 26758 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.110813 26864 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:54.111222 26864 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.111583 26864 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.106865 26828 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:54.113582 26828 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.113657 26622 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:54.114027 26828 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.114228 26622 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.116274 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.113057 26861 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.118053 26861 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:54.120010 26710 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:54.116521 26622 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:54.120639 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:54.120242 26861 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:54.121500 26710 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:54.121950 26755 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:54.122421 26855 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.123256 26919 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:54.123368 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:54.124364 22503 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:54.124189 26864 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.122475 26755 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:54.125790 26755 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.126453 26864 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:54.100468 22619 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:54.117444 26666 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:54.117224 22571 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:54.134063 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:54.133314 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:54.148736 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:54.149479 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:54.133289 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:54.151479 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.153980 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 401fe414b8f443bebfed8254895d71c3: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:08:54.158169 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.158646 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:54.159824 22496 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:54.160032 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.161381 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:54.162218 22504 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:54.164578 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.147989 26864 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:54.170712 26945 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.165654 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:54.166538 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:54.213356 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46928.6us
I20260709 13:08:54.176950 26591 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:54.214360 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:54.215586 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.172575 26833 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:54.184294 26885 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.001s
I20260709 13:08:54.189667 26805 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.193274 26866 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:54.193913 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 414572us
I20260709 13:08:54.200459 22504 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:54.240494 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.243813 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.226401 26920 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:54.249238 26763 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.252960 26955 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.253654 26955 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:54.251112 26743 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:08:54.256028 26763 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:54.256192 26955 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:54.256522 26763 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:54.257616 26747 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.257714 26763 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.259512 26763 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.263630 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:54.266955 22652 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:54.266970 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:54.268630 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:54.269212 22651 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.269590 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.165450 26488 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:54.205780 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.132447 26787 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.207406 22503 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.211477 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:54.193750 26832 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.151181 26835 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:54.216796 26751 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:54.224495 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 444929us
I20260709 13:08:54.214280 26591 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:54.245504 26855 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:54.246526 22544 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.273396 22649 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:54.103875 22646 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:54.275116 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.280705 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.288522 26966 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:54.288746 22497 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:08:54.289827 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.288821 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:54.273087 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:54.292011 22646 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:54.273233 26956 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:54.294163 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:54.294471 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:54.295245 23262 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:54.295439 22649 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:08:54.285099 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:54.267520 26920 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:54.302484 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:54.282554 22651 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:54.305370 26956 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:54.305562 26743 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:54.305717 26954 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:08:54.291257 26659 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.288941 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:54.307003 26741 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:54.280210 26751 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.281797 26591 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:54.422317 26964 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:08:54.280843 26884 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.301440 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:08:54.425239 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 123902us
W20260709 13:08:54.312798 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.428840 22571 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:54.279210 26832 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.431408 22572 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:54.431841 22572 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:54.432092 26832 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:54.434525 26743 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:54.376609 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:54.320586 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 710) took 1341 ms. Trace:
I20260709 13:08:54.435803 22578 rpcz_store.cc:276] 0709 13:08:52.979325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.019858 (+ 40533us) service_pool.cc:224] Handling call
0709 13:08:53.044666 (+ 24808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.283218 (+238552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.320265 (+1037047us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001e55d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:54.320508 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518052224}
I20260709 13:08:54.321137 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.344208 23229 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.281597 26787 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:54.432615 22572 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.413713 26751 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.416115 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2574) took 1733 ms. Trace:
I20260709 13:08:54.457707 22648 rpcz_store.cc:276] 0709 13:08:52.682528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.204570 (+522042us) service_pool.cc:224] Handling call
0709 13:08:53.206828 (+  2258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.208722 (+  1894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.415862 (+1207140us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5400167e50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:54.416039 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4114816}
I20260709 13:08:54.425660 26920 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:54.319306 23264 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.440528 23256 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:54.442505 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 121482us
I20260709 13:08:54.442509 22652 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:08:54.443351 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 99291us
I20260709 13:08:54.291574 26855 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.289260 26966 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:54.453306 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:54.454664 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.244s (SENT) [suppressed 20 similar messages]
I20260709 13:08:54.428934 26660 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:54.464529 26786 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.464239 26743 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:54.409466 26659 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:54.465559 26306 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:54.466305 26712 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:54.468695 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.452050 22619 leader_election.cc:400] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:08:54.498337 22619 leader_election.cc:403] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.276646 26955 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.485252 22647 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:54.485942 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 632) took 4583 ms. Trace:
W20260709 13:08:54.508355 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.413014 26741 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:54.498833 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.018s	sys 0.018s
W20260709 13:08:54.513285 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.019s	sys 0.018s
I20260709 13:08:54.513222 26741 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:54.513865 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 516361us
I20260709 13:08:54.515376 26681 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:54.519702 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.520082 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.521274 26864 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:08:54.497152 26786 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:54.523370 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.525470 22647 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:54.537273 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.537339 26956 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:54.471031 26378 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:54.542646 26378 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:54.543674 26378 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.545034 22647 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:54.504298 23260 rpcz_store.cc:276] 0709 13:08:49.888777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.888997 (+   220us) service_pool.cc:224] Handling call
0709 13:08:50.690226 (+801229us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:52.496968 (+1806742us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6e9c 00007fec231d6a5b 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:52.497172 (+   204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.210889 (+713717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.471943 (+1261054us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400834d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:54.472218 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709931136}
I20260709 13:08:54.501161 22648 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:54.481485 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:54.502343 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50461.3us
I20260709 13:08:54.502574 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2338) took 1073 ms. Trace:
I20260709 13:08:54.509110 26317 raft_consensus.cc:2764] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:54.547667 22653 rpcz_store.cc:276] 0709 13:08:53.429125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.435362 (+  6237us) service_pool.cc:224] Handling call
0709 13:08:53.627274 (+191912us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:53.629559 (+  2285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.629590 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:53.637322 (+  7732us) log.cc:844] Serialized 52 byte log entry
0709 13:08:54.013371 (+376049us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:54.496745 (+483374us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.502233 (+  5488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.502312 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.502350 (+    38us) raft_consensus.cc:1685] finished
0709 13:08:54.502363 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.502512 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4142,"prepare.queue_time_us":160044,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":25,"raft.queue_time_us":8708,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":7914,"thread_start_us":805054,"threads_started":2,"wal-append.queue_time_us":566134}
I20260709 13:08:54.547672 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:54.552812 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 662104us
I20260709 13:08:54.468287 26828 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.558779 22647 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:54.562494 23264 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:54.562665 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.562722 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:54.566476 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 85115.4us
I20260709 13:08:54.566669 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:54.567202 22648 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:54.567768 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.564436 22647 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:08:54.571774 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.545486 26712 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.575156 22503 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:54.579365 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:54.579854 22618 leader_election.cc:400] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9.
I20260709 13:08:54.582815 22618 leader_election.cc:403] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.549751 26498 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.484956 26960 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:08:54.584046 22653 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:54.584211 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.581516 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.548715 26660 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:08:54.628051 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65396.6us
I20260709 13:08:54.586750 22575 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:54.561654 26666 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:54.549177 26787 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:54.625171 23264 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:54.651279 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 67125.2us
I20260709 13:08:54.577975 26681 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:54.630579 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.655918 22578 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:08:54.631760 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:54.627621 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55983.5us
I20260709 13:08:54.657413 22580 raft_consensus.cc:2410] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:08:54.662369 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.663074 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.638827 22505 raft_consensus.cc:2410] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:54.604323 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:54.664400 22647 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.580842 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.652403 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:54.585548 26832 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:54.577105 26952 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:54.577921 26712 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:08:54.634784 26837 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.012s	sys 0.013s
I20260709 13:08:54.631492 26847 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.626156 26864 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9.
W20260709 13:08:54.679054 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.680897 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:54.622212 22617 leader_election.cc:400] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:08:54.625774 26786 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:54.635910 26666 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.636783 26861 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:54.722376 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:54.722855 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:54.586186 26958 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 13:08:54.693605 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71581.3us
I20260709 13:08:54.695465 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:54.646464 26755 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:54.699978 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.701081 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.728042 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:54.636871 26907 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:08:54.731968 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 277321us
I20260709 13:08:54.705951 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:54.688540 26638 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:54.698796 26777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.008s	sys 0.012s
W20260709 13:08:54.684736 26837 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.013s	sys 0.013s
I20260709 13:08:54.723716 22503 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:54.733438 22648 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:54.735311 22577 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:08:54.777539 22577 pending_rounds.cc:85] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 7
I20260709 13:08:54.777832 22577 pending_rounds.cc:107] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:08:54.778136 22577 raft_consensus.cc:2889] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.686401 26975 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:54.736203 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:08:54.736464 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.688460 26498 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.725066 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:54.785820 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 60834.8us
I20260709 13:08:54.722458 26861 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.694669 26681 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:54.719458 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:54.727843 26958 consensus_queue.cc:1243] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:54.781262 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:54.721925 26666 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:54.776667 26777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.008s	sys 0.012s
I20260709 13:08:54.742496 26832 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.757846 22647 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:54.798286 22653 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:08:54.787156 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:54.813272 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:54.815157 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:54.700151 26847 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:54.807385 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 228074us
I20260709 13:08:54.735037 26976 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:54.796698 26861 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:54.856771 26976 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.121707 26976 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:55.044606 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.058854 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2578) took 1270 ms. Trace:
W20260709 13:08:55.125175 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.058575 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 377630us
I20260709 13:08:55.125118 22649 rpcz_store.cc:276] 0709 13:08:53.788614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.296429 (+507815us) service_pool.cc:224] Handling call
0709 13:08:54.372256 (+ 75827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.372482 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:54.409074 (+ 36592us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.057709 (+648635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:55.057867 (+   158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:55.058042 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.058230 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.058564 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32706,"prepare.queue_time_us":57081,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":42433,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":40590,"thread_start_us":615112,"threads_started":2,"wal-append.queue_time_us":391865}
I20260709 13:08:55.060539 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:55.130364 27000 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:55.131170 27000 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.131719 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2577) took 1343 ms. Trace:
I20260709 13:08:54.783210 26660 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.070885 26638 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.073292 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:55.074712 26591 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.005s
I20260709 13:08:55.076038 26681 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.077742 22503 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:54.817462 26712 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:55.080132 26741 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:08:55.082624 26659 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.093948 26828 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.100253 26847 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:54.797767 26864 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.162171 26864 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.165135 26591 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.165565 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 839) took 1050 ms. Trace:
I20260709 13:08:55.166210 22652 rpcz_store.cc:276] 0709 13:08:54.115281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.272797 (+157516us) service_pool.cc:224] Handling call
0709 13:08:55.164940 (+892143us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002daad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:55.165298 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328671616}
I20260709 13:08:55.167725 26591 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.170625 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:55.171416 22653 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.132335 22646 rpcz_store.cc:276] 0709 13:08:53.788357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.293418 (+505061us) service_pool.cc:224] Handling call
0709 13:08:54.310976 (+ 17558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.311593 (+   617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.311637 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.339632 (+ 27995us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.743929 (+404297us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:54.804097 (+ 60168us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.804332 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.804429 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.131121 (+326692us) raft_consensus.cc:1685] finished
0709 13:08:55.131168 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.131449 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22145,"raft.queue_time_us":325244,"raft.run_cpu_time_us":532,"raft.run_wall_time_us":51089,"thread_start_us":314526,"threads_started":1,"wal-append.queue_time_us":708832}
I20260709 13:08:55.173067 22651 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:08:54.943619 26978 log.cc:927] Time spent T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:08:55.174196 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:55.123282 26999 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:55.176682 26987 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:55.177125 26999 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.179741 26712 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.180182 26999 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:55.181542 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.157485 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 89801.2us
W20260709 13:08:55.182566 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.183079 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:55.130625 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:55.185793 26995 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:55.186033 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2580) took 1358 ms. Trace:
I20260709 13:08:55.186540 26995 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:55.130609 22505 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:08:55.187002 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56689.6us
I20260709 13:08:55.186687 22645 rpcz_store.cc:276] 0709 13:08:53.827478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.432839 (+605361us) service_pool.cc:224] Handling call
0709 13:08:54.491002 (+ 58163us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:08:54.491328 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.502140 (+ 10812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.502174 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.546479 (+ 44305us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.790484 (+244005us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:54.790558 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.790698 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.185178 (+394480us) raft_consensus.cc:1685] finished
0709 13:08:55.185232 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.185840 (+   608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":936,"raft.queue_time_us":10970,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":45357,"spinlock_wait_cycles":14911872,"thread_start_us":206998,"threads_started":1,"wal-append.queue_time_us":556972}
I20260709 13:08:55.160650 22572 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:55.190469 22645 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:55.062242 22647 raft_consensus.cc:2410] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:08:55.191210 26747 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:54.792789 26498 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.191789 22498 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:55.157416 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:55.194108 26498 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.159636 26847 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:55.181146 26741 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:54.726194 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:55.196998 26741 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.194279 22649 raft_consensus.cc:2410] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:08:55.131810 27000 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:55.197269 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2579) took 1389 ms. Trace:
I20260709 13:08:55.205245 22651 rpcz_store.cc:276] 0709 13:08:53.808243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.382986 (+574743us) service_pool.cc:224] Handling call
0709 13:08:55.172246 (+789260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.173837 (+  1591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.196713 (+ 22876us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002daad0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:55.197147 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814125824}
I20260709 13:08:55.180214 26710 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:55.201617 26847 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.235728 26710 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:08:55.247104 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 59025.7us
I20260709 13:08:55.259465 26847 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:55.271034 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.249682 26710 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:55.266034 26984 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:55.307215 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 59181.5us
I20260709 13:08:55.243418 26999 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.272307 26833 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.048s	user 0.004s	sys 0.024s
W20260709 13:08:55.329523 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 516191us
I20260709 13:08:55.331175 26638 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:55.332998 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 518410us
W20260709 13:08:55.333891 27001 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.004s
I20260709 13:08:55.335486 26832 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:55.337769 26832 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.341856 26638 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.342829 26638 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.346208 27004 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:55.347081 27004 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.347290 26861 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.349323 26687 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.349548 26995 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.264204 26591 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.260761 26932 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.243614 26828 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:08:55.314917 26805 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.046s	user 0.010s	sys 0.021s
W20260709 13:08:55.316555 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.014s	sys 0.027s
W20260709 13:08:55.371109 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.380465 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.380815 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.353906 26825 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:55.371038 22654 raft_consensus.cc:2410] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:08:55.354010 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:08:55.358636 23263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.008s	sys 0.010s
I20260709 13:08:55.402770 22653 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:55.269181 27007 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:55.401000 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.014s	sys 0.028s
I20260709 13:08:55.354166 26955 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:55.353976 26864 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.358803 26971 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:55.360546 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.365044 27009 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:55.417407 23263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.009s	sys 0.010s
I20260709 13:08:55.364290 26638 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.360193 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:55.361224 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.364632 26975 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:55.352074 26710 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.459407 26975 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.461176 26710 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.462073 26975 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.462999 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:55.463737 22652 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:55.466907 26666 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.650s	user 0.002s	sys 0.013s
I20260709 13:08:55.467744 26666 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.353389 26591 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.429531 26867 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.430080 26847 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.430805 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.431476 26901 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:55.432650 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 818) took 1217 ms. Trace:
I20260709 13:08:55.404125 26805 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.433341 22572 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:55.433504 23255 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:55.433079 26955 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.434338 23257 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:55.434533 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:55.435250 26758 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:55.435988 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.437348 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.450069 22649 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:55.428272 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.028s
I20260709 13:08:55.453079 27009 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.458403 22651 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:55.417703 26971 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:55.365114 26999 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:55.434388 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 126306us
I20260709 13:08:55.497148 22650 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:55.507922 22652 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:55.436177 27007 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.508894 22572 pending_rounds.cc:85] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 8
I20260709 13:08:55.519250 22647 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:55.517289 22572 pending_rounds.cc:107] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:55.528167 22572 raft_consensus.cc:2889] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:55.525221 26644 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.507292 26901 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:55.515612 26710 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.535890 26644 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.544773 26710 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.547477 26710 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:55.548019 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.547714 26971 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.539760 26975 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:55.549165 26971 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:55.549538 26975 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.550922 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 819) took 1314 ms. Trace:
I20260709 13:08:55.551369 22498 rpcz_store.cc:276] 0709 13:08:54.236277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.236438 (+   161us) service_pool.cc:224] Handling call
0709 13:08:54.236786 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.192359 (+955573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.550573 (+358214us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b540033f4d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:55.550843 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195312384}
I20260709 13:08:55.552066 26975 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.536592 26847 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:55.553413 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.553288 26847 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:55.554883 22654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2336) took 2127 ms (client timeout 2542 ms). Trace:
W20260709 13:08:55.555429 22654 rpcz_store.cc:269] 0709 13:08:53.427148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.427523 (+   375us) service_pool.cc:224] Handling call
0709 13:08:55.554652 (+2127129us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400395154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:55.554807 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4462579968}
I20260709 13:08:55.555847 26601 tablet_copy_client.cc:538] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:55.525202 26805 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.500056 26867 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.557749 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 721) took 1130 ms. Trace:
I20260709 13:08:55.558178 22572 rpcz_store.cc:276] 0709 13:08:54.427333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.431008 (+  3675us) service_pool.cc:224] Handling call
0709 13:08:54.431280 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.159502 (+728222us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5800a307d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262570aa 00007fec262d9447 00007fec262f1fe7 00007fec262f37de 00007fec262fdb49 00007fec262fe416 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4
0709 13:08:55.557498 (+397996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.557667 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659193088}
I20260709 13:08:55.561026 26758 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.562427 26666 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.563549 26758 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.564759 26805 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.565342 22645 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:55.507509 22500 rpcz_store.cc:276] 0709 13:08:54.215089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.215361 (+   272us) service_pool.cc:224] Handling call
0709 13:08:54.215721 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.215974 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:54.571075 (+355101us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.431961 (+860886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:55.432101 (+   140us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:55.432196 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.432326 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.432559 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":512980,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":6168,"raft.queue_time_us":10564,"raft.run_wall_time_us":30634,"spinlock_wait_cycles":73796864,"thread_start_us":1182085,"threads_started":2,"wal-append.queue_time_us":856991}
W20260709 13:08:55.575139 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.578255 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.578293 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:55.579396 23259 raft_consensus.cc:2368] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:55.580015 27015 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:55.580750 27015 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.581286 22544 leader_election.cc:400] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:55.581704 22544 leader_election.cc:403] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:08:55.581745 26951 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:55.582322 26442 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:55.582952 26681 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.583289 27015 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:55.595172 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64050.6us
I20260709 13:08:55.542662 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:55.544449 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 62708.5us
W20260709 13:08:55.598627 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.596216 22651 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:08:55.612434 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:55.540293 26901 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:55.621268 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.622072 26976 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.629623 26317 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:55.630589 26740 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.630426 26317 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.631222 26740 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.632743 26317 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:55.633054 26751 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.125s	user 0.006s	sys 0.015s
I20260709 13:08:55.633643 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.633833 26751 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.634225 27007 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.634687 22577 raft_consensus.cc:2410] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:55.635391 22573 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:55.636670 27009 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.636287 26751 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.637400 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.638479 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.630455 26688 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:08:55.641230 26317 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:55.634686 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:55.642261 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:55.641943 26317 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.644439 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.645939 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:55.647382 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.648936 26317 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.650426 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.651880 26317 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:55.652601 26805 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:55.649732 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.653160 26317 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.655193 22572 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:55.654160 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:55.655965 26687 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:55.656189 22579 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.656472 26687 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.658785 26317 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.653746 27009 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:55.651343 22578 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:55.673187 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.664677 26976 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.662014 26847 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:55.683590 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.681926 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 64274.7us
I20260709 13:08:55.662976 27009 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.653254 26805 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.728013 22573 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:08:55.728718 22573 pending_rounds.cc:85] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 10
I20260709 13:08:55.706383 27007 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:55.738091 22573 pending_rounds.cc:107] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 10.11
W20260709 13:08:55.736202 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 195409us
I20260709 13:08:55.738498 22573 raft_consensus.cc:2889] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:55.742017 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:55.751436 22579 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:55.736686 27007 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:55.758870 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 718) took 2047 ms. Trace:
I20260709 13:08:55.762102 22573 rpcz_store.cc:276] 0709 13:08:53.711153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.803365 (+ 92212us) service_pool.cc:224] Handling call
0709 13:08:53.807364 (+  3999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.583588 (+1776224us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5800830fd0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262570aa 00007fec262d9447 00007fec262f1fe7 00007fec262f37de 00007fec262fdb49 00007fec262fe416 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4
0709 13:08:55.752532 (+168944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.758793 (+  6261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923852032}
I20260709 13:08:55.753129 26951 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.773267 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.773680 26755 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:55.776787 26867 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.777899 27020 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.778502 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 847) took 1321 ms. Trace:
I20260709 13:08:55.778672 27020 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.778934 22648 rpcz_store.cc:276] 0709 13:08:54.456646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.578137 (+121491us) service_pool.cc:224] Handling call
0709 13:08:54.635725 (+ 57588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.777267 (+141542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.778043 (+1000776us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b5400394c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:55.778324 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223846784}
I20260709 13:08:55.781021 26740 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:55.782524 27011 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.347s	user 0.002s	sys 0.000s
I20260709 13:08:55.785647 26999 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:55.787814 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71422.6us
I20260709 13:08:55.795720 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:55.764593 27007 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:55.792810 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2635) took 1131 ms. Trace:
W20260709 13:08:55.769106 27000 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.002s
W20260709 13:08:55.793901 26747 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.009s
I20260709 13:08:55.792586 26976 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:55.770722 26591 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.818146 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:55.799638 22504 rpcz_store.cc:276] 0709 13:08:54.661540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.159483 (+497943us) service_pool.cc:224] Handling call
0709 13:08:55.160101 (+   618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.424068 (+263967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.424118 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.442902 (+ 18784us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.611520 (+168618us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:55.611574 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.611673 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.792276 (+180603us) raft_consensus.cc:1685] finished
0709 13:08:55.792299 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.792509 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93265,"raft.queue_time_us":109213,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":104,"thread_start_us":315048,"threads_started":2,"wal-append.queue_time_us":227621}
I20260709 13:08:55.828989 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:55.830616 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:55.815049 26971 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.809345 27020 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.817797 26747 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:55.841194 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.842176 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:55.836877 26571 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.791442 26951 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.827930 26955 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.835211 26867 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:55.827764 27004 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.807760 27000 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:55.859902 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 122981us
I20260709 13:08:55.861230 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:55.865389 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.866279 22575 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:55.867208 26695 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:55.867913 26687 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:55.868682 27021 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:55.870821 26971 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.873921 26971 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:55.876292 22579 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:55.879129 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.841670 26999 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:55.880622 22505 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:55.881695 22573 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:55.880824 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2324) took 3776 ms. Trace:
I20260709 13:08:55.890318 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:55.891281 22650 rpcz_store.cc:276] 0709 13:08:52.098148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.627386 (+529238us) service_pool.cc:224] Handling call
0709 13:08:52.627719 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.519421 (+2891702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.874017 (+354596us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b5400168854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:55.874262 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6350048128}
I20260709 13:08:55.891007 27004 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:55.894376 22577 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:55.895157 27023 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:55.894865 27004 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.896468 26967 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.889958 26847 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.897300 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:55.897605 26847 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.898267 22505 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.898535 26681 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:55.900123 26847 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:55.875335 26867 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:55.901082 26601 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:08:55.901153 26867 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:55.885447 27009 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.883008 26805 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.876003 27020 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:55.906175 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.906863 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2344) took 1301 ms. Trace:
I20260709 13:08:55.907311 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2629) took 1248 ms. Trace:
I20260709 13:08:55.907691 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:55.893252 26999 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:55.876164 26571 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:55.909968 27006 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.475s	user 0.000s	sys 0.003s
I20260709 13:08:55.910166 26999 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:55.893590 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:55.885871 22574 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:55.918869 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:55.919734 22575 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:55.920185 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:55.921056 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 130363us
I20260709 13:08:55.907285 22646 rpcz_store.cc:276] 0709 13:08:54.606378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.175518 (+569140us) service_pool.cc:224] Handling call
0709 13:08:55.176091 (+   573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.236855 (+ 60764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.236902 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.255437 (+ 18535us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.680402 (+424965us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:55.680449 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.873005 (+192556us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54002bff54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:55.873064 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.906568 (+ 33504us) raft_consensus.cc:1685] finished
0709 13:08:55.906588 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.906805 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54132480,"thread_start_us":267084,"threads_started":1,"wal-append.queue_time_us":422045}
I20260709 13:08:55.881521 26591 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.886336 26832 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:55.908133 27024 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:08:55.927790 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:55.921013 23262 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:55.885607 26976 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:55.929628 26847 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.952194 26976 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.952517 26847 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.952708 26976 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:55.932971 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.953392 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.907903 22499 rpcz_store.cc:276] 0709 13:08:54.659065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.662134 (+  3069us) service_pool.cc:224] Handling call
0709 13:08:54.662500 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.662938 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.662977 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.675517 (+ 12540us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.906695 (+1231178us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54002c77a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec262726b8 00007fec262fb92b 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c
0709 13:08:55.906807 (+   112us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:55.906856 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.906977 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.907020 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:55.907034 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.907249 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":606,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":8522,"spinlock_wait_cycles":168437632,"thread_start_us":780660,"threads_started":1,"wal-append.queue_time_us":706124}
I20260709 13:08:55.897123 26967 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.959580 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:55.957453 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 659) took 1511 ms. Trace:
I20260709 13:08:55.965574 26666 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:55.957383 26847 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.975493 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:55.974182 22645 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:55.974738 22648 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:55.958257 26681 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:55.977993 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:55.980379 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46540.7us
I20260709 13:08:55.966378 23263 rpcz_store.cc:276] 0709 13:08:54.421336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.438121 (+ 16785us) service_pool.cc:224] Handling call
0709 13:08:54.438468 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.438742 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.438779 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.472420 (+ 33641us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.433961 (+961541us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:55.434064 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.434169 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.909205 (+475036us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:55.911524 (+  2319us) raft_consensus.cc:1685] finished
0709 13:08:55.911549 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.932832 (+ 21283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23938304,"thread_start_us":871177,"threads_started":1,"wal-append.queue_time_us":935350}
I20260709 13:08:55.958822 27020 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:55.969976 26687 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:55.986230 26710 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.954895 26591 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.993845 26681 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:55.995204 22579 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:55.990578 26442 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:55.971654 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:55.975665 26666 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.007963 26666 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.003552 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:55.992313 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:55.991626 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:55.975843 26747 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.005694 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.005852 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.006502 26956 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.013180 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2634) took 1352 ms. Trace:
I20260709 13:08:56.013314 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:56.020334 22505 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:56.017104 26571 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:56.024302 26920 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:56.001502 26710 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:56.024986 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 117438us
I20260709 13:08:56.025331 26710 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.025735 22576 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:56.026304 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:56.027663 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:56.028997 27009 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.029465 27009 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.029830 27009 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:55.984146 26932 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:08:56.035687 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:56.033028 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63660.2us
I20260709 13:08:56.044572 22501 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.034322 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:56.053640 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.046260 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:56.016556 22503 rpcz_store.cc:276] 0709 13:08:54.660775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.147482 (+486707us) service_pool.cc:224] Handling call
0709 13:08:55.157874 (+ 10392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:55.618998 (+461124us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:55.700453 (+ 81455us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.959344 (+258891us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:55.993007 (+ 33663us) log.cc:844] Serialized 52 byte log entry
0709 13:08:55.993171 (+   164us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:55.993205 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.993271 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:56.012966 (+ 19695us) raft_consensus.cc:1685] finished
0709 13:08:56.012987 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:56.013124 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86809,"prepare.queue_time_us":37841,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":111032,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":3428,"spinlock_wait_cycles":272128,"thread_start_us":554344,"threads_started":2,"wal-append.queue_time_us":294374}
I20260709 13:08:56.058068 22499 pending_rounds.cc:85] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 7
I20260709 13:08:56.072355 22499 pending_rounds.cc:107] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:08:56.072710 22499 raft_consensus.cc:2889] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.024647 26903 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:56.100096 22578 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:56.090611 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.112466 22648 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:56.116518 22577 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:56.121250 26832 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:56.088833 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.039304 27025 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:56.039582 27015 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.125299 22502 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:08:56.040164 26847 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.040398 26644 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.036594 26681 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.044646 26995 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:08:56.139026 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.089659 26967 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.109001 26999 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:56.093541 26932 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.017477 26747 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.149123 22501 raft_consensus.cc:2368] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:56.139842 26903 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:56.113077 26740 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:56.152284 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 106227us
I20260709 13:08:56.153709 22503 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:56.126902 26751 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:56.017292 26442 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.144670 26971 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:56.132762 26976 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.162293 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.149489 26832 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.158028 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.101486 26920 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.152402 26901 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.133766 26867 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.178047 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.206759 22648 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:08:56.207501 26903 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:56.181185 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.186252 26847 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.209496 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.209579 26751 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.173477 26710 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.210016 26687 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:56.210744 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.211542 22502 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:56.211817 26710 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:56.172497 27034 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:08:56.173082 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.171793 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 189914us
I20260709 13:08:56.181095 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.101150 26956 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:56.185740 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.219473 22652 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:56.181392 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:56.220613 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.163125 26740 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:56.207998 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.172189 22496 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.162256 26999 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:56.171355 22654 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:56.170193 26971 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.186374 26747 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.236824 22497 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:56.213776 26591 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.160755 26932 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.244225 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.211844 26751 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.245527 22649 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:56.246860 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.243397 22648 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:56.187630 26741 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:56.230161 26995 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:56.257264 26786 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:56.253546 22646 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:56.256559 26847 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.183595 26378 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:08:56.257102 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.261483 22648 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:08:56.258714 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.238049 26971 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:56.261817 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:56.262149 26847 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.268087 26920 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:56.268985 26847 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:56.273013 27026 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.398s	user 0.002s	sys 0.000s
I20260709 13:08:56.276836 27000 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.278208 26378 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.257270 26956 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.279033 26378 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.279814 26786 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:56.280340 26786 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:56.278863 26976 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.282056 26786 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.285576 26861 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.287221 26867 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.289659 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.290117 27009 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.291204 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.292229 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.296583 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.298199 22502 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.247952 26571 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:56.297842 26378 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.299135 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:56.299455 27044 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:56.300071 26971 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.300200 26999 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:56.304334 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48777.7us
I20260709 13:08:56.226342 26832 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.318184 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.291271 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:56.350374 22501 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:56.323513 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110709us
I20260709 13:08:56.332352 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.330431 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.332103 26687 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:56.323899 26317 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:56.355907 22497 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:08:56.335101 23257 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:56.325855 26695 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:56.353466 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62364.8us
I20260709 13:08:56.352452 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.335852 26786 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.374861 22502 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:08:56.354454 22498 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:56.335139 26932 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.355649 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.379283 22545 leader_election.cc:400] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9.
I20260709 13:08:56.381831 22648 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:56.384757 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.387056 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:56.410276 23264 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:56.389020 26861 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.372707 26967 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:56.415678 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 73490.4us
I20260709 13:08:56.416795 23264 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.353142 26867 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:08:56.420945 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.421911 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.413370 26967 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.426769 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:56.434337 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.416785 26317 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:56.456401 27042 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:08:56.457353 26317 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.458431 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.459126 22497 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.459620 26740 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.462193 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.462683 22645 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:56.463513 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.463726 27000 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:56.464172 22503 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.464378 27000 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.465731 22647 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:56.465919 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.466657 27000 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.467149 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.468294 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.471467 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.472280 22501 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:08:56.432209 26976 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:56.475234 22399 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 190) took 20294 ms (client timeout 15000 ms). Trace:
I20260709 13:08:56.477278 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.477726 26971 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:56.477926 22501 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.425141 26861 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:56.432740 26967 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:56.433185 27007 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.002s
I20260709 13:08:56.416492 26932 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:56.476634 22400 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 8 to 9, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 9 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.481413 27007 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.484364 22400 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:56.475687 22399 rpcz_store.cc:269] 0709 13:08:36.180722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.180997 (+   275us) service_pool.cc:224] Handling call
0709 13:08:37.119985 (+938988us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:08:56.474990 (+19355005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:48.779564 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:48.784344 (+  4780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:48.784397 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:08:48.784417 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:48.785251 (+   834us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:48.785357 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:48.785386 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:48.786006 (+   620us) tablet.cc:701] Row locks acquired
0709 13:08:48.786066 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:08:48.786248 (+   182us) write_op.cc:270] Start()
0709 13:08:48.786388 (+   140us) write_op.cc:276] Timestamp: P: 1783602528786158 usec, L: 0
0709 13:08:48.786413 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:48.787156 (+   743us) log.cc:844] Serialized 2084 byte log entry
0709 13:08:49.142733 (+355577us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:08:49.410841 (+268108us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.573925 (+163084us) write_op.cc:301] APPLY: starting
0709 13:08:49.574008 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.574457 (+   449us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.574480 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.574969 (+   489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.575193 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:08:49.575235 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:49.575481 (+   246us) log.cc:844] Serialized 47 byte log entry
0709 13:08:49.575652 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.575761 (+   109us) write_op.cc:454] Released schema lock
0709 13:08:49.575800 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.598460 (+ 22660us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.598509 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1478533,"reported_tablets":26,"spinlock_wait_cycles":689007360,"child_traces":[["op",{"apply.queue_time_us":149747,"apply.run_cpu_time_us":2289,"apply.run_wall_time_us":2289,"num_ops":5,"prepare.queue_time_us":295379,"prepare.run_cpu_time_us":13209,"prepare.run_wall_time_us":61519,"raft.queue_time_us":231015,"raft.run_cpu_time_us":32218,"raft.run_wall_time_us":237367,"replication_time_us":610596,"spinlock_wait_cycles":2356992,"thread_start_us":491365,"threads_started":4,"wal-append.queue_time_us":196410,"wal-append.run_cpu_time_us":49151,"wal-append.run_wall_time_us":1586205}]]}
I20260709 13:08:56.489676 27009 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.415051 26695 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.493229 26695 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.493391 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.426040 26825 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:08:56.438089 26867 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.495688 26867 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.496156 26867 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.499658 26951 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.501379 26832 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.502612 27004 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.503044 22497 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
W20260709 13:08:56.509594 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 89454.3us
I20260709 13:08:56.487723 22400 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 6 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.513653 22501 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:08:56.520237 22498 raft_consensus.cc:2410] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:56.488306 26666 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.539702 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.482919 26828 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:56.546875 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53599.6us
I20260709 13:08:56.548077 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.553089 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:56.553416 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.554293 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:56.557432 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.561798 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.558669 22400 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 7 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 10 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.519536 27007 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.566313 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:08:56.568594 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49693.3us
I20260709 13:08:56.563808 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.552752 26740 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.571393 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:56.572180 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 135533us
I20260709 13:08:56.551972 26951 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.574759 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:56.546927 26828 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:08:56.575577 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 217410us
I20260709 13:08:56.578527 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:56.564740 26932 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:56.537736 26695 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:56.565479 26498 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:56.581795 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.591423 22619 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.592494 26855 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.592989 27058 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:56.593168 26855 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.597306 26828 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.598767 26828 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.599179 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.600355 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.601456 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.601908 27004 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:56.602550 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.581638 26932 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.603258 26932 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:56.603335 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.602710 27046 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.571180 26741 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:56.604732 26741 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.604588 27046 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.605180 26741 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.606351 26867 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:56.609548 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44066.7us
I20260709 13:08:56.610005 26666 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.601370 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.611586 27046 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.608489 26867 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:56.589602 27007 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:56.617913 27007 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:56.618399 27007 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:56.623924 27059 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:56.625030 22646 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.625430 23264 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.627645 22645 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:56.627830 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.628180 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.628983 22503 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:56.629182 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:56.630820 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52573.6us
I20260709 13:08:56.632093 22498 raft_consensus.cc:2410] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:56.628799 23263 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:56.582056 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.633103 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:56.633234 22501 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:56.635013 22619 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:56.637843 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:56.639535 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.576627 26971 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:56.642154 26976 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:56.643529 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.644321 26976 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.644702 22619 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.645488 26976 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:56.649437 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74815us
W20260709 13:08:56.641360 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60526.3us
W20260709 13:08:56.653674 27052 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:08:56.653810 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.654561 22503 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:08:56.608366 26967 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.662428 23258 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:56.662829 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:08:56.665805 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.670377 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.637611 26855 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.636090 27004 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:56.674234 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.674839 22504 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.676496 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:56.677575 22650 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:56.678690 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:56.682339 23259 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:56.676721 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:56.687309 22501 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:08:56.688963 22572 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:56.688793 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.691494 23262 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:08:56.692981 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.689270 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:56.639994 26666 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:56.649641 27009 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:56.702404 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:56.658805 26681 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:56.650032 26971 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.655853 26755 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:56.694912 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:08:56.695848 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.661695 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.706861 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.707942 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.710952 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:56.711504 23262 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.704241 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:56.705817 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.661489 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.703135 22654 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:56.712802 22574 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:08:56.717087 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.717796 23259 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:08:56.699314 26378 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.737480 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.733549 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:56.724035 26666 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.742204 23258 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:08:56.743985 26666 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.745674 26712 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:56.746189 27059 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:56.706617 26681 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:56.741638 26932 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.708802 26971 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.712705 26498 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.788370 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:56.704970 26928 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:08:56.722091 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:56.800195 22654 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:56.812551 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:56.813342 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.813769 26967 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:56.815496 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.816120 22499 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:08:56.817157 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.818940 22578 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:56.795794 22501 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:56.822022 26901 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:56.794413 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 105350us
W20260709 13:08:56.812819 27067 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:08:56.813586 27046 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:56.825225 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.734087 27009 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:56.795667 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:56.739284 26755 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:56.780891 26681 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.749017 26855 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:56.810693 22573 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:08:56.860981 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.864728 22501 raft_consensus.cc:2410] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:56.866473 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:56.737131 26741 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:56.824004 27058 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:56.948119 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.850673 26828 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:56.785614 26378 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.963172 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.964066 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:56.964148 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:08:56.962770 22573 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:56.805212 27059 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:08:56.969664 22499 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:56.972517 22576 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:56.972754 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:56.794198 27066 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.156s
I20260709 13:08:56.976065 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:56.978181 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:56.951767 26901 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:56.982191 26901 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:56.982574 27065 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:08:56.983376 26901 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.985214 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.861800 26710 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:08:56.945924 26967 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:56.889635 26855 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.963678 26828 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.989838 26932 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:56.990336 26755 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:56.853358 26498 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.016765 22499 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:57.018358 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:56.978015 27056 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:57.030454 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 217974us
W20260709 13:08:57.005153 27064 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 13:08:57.012746 26901 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:57.042723 22504 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:57.042541 22469 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:57.032823 22573 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:57.015329 26828 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:57.064416 22572 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:57.041227 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:57.010732 26967 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.017340 27007 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.095760 22544 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:57.159049 26855 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:57.164479 26971 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.163537 26442 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:57.109764 22572 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:08:57.162124 27060 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.552s	user 0.004s	sys 0.000s
W20260709 13:08:57.106211 27068 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
I20260709 13:08:57.145380 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2605) took 1173 ms. Trace:
I20260709 13:08:57.272099 22648 rpcz_store.cc:276] 0709 13:08:55.972264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.276944 (+304680us) service_pool.cc:224] Handling call
0709 13:08:56.277390 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.382393 (+105003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.145072 (+762679us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400236c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:57.145308 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239032192}
I20260709 13:08:57.111538 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:57.147563 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:57.104781 26740 consensus_queue.cc:1059] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:57.045235 27009 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.158898 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:57.101076 26932 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.116192 27077 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:57.247484 26967 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:57.250332 26571 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:57.250912 27007 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:57.252808 22498 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:08:57.260517 23262 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.003s
I20260709 13:08:57.044683 26995 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:57.275028 22502 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:57.241541 27046 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:57.314970 23262 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:08:57.317304 22575 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:57.333877 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 175060us
I20260709 13:08:57.308653 27077 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.348124 22498 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:57.335392 27074 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:57.329107 27046 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:57.355304 27062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.011s	sys 0.012s
I20260709 13:08:57.316148 26932 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.369675 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:57.317298 27082 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.333169 26378 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:57.342605 26855 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:57.346997 26498 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:57.344997 27077 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:57.375016 27062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.011s	sys 0.013s
I20260709 13:08:57.375419 27082 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:57.381692 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 339231us
I20260709 13:08:57.389819 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:57.397050 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2613) took 1167 ms. Trace:
I20260709 13:08:57.404385 22647 rpcz_store.cc:276] 0709 13:08:56.229795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.467415 (+237620us) service_pool.cc:224] Handling call
0709 13:08:56.467659 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.508089 (+ 40430us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:56.543528 (+ 35439us) log.cc:844] Serialized 14 byte log entry
0709 13:08:56.543798 (+   270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:56.543867 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:56.543937 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.396621 (+852684us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b54002990d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:57.396705 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.396942 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35199,"raft.queue_time_us":2780,"raft.run_wall_time_us":9391,"spinlock_wait_cycles":115657216}
I20260709 13:08:57.391763 27082 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.445333 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:57.383019 26855 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.457331 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:57.464331 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:57.462374 26681 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.002s
I20260709 13:08:57.470635 26681 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.472854 22580 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:57.403641 27046 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.495886 27046 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:57.468266 27081 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:08:57.499203 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 403513us
I20260709 13:08:57.506916 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:57.509843 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:57.512018 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:57.513669 22576 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:57.472813 26681 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:57.519136 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:57.525257 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.524474 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.526650 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.529894 22580 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:57.526345 22579 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:57.530745 22573 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:57.527022 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.532214 22572 raft_consensus.cc:2410] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:57.526736 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.547556 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:57.523950 26932 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:57.513726 26971 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:57.567270 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:57.568176 22502 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:57.569887 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.527181 26967 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:57.620738 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 405685us
I20260709 13:08:57.513701 26378 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:57.622988 22502 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:57.623083 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:57.554862 26681 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.658113 22500 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:57.657867 22502 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:08:57.632515 22504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.013s	sys 0.004s
W20260709 13:08:57.664716 22504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.014s	sys 0.004s
I20260709 13:08:57.570605 26932 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.624594 27081 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:57.627923 27041 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:57.619845 26967 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:57.666255 26901 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.012s
I20260709 13:08:57.688627 22576 raft_consensus.cc:2410] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:57.671362 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.689718 26967 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.697317 26741 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:57.701207 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:57.701895 22572 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:57.702054 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:57.702461 26901 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:57.701385 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:57.703151 26901 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.705333 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:57.705924 23260 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:57.708317 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:57.709101 23262 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:08:57.709489 27095 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:08:57.711731 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:57.713305 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:57.714504 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:57.715502 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:57.718181 26712 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:57.718715 26712 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.720711 26712 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:57.721251 27092 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:08:57.722057 26442 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:57.722594 26442 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:08:57.723759 27090 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:57.723768 26442 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.731590 26442 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:57.735183 27054 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.146s	user 0.010s	sys 0.012s
I20260709 13:08:57.737622 26901 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:57.740131 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:57.740443 26951 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.740957 26951 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.744112 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:57.745163 22503 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:57.749018 27093 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:57.690104 27085 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:57.751022 26855 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:57.624418 27098 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:57.669310 26903 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.754055 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:57.674008 26740 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:57.680116 22502 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:57.674580 27084 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:57.673278 27072 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:57.687842 27041 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:57.669584 26681 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.786204 22502 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.787294 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:57.771224 23229 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:57.768801 22573 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:08:57.774556 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:57.791749 22650 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:57.783872 23262 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:57.776657 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:57.774809 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:57.803839 22572 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:57.770586 22647 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:57.683097 26932 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.771077 22498 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:08:57.790772 27098 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.771309 27097 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:57.779874 27084 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:57.774989 26740 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:57.781118 26901 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:57.823590 22572 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:57.806195 26741 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.784108 26712 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:57.779314 26903 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:57.823386 26828 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.000s
I20260709 13:08:57.770649 26995 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:57.819491 26378 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:57.823122 27084 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.784324 27082 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.844496 26828 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.817000 26695 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:57.770299 27066 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:08:57.844821 26755 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.844527 26951 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:57.868587 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 455683us
I20260709 13:08:57.864885 26712 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:57.871809 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:57.846359 26901 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:08:57.878106 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.880038 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 434774us
I20260709 13:08:57.888501 22500 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:57.841143 27041 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:57.874603 26712 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:57.876822 27098 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:57.879845 26571 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.555s	user 0.015s	sys 0.004s
I20260709 13:08:57.878630 27066 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:57.901607 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.877578 26755 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:57.894767 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2660) took 1165 ms. Trace:
I20260709 13:08:57.859882 26740 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.924364 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:57.929318 22504 rpcz_store.cc:276] 0709 13:08:56.729851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.050388 (+320537us) service_pool.cc:224] Handling call
0709 13:08:57.050991 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.059173 (+  8182us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:57.665421 (+606248us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.894387 (+228966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.894447 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:57.894500 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.894571 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.894703 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":408231,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":785333,"threads_started":2}
I20260709 13:08:57.934185 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:57.936771 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:57.956597 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 176063us
I20260709 13:08:57.926816 26571 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:57.962528 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2663) took 1231 ms. Trace:
I20260709 13:08:57.929076 26755 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:57.934537 27085 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:57.927791 27066 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:57.948900 26681 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:57.938406 27103 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:08:57.970082 22504 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:57.961423 26740 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.927428 27098 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.963025 22496 rpcz_store.cc:276] 0709 13:08:56.731040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.148516 (+417476us) service_pool.cc:224] Handling call
0709 13:08:57.148845 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.149082 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:57.352524 (+203442us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.934840 (+582316us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.962123 (+ 27283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.962183 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:57.962249 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.962320 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.962468 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35884,"prepare.queue_time_us":319628,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":278543,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4821,"thread_start_us":784648,"threads_started":3,"wal-append.queue_time_us":431075}
I20260709 13:08:57.939127 27041 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:57.965517 27107 log.cc:927] Time spent T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:08:57.989988 22650 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:57.967974 27111 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:57.940976 26967 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:57.992995 27101 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
W20260709 13:08:57.993788 27106 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:08:57.994287 27098 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:57.994562 27113 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:58.011096 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:58.011946 27082 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:58.013813 26755 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.015259 27116 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:08:58.016185 27046 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
I20260709 13:08:58.022012 27118 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:58.022773 26903 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:57.980538 26828 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:58.025411 27111 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.975894 26712 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.029279 27122 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:57.983129 27102 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:08:58.034775 27066 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:57.985667 26932 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:58.036756 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2658) took 1307 ms. Trace:
I20260709 13:08:58.044474 22502 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:58.046788 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 863) took 1040 ms. Trace:
I20260709 13:08:58.051508 26967 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:58.057166 22580 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
W20260709 13:08:58.059396 27053 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.450s	user 0.011s	sys 0.009s
I20260709 13:08:58.062393 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2659) took 1332 ms. Trace:
I20260709 13:08:58.063583 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:58.149464 23262 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.064229 26786 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:58.124297 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 314350us
W20260709 13:08:58.129933 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 224054us
W20260709 13:08:58.132534 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 170929us
I20260709 13:08:58.126675 26755 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.139703 22501 rpcz_store.cc:276] 0709 13:08:56.729215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.988135 (+258920us) service_pool.cc:224] Handling call
0709 13:08:57.007700 (+ 19565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:57.412289 (+404589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.412329 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:57.467245 (+ 54916us) log.cc:844] Serialized 52 byte log entry
0709 13:08:57.832045 (+364800us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:57.832099 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.832197 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.036527 (+204330us) raft_consensus.cc:1685] finished
0709 13:08:58.036550 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.036692 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237374,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":31762,"thread_start_us":664193,"threads_started":2,"wal-append.queue_time_us":472685}
I20260709 13:08:58.147342 22499 rpcz_store.cc:276] 0709 13:08:56.729507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.031870 (+302363us) service_pool.cc:224] Handling call
0709 13:08:57.032252 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.037040 (+  4788us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:57.382808 (+345768us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.860450 (+477642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.860507 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:57.860554 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.062084 (+201530us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5400108454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:58.062144 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.062319 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":379611,"prepare.run_cpu_time_us":254,"prepare.run_wall_time_us":3246,"raft.queue_time_us":78,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":4422,"spinlock_wait_cycles":10384256,"thread_start_us":802494,"threads_started":2,"wal-append.queue_time_us":582243}
I20260709 13:08:58.141858 22645 rpcz_store.cc:276] 0709 13:08:57.006708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.249339 (+242631us) service_pool.cc:224] Handling call
0709 13:08:57.249640 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.283007 (+ 33367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.283054 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.333277 (+ 50223us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.672884 (+339607us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:57.672944 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.673033 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.046531 (+373498us) raft_consensus.cc:1685] finished
0709 13:08:58.046554 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.046724 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8733,"raft.queue_time_us":21335,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":32549,"thread_start_us":303484,"threads_started":1,"wal-append.queue_time_us":482151}
W20260709 13:08:58.154490 27077 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.769s	user 0.021s	sys 0.000s
I20260709 13:08:58.150272 26928 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:58.187906 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 416752us
I20260709 13:08:58.152671 27066 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:58.103936 27116 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.194830 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.186096 26712 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.199689 23262 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:58.089700 27085 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.189672 27077 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.202858 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 861) took 1424 ms. Trace:
I20260709 13:08:58.207720 26695 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:58.236179 22469 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:58.201829 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.143412 27122 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.233127 22651 rpcz_store.cc:276] 0709 13:08:56.778151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.114596 (+336445us) service_pool.cc:224] Handling call
0709 13:08:57.137032 (+ 22436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.223652 (+ 86620us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:57.223698 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.259832 (+ 36134us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.620526 (+360694us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:57.620569 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.620642 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.202556 (+581914us) raft_consensus.cc:1685] finished
0709 13:08:58.202588 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.202782 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25754,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3806,"thread_start_us":295542,"threads_started":1,"wal-append.queue_time_us":517676}
I20260709 13:08:58.239104 27118 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:58.240521 27046 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:58.243539 27046 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:58.244167 26786 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:58.244820 26786 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.244546 27046 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:58.248771 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63036.8us
I20260709 13:08:58.259358 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:58.262413 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67629.6us
I20260709 13:08:58.249732 27048 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:58.267191 27048 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:58.268219 27048 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.269315 27048 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.272481 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:58.266305 27051 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.652s	user 0.004s	sys 0.004s
I20260709 13:08:58.263805 27118 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:58.265399 27061 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.652s	user 0.000s	sys 0.014s
I20260709 13:08:58.250905 27084 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.274080 27116 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:58.260958 27111 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:58.290315 27122 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:58.290511 26867 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:58.290987 26867 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.291380 26867 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.293043 22505 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:58.284112 27118 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:58.293386 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 851) took 1635 ms. Trace:
I20260709 13:08:58.293562 27084 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:58.293862 27118 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:58.294466 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 855) took 1631 ms. Trace:
I20260709 13:08:58.295055 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2278) took 1240 ms. Trace:
I20260709 13:08:58.294857 27118 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.296986 26999 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:58.298156 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 849) took 1671 ms. Trace:
I20260709 13:08:58.291539 22498 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:08:58.290234 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 1.17872e+06us
I20260709 13:08:58.300631 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 858) took 1636 ms. Trace:
I20260709 13:08:58.302253 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:58.295387 22571 rpcz_store.cc:276] 0709 13:08:57.054949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.055113 (+   164us) service_pool.cc:224] Handling call
0709 13:08:57.069656 (+ 14543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.116996 (+ 47340us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:57.454831 (+337835us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.820110 (+365279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.820179 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:57.820249 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.294835 (+474586us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b540027a1d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:08:58.294886 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.295002 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29711,"prepare.queue_time_us":367634,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":64395,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5283,"spinlock_wait_cycles":119675648,"thread_start_us":587426,"threads_started":2,"wal-append.queue_time_us":438894}
I20260709 13:08:58.294867 22652 rpcz_store.cc:276] 0709 13:08:56.662891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.680208 (+ 17317us) service_pool.cc:224] Handling call
0709 13:08:56.680521 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.713157 (+ 32636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.713190 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:56.725459 (+ 12269us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.114455 (+388996us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:57.307287 (+192832us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.294150 (+986863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.294229 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.294272 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:58.294290 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.294413 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1051632,"prepare.queue_time_us":137844,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":1012371,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":8064,"thread_start_us":436774,"threads_started":2,"wal-append.queue_time_us":562500}
I20260709 13:08:58.298552 22649 rpcz_store.cc:276] 0709 13:08:56.626650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.636065 (+  9415us) service_pool.cc:224] Handling call
0709 13:08:56.658387 (+ 22322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:56.690992 (+ 32605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.691023 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:56.698146 (+  7123us) log.cc:844] Serialized 52 byte log entry
0709 13:08:57.055803 (+357657us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:57.381072 (+325269us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.297863 (+916791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.297936 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.297973 (+    37us) raft_consensus.cc:1685] finished
0709 13:08:58.297983 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.298102 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":956725,"prepare.queue_time_us":196257,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":18217,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7589,"thread_start_us":547708,"threads_started":2,"wal-append.queue_time_us":410275}
I20260709 13:08:58.288769 26601 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:08:58.306118 27009 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.306939 26601 tablet_bootstrap.cc:492] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:08:58.306690 27009 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.307804 26601 ts_tablet_manager.cc:1403] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 2.407s	user 0.054s	sys 0.030s
I20260709 13:08:58.308516 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.308945 27009 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:58.309388 22650 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:08:58.301229 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.301045 22653 rpcz_store.cc:276] 0709 13:08:56.663742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.681552 (+ 17810us) service_pool.cc:224] Handling call
0709 13:08:56.681922 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:56.715084 (+ 33162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.715114 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:56.741758 (+ 26644us) log.cc:844] Serialized 52 byte log entry
0709 13:08:57.000569 (+258811us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:57.244583 (+244014us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.258920 (+ 14337us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.288558 (+1029638us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b18002a1120. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:08:58.288888 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.289036 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.300422 (+ 11386us) raft_consensus.cc:1685] finished
0709 13:08:58.300442 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.300568 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1061802,"prepare.queue_time_us":254631,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":7899,"raft.queue_time_us":1057484,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":23343,"spinlock_wait_cycles":25113728,"thread_start_us":465002,"threads_started":2,"wal-append.queue_time_us":387719}
I20260709 13:08:58.306061 27066 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.293829 22646 rpcz_store.cc:276] 0709 13:08:56.658275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.659103 (+   828us) service_pool.cc:224] Handling call
0709 13:08:56.673913 (+ 14810us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:56.702114 (+ 28201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.702158 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:56.716182 (+ 14024us) log.cc:844] Serialized 52 byte log entry
0709 13:08:57.023925 (+307743us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:57.292012 (+268087us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.293044 (+1001032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.293124 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.293165 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:58.293177 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.293329 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1034831,"prepare.queue_time_us":227913,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1033641,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":10496,"thread_start_us":496978,"threads_started":2,"wal-append.queue_time_us":403852}
I20260709 13:08:58.341120 22652 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:58.342300 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.311286 23262 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:58.345326 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.345854 22645 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:58.346722 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:58.347318 23258 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:08:58.349252 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.352177 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.353005 22651 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:58.356189 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.310156 27058 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:58.357045 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.328066 26832 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:58.370324 27126 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:08:58.370553 26976 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:58.348369 27122 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.337008 27009 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:58.344606 27066 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.309819 27127 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:08:58.353060 26861 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.362506 27000 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.396801 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:58.411588 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 122555us
I20260709 13:08:58.380681 26999 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:58.381896 27007 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.417073 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.371179 26976 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.420433 22651 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:58.416169 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:58.420789 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45458.8us
I20260709 13:08:58.423203 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.422511 22650 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:58.360734 26786 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.432766 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.434037 22650 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:58.431388 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.441962 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.375239 26832 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.419209 26999 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.453220 26999 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:58.457214 22649 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.428243 27085 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:58.462011 26976 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:58.462183 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.462692 26976 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.463016 22650 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:58.463208 26976 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.464112 27116 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:58.464527 27116 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.464896 27116 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.363440 27058 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.469026 27046 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:58.459647 26601 raft_consensus.cc:359] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f [term 9 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.471201 26601 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:08:58.471987 26601 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:08:58.448342 27128 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:08:58.473367 27125 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:58.478485 27100 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:58.479007 27100 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:58.478855 26828 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:58.479687 26828 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:58.480077 26828 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:58.479831 27100 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.481479 27085 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:58.481953 26928 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.482462 26928 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:58.482923 27129 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:58.483321 27129 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:58.484175 27129 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.463940 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.485453 27129 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:58.485548 22650 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:58.417562 27122 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:08:58.486728 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.487368 22650 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:58.488222 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.488322 26976 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:58.387852 27009 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.452158 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 864) took 1376 ms. Trace:
I20260709 13:08:58.489192 22648 rpcz_store.cc:276] 0709 13:08:57.075576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.282649 (+207073us) service_pool.cc:224] Handling call
0709 13:08:57.324275 (+ 41626us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:58.295425 (+971150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.295456 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:58.296296 (+   840us) log.cc:844] Serialized 52 byte log entry
0709 13:08:58.348963 (+ 52667us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:58.349030 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.349129 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.451906 (+102777us) raft_consensus.cc:1685] finished
0709 13:08:58.451932 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.452093 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":970690,"raft.queue_time_us":972837,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":52188,"threads_started":1,"wal-append.queue_time_us":123810}
I20260709 13:08:58.490556 27009 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:58.491137 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.491233 27009 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:58.493362 26828 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.494675 26786 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:58.495782 26740 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.001s
I20260709 13:08:58.400195 26861 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.497304 26805 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:58.497844 26805 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:58.412811 27000 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:08:58.498761 26805 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.424818 27007 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.505745 22652 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:58.469118 26867 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:58.472837 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.450917 26832 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:58.511984 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88864.1us
I20260709 13:08:58.513682 22645 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:08:58.503027 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.492370 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.459718 22618 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:58.505139 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.515300 22650 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.510093 22651 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:58.516633 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:58.517314 23260 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:58.518841 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:58.459837 27111 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:58.488974 26976 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:58.459683 26995 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:58.494712 26828 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:58.526527 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:58.517349 27100 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.563169 27084 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:58.563670 26867 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:58.564190 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:08:58.571818 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 112168us
I20260709 13:08:58.572832 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.574555 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.565495 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:08:58.522420 27041 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 13:08:58.524504 27111 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.579876 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:58.578964 22648 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:58.525390 27000 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:08:58.529604 26995 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:58.581523 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:58.582993 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.584115 27145 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:58.584256 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.585201 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:58.595048 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 616210us
I20260709 13:08:58.596027 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:58.585873 26855 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:58.589195 26601 ts_tablet_manager.cc:1434] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.264s	user 0.009s	sys 0.000s
I20260709 13:08:58.581357 27111 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:58.591800 22649 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:58.592423 27077 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:58.598055 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 84968.7us
I20260709 13:08:58.579051 27046 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:58.579234 27009 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:58.613984 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 461209us
I20260709 13:08:58.614176 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:58.609328 26976 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:58.608634 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.626915 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.614094 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.601861 27084 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:58.635936 22650 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:58.597810 27000 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:58.608455 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 299317us
I20260709 13:08:58.625491 22571 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:58.591835 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.642829 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:58.645232 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49352.6us
I20260709 13:08:58.647344 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:58.648169 22572 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.649358 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:08:58.645267 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:58.650240 23262 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.650748 22578 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:58.659091 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.600834 26832 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:58.627637 27063 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.609477 27122 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:58.618052 27149 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.611320 27085 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:08:58.702273 22575 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:58.688975 22574 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:58.700332 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83480.1us
I20260709 13:08:58.646775 26867 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.660676 27145 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:58.706780 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.693183 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:58.665839 27058 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:08:58.722836 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 96022.4us
W20260709 13:08:58.723275 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.721832 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 79076.9us
I20260709 13:08:58.712618 26932 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.693598 27137 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.641588 26999 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.726824 27152 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:58.745398 23262 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:08:58.717212 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.748448 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.715395 26847 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.698734 27046 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.710716 27153 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:58.684921 26967 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:08:58.696749 27130 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:58.708361 27041 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:58.733183 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.734104 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.697103 27150 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:58.765053 22572 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:08:58.792588 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:58.804143 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.743875 27129 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:58.799309 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:08:58.800376 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66415.9us
I20260709 13:08:58.749522 27007 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:58.813576 22648 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:58.814762 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.745990 27152 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.747201 27145 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:58.805635 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:58.819833 22653 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:58.804455 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 860) took 2106 ms. Trace:
I20260709 13:08:58.775362 27097 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:58.808300 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:58.808748 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.717667 27009 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:08:58.747638 26805 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:58.774187 26317 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:58.689208 26995 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.775532 26867 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:58.825960 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.835623 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.836454 22503 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:08:58.744601 26932 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.821004 22654 rpcz_store.cc:276] 0709 13:08:56.698488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.813418 (+114930us) service_pool.cc:224] Handling call
0709 13:08:56.813738 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.814156 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:57.057000 (+242844us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.298770 (+1241770us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.343188 (+ 44418us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.343346 (+   158us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:58.497011 (+153665us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4800190158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:08:58.609607 (+112596us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.781741 (+172134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.781858 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.804260 (+ 22402us) raft_consensus.cc:1685] finished
0709 13:08:58.804281 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.804404 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":992565,"prepare.queue_time_us":608764,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":115,"raft.queue_time_us":1001071,"raft.run_cpu_time_us":2316,"raft.run_wall_time_us":221234,"spinlock_wait_cycles":33957120,"thread_start_us":934807,"threads_started":4,"wal-append.queue_time_us":384410}
I20260709 13:08:58.807559 27041 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:58.809851 27129 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:58.761688 26847 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.774760 27046 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.864163 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.867727 22500 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:08:58.850809 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.851733 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.868896 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:58.826489 27152 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:58.823297 26786 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:58.856360 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.856483 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.837596 26498 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:58.706817 27063 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.869769 22571 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:58.870728 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.832528 26317 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.872218 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.889842 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:58.872627 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.832896 26747 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:58.753294 26976 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.717286 27149 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.860551 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.880024 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.750384 27137 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:58.843257 27097 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:58.884022 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.918520 22579 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:08:58.888559 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.889159 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.894709 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:58.789386 27153 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:58.905049 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 151571us
I20260709 13:08:58.913024 22572 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:08:58.875206 26378 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:58.857743 27114 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.919795 22576 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:08:58.875663 27162 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:58.927649 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 182624us
I20260709 13:08:58.884021 27150 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:58.928678 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 77961.2us
I20260709 13:08:58.897629 26317 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.921200 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.897132 26832 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:58.940470 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:58.910741 27118 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.907115 26867 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:58.931741 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:08:58.922097 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 307783us
I20260709 13:08:58.933481 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.935060 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:58.947566 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:58.939447 23260 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:58.949589 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:58.906863 26571 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:58.893184 27116 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.892002 26498 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.973131 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.974623 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.927404 26378 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:58.975322 26378 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:58.957276 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.930773 26747 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:58.977506 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44138.3us
I20260709 13:08:58.959781 26740 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:58.961026 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.961979 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:58.963029 22576 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:58.954738 27085 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:58.965392 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-0328fc7e60424283b5d1ea734bd5136a received from {username='slave'} at 127.0.0.1:37482
W20260709 13:08:58.966329 27159 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:58.966805 27166 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:58.967080 27157 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:08:58.967873 27156 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:08:58.969151 27131 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.162s
I20260709 13:08:58.971320 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:58.933087 27082 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.935629 26861 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:58.928851 27129 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:58.948135 26975 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:59.097491 22573 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
W20260709 13:08:59.065438 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52091.2us
I20260709 13:08:59.101156 26571 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.980006 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:58.955240 27062 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:59.100203 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:08:59.073568 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 125687us
I20260709 13:08:59.042034 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:08:59.115252 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 135366us
I20260709 13:08:58.936676 27120 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:59.107357 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:59.066526 26999 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:59.109148 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:59.128620 22500 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:08:58.975287 22502 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:58.955039 26786 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:59.098767 26828 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.001s
I20260709 13:08:59.110316 26571 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.112366 27163 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:58.978518 27072 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:59.097532 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 140366us
I20260709 13:08:58.974951 26498 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.011622 27162 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:59.108419 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:59.125605 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:59.144011 22501 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:08:59.109321 26928 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.007s
I20260709 13:08:59.109824 26740 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:59.113704 27166 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:08:59.083210 27161 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:59.115610 27062 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.952600 27118 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.116065 26975 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:59.196136 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.197139 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:59.196976 26975 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.198083 27118 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.199239 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:59.131836 27129 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:59.201287 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.196156 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.200448 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.143837 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:59.139354 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:08:59.205471 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66249.6us
I20260709 13:08:59.170390 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.132215 26867 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.049628 27041 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.213922 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.102216 27097 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.123865 27120 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.137706 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-0328fc7e60424283b5d1ea734bd5136a on tablet 0328fc7e60424283b5d1ea734bd5136a with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:08:59.152016 27137 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.152622 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:59.153100 27116 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.104013 27082 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.153550 27153 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:59.154102 27160 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:59.142294 27072 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.947144 27150 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:59.131932 27158 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.300s	user 0.001s	sys 0.001s
I20260709 13:08:59.159124 27009 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:59.159399 26967 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:59.159991 27164 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:59.105348 27085 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.162263 26861 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:59.046906 26747 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.246122 27120 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:59.174916 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.193892 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.148907 27146 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:59.207193 22571 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:59.211926 22577 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:08:59.156713 27000 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.000s
I20260709 13:08:59.221943 26317 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.223157 26378 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.169168 26786 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:59.240037 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 123917us
I20260709 13:08:58.945585 27145 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.243557 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.214995 27152 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.247494 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.200317 27062 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.327536 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:08:59.293547 27009 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:59.193209 27162 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:08:59.283537 27137 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.285300 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 177999us
I20260709 13:08:59.175406 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.283398 27072 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.303030 22653 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:08:59.142048 27163 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.322732 27000 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.288988 27160 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:59.323681 22652 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
W20260709 13:08:59.243635 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 112122us
I20260709 13:08:59.173542 27046 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.329339 22573 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:08:59.303539 26967 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:59.316639 27166 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.281108 22646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1abd591408b04d32a9049743f1e89547"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:08:59.378765 22576 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:59.379247 22646 raft_consensus.cc:606] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:08:59.379596 22646 raft_consensus.cc:614] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:59.341002 27150 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:59.289887 27116 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:08:59.345614 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:59.386407 23260 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:08:59.346627 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 140299us
I20260709 13:08:59.387398 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:08:59.354148 23258 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:59.294312 26740 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.366425 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:08:59.373157 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.377041 26786 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:08:59.343847 26999 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:59.385239 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:59.394167 22651 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:59.167984 26928 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.393323 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:08:59.370867 27160 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:59.352540 27137 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:59.410295 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.420439 27082 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:08:59.402693 27111 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.776s	user 0.002s	sys 0.010s
I20260709 13:08:59.426674 22576 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:59.426703 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.424259 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.384827 27097 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.400068 27160 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:59.397396 27129 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.428121 22646 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:08:59.435317 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.397804 27046 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:59.430184 23227 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:59.396235 26999 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:08:59.417299 27100 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.003s
I20260709 13:08:59.397991 27182 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:59.446843 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:59.429391 27177 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:59.457643 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.461196 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.462196 22575 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:08:59.443570 26999 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.439957 27046 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:08:59.472205 22651 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:08:59.445840 27182 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:08:59.408576 26786 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.437119 27111 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.411942 27009 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.483268 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:59.498744 22646 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.482376 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.407990 27162 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:08:59.485983 27183 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:59.489630 27152 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.492748 27163 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:08:59.492487 27120 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.480659 27127 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:59.443277 26967 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.505143 22651 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:08:59.509800 23263 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:08:59.481204 27182 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:59.459378 27177 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:08:59.434353 27097 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.482635 27085 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:59.509003 26687 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.519121 26378 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.541879 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.542779 22651 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:08:59.520385 26747 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:59.526229 27127 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:08:59.532459 27177 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:59.550642 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 120555us
I20260709 13:08:59.523936 26317 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.557534 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:08:59.563176 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:59.575151 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2615) took 1268 ms. Trace:
I20260709 13:08:59.594938 22649 rpcz_store.cc:276] 0709 13:08:58.306904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.310453 (+  3549us) service_pool.cc:224] Handling call
0709 13:08:59.574823 (+1264370us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400298bd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:08:59.574990 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262280960}
I20260709 13:08:59.600669 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:08:59.579366 27062 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.587457 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:08:59.555413 27127 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:59.613370 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:59.545899 26687 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.619737 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:08:59.584522 26932 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:08:59.630008 22502 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:59.629942 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:59.630376 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:08:59.633687 22572 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:08:59.537039 27046 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:08:59.642416 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:59.647312 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:59.608687 27129 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:59.613421 27152 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:59.613495 27184 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.661888 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:59.650719 27129 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.646431 27116 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.653721 27137 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.676263 22651 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:59.658949 27152 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.677429 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:08:59.665843 27169 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:59.666391 27184 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:08:59.680635 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:08:59.658104 23257 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:08:59.678470 27116 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:08:59.718852 27122 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:59.696730 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:08:59.679991 27152 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.717453 27120 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:08:59.713300 27193 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:08:59.695506 27184 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.706875 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:08:59.673585 27046 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:59.681106 27169 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.675681 27129 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:08:59.871665 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 478427us
I20260709 13:09:00.420593 22572 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:00.421924 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:08:59.962321 26971 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.422933 26971 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.426424 26971 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:00.238081 22469 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.132:42571 timed out after 1.980s (SENT) [suppressed 2 similar messages]
I20260709 13:09:00.429847 27111 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:08:59.975452 27176 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.289266 22503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.018s	sys 0.031s
I20260709 13:08:59.814046 27162 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:00.641695 22503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.021s	sys 0.034s
I20260709 13:09:00.437239 22649 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:00.015308 27082 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:00.176406 27160 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.003s
I20260709 13:09:00.440124 27062 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:00.460906 27155 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.659s	user 0.003s	sys 0.002s
W20260709 13:09:00.420523 22646 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.903s	user 0.013s	sys 0.028s
I20260709 13:09:00.720633 22646 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:00.721398 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2372) took 1472 ms. Trace:
I20260709 13:09:00.380808 27205 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.487079 26786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.002s	sys 0.007s
W20260709 13:09:00.412345 27182 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.002s
W20260709 13:09:00.413805 27177 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.002s
I20260709 13:09:00.721876 22646 rpcz_store.cc:276] 0709 13:08:59.248969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.465853 (+216884us) service_pool.cc:224] Handling call
0709 13:09:00.721336 (+1255483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.507324 22572 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:08:59.852504 27173 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.960443 27072 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.006s
I20260709 13:09:00.385711 26855 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:00.637687 27122 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:00.729737 22499 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:09:00.721673 27120 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.219877 26687 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:00.015704 27198 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.713940 27009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.005s	sys 0.013s
I20260709 13:08:59.914364 27145 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:00.599992 27169 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.766607 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:00.790520 22502 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:08:59.773403 27097 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:00.773945 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:00.792057 22646 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:09:00.774612 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2297) took 1092 ms. Trace:
I20260709 13:09:00.778590 27072 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.774757 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:00.594432 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.756184 26786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.002s	sys 0.012s
I20260709 13:09:00.756546 27207 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.792837 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 881) took 1139 ms. Trace:
I20260709 13:09:00.793015 22572 rpcz_store.cc:276] 0709 13:08:59.673106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.674090 (+   984us) service_pool.cc:224] Handling call
0709 13:09:00.765240 (+1091150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.827979 22646 rpcz_store.cc:276] 0709 13:08:59.653121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.773539 (+1120418us) service_pool.cc:224] Handling call
0709 13:09:00.792775 (+ 19236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.797003 22497 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.723374 27082 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.729574 27160 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.800464 22649 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:00.834412 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 879) took 1217 ms. Trace:
I20260709 13:09:00.834959 22649 rpcz_store.cc:276] 0709 13:08:59.617115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.678739 (+ 61624us) service_pool.cc:224] Handling call
0709 13:09:00.834323 (+1155584us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:00.783836 27009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.005s	sys 0.013s
I20260709 13:09:00.706156 27085 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:00.780400 26855 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.759119 27205 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:00.856137 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 376044us
I20260709 13:09:00.769172 27182 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.794122 27145 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.864976 26855 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:00.865845 27145 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:00.841876 27208 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.778349 27173 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.777161 27177 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.858206 22497 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:00.787703 27198 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.873363 22646 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 13:09:00.715935 27176 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.870899 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:00.854977 27209 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:00.877707 22578 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:00.854740 27111 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:00.879711 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2374) took 1591 ms. Trace:
I20260709 13:09:00.894682 22646 rpcz_store.cc:276] 0709 13:08:59.288880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.857637 (+1568757us) service_pool.cc:224] Handling call
0709 13:09:00.873024 (+ 15387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:00.879323 (+  6299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.879639 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.865842 26855 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:00.889091 27122 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.845274 27085 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.731376 27162 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.911497 27162 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:00.876796 27208 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:00.890817 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 652729us
I20260709 13:09:00.891010 22572 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:00.914288 27208 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:00.877168 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 278676us
I20260709 13:09:00.886202 27182 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:00.879271 26999 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.395s	user 0.013s	sys 0.000s
I20260709 13:09:00.915977 26999 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.895692 27209 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:00.918036 27186 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.464s	user 0.007s	sys 0.029s
I20260709 13:09:00.918696 26903 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:00.919196 27209 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:00.919693 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:00.920131 27214 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:00.920310 22497 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:00.926440 27173 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:00.887849 27127 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.249s	user 0.003s	sys 0.007s
I20260709 13:09:00.889146 27116 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:00.834213 27207 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.903154 27215 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.903654 27072 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:00.899230 27111 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.904738 26855 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:00.905839 27160 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:00.906934 27152 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:00.909439 27198 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:01.030820 27152 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:00.930195 22647 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:00.934144 22497 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
W20260709 13:09:00.936993 27046 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.001s
I20260709 13:09:00.947397 26571 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:00.952077 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 870) took 2308 ms. Trace:
I20260709 13:09:00.970921 22579 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:00.974468 27211 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.552s	user 0.003s	sys 0.000s
W20260709 13:09:00.934491 27223 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:09:00.931419 27209 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.054467 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2695) took 1437 ms. Trace:
I20260709 13:09:01.054593 27209 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:01.054924 22503 rpcz_store.cc:276] 0709 13:08:59.617559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.617858 (+   299us) service_pool.cc:224] Handling call
0709 13:08:59.638704 (+ 20846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.678215 (+ 39511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.678257 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.678739 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.642193 (+963454us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:00.642253 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.642347 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.964131 (+321784us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:01.054072 (+ 89941us) raft_consensus.cc:1685] finished
0709 13:09:01.054105 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.054397 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52267,"raft.queue_time_us":78453,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7768,"spinlock_wait_cycles":107466624,"thread_start_us":955426,"threads_started":2,"wal-append.queue_time_us":713121}
I20260709 13:09:01.056907 27209 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:01.040512 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2376) took 1717 ms. Trace:
I20260709 13:09:01.057789 22647 rpcz_store.cc:276] 0709 13:08:59.323075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.922854 (+1599779us) service_pool.cc:224] Handling call
0709 13:09:00.927249 (+  4395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.040133 (+112884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.040439 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.059619 22647 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:01.060843 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2377) took 1735 ms. Trace:
I20260709 13:09:01.061347 22647 rpcz_store.cc:276] 0709 13:08:59.325406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.058769 (+1733363us) service_pool.cc:224] Handling call
0709 13:09:01.059192 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.060033 (+   841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.060779 (+   746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.062631 26999 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:01.064397 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 876) took 1689 ms. Trace:
I20260709 13:09:01.064937 22647 rpcz_store.cc:276] 0709 13:08:59.375263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.062329 (+1687066us) service_pool.cc:224] Handling call
0709 13:09:01.063238 (+   909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.063524 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.063562 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.063658 (+    96us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:01.063942 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.064018 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.064326 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.066134 27082 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:01.067148 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 877) took 1460 ms. Trace:
I20260709 13:09:01.068077 27207 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:01.069849 27085 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:01.067586 22647 rpcz_store.cc:276] 0709 13:08:59.606913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.066257 (+1459344us) service_pool.cc:224] Handling call
0709 13:09:01.066607 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.066825 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.066851 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.066890 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:01.066933 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.066986 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.067088 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.943058 27127 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.071755 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 880) took 1454 ms. Trace:
I20260709 13:09:01.072134 22654 rpcz_store.cc:276] 0709 13:08:59.617388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.070999 (+1453611us) service_pool.cc:224] Handling call
0709 13:09:01.071267 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.071437 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.071466 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.071507 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:01.071543 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.071593 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.071700 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.073570 27127 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:01.073822 27156 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.967s	user 0.010s	sys 0.015s
W20260709 13:09:01.074934 23257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 578) took 2335 ms (client timeout 1743 ms). Trace:
I20260709 13:09:01.075172 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 854) took 2598 ms. Trace:
I20260709 13:09:01.077953 27205 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:01.075685 22498 rpcz_store.cc:276] 0709 13:08:58.476527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.481191 (+  4664us) service_pool.cc:224] Handling call
0709 13:08:58.481539 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.481915 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:58.482233 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.631295 (+149062us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.638328 (+  7033us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.638492 (+   164us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:58.638523 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.638590 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.069353 (+2430763us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b240017a368. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324d09d 00007fec25e7f10e 00007fec25e9688c 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221
0709 13:09:01.074766 (+  5413us) raft_consensus.cc:1685] finished
0709 13:09:01.074908 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.075069 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4662,"prepare.queue_time_us":6909,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":5683,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":6994,"spinlock_wait_cycles":5586688,"thread_start_us":143801,"threads_started":1,"wal-append.queue_time_us":309652}
I20260709 13:09:01.079881 26855 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:01.081871 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 659973us
I20260709 13:09:01.036734 22650 rpcz_store.cc:276] 0709 13:08:58.643466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.658338 (+ 14872us) service_pool.cc:224] Handling call
0709 13:08:58.658709 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.948555 (+289846us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:58.964685 (+ 16130us) log.cc:844] Serialized 14 byte log entry
0709 13:08:59.114155 (+149470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.114214 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:59.114261 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.950163 (+1835902us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b18003a8e20. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:09:00.951685 (+  1522us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400325854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:00.951758 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.951977 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622,"prepare.queue_time_us":20014,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":733,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2793,"spinlock_wait_cycles":671208064,"thread_start_us":148391,"threads_started":1,"wal-append.queue_time_us":281422,"wal-append.run_cpu_time_us":1358,"wal-append.run_wall_time_us":1083984}
I20260709 13:09:01.071766 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 878) took 1463 ms. Trace:
I20260709 13:09:01.084297 22647 rpcz_store.cc:276] 0709 13:08:59.608755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.070778 (+1462023us) service_pool.cc:224] Handling call
0709 13:09:01.071158 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.071376 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.071413 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.071466 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:01.071511 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.071580 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.071704 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:01.075577 23257 rpcz_store.cc:269] 0709 13:08:58.739194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.739797 (+   603us) service_pool.cc:224] Handling call
0709 13:08:59.587316 (+847519us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6f8c 00007fec231d6ef6 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:09:01.074690 (+1487374us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b54006d9cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:01.074811 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93563648}
I20260709 13:09:01.093364 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:01.094302 22503 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:01.095577 27152 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.919241 26903 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.096133 23260 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:01.098462 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:01.096601 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.102099 23262 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:01.103571 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.104532 23262 raft_consensus.cc:2393] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 6: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:01.106914 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.108790 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.109931 23262 raft_consensus.cc:2410] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:01.110915 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:01.111500 23264 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:01.111759 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:01.113588 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:01.114502 22650 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:09:01.018499 27215 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.116155 22647 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:09:01.118914 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.117193 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.117635 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:01.123014 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.123950 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:01.096124 27152 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.124361 22503 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:01.647177 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:01.611053 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:01.656970 22579 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:01.657440 22502 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:01.393034 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.660240 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:01.152040 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:01.664816 22498 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:01.391285 23260 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:01.599368 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:01.475114 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:01.110381 27114 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:01.126399 22650 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:01.108081 26571 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.634s
I20260709 13:09:01.742978 26571 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:01.743623 26571 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.746115 26571 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:01.747830 27205 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:01.370594 26855 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:01.749348 26855 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:01.752844 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:01.753770 22579 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:09:01.754770 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:01.755299 22579 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:01.748458 27205 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.765129 27205 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:01.765280 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.766716 26999 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:01.767462 26999 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:01.769776 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:01.114768 27162 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.831736 22646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.014s	sys 0.052s
W20260709 13:09:01.832307 22646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.014s	sys 0.052s
I20260709 13:09:01.391554 27111 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:01.800832 27226 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:01.520978 27184 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.090s	user 0.009s	sys 0.003s
I20260709 13:09:01.800897 26855 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:01.126840 27066 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:01.808280 23264 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
I20260709 13:09:01.391862 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:01.155893 27046 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:01.797811 22579 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
W20260709 13:09:01.929091 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.930610 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:01.940780 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3311) took 2580 ms. Trace:
I20260709 13:09:01.945516 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:01.946642 22579 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:01.952576 27122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.141s	sys 0.238s
W20260709 13:09:01.956998 27122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.143s	sys 0.239s
I20260709 13:09:01.962190 26999 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:01.941840 22578 rpcz_store.cc:276] 0709 13:08:59.344041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.369523 (+ 25482us) service_pool.cc:224] Handling call
0709 13:08:59.386514 (+ 16991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.893768 (+1507254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.924150 (+1030382us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54003cafd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:01.924352 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3428971264}
I20260709 13:09:01.965430 27122 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:01.966984 27130 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:01.967500 27130 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:01.890017 27226 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.968624 27130 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:01.970353 27226 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:01.971601 22499 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.042s	sys 0.055s
W20260709 13:09:01.972429 22499 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.042s	sys 0.055s
I20260709 13:09:01.383054 26903 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:01.382958 27220 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.769320 26740 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.860451 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:01.979161 22647 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:01.697072 27176 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:01.804275 27205 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:01.810330 27114 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:01.126399 27084 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.733s
I20260709 13:09:01.913060 23264 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:01.152757 27160 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.973893 22579 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:01.854902 27162 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.977039 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:01.940672 27066 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.892343 27184 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:01.947345 27224 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:02.000787 27152 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:01.987429 26740 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.003847 26740 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:01.944360 27046 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:01.975704 27111 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:02.030018 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.031232 22648 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:09:02.035851 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 691) took 2873 ms. Trace:
I20260709 13:09:02.037578 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.038416 22654 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:02.035327 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.039718 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.040802 22648 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:02.036376 23258 rpcz_store.cc:276] 0709 13:08:59.145656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.146637 (+   981us) service_pool.cc:224] Handling call
0709 13:08:59.147001 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.388018 (+241017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.018169 (+2630151us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400680954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:02.018470 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475778816}
W20260709 13:09:02.045373 27227 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:09:01.985419 27220 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.021981 27215 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.009042 27160 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.014559 27066 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:02.070391 27120 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.290s	user 0.008s	sys 0.006s
I20260709 13:09:02.070916 27120 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:02.086385 27160 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.065907 27114 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.091497 27046 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.094367 27066 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:02.061539 27229 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:09:02.098742 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2298) took 2419 ms. Trace:
I20260709 13:09:02.099267 22497 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:02.099936 22647 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:02.099125 22572 rpcz_store.cc:276] 0709 13:08:59.677134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.913553 (+1236419us) service_pool.cc:224] Handling call
0709 13:09:00.913960 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.914309 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.914344 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.914782 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.157392 (+242610us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:01.157451 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.157551 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.096482 (+938931us) raft_consensus.cc:1685] finished
0709 13:09:02.096503 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.096759 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3202,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":242155,"threads_started":1,"wal-append.queue_time_us":1056957}
I20260709 13:09:02.105278 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.106024 22498 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:02.107735 26928 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.111493 22654 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:02.113090 22648 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:02.123986 23259 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:02.126892 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.134143 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.135756 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.136512 22504 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:02.118901 26999 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.137744 26999 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.139991 26999 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:02.141265 26928 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:02.148042 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 467652us
I20260709 13:09:02.158594 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.159508 22498 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:02.120759 27215 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.194128 22504 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:02.188833 22497 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:02.190793 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.198087 23257 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:02.198539 23257 pending_rounds.cc:85] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 9
I20260709 13:09:02.198848 23257 pending_rounds.cc:107] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:02.199107 23257 raft_consensus.cc:2889] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.206089 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.207222 22503 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:09:02.206054 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 89707.1us
I20260709 13:09:02.192116 27178 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.211923 27178 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.213798 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.214093 27178 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.156183 27111 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.214488 23257 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:02.219441 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.220116 23257 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:02.222046 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.214962 27111 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.223346 22504 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:09:02.160794 26928 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.206414 27215 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.248019 22580 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:02.248306 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:02.243046 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:09:02.252933 22573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3302) took 3080 ms (client timeout 1581 ms). Trace:
W20260709 13:09:02.237919 27206 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 2.140s	user 0.009s	sys 0.016s
W20260709 13:09:02.253566 22573 rpcz_store.cc:269] 0709 13:08:59.166527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.166666 (+   139us) service_pool.cc:224] Handling call
0709 13:09:02.246783 (+3080117us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001e5fd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:02.246964 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292544896}
I20260709 13:09:02.228780 27162 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.257747 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:02.261883 26442 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:02.263043 26442 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:02.263497 26442 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:02.249513 27205 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:02.264521 26442 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.267207 26442 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:02.267057 27205 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.271492 22504 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:02.272758 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:02.281672 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet a4afa4eec9774883a53b37419c20bbf4: Illegal state: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:09:02.283131 27169 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.455s	user 0.010s	sys 0.003s
I20260709 13:09:02.284456 27215 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.283634 27169 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.285277 26928 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.286271 27220 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.289528 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2375) took 2986 ms. Trace:
I20260709 13:09:02.290205 22646 rpcz_store.cc:276] 0709 13:08:59.303344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.899824 (+1596480us) service_pool.cc:224] Handling call
0709 13:09:00.924489 (+ 24665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.925635 (+  1146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.925683 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.926473 (+   790us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.832787 (+906314us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:02.220164 (+387377us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.289090 (+ 68926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.289203 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.289265 (+    62us) raft_consensus.cc:1685] finished
0709 13:09:02.289285 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.289450 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":429431,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":3680,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12147,"thread_start_us":1301472,"threads_started":3,"wal-append.queue_time_us":1038983}
I20260709 13:09:02.293190 27114 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.293839 27114 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.257441 27178 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:02.295269 27178 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:02.295744 27178 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.297953 27244 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.298575 27244 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.305176 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:02.314354 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.315150 22501 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:02.321503 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.334291 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.334990 22500 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:09:02.290778 26928 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.293190 26442 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.339807 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.302008 27111 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.300833 27244 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.312309 26999 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.350103 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.350517 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:02.348665 23229 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.352607 22504 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:02.351933 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:02.345585 22617 connection.cc:256] RPC call timeout handler was delayed by -1.1140058580000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 13:09:02.356763 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.357381 22654 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.357191 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.359192 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.360260 22646 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:02.341521 27169 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.363417 27168 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.354013 27245 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.392328 27168 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.392783 27168 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.392526 27245 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.344300 26442 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.394137 27184 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:02.394613 23263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 739) took 3885 ms (client timeout 1980 ms). Trace:
W20260709 13:09:02.395021 23263 rpcz_store.cc:269] 0709 13:08:58.509114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.509484 (+   370us) service_pool.cc:224] Handling call
0709 13:09:02.394422 (+3884938us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400719b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:02.394542 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419743616}
I20260709 13:09:02.362823 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.351119 26999 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.339811 27063 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.366358 27114 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.378854 27218 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.407560 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:02.382280 27235 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:02.383963 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:02.324440 27220 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:02.412257 27220 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:02.411991 27218 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.412621 27220 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:02.413502 27220 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.414276 27218 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.414692 27220 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:02.415271 27250 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:02.421576 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:02.418047 26999 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.422489 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:02.422978 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.423568 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:02.423839 22646 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:02.424728 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.425160 27063 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:02.425392 22646 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:09:02.425688 27063 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:02.426324 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.426602 27063 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.427453 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.429018 27114 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:02.429498 27114 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:02.430356 27114 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.431746 27114 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:02.433262 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 750) took 2826 ms. Trace:
I20260709 13:09:02.433651 22576 rpcz_store.cc:276] 0709 13:08:59.606732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.607156 (+   424us) service_pool.cc:224] Handling call
0709 13:08:59.621524 (+ 14368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.641436 (+ 19912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.641487 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.215153 (+2573666us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b2c00010828. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:09:02.217246 (+  2093us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.270866 (+ 53620us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:02.270925 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.271031 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.432946 (+161915us) raft_consensus.cc:1685] finished
0709 13:09:02.432967 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.433200 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15779,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7391,"spinlock_wait_cycles":9783680,"thread_start_us":33712,"threads_started":1,"wal-append.queue_time_us":119977}
W20260709 13:09:02.435565 22544 connection.cc:256] RPC call timeout handler was delayed by -1.4360185699999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:09:02.436061 22544 connection.cc:256] RPC call timeout handler was delayed by -1.1866022799999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:09:02.436100 26740 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.436738 26740 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.438915 26740 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.442167 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.390151 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.418437 23258 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:02.449321 27252 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:09:02.404970 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54528.6us
I20260709 13:09:02.420351 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2644) took 3610 ms. Trace:
I20260709 13:09:02.451012 22645 rpcz_store.cc:276] 0709 13:08:58.810064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.810758 (+   694us) service_pool.cc:224] Handling call
0709 13:08:58.811124 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.937131 (+126007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.937160 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.937198 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:58.937233 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.420135 (+3482902us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:02.420182 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.420296 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289324800}
I20260709 13:09:02.452400 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2292) took 3041 ms. Trace:
I20260709 13:09:02.405702 22654 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:02.367587 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.401429 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.411464 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.395833 26442 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.411656 27245 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.352276 27215 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:02.343379 26928 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.419880 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.427037 26903 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:02.424787 27235 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:02.452852 22580 rpcz_store.cc:276] 0709 13:08:59.411340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.411449 (+   109us) service_pool.cc:224] Handling call
0709 13:09:02.247817 (+2836368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.248493 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.452171 (+203678us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b54001e5fd0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:02.452333 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6489828608}
I20260709 13:09:02.453621 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.467532 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.468295 22654 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:02.469691 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.472189 27244 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:02.473062 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.474334 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.474985 22496 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:02.454595 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.476419 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.470930 22619 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:02.454684 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.458694 22649 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:09:02.454456 22647 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
W20260709 13:09:02.459072 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.481611 22573 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:09:02.481724 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:02.483489 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:02.421294 27131 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.462267 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:02.463075 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.482203 22573 pending_rounds.cc:85] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 6
I20260709 13:09:02.486284 22574 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:02.486634 22573 pending_rounds.cc:107] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:09:02.458076 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.486933 22573 raft_consensus.cc:2889] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.490440 22503 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:02.493984 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.494544 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.496297 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.494663 22650 raft_consensus.cc:2376] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13. Re-sending same reply.
I20260709 13:09:02.497161 22579 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
I20260709 13:09:02.489956 22502 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:02.500979 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.501638 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.501884 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.502476 22579 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:02.502599 22654 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:02.500547 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.504027 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.504534 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.456580 27130 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.455068 27247 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.458976 27250 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.526825 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.527108 22577 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:09:02.527462 22577 pending_rounds.cc:85] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 9
I20260709 13:09:02.527665 22577 pending_rounds.cc:107] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:09:02.455482 27215 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.464425 27251 raft_consensus.cc:2764] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:02.505244 22576 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:02.490631 27131 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:02.509799 22545 connection.cc:256] RPC call timeout handler was delayed by -1.301868614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:09:02.532348 22545 connection.cc:256] RPC call timeout handler was delayed by -1.2371678270000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24480000000000002s for a response
I20260709 13:09:02.532768 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.533469 22649 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
W20260709 13:09:02.533629 22545 connection.cc:256] RPC call timeout handler was delayed by -1.1272686140000587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 13:09:02.511091 22574 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:02.531258 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:02.534407 22545 connection.cc:256] RPC call timeout handler was delayed by -1.0525686140000516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:09:02.504256 27111 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:02.458009 27184 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:09:02.505345 27077 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:02.512348 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 155776us
I20260709 13:09:02.513726 22578 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:02.542346 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.543007 22578 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:02.542302 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.543825 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:02.516602 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 88d0b8c255a14106a3b00b5476896b2c: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:02.518252 27177 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:02.520254 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 54797.4us
I20260709 13:09:02.541358 27077 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.521834 27084 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:02.578840 27077 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.579380 27084 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:02.579739 27084 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:02.580562 27084 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.581817 27084 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:02.521088 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:02.521793 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2366) took 3333 ms. Trace:
I20260709 13:09:02.582571 22651 rpcz_store.cc:276] 0709 13:08:59.188321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.565957 (+377636us) service_pool.cc:224] Handling call
0709 13:08:59.610215 (+ 44258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.678326 (+ 68111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.521512 (+2843186us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b54003f0a54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:02.521725 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151364864}
I20260709 13:09:02.583803 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.458855 27240 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.584579 27240 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.458391 26928 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.522655 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.585731 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:02.586212 22650 raft_consensus.cc:2376] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15. Re-sending same reply.
I20260709 13:09:02.586882 27240 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:02.587175 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.587795 22650 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:02.506608 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:02.459149 26999 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:09:02.525585 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.531576 27250 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.589659 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:02.589922 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.590564 22646 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:02.526216 22572 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:02.591198 22651 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:02.591400 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.592203 22646 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:02.592120 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.593163 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.527885 22577 raft_consensus.cc:2889] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.557250 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2704) took 1535 ms. Trace:
I20260709 13:09:02.453888 26847 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:02.462523 27235 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:02.459578 26903 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:02.462878 27129 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.507875 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.455366 27245 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:02.597136 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.597393 27235 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.597692 27245 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.598364 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.599469 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.599833 27245 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:02.511523 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.463270 27249 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:09:02.521482 27149 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:02.549857 26995 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:02.551327 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:02.543243 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:02.553099 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.545092 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.553628 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.539258 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.475003 27244 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:09:02.557214 27168 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.565776 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.530155 27247 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.573328 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.522728 27205 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:09:02.576771 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.577039 27152 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:02.463903 27178 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.531941 27215 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:02.534435 27131 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.591142 27250 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.673964 22648 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:02.681471 23263 raft_consensus.cc:2368] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:09:02.683440 22651 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:02.683902 22651 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:02.593634 22572 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:02.506821 22647 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:02.597549 26903 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.588644 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.558149 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.697403 22645 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:02.698663 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.600724 22646 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:02.620774 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.700712 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.701277 22653 raft_consensus.cc:2376] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9. Re-sending same reply.
I20260709 13:09:02.603659 22654 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 5.
I20260709 13:09:02.605414 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.687130 22651 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.662703 27152 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:02.649940 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.710791 22651 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.650256 22652 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:02.650934 26442 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:02.665103 27254 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:02.648977 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 97795us
I20260709 13:09:02.652648 27251 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:02.653755 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 132757us
I20260709 13:09:02.732049 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:02.654263 27240 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:02.656363 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111352us
I20260709 13:09:02.735183 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.648808 22575 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:02.595525 22499 rpcz_store.cc:276] 0709 13:09:01.022008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.022308 (+   300us) service_pool.cc:224] Handling call
0709 13:09:01.026588 (+  4280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.078885 (+ 52297us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:01.972785 (+893900us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.235808 (+263023us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.236838 (+  1030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.236918 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:02.236982 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.556223 (+319241us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b18001e52c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:09:02.556997 (+   774us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b54001a9354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:02.557046 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.557191 (+   145us) inbound_call.cc:177] Queueing success response
0709 13:09:02.573785 (+ 16594us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b18001e52c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
Metrics: {"prepare.queue_time_us":1119715,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":1653,"raft.queue_time_us":6307,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":257,"spinlock_wait_cycles":146901376,"thread_start_us":1153184,"threads_started":2,"wal-append.queue_time_us":302667}
I20260709 13:09:02.599476 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.738806 22573 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:02.693560 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.714617 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.665555 26847 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:02.709589 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 173154us
I20260709 13:09:02.720112 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.720930 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.673449 27239 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:02.651757 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108615us
I20260709 13:09:02.723379 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.745641 22647 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:02.745826 22496 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:02.724432 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.746481 22497 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:09:02.725229 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.747622 22654 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:02.725886 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.649504 22649 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:02.712684 27149 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:02.663020 27260 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:02.729008 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:02.730564 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.756341 22646 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:02.732548 22544 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:02.740089 22648 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:02.741320 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:02.816308 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 83838.2us
I20260709 13:09:02.816408 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.742213 22469 leader_election.cc:400] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:09:02.817286 22469 leader_election.cc:403] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:02.817837 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:02.733271 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:02.740485 22498 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
W20260709 13:09:02.749372 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 279696us
I20260709 13:09:02.755242 27260 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:02.753067 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.708763 27259 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.728685 27254 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:02.832506 27184 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.833173 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.833098 27254 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.833817 22648 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.836440 27178 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:02.837229 27120 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:02.837709 27120 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.818554 27177 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:02.838160 27120 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.813542 27235 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:09:02.839346 27235 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:02.839709 27235 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:02.841205 27265 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:02.822307 27260 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:02.844008 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3312) took 3495 ms. Trace:
I20260709 13:09:02.844403 22571 rpcz_store.cc:276] 0709 13:08:59.348685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.348855 (+   170us) service_pool.cc:224] Handling call
0709 13:08:59.349296 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:59.389548 (+ 40252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.389576 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:59.394331 (+  4755us) log.cc:844] Serialized 52 byte log entry
0709 13:09:02.428822 (+3034491us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b18003bf680. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:02.515875 (+ 87053us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.515921 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.515995 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.843711 (+327716us) raft_consensus.cc:1685] finished
0709 13:09:02.843731 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.843950 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9577,"raft.queue_time_us":50320,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":22146,"spinlock_wait_cycles":9636736,"thread_start_us":126552,"threads_started":2,"wal-append.queue_time_us":3289852}
I20260709 13:09:02.847744 22648 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:09:02.840520 27235 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.850438 22576 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:02.850615 27235 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:02.855769 27077 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.856995 22505 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:02.857743 23264 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:02.791536 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:02.791687 22650 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:02.748148 27250 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:02.747458 26951 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:02.862079 26442 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:02.745177 27239 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:02.860577 27250 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.863608 27250 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.863461 27239 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.744999 26847 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.864702 26847 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:02.861179 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.792408 23261 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:02.811725 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.869622 22647 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:02.746716 27240 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:02.755340 27137 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:02.814076 22654 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:02.872155 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:02.815327 22651 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:02.782568 22501 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:02.743386 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:02.722986 27152 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:02.819406 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 86215.5us
W20260709 13:09:02.874406 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 131116us
I20260709 13:09:02.787799 27149 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:02.820134 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 78110.1us
W20260709 13:09:02.878855 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.821448 22652 raft_consensus.cc:2376] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15. Re-sending same reply.
I20260709 13:09:02.824543 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.825325 27263 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.825984 27249 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:02.849341 27259 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.883793 27168 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:02.870426 27177 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:02.848749 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:02.859838 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68375.4us
I20260709 13:09:02.874014 26442 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:02.785904 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.861910 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.875478 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:02.819803 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.877370 27251 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:02.875979 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:02.871672 27240 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.881204 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.877497 27137 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:02.882965 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:02.856266 27260 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:02.895551 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:02.880574 27245 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:09:02.890057 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:02.890811 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:02.786182 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:02.875563 27077 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.935307 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.894898 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.886281 22646 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:02.898938 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.936955 22649 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:02.894361 23257 raft_consensus.cc:2410] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:09:02.936592 22648 raft_consensus.cc:2410] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:09:02.939971 23259 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:02.885283 27259 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:02.939723 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.897336 26999 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:02.880113 27234 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:09:02.941793 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:02.948720 22649 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:02.949079 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:02.910079 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.942500 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.935761 27178 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:02.944723 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53960.9us
I20260709 13:09:02.945930 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.946161 22646 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:02.951985 22649 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:02.954185 23256 raft_consensus.cc:2393] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:02.944494 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.937280 26712 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:02.955513 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:02.906322 26442 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:02.943928 22571 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:02.935842 27262 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:02.967025 22652 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:02.898042 27251 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:02.893651 27249 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:09:02.974618 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:02.891776 27215 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:02.971036 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:02.945508 27066 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:02.946837 26999 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.952446 27225 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:02.985623 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:02.955302 27063 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:02.978555 26847 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:03.003566 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110788us
W20260709 13:09:03.007578 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56201.5us
I20260709 13:09:02.950136 26740 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:09:02.965655 26712 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.012378 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:02.954432 27131 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.011703 22650 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:02.976457 27251 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.013994 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.014103 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:03.011830 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56392us
I20260709 13:09:03.011430 23259 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:09:03.015161 27272 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:03.011108 23258 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:02.979336 27249 consensus_queue.cc:1243] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:02.986662 27259 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:03.003111 26999 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.021303 22501 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:03.021723 23259 pending_rounds.cc:85] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 10
I20260709 13:09:03.023403 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.004711 27176 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:02.978863 27262 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.025616 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.025817 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.034076 22579 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:03.026321 27149 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:02.980419 27244 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:09:02.981544 27265 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:09:03.032752 23259 pending_rounds.cc:107] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:09:03.034307 22496 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:03.036772 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.018333 26712 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.009924 27066 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:03.037425 23259 raft_consensus.cc:2889] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:03.042162 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.016326 26847 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.050235 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.051411 22498 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:03.056886 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.057142 22505 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:03.009295 27137 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.061281 27215 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:03.065274 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.066650 22501 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:03.071368 22499 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:03.033622 27176 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.073513 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:03.070135 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 118967us
I20260709 13:09:03.074393 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.077129 22500 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:03.075968 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:03.078186 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.079371 22505 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:09:03.056396 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45853us
I20260709 13:09:03.080760 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.081779 22496 raft_consensus.cc:2410] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:03.081789 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.049664 27271 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:03.049467 27177 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:03.087924 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.103757 22499 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.087929 27215 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:03.089794 27131 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.090129 27239 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.090689 27184 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:09:03.090881 27262 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.037734 27063 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:03.095048 23255 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:03.095867 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:03.096660 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.117638 22498 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:03.099615 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.107159 22502 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.119683 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.120738 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:03.081297 27176 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.040894 27268 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:09:03.122633 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:03.128710 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.130066 27149 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:03.108429 27234 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:03.056520 26442 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.117640 27260 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:03.147758 27254 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.121310 26755 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.149178 26755 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.150614 27254 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:03.151559 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.152184 22498 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:03.124917 27131 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:09:03.152503 23264 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:03.154001 27152 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.156216 27152 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.136255 27234 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:03.157272 27234 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:03.159570 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.160243 22496 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:03.161156 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.161218 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.161914 22505 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.162539 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.163136 22502 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.163035 27240 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.125968 26847 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:03.165141 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.165463 23229 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:03.166306 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.166543 22503 pending_rounds.cc:85] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 3
I20260709 13:09:03.166844 22503 pending_rounds.cc:107] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:09:03.167060 22503 raft_consensus.cc:2889] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:03.168273 22645 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
W20260709 13:09:03.169664 27273 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:09:03.172609 27268 consensus_queue.cc:1243] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:03.137327 27259 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.186421 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.190980 22504 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:09:03.164175 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.176749 22505 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:03.178432 27168 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:03.132941 27066 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.179054 22498 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:03.179497 26951 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.183638 27149 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:03.191921 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.199111 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.098287 27120 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.196568 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:03.203949 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:03.214251 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.205519 27254 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:03.194029 27178 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:03.192660 27168 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.196245 26847 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:09:03.218423 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:03.193053 27259 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:03.203249 26951 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.203847 27149 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:03.215690 27254 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.219609 22502 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:03.204075 26755 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:03.225476 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 180494us
I20260709 13:09:03.205947 27245 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:03.212695 27137 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:03.215663 27240 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.213152 27152 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:03.241991 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 121312us
I20260709 13:09:03.245395 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:03.223484 27168 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.261235 22651 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 7: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:03.260789 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 217544us
I20260709 13:09:03.227402 27259 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.220841 27244 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:09:03.217639 27251 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:03.269026 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.277357 22646 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.236112 27254 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.244774 27220 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:03.298012 22468 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.520s (SENT)
I20260709 13:09:03.227438 27250 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.220031 26999 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.245385 23227 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.270020 27137 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:03.321017 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75716.9us
I20260709 13:09:03.323885 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:03.243571 27225 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:03.312132 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:03.328895 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:03.296839 27240 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:03.303696 27244 consensus_queue.cc:1243] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:03.341401 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.345908 22647 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:03.346084 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:03.350534 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.351505 22576 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.353331 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.354290 22571 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:03.304816 27152 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:03.367887 22580 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.325083 26755 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:03.260406 27178 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.372438 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.378269 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.370821 22645 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.336254 27284 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.370117 27147 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:03.369268 27280 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.316638 27149 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.398406 27284 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:03.411866 27284 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.384744 27268 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:03.416455 27268 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:03.417392 27268 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.417923 27225 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:03.426234 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.418507 27268 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.447292 27250 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:03.447824 27277 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:03.406092 27147 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.453548 27147 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:03.420266 27137 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.422875 27280 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.456583 27280 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:03.458787 23255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 744) took 2353 ms (client timeout 1516 ms). Trace:
W20260709 13:09:03.459419 23255 rpcz_store.cc:269] 0709 13:09:01.106036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.107847 (+  1811us) service_pool.cc:224] Handling call
0709 13:09:03.458511 (+2350664us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54008359d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:03.458672 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684706688}
I20260709 13:09:03.460089 27247 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.405081 27120 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.459439 26995 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:03.461979 26995 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:03.462263 27249 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:03.462743 27249 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:03.462859 26995 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.463689 27249 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.473881 27184 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.474742 27184 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:03.476665 22468 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.699s (SENT)
I20260709 13:09:03.376582 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:09:03.521548 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44914.4us
W20260709 13:09:03.521600 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 307433us
I20260709 13:09:03.523597 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.535290 22576 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:09:03.539927 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 163436us
I20260709 13:09:03.541041 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.547528 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.549753 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:03.551244 22645 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:03.544272 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.553467 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:03.557268 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.405295 27166 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 13:09:03.573199 27220 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:03.553968 26995 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.577752 27247 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:03.554670 27281 raft_consensus.cc:2764] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:03.578931 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.573812 27220 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.557955 22576 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.559219 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.560603 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.544691 27290 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:03.587677 27290 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:03.588979 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:03.478093 27152 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.593420 27168 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.594748 23262 raft_consensus.cc:2368] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10.
W20260709 13:09:03.595054 26712 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
W20260709 13:09:03.563153 27286 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:09:03.563527 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 743091us
I20260709 13:09:03.561374 26999 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:03.553447 27235 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:03.554507 26498 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:03.553285 27249 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:03.552532 27120 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:03.569682 22402 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 8 to 10, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 10 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:03.590078 22400 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 322) took 33520 ms (client timeout 15000 ms). Trace:
I20260709 13:09:03.616912 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:03.617544 22654 raft_consensus.cc:606] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.617890 22654 raft_consensus.cc:614] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:03.595466 26712 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.565603 27176 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.602406 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.618247 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.604839 22576 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:03.607332 22499 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
W20260709 13:09:03.557433 27278 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
W20260709 13:09:03.593142 22468 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.527s (SENT)
I20260709 13:09:03.627048 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:03.622671 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.629719 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.630295 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.632899 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.633193 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:03.635505 22468 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.837s (SENT)
I20260709 13:09:03.635545 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.637811 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.636415 22571 raft_consensus.cc:2376] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12. Re-sending same reply.
I20260709 13:09:03.558211 27275 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:03.643242 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.643883 22575 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:03.647091 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.646281 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.651772 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:03.653764 22402 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 8 to 11, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.654512 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.611346 27235 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.655793 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.656128 22579 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:03.656534 22577 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:03.658360 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:03.659771 23257 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.660611 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:03.661578 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.662093 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.626473 27281 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.664491 22618 leader_election.cc:400] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10.
I20260709 13:09:03.664436 22619 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:03.664944 22618 leader_election.cc:403] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:03.642261 26855 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:03.645185 27275 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.644251 27239 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:03.666307 27240 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:03.689291 22577 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:03.673964 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:03.611135 27290 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:09:03.690718 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.660316 27244 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:03.667150 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 319744us
I20260709 13:09:03.663038 27250 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:03.663466 26999 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:03.663228 27205 raft_consensus.cc:2764] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:03.660458 27235 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:03.674165 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:03.626533 26951 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.689067 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:03.694965 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:03.639479 27245 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:03.699252 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:03.668818 27137 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:03.616001 22400 rpcz_store.cc:269] 0709 13:08:30.069901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.075722 (+  5821us) service_pool.cc:224] Handling call
0709 13:09:03.589904 (+33514182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:57.104623 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:57.145526 (+ 40903us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:57.145591 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:08:57.145615 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:57.146369 (+   754us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:57.146465 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:57.146492 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:57.147034 (+   542us) tablet.cc:701] Row locks acquired
0709 13:08:57.147062 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:08:57.147254 (+   192us) write_op.cc:270] Start()
0709 13:08:57.147408 (+   154us) write_op.cc:276] Timestamp: P: 1783602537147182 usec, L: 0
0709 13:08:57.147445 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:08:57.246600 (+ 99155us) log.cc:844] Serialized 1713 byte log entry
0709 13:08:58.128374 (+881774us) op_driver.cc:464] REPLICATION: finished
0709 13:08:58.330927 (+202553us) write_op.cc:301] APPLY: starting
0709 13:08:58.339557 (+  8630us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:58.480659 (+141102us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:58.480784 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:58.837322 (+356538us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:58.923909 (+ 86587us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:58.931243 (+  7334us) write_op.cc:312] APPLY: finished
0709 13:08:58.968328 (+ 37085us) log.cc:844] Serialized 49 byte log entry
0709 13:08:58.968550 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.968650 (+   100us) write_op.cc:454] Released schema lock
0709 13:08:58.968717 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:58.969161 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.969199 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3330176,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":148424,"apply.run_cpu_time_us":15537,"apply.run_wall_time_us":679876,"cfile_cache_hit":14,"cfile_cache_hit_bytes":14644,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":1247,"lbm_reads_lt_1ms":12,"num_ops":4,"prepare.queue_time_us":401986,"prepare.run_cpu_time_us":78384,"prepare.run_wall_time_us":564361,"raft.queue_time_us":60973,"raft.run_cpu_time_us":12961,"raft.run_wall_time_us":108278,"replication_time_us":980737,"thread_start_us":482137,"threads_started":4,"wal-append.queue_time_us":527436,"wal-append.run_cpu_time_us":13918,"wal-append.run_wall_time_us":2201699}]]}
I20260709 13:09:03.704772 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.671594 27281 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.670586 27294 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:03.715567 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:03.716086 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:03.698091 27250 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:03.727257 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.725993 22501 raft_consensus.cc:1217] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-11.6]   Dedup: 6.4->[8.5-11.6]
I20260709 13:09:03.786455 22501 pending_rounds.cc:85] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 4
I20260709 13:09:03.786860 22501 pending_rounds.cc:107] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:09:03.787096 22501 raft_consensus.cc:2889] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:03.787310 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 129055us
I20260709 13:09:03.783164 22575 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:03.788617 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.659523 27288 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:09:03.673183 27292 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:03.712183 22402 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.667106 27251 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:03.740172 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.825716 22497 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:03.712543 27289 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:09:03.847173 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:03.746347 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:03.723320 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.848188 22496 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.848345 22646 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:03.701033 27275 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:03.715051 27265 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.861048 27280 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.713713 27149 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:03.742403 27152 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:09:03.688531 27239 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.706955 27205 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:03.820960 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:03.844404 27316 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:03.874490 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.875191 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.863806 27147 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.875192 22580 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:03.877125 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.877585 27147 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.739446 26755 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:03.845759 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:03.833491 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 176854us
I20260709 13:09:03.845275 27137 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:03.703356 27048 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:09:03.824797 27198 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.784814 27225 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 13:09:03.857050 27234 consensus_meta.cc:287] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.699s	user 0.020s	sys 0.018s
I20260709 13:09:03.792631 27250 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.858013 27176 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.739504 27220 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.869334 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "384f494818f741d1bb257daeaab933f2"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:03.903148 22650 raft_consensus.cc:606] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:03.903609 22650 raft_consensus.cc:614] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:03.846422 22402 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:03.870854 22497 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:03.875792 22575 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:09:03.851540 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63003.2us
I20260709 13:09:03.878185 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.878778 22577 raft_consensus.cc:2368] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:09:03.880255 22573 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:03.821934 27184 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.861526 26712 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.884975 27316 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.863255 27280 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.900645 27234 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.899818 27205 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:03.898257 27198 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:03.921603 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.921885 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.926940 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.933547 22577 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:09:03.921619 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.907197 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.922384 22402 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.942554 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.937023 22496 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
W20260709 13:09:03.936080 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.945923 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:03.904949 27254 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.006s
I20260709 13:09:03.932287 23229 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:03.927235 22502 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:03.948902 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:03.962709 22402 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 8, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 8 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.966713 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:03.970873 22503 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:09:03.971267 22503 pending_rounds.cc:85] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 6
I20260709 13:09:03.971514 22503 pending_rounds.cc:107] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:09:03.971796 22503 raft_consensus.cc:2889] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:03.972518 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.973182 22577 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:03.971530 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.904320 27168 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.973994 22498 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:03.961506 22575 raft_consensus.cc:2376] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11. Re-sending same reply.
I20260709 13:09:03.975610 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:03.909909 26951 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.977193 22497 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:03.983896 22497 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:03.919417 27220 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.979350 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:03.915313 27239 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:03.976328 26712 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:03.963176 27184 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:03.985308 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:04.006281 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:03.918134 26847 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.010701 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:03.988941 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:04.011543 22652 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:03.920837 27234 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:03.991375 22498 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:03.915423 27292 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:03.925750 27198 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:03.993302 22653 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:04.015043 22574 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:04.015453 23264 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:03.977746 22402 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.994145 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:03.994774 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:03.989974 22497 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.019313 22497 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.916806 27235 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.992444 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.007477 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:04.007946 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:04.009186 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:04.010434 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.022100 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:03.971603 27178 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:04.012184 26951 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:03.992240 27318 raft_consensus.cc:2764] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:09:04.026175 23263 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:04.028663 22578 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:04.025163 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:04.034719 22574 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:04.030988 22577 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:03.917217 27316 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:03.976629 27225 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:09:04.027799 27275 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.047250 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:03.923569 27205 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.048055 22402 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 11, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.014230 26712 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:04.076165 26712 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.033413 27239 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:03.971943 27254 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.003718 27184 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:03.923413 27137 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.050364 22402 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 11, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.039886 22652 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:04.017547 26847 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.081971 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:04.035137 27048 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:04.086282 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:04.089100 27298 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.545s	user 0.004s	sys 0.000s
I20260709 13:09:04.088821 22402 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 8, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 8 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:04.093163 22572 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:09:04.094259 23256 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:04.098941 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 123401us
I20260709 13:09:04.099817 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:04.079367 27239 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:04.087131 27162 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:04.092165 27259 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.011s
I20260709 13:09:04.082353 27276 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.100793 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 704) took 1155 ms. Trace:
I20260709 13:09:04.128829 23257 rpcz_store.cc:276] 0709 13:09:02.944996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.950284 (+  5288us) service_pool.cc:224] Handling call
0709 13:09:02.950558 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.663805 (+713247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.100568 (+436763us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54006d9cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:04.100732 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622284544}
I20260709 13:09:04.042855 26951 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.089808 27184 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:04.104719 22402 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:04.088218 27240 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:04.110754 26755 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:04.113379 27305 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:09:04.114210 26847 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:04.117377 23255 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:04.117769 27292 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.118924 27114 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:04.097136 27048 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.119845 27178 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:04.121997 22647 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
W20260709 13:09:04.124372 27284 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.004s
I20260709 13:09:04.148720 26687 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:04.125958 27254 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:04.134439 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:04.080494 22497 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:09:04.194181 22497 pending_rounds.cc:85] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 6
I20260709 13:09:04.193432 22402 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 9, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 9 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:04.194475 22497 pending_rounds.cc:107] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:09:04.194809 22497 raft_consensus.cc:2889] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:04.195189 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 60833.4us
I20260709 13:09:04.105260 27239 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:04.164250 22647 pending_rounds.cc:85] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 10
I20260709 13:09:04.271534 22647 pending_rounds.cc:107] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:09:04.271811 22647 raft_consensus.cc:2889] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.272997 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.273975 22578 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:04.124089 27250 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.140679 27120 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:09:04.185521 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.151906 26755 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:04.227185 22654 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:04.228986 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 5c413dbaae364e3a919a92c57b6216ba: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:04.229465 27271 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:04.301823 27275 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:04.303771 27320 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:09:04.305251 27250 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:04.238178 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:04.242163 27235 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:04.243825 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.170044 27323 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:04.244760 26855 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:04.249711 27066 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:04.326486 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:04.262147 22498 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:04.264056 22652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:04.327666 22652 raft_consensus.cc:606] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:04.255473 27307 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:04.269496 27177 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:04.134460 27259 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.275549 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.155788 27240 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:04.279014 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.362629 22580 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:04.185338 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:04.362999 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.364816 22578 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:04.158866 27114 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:04.283599 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.283059 22402 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.183827 26687 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:04.405277 22648 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:04.328200 27322 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:04.272423 27319 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.241s	user 0.000s	sys 0.002s
I20260709 13:09:04.299932 22653 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:09:04.301270 26755 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.243453 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:04.310482 22572 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:09:04.310889 22649 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:04.315295 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.136761 27276 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.319672 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:04.320925 22501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.029s
I20260709 13:09:04.419993 22575 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:04.420213 22501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.010s	sys 0.029s
I20260709 13:09:04.318599 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.326629 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.424400 22577 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:04.328019 22652 raft_consensus.cc:614] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:04.426255 22652 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:04.268839 27281 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:04.333076 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:04.340107 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:04.435016 22647 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:04.273556 26498 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:04.314674 27265 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10.
I20260709 13:09:04.193070 27284 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.325291 27066 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:04.387257 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.293457 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.449673 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:04.413705 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.451339 26951 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:04.415681 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:04.433135 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.452875 22575 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:04.454021 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:09:04.434291 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 401fe414b8f443bebfed8254895d71c3: Illegal state: Replica 6ca917eaada84bf38a5daae9f8ffa066 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:04.434914 22645 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:04.461284 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:04.464095 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:04.464937 22498 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:04.435511 22402 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.437918 22652 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:04.406561 27290 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:04.471181 27048 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:04.428941 27316 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:04.453467 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:04.481560 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:04.444550 27318 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:04.497776 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43829.6us
I20260709 13:09:04.483291 23258 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:04.498119 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.418036 27322 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.448841 27259 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:04.517279 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44861.4us
I20260709 13:09:04.526008 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:04.501114 27295 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:04.476112 27149 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.572342 22647 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
W20260709 13:09:04.572840 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45381.9us
I20260709 13:09:04.495235 22645 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
W20260709 13:09:04.582353 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.573323 22402 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 10 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:04.505203 27265 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:04.600492 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:04.497648 27318 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:04.548425 27296 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:09:04.570698 27307 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.610417 22575 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:09:04.571501 26995 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:04.646981 26995 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:04.616050 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 529789us
I20260709 13:09:04.600057 27314 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:04.520534 22646 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:04.478120 27114 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.624612 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:04.633383 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:04.607630 27316 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:04.480719 27290 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.579993 27166 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:09:04.615271 27286 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:09:04.638237 22498 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:04.640125 22402 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:04.648473 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:04.691412 22579 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:04.611472 26498 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:09:04.514637 27240 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:04.619969 26712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.011s
I20260709 13:09:04.663692 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.664083 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.665495 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.668138 22647 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:04.701896 22402 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 14, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 14 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:04.647581 26995 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:04.673203 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.714701 22575 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:04.643464 27329 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 13:09:04.691335 27330 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
W20260709 13:09:04.692035 27334 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:09:04.661712 27344 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.697748 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:04.705245 27323 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:04.708081 26932 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:04.704952 22645 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:04.718461 26712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.008s	sys 0.011s
I20260709 13:09:04.654105 26903 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:04.717753 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.721246 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:04.722765 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.621434 27317 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.726146 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.692644 27284 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:04.734565 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:04.598155 27066 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.669426 27265 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:04.804680 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2418) took 1139 ms. Trace:
I20260709 13:09:04.805316 22648 rpcz_store.cc:276] 0709 13:09:03.665338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.665601 (+   263us) service_pool.cc:224] Handling call
0709 13:09:04.804389 (+1138788us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:04.804603 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642634496}
I20260709 13:09:04.806947 27322 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:04.807265 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2419) took 1141 ms. Trace:
I20260709 13:09:04.741691 27344 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.807880 22651 rpcz_store.cc:276] 0709 13:09:03.665600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.665696 (+    96us) service_pool.cc:224] Handling call
0709 13:09:04.806989 (+1141293us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:04.807191 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959094528}
W20260709 13:09:04.812386 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.772843 27337 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:04.813163 22650 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:04.695986 27325 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:09:04.745975 27114 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:04.800521 27066 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:04.817842 27331 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:04.819149 27331 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:04.819497 27331 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:04.821406 22654 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:04.693943 27281 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:04.822695 27281 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:04.823768 27326 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:04.824301 27326 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:04.823729 27281 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.741943 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.650012 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:04.825366 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 175470us
I20260709 13:09:04.718158 22402 catalog_manager.cc:5697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 7 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.827029 26755 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:04.699690 27314 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:04.710807 27249 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.095s	user 0.004s	sys 0.008s
I20260709 13:09:04.827054 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:04.778407 22571 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:04.730578 27301 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:04.693830 27316 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.773227 27250 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:04.781494 22572 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:04.792608 27317 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:04.742832 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45211.6us
W20260709 13:09:04.769807 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.828050 22402 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 6, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 6 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:09:04.876399 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49416.4us
I20260709 13:09:04.877408 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:04.802238 27265 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.861776 22653 raft_consensus.cc:2410] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:04.846794 22575 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:04.901245 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.905161 22402 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.779774 27294 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:04.909462 22402 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 9, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 9 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:04.855226 27178 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:04.925876 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.920209 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:04.931068 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:04.665261 27307 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.902534 27311 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.951349 22649 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:04.940682 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:04.820341 27331 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:04.901959 27323 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:04.949016 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 505650us
I20260709 13:09:04.863719 26932 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:09:04.909533 27250 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:04.918035 27235 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:04.957746 27131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.014s	sys 0.018s
I20260709 13:09:04.946601 27244 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:04.989502 27239 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.003s
I20260709 13:09:05.011257 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:04.983598 27260 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.874007 27176 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:09:04.925462 27276 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:05.015534 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.005s	sys 0.008s
W20260709 13:09:04.986133 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 316745us
I20260709 13:09:04.921169 27294 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.924924 27325 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:09:04.961181 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:05.001994 27184 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.851s	user 0.006s	sys 0.006s
W20260709 13:09:05.097795 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 136728us
W20260709 13:09:05.068606 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75148.9us
W20260709 13:09:05.070725 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.070274 23258 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
W20260709 13:09:05.003377 27162 consensus_meta.cc:287] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.003s
I20260709 13:09:05.099419 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:05.083084 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.006s	sys 0.008s
W20260709 13:09:05.161145 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 1.06132e+06us
I20260709 13:09:05.161899 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:05.094154 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:04.994395 27048 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:09:05.089677 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:05.105388 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:04.946811 27326 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.067940 27335 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.114450 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.113065 27324 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:05.116801 23255 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:05.001202 27314 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.118876 27316 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:05.119649 27349 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.126583 27294 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:05.088634 27240 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:05.129480 27317 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:05.036448 27239 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:04.985811 27311 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.090696 26498 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:05.133600 27244 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.135473 27307 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:05.135238 27318 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:05.136852 27346 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:09:05.137045 22503 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:05.137423 27259 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.138150 27344 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:05.230192 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.230520 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.230928 22501 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:05.185144 27168 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:05.159966 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:05.162660 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.162976 22498 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:05.163760 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 64480us
I20260709 13:09:05.239060 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:04.947481 27292 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:09:05.166157 23257 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:05.166329 26847 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:05.170221 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.249359 23262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:09:05.106962 27162 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:05.179267 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 73973.5us
I20260709 13:09:05.253276 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:05.183419 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.164502 27325 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.107661 27276 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:09:05.166337 27290 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:05.108237 27184 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.172761 27333 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:05.138279 26951 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:05.169631 27215 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:05.190482 27326 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:05.244376 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:05.168046 26995 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.097781 27260 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:05.317632 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64428.7us
I20260709 13:09:05.176564 27324 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:05.327030 27346 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:09:05.327193 27355 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.232648 27244 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.373093 27290 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:05.373522 27290 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:05.374155 27184 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:05.327857 27342 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:09:05.327948 27259 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:05.374382 27290 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.375159 27354 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:09:05.375703 27355 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:05.376127 27290 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.376175 27355 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:05.364511 27333 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:05.377351 27355 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:05.329536 27327 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.709s	user 0.004s	sys 0.000s
I20260709 13:09:05.374536 27244 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:05.330868 26712 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:05.332288 27364 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:09:05.260752 26932 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:09:05.174371 27335 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.172143 27250 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:05.341645 27319 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:09:05.255827 27149 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:05.329593 27367 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:09:05.199234 27349 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.255009 27168 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:05.377969 27333 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:05.328804 27352 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:09:05.250020 27294 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
W20260709 13:09:05.361496 27353 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:09:05.356382 27249 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.367735 27356 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:05.374361 27260 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:05.371356 27325 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.431070 27356 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:05.434309 27356 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:05.428462 27362 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:09:05.442975 27335 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:05.447103 27349 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:05.457985 27311 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:05.473784 27367 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:05.171010 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:05.533595 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 362419us
I20260709 13:09:05.536473 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 907) took 1304 ms. Trace:
W20260709 13:09:05.198895 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 283275us
W20260709 13:09:05.538637 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.538450 22498 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:05.541497 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.542189 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.251341 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:05.544229 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 292804us
I20260709 13:09:05.542200 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2722) took 1569 ms. Trace:
I20260709 13:09:05.236007 22496 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:05.354300 22579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.020s	sys 0.030s
I20260709 13:09:05.550330 22504 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:05.550925 22579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.020s	sys 0.031s
W20260709 13:09:05.551349 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.537137 22497 rpcz_store.cc:276] 0709 13:09:04.231549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.233071 (+  1522us) service_pool.cc:224] Handling call
0709 13:09:04.233578 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.517966 (+284388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.518093 (+   127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.519014 (+   921us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.933138 (+414124us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:04.933536 (+   398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.933728 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.535625 (+601897us) raft_consensus.cc:1685] finished
0709 13:09:05.535709 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.536152 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44626,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":21876,"thread_start_us":696980,"threads_started":2,"wal-append.queue_time_us":588054}
W20260709 13:09:05.557154 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.013s	sys 0.031s
W20260709 13:09:05.557720 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.013s	sys 0.031s
W20260709 13:09:05.558385 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 654854us
I20260709 13:09:05.547055 22505 rpcz_store.cc:276] 0709 13:09:03.972519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.972645 (+   126us) service_pool.cc:224] Handling call
0709 13:09:03.972968 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.975165 (+  2197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.975195 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.983578 (+  8383us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.276078 (+292500us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:04.276116 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.276181 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.328909 (+1052728us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:05.541431 (+212522us) raft_consensus.cc:1685] finished
0709 13:09:05.541479 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.541992 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1836,"raft.queue_time_us":19108,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":16304,"spinlock_wait_cycles":17921920,"thread_start_us":241781,"threads_started":1,"wal-append.queue_time_us":493275}
I20260709 13:09:05.566610 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:05.381533 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 137246us
I20260709 13:09:05.380877 23256 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:05.612542 27323 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:05.616637 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.478128 27325 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:05.621399 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.622202 26999 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:05.622804 26999 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:05.207027 26498 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:05.658041 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.657588 26498 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.659942 26498 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.660308 27205 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.335398 26687 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.379328 26712 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:05.678345 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.376223 26995 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:05.366061 26442 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.225s
I20260709 13:09:05.591032 27239 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:05.626489 23263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.041s	sys 0.073s
I20260709 13:09:05.628937 22498 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
W20260709 13:09:05.630978 27383 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:09:05.627051 26999 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:05.637181 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 380662us
I20260709 13:09:05.593343 27294 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.638216 27281 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:05.641074 26847 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:05.701372 26847 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.704273 26847 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:05.645380 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 275347us
I20260709 13:09:05.649957 26903 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:05.389573 27137 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:05.709084 26903 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:05.709479 27137 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.710053 27137 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.710661 26903 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.712038 26903 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.712289 22654 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:05.419622 27249 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.713363 27184 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:05.713858 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:05.649785 27356 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:05.650950 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.653019 27331 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.662156 22505 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:05.663149 27318 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.671381 27244 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:05.673823 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.677551 27205 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:05.365203 26951 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:05.729210 27205 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.731045 26951 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.619129 27120 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.733371 27120 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.736163 27120 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:05.684756 22498 pending_rounds.cc:85] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 6
I20260709 13:09:05.690423 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.695364 26932 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:05.741112 22498 pending_rounds.cc:107] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:09:05.741420 26932 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.741580 22498 raft_consensus.cc:2889] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:05.648481 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:05.741750 22504 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:05.743088 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:05.743472 22502 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:05.732684 26951 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.741907 26932 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:05.752063 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 62316.7us
I20260709 13:09:05.647645 27168 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.708328 27333 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.720903 27244 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:05.767047 22654 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:05.767454 22497 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:05.768580 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.769100 22497 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:05.769773 22505 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:05.771775 27281 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.774260 27355 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.774381 27294 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.777954 27244 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.779889 27244 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.781535 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:05.781801 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3340) took 1495 ms. Trace:
I20260709 13:09:05.783016 27281 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:05.783389 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:05.784080 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 911) took 1524 ms. Trace:
I20260709 13:09:05.784399 27288 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.784912 27294 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:05.785050 26847 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:05.785569 26847 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.785962 26847 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.786576 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:05.787631 22577 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:05.788195 22580 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:09:05.794828 27358 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.401s	user 0.018s	sys 0.007s
I20260709 13:09:05.795650 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:05.784570 22496 rpcz_store.cc:276] 0709 13:09:04.259529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.259719 (+   190us) service_pool.cc:224] Handling call
0709 13:09:04.260191 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.548126 (+1287935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.783621 (+235495us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54001d9cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:05.783900 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2243652864}
W20260709 13:09:05.799490 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.782258 22573 rpcz_store.cc:276] 0709 13:09:04.286575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.288442 (+  1867us) service_pool.cc:224] Handling call
0709 13:09:04.288834 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.341291 (+ 52457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.341336 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.341923 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.096255 (+754332us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18000b3620. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:05.560538 (+464283us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:05.560660 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.781263 (+220603us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54003b3154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:05.781318 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.781394 (+    76us) raft_consensus.cc:1685] finished
0709 13:09:05.781408 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.781609 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40103,"raft.queue_time_us":12136,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":36374,"spinlock_wait_cycles":100733568,"thread_start_us":463628,"threads_started":1,"wal-append.queue_time_us":1089713}
I20260709 13:09:05.811110 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:05.812609 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:05.813597 26712 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.815126 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:05.817391 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 251017us
I20260709 13:09:05.819008 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3354) took 1075 ms. Trace:
I20260709 13:09:05.819528 22579 rpcz_store.cc:276] 0709 13:09:04.743552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.826323 (+ 82771us) service_pool.cc:224] Handling call
0709 13:09:04.826639 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.827034 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.827067 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.827587 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.551890 (+724303us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:05.584404 (+ 32514us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.797295 (+212891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.801009 (+  3714us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.801065 (+    56us) raft_consensus.cc:1685] finished
0709 13:09:05.801080 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.818918 (+ 17838us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113940,"prepare.queue_time_us":31583,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":202211,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":31168,"thread_start_us":723483,"threads_started":1,"wal-append.queue_time_us":578851}
I20260709 13:09:05.798910 27184 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.822239 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 915) took 1290 ms. Trace:
I20260709 13:09:05.822799 22649 rpcz_store.cc:276] 0709 13:09:04.539541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.673229 (+133688us) service_pool.cc:224] Handling call
0709 13:09:04.673554 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.957247 (+283693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.821610 (+864363us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400325854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:05.821999 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635856256}
I20260709 13:09:05.823956 27249 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:05.826609 22646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 911) took 1505 ms (client timeout 1769 ms). Trace:
W20260709 13:09:05.827209 22646 rpcz_store.cc:269] 0709 13:09:04.321355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.326229 (+  4874us) service_pool.cc:224] Handling call
0709 13:09:05.826177 (+1499948us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002daad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:05.826381 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274810624}
I20260709 13:09:05.829632 23258 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:05.830461 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:05.831243 23262 raft_consensus.cc:606] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:05.831889 27316 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.832612 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:05.833550 27316 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.834420 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:05.837280 27390 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.840030 26712 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:05.822799 27184 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.841163 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:05.841300 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:05.842335 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.842504 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79591.5us
I20260709 13:09:05.842604 27333 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:05.817608 23261 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:05.844226 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:05.824280 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.842622 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 58320.7us
I20260709 13:09:05.851375 22651 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:05.836809 22468 leader_election.cc:400] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:05.853181 22468 leader_election.cc:403] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:09:05.856338 22497 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:05.859619 22505 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:05.861483 22496 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:09:05.862958 26999 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.863301 27177 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:05.863914 27177 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:05.865336 27177 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.866835 27177 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:05.910530 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.009s	sys 0.009s
W20260709 13:09:05.911095 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.010s	sys 0.009s
W20260709 13:09:05.911278 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 74717.5us
I20260709 13:09:05.912246 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3329) took 1452 ms. Trace:
I20260709 13:09:05.913014 27326 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:05.913517 27326 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:05.914870 27326 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.916850 27386 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.917352 27387 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:05.917728 27386 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.918185 27387 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.920372 27341 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:05.921896 27341 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:05.925254 22468 connection.cc:256] RPC call timeout handler was delayed by -2.1559446439999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 13:09:05.927667 27284 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.927874 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:05.928288 27269 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:05.930859 27284 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:05.929316 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:05.932468 22576 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:05.929512 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:05.929697 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:05.934134 22573 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:05.934204 22578 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:05.935365 27168 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:05.937235 27356 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:05.937330 27220 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:09:05.989524 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.793s (SENT) [suppressed 50 similar messages]
I20260709 13:09:05.938848 27356 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:06.000430 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.002457 27176 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:06.002485 23259 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:06.008785 27376 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.009799 27328 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.013332 27324 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:06.013887 27333 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.014927 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.023161 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:06.022966 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.024638 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:06.039155 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.039759 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.041507 27328 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:06.042574 22645 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 5.
I20260709 13:09:06.042917 27176 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:06.043569 22578 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:06.044111 27328 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:06.044770 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.044932 27376 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.046727 22576 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:06.044780 27333 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.049150 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.050978 22573 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:06.053097 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:06.053714 27120 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.055222 27120 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:06.056486 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:05.991328 27220 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:06.057647 22579 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:06.057981 27220 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:06.059468 27220 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.025861 27356 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:06.026391 27205 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:05.912781 22500 rpcz_store.cc:276] 0709 13:09:04.459563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.467276 (+  7713us) service_pool.cc:224] Handling call
0709 13:09:04.467870 (+   594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.468155 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:04.949989 (+481834us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.911591 (+961602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.911739 (+   148us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:05.911819 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.911939 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.912130 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21488,"prepare.queue_time_us":670983,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":9989,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"thread_start_us":1394037,"threads_started":2}
I20260709 13:09:06.122293 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:06.130113 22504 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:06.131491 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 72273.6us
I20260709 13:09:06.123680 27168 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:06.142963 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.146268 27387 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.147949 27120 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:06.149463 22580 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:06.150709 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 913) took 1828 ms. Trace:
I20260709 13:09:06.151132 22653 rpcz_store.cc:276] 0709 13:09:04.321938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.415438 (+ 93500us) service_pool.cc:224] Handling call
0709 13:09:06.150316 (+1734878us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54002da5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:06.150538 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941152000}
I20260709 13:09:06.152598 22652 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:09:06.152999 22652 pending_rounds.cc:85] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 11
I20260709 13:09:06.153268 22652 pending_rounds.cc:107] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:09:06.153507 22579 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:09:06.153550 22652 raft_consensus.cc:2889] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.165184 22497 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 6.
W20260709 13:09:06.170454 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.171955 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 244239us
I20260709 13:09:06.173076 27120 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:06.173779 27120 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.174381 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:06.176132 27120 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.177776 27376 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.179486 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.180575 22579 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:09:06.176071 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:06.138213 27220 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:06.183768 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48668.4us
I20260709 13:09:06.194494 27288 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:06.192395 27269 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:06.196197 22496 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:06.197532 27176 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:06.197875 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.198743 22580 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:09:06.205451 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.199764 27137 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.207247 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.210796 22504 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:06.223982 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.222337 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46437.6us
I20260709 13:09:06.228408 22580 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:06.222136 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:06.230084 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.194016 27184 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:06.207998 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:06.211164 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:06.203280 27326 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:06.215773 26755 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.388s	user 0.029s	sys 0.035s
I20260709 13:09:06.207422 27120 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.205279 27288 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:06.214818 26995 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.219740 27176 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:06.243736 22500 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:06.246483 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.214566 27259 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.247263 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:06.255102 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47188.7us
I20260709 13:09:06.257782 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.258888 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2701) took 1805 ms. Trace:
I20260709 13:09:06.259325 22652 rpcz_store.cc:276] 0709 13:09:04.453473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.469867 (+ 16394us) service_pool.cc:224] Handling call
0709 13:09:06.152035 (+1682168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.162162 (+ 10127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.258694 (+ 96532us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54002da5d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:06.258833 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3867669760}
I20260709 13:09:06.234597 27328 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:06.273025 23262 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:09:06.273505 27176 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:06.274791 27318 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.516s	user 0.015s	sys 0.018s
I20260709 13:09:06.275239 27259 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:06.276635 27149 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.883s	user 0.018s	sys 0.000s
I20260709 13:09:06.276921 27322 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:06.291672 27322 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.245007 27240 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:06.292894 26932 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.017s
I20260709 13:09:06.293345 27240 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:06.245148 27260 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:06.280959 26498 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.013s
I20260709 13:09:06.247702 27120 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.269129 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:06.207548 27356 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.253178 27284 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:06.259306 27379 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:06.245814 27244 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.290828 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.268828 27386 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:06.278105 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 288650us
I20260709 13:09:06.277710 27323 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:06.306419 27137 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:06.307160 23256 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:06.269802 27215 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.303784 27149 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:06.310043 27288 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:06.302867 27333 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.296830 27240 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:06.285101 26847 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:06.323284 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.316636 22468 connection.cc:256] RPC call timeout handler was delayed by -2.0559681759999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:09:06.327033 27288 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.341253 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:06.319415 27260 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.310264 27379 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:06.330492 26951 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.000s
I20260709 13:09:06.333415 27120 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.357360 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.333639 22653 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:06.359516 22646 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:06.359820 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.360554 22653 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:06.360752 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.363066 22650 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:06.365434 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.366190 22647 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:06.366530 27176 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:06.367906 27114 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.553s	user 0.023s	sys 0.004s
I20260709 13:09:06.335409 27259 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:06.293532 26932 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.372293 26932 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:06.339854 22468 connection.cc:256] RPC call timeout handler was delayed by -2.0382171089999019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 13:09:06.373070 22468 connection.cc:256] RPC call timeout handler was delayed by -1.9032557259998839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:09:06.373430 22468 connection.cc:256] RPC call timeout handler was delayed by -1.8926152689998617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:09:06.373935 22468 connection.cc:256] RPC call timeout handler was delayed by -1.5546964499999376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:09:06.374264 22468 connection.cc:256] RPC call timeout handler was delayed by -1.4344132649998755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:09:06.374565 22468 connection.cc:256] RPC call timeout handler was delayed by -1.3296470339998905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:09:06.374893 22468 connection.cc:256] RPC call timeout handler was delayed by -1.2084748609998996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2425s for a response
W20260709 13:09:06.375188 27290 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.998s	user 0.014s	sys 0.018s
I20260709 13:09:06.375356 27333 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.375897 27333 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.376720 27205 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:06.378090 27333 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.378683 27260 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:06.379375 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62063.8us
I20260709 13:09:06.381484 27137 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:06.382097 27265 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.382649 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.383412 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.383750 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.379393 22576 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:06.375213 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1911203739999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 13:09:06.385591 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1146903420000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.41280000000000006s for a response
W20260709 13:09:06.385867 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0444203739999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:09:06.386152 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0201203740000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 13:09:06.318059 27323 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:06.350270 22645 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:06.350706 27338 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:06.351380 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108896us
I20260709 13:09:06.337864 27371 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:06.343577 27215 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.352416 27379 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:06.358431 22649 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:06.315449 27322 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.392562 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:06.393488 22653 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:06.394304 27323 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.422350 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.422652 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.423254 22652 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:06.423434 22645 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:06.424324 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:06.424427 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.431224 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.425254 26687 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:06.426280 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:06.426410 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.426808 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:06.427031 26932 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:06.425266 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.437224 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:06.458092 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71274.2us
I20260709 13:09:06.438315 27288 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.442361 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:06.382691 27265 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.443066 27322 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:06.389084 27137 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:06.325793 27244 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:06.446027 27120 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:09:06.472965 27244 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:06.462867 22647 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:06.480531 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.481657 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.467497 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.469201 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.469538 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.470160 27288 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.470468 27137 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.457778 22654 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:06.471776 22653 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:06.457321 26932 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:06.434161 27114 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.477782 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:06.461784 27260 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.494590 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.495484 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:06.499841 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.456419 27176 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:09:06.478793 26847 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.504087 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.506222 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:06.497689 26932 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.504846 23262 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:06.507037 23257 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:06.469200 27284 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:09:06.444343 27371 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.509671 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:06.510380 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.492931 27338 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.514031 22653 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:06.516763 22577 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:06.502239 27333 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:06.517781 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.506186 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.498584 27288 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.522627 22647 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
W20260709 13:09:06.536129 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 60423.3us
W20260709 13:09:06.532248 27177 consensus_meta.cc:287] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.003s
I20260709 13:09:06.505571 27269 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:09:06.533200 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:06.533423 27265 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.533731 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 923) took 1240 ms. Trace:
W20260709 13:09:06.525291 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 83096.6us
W20260709 13:09:06.519411 26903 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.807s	user 0.006s	sys 0.022s
I20260709 13:09:06.503875 26995 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:09:06.519305 27333 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:06.555305 22573 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:09:06.505302 27114 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.518945 27260 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.564033 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:06.856609 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:06.744249 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.872978 22497 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:06.671712 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:06.873804 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:06.546875 22501 rpcz_store.cc:276] 0709 13:09:05.193006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.258077 (+ 65071us) service_pool.cc:224] Handling call
0709 13:09:05.258424 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.258834 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.258874 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.259411 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.048099 (+788688us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4800080358. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:09:06.136125 (+ 88026us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b1800081640. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:06.393193 (+257068us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:06.393261 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.408177 (+ 14916us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.433033 (+ 24856us) raft_consensus.cc:1685] finished
0709 13:09:06.433051 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.433179 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":14893,"raft.run_wall_time_us":785021,"spinlock_wait_cycles":47219968,"thread_start_us":183669,"threads_started":1,"wal-append.queue_time_us":1151965}
I20260709 13:09:06.750910 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:06.666949 22574 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
W20260709 13:09:06.702597 27220 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.008s
I20260709 13:09:06.882979 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:06.885882 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.884414 22505 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:06.666517 27404 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:09:06.658367 27331 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.899s	user 0.013s	sys 0.009s
I20260709 13:09:06.885654 22573 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:06.884086 27376 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.569608 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:06.653506 26712 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.009s
I20260709 13:09:06.561561 27333 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:06.897907 22652 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:06.895717 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 366984us
I20260709 13:09:06.653239 27371 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.772964 27265 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.728981 26847 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.898998 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.902573 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 313914us
I20260709 13:09:06.876084 27288 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:06.911592 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.922793 23263 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:09:06.563467 27244 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.348s
I20260709 13:09:06.898877 27322 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:06.923571 23263 pending_rounds.cc:85] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 8
I20260709 13:09:06.927889 23263 pending_rounds.cc:107] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:06.928220 23263 raft_consensus.cc:2889] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.928543 23263 pending_rounds.cc:107] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:09:06.928786 23263 raft_consensus.cc:2889] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.911669 26999 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:06.932665 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 340535us
I20260709 13:09:06.671336 22647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:06.933956 22647 raft_consensus.cc:606] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:06.934320 22647 raft_consensus.cc:614] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:06.935051 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.935663 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:06.902454 27376 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:06.931507 26999 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.933547 27355 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:06.939159 23256 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:09:06.914151 27265 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:06.941001 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:06.943349 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.924887 26847 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:06.947788 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:06.940557 26999 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:06.936369 27220 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:09:06.941308 27355 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:06.938949 26687 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:09:06.955088 23255 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:06.958052 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.964787 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:06.965890 22649 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:06.952665 27244 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:06.973948 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:06.975730 22505 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:06.958801 27265 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:06.965924 27249 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:06.989801 27249 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.990221 27249 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:06.976891 22468 leader_election.cc:400] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7.
I20260709 13:09:06.992123 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:06.994104 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:06.985445 27288 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:06.986321 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:06.989226 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:06.970768 27322 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:06.998705 23259 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:06.999737 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:07.001478 23255 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:06.972832 27244 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.013722 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:07.015568 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.016188 23255 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:07.017011 27354 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.017552 27354 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.017800 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.027809 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.001839 27322 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:07.007153 26687 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.008541 27114 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.034689 22571 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:07.009101 27244 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.013078 27265 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:07.042579 27235 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.046531 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:07.038478 27322 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.047413 27269 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:07.046543 27260 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.054997 27269 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.056257 26712 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:07.056773 27269 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.057082 26712 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:07.058058 26847 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.065972 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:07.045776 27235 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:07.073951 27415 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:09:07.076282 27401 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.640s	user 0.000s	sys 0.012s
I20260709 13:09:07.055404 27265 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.079627 26687 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:07.058306 26712 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.062855 27249 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.093303 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:07.097440 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69895us
I20260709 13:09:07.099443 26687 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:07.103044 27376 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.104558 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.105414 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:07.117156 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 51304us
I20260709 13:09:07.109664 27205 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:07.106714 26932 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.588s	user 0.003s	sys 0.008s
I20260709 13:09:07.124001 27205 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:07.124281 26932 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.124799 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2738) took 1467 ms. Trace:
W20260709 13:09:07.106032 27410 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:09:07.125425 22572 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:07.124912 27205 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.126982 26932 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.127497 27205 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:07.116012 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.118216 27322 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.119421 27269 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.120004 27254 raft_consensus.cc:993] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:09:07.104663 26999 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.106475 27417 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.120604 27249 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:07.127933 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.147553 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.130374 22647 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:07.131692 22649 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:07.131899 22645 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:07.132058 22648 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:09:07.132642 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:07.106269 27379 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.001s
I20260709 13:09:07.120679 22498 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:07.125306 22499 rpcz_store.cc:276] 0709 13:09:05.657348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.797518 (+140170us) service_pool.cc:224] Handling call
0709 13:09:05.835278 (+ 37760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.918693 (+ 83415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.918737 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.919389 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.239302 (+319913us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:06.239355 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.124429 (+885074us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b540042b3d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:07.124479 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.124523 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:07.124535 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.124739 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3269,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"spinlock_wait_cycles":146557824,"thread_start_us":319443,"threads_started":1,"wal-append.queue_time_us":400080}
I20260709 13:09:07.145838 27168 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:07.164124 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 170127us
W20260709 13:09:07.172634 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.167200 22653 raft_consensus.cc:2376] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10. Re-sending same reply.
W20260709 13:09:07.193408 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.162077 27254 raft_consensus.cc:1081] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:09:07.170068 26755 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:07.195618 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.196242 23259 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:09:07.178480 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 178825us
I20260709 13:09:07.184080 27333 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.189111 27220 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:07.189520 26999 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:07.190933 22499 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:07.167970 27168 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.181704 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:07.196040 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.183558 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:07.200417 27322 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.200747 27419 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:07.161504 27379 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.195130 27249 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.220471 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 51010us
I20260709 13:09:07.201247 27419 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:07.201459 27168 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.226615 23259 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:07.227027 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:07.230397 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:07.231177 22650 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.201257 27269 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.234099 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:07.205328 26755 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:07.237504 22496 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.239279 22646 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:07.210736 26687 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:07.210615 27322 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:07.228549 27419 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.233820 22504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:48204
I20260709 13:09:07.239064 27423 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.232625 27249 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.280377 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:07.281797 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 100179us
I20260709 13:09:07.285563 22503 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:07.288100 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.236819 27254 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:09:07.289638 22501 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:07.291245 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.251579 27288 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:09:07.305589 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:07.262853 26687 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.307358 27379 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:07.308804 26687 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.309342 27420 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:07.309237 27379 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:07.310158 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:07.310298 27354 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:07.310787 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.313238 27356 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.316373 27417 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.322068 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2710) took 1001 ms. Trace:
W20260709 13:09:07.322871 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.323539 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.324048 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.324342 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.310459 27421 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:09:07.325230 22496 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:09:07.322520 22651 rpcz_store.cc:276] 0709 13:09:06.320245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.320398 (+   153us) service_pool.cc:224] Handling call
0709 13:09:06.324326 (+  3928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.421136 (+ 96810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.421186 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.421263 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:06.421318 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.321857 (+900539us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b5400298bd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:07.321895 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.322021 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156038400}
I20260709 13:09:07.330904 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.331189 23229 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.331887 22496 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:07.295504 26999 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.270490 27322 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.336218 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.296717 26847 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:07.337010 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 766581us
I20260709 13:09:07.338279 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.343433 23259 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:07.340437 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:07.363498 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 64013.8us
I20260709 13:09:07.363927 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.367631 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:07.288133 27423 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.341034 27326 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.370787 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.372573 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:07.340569 26687 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:07.346975 27386 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.371529 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.336802 26999 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.375330 22504 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:07.342633 26847 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.378387 22504 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.377439 22498 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:07.382084 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:07.382949 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:07.386919 27425 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:09:07.387243 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:07.388206 22573 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:07.374431 27429 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.389739 27429 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:07.390096 22573 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:07.390430 27429 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.390547 22573 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:07.391551 22573 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.392535 22573 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.384155 27120 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.393270 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:07.393950 22580 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:07.393679 27120 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.395972 27120 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.363142 27324 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:09:07.384603 27333 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.397548 22579 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:07.399713 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:07.401306 22650 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:09:07.406030 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:07.410408 22496 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:07.411567 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.412340 22496 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:07.384387 26687 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:07.419037 26687 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.379215 26999 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.427493 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.423389 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:07.465775 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.385123 26847 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.469448 22501 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:09:07.469733 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46434.4us
I20260709 13:09:07.470635 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:07.472626 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:07.441365 22496 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:07.435336 27168 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.463989 27421 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:09:07.475795 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.329483 26755 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:07.493146 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.385326 27386 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:07.475939 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106615us
I20260709 13:09:07.481324 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:07.499908 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.500706 22579 raft_consensus.cc:2410] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:09:07.487532 22504 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.484484 23259 raft_consensus.cc:2368] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11.
I20260709 13:09:07.406543 27260 raft_consensus.cc:2764] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:09:07.501662 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 83045us
I20260709 13:09:07.497056 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:07.504112 22498 raft_consensus.cc:2410] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:07.377290 27326 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.504161 22580 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:07.504951 22497 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:07.476759 27288 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.466845 27338 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.476068 27048 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:07.476593 27426 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.483942 27168 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:07.476401 26903 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.509579 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:07.479718 27411 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:09:07.475524 27417 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:07.476879 27265 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:07.490963 27423 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.488396 27421 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:07.542649 22576 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:07.523988 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:07.543273 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:07.543828 22501 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.489580 27322 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.511142 27420 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.544126 22578 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:07.548646 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 250837us
I20260709 13:09:07.520706 27048 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.517393 27288 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:07.487493 27419 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.526564 26903 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.547039 27420 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.565107 26903 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.565214 27420 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.566152 27386 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.567684 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:07.570025 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:09:07.571431 27437 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:07.542412 27417 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.572012 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:07.573130 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46640.4us
I20260709 13:09:07.531091 27176 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:07.573666 27417 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.573829 27176 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.574774 27235 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:07.575294 27244 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.007s
I20260709 13:09:07.575775 27244 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.576174 27176 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.548184 27421 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:07.577431 27421 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.578006 27326 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.480821 27355 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.578501 27421 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.578394 22652 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:07.557713 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:07.574324 27417 raft_consensus.cc:2764] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:09:07.579210 23261 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:07.582340 22579 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.573923 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:07.579979 22504 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.531324 27338 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.594733 27338 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.596647 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:07.597651 23255 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:07.583890 27120 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.598038 23255 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:07.598290 27120 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.598712 27120 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.599009 23255 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.599543 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:07.600030 23255 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.600875 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.601725 23256 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:07.602523 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.559244 27048 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.606139 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:07.598786 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.608316 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.583985 27355 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.592013 27323 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.605144 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:07.590314 27419 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.589614 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.618827 22501 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:07.577943 27244 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:07.624707 22573 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:09:07.625229 22573 pending_rounds.cc:85] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 7
I20260709 13:09:07.625576 22573 pending_rounds.cc:107] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:09:07.625345 27244 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:07.625901 22573 raft_consensus.cc:2889] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:07.626981 27244 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.627431 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:07.627488 27244 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.630327 27244 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:07.631395 27244 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.632081 27244 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:07.622040 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.559671 27288 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.636807 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:07.614774 26903 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:07.581241 27265 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:07.621009 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:07.638679 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:07.643986 27427 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.646260 27215 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.646781 27429 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.647958 22503 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:07.648064 27439 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:07.650403 23255 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:07.641949 27176 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:07.637111 27356 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.653105 27244 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:07.653362 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 79526.8us
I20260709 13:09:07.654332 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:07.654421 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:07.656476 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:07.656983 22571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3356) took 2754 ms (client timeout 1706 ms). Trace:
I20260709 13:09:07.661173 27356 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.684731 22579 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:07.686748 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:07.642963 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:07.683043 22469 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.663981 27429 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.665445 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 796) took 1130 ms. Trace:
I20260709 13:09:07.643065 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:07.701944 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58950.1us
W20260709 13:09:07.702972 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64627.3us
I20260709 13:09:07.702787 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:07.674093 22571 rpcz_store.cc:269] 0709 13:09:04.902583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.902815 (+   232us) service_pool.cc:224] Handling call
0709 13:09:07.656720 (+2753905us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54003bcc54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:07.656893 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4563766016}
I20260709 13:09:07.664601 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:07.702450 22573 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:09:07.700631 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:07.708705 22578 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.709877 27284 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.710412 27284 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.713773 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.700789 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:07.714682 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.714912 22504 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.720685 27284 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:07.715296 27244 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:07.724900 27176 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:07.714956 22505 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:09:07.725416 27176 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.725848 27176 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.727236 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.727902 22505 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:07.729194 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.729789 22505 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:07.730883 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:07.732499 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.725132 22578 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:07.735874 22504 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
W20260709 13:09:07.739511 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.741314 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.742915 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:07.640710 26903 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.701053 22572 rpcz_store.cc:276] 0709 13:09:06.534772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.569088 (+ 34316us) service_pool.cc:224] Handling call
0709 13:09:07.665181 (+1096093us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003f5554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:07.665333 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529299712}
I20260709 13:09:07.705101 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:07.751528 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2718) took 1400 ms. Trace:
W20260709 13:09:07.753955 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 97555.1us
I20260709 13:09:07.754745 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.641870 27265 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.756016 27417 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:07.673233 27427 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:07.757539 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 608) took 1166 ms. Trace:
I20260709 13:09:07.760120 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 720) took 1523 ms. Trace:
I20260709 13:09:07.693056 27419 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:07.693449 27442 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.766940 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:07.766500 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:07.752104 27260 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:07.750819 27177 raft_consensus.cc:2764] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:09:07.788160 22646 rpcz_store.cc:276] 0709 13:09:06.351218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.361840 (+ 10622us) service_pool.cc:224] Handling call
0709 13:09:06.362098 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.248784 (+886686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.751272 (+502488us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b540017fa54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:07.751466 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001008000}
W20260709 13:09:07.789103 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 84116.7us
I20260709 13:09:07.788774 22497 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:07.757313 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:07.787058 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.791428 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:07.791458 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 59015.4us
I20260709 13:09:07.819022 22573 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:09:07.806869 23261 rpcz_store.cc:276] 0709 13:09:06.876157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.882668 (+  6511us) service_pool.cc:224] Handling call
0709 13:09:07.757397 (+874729us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54007021d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:07.757492 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590197632}
W20260709 13:09:07.811126 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80315.4us
I20260709 13:09:07.807067 23263 rpcz_store.cc:276] 0709 13:09:06.230010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.230166 (+   156us) service_pool.cc:224] Handling call
0709 13:09:06.241660 (+ 11494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.930461 (+688801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.705793 (+775332us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54006d2254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:07.753092 (+ 47299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526983936}
I20260709 13:09:07.814600 22571 raft_consensus.cc:2376] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14. Re-sending same reply.
I20260709 13:09:07.819949 22619 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:07.792968 26903 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.820597 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:07.821250 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:07.791395 27429 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:07.798502 27338 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:07.795747 27265 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.823256 22653 raft_consensus.cc:2410] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:09:07.823083 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46059.2us
I20260709 13:09:07.766476 26999 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.805927 27235 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:07.750185 27176 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.857052 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:07.830550 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106027us
I20260709 13:09:07.840312 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:07.831205 22576 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:07.854101 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:07.814232 27417 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:07.816839 27244 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:07.838882 27269 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:07.836985 27338 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.870808 22573 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:07.836107 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:07.874061 22654 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:07.853428 27235 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.815536 27426 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:07.877707 27447 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.877321 27417 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.874883 27439 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.878827 27458 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:07.892176 27458 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.892262 27356 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:07.892661 27458 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:07.879318 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:07.880081 27455 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:07.830241 26932 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:07.832670 27324 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:09:07.878346 27460 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:07.881037 27235 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:07.863963 27429 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.837164 27420 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.873538 27338 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:07.906634 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:07.907711 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67624.6us
W20260709 13:09:07.897850 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53275.5us
I20260709 13:09:07.882051 27269 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:07.925060 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.834322 27442 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:07.927062 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.50024e+06us
I20260709 13:09:07.887365 27419 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:09:07.919389 27460 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.942730 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:07.943503 22500 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
W20260709 13:09:07.949997 22574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3343) took 3631 ms (client timeout 1703 ms). Trace:
W20260709 13:09:07.958329 22574 rpcz_store.cc:269] 0709 13:09:04.318253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.318378 (+   125us) service_pool.cc:224] Handling call
0709 13:09:07.937042 (+3618664us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54003cc8d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:07.949900 (+ 12858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4480282496}
W20260709 13:09:07.973240 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 77099.4us
I20260709 13:09:07.974210 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:07.940738 27354 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.946638 27460 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:07.928285 26687 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:09:07.915297 27455 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.889599 27447 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:07.915228 27439 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:07.954182 27462 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.004611 22575 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:09:08.005304 27451 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:09:07.986251 27220 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.979939 27354 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.948796 27450 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.984400 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:08.014899 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.017051 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 112462us
I20260709 13:09:07.982079 27376 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:08.026247 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 131533us
I20260709 13:09:08.082754 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.086771 22501 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:08.027446 27439 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:08.028577 27454 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:08.029377 27333 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:08.029527 27453 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:07.935397 27244 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.030998 22574 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:08.031297 27442 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:08.033536 27449 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:09:08.034698 27461 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.116s	user 0.003s	sys 0.000s
I20260709 13:09:08.037580 26999 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.043413 22499 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:08.033551 27455 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.046195 27269 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.101044 27333 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:08.005689 27448 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:09:08.003880 26847 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.057283 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.059322 27354 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.059841 27467 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:08.061554 27177 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:08.064399 27456 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:09:08.065702 27420 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.066151 27427 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:08.070086 27429 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.072980 27403 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.075344 27176 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.076637 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:08.050004 27324 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:09:07.957523 27048 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.161580 23264 raft_consensus.cc:2368] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:08.162635 27048 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.093884 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:08.164078 27450 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:08.164785 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 141115us
I20260709 13:09:08.112349 22646 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:08.165056 27429 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:08.165575 27429 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.165613 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.166159 27429 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:08.166544 27419 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:08.167335 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.168179 27419 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.112237 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:08.167768 27338 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:08.169624 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57492.4us
I20260709 13:09:08.170506 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:08.171656 27338 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.171861 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:08.052675 27386 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.173174 27386 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.094628 27426 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.177030 27426 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.179754 27426 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.141242 22651 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:08.140753 27120 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
W20260709 13:09:08.173019 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 195601us
I20260709 13:09:08.129624 27379 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:08.135802 27439 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:08.148972 27447 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.150843 26847 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.153249 27349 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:08.153302 27235 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:08.154803 27421 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.571s	user 0.001s	sys 0.009s
I20260709 13:09:08.144661 27464 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:08.155930 27323 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.002s
I20260709 13:09:08.156723 27333 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.157896 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:08.111833 27288 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.239754 27249 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.240248 27288 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.054514 27220 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.241109 27220 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.191619 27467 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:08.184689 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.131948 27260 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.191922 22577 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:09:08.095427 27462 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.140055 27427 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:08.257597 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 250497us
I20260709 13:09:08.188719 27386 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.229355 22469 leader_election.cc:400] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:08.229488 22578 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:09:08.198693 27470 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:08.228444 27458 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.234596 22544 leader_election.cc:400] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11.
I20260709 13:09:08.279546 22544 leader_election.cc:403] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.191223 27120 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.248479 27420 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:08.181342 27403 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.168759 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:08.220567 27465 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:08.146920 27442 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:08.199512 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:08.290019 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 121335us
I20260709 13:09:08.263931 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 928) took 1135 ms. Trace:
I20260709 13:09:08.290558 22652 rpcz_store.cc:276] 0709 13:09:07.128956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.139881 (+ 10925us) service_pool.cc:224] Handling call
0709 13:09:07.145145 (+  5264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.584675 (+439530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.263699 (+679024us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400324954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:08.263872 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995821824}
I20260709 13:09:08.264627 22469 leader_election.cc:403] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.262306 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:08.268774 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 268822us
W20260709 13:09:08.278681 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.237257 27176 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.254170 27355 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.186928 27439 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:08.201339 27379 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:08.329730 27439 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:08.330535 27462 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.286310 27464 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:08.331542 27379 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
W20260709 13:09:08.286478 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 52070.4us
I20260709 13:09:08.332119 27464 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.335757 22573 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:09:08.286748 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 102186us
I20260709 13:09:08.337468 22580 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:08.338856 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:08.263291 27455 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:08.341189 27455 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.255792 22577 pending_rounds.cc:85] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 10
I20260709 13:09:08.342573 22577 pending_rounds.cc:107] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:08.342875 22577 raft_consensus.cc:2889] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.343299 27455 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.343909 27455 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:08.344393 27455 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:08.344478 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 797) took 1801 ms. Trace:
I20260709 13:09:08.297212 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.302515 22654 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:08.304044 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 74857.6us
I20260709 13:09:08.304363 27426 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:08.366542 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.304811 27427 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.306246 27284 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:08.306113 26687 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:08.308173 22647 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:08.308794 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.429438 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.322960 26932 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:08.325357 27355 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.327160 27235 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.328812 27403 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.295719 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.338868 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:08.439237 23263 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:08.348706 27356 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:08.349116 27455 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.302922 27288 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:08.340591 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.297964 27450 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:08.447846 22652 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:08.352335 27379 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:08.352422 27458 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.353701 27460 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:08.357049 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58212.8us
I20260709 13:09:08.357703 27419 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:08.360363 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.360836 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.361677 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.475278 22499 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.361343 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.476450 22497 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:08.362030 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.477816 22496 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:08.365015 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.479024 22501 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.323768 27467 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:08.483881 27467 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.428078 27465 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:08.433735 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.296931 27326 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11.
I20260709 13:09:08.361892 22646 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:08.430267 22500 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:08.435207 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 940) took 1085 ms. Trace:
I20260709 13:09:08.563628 22651 rpcz_store.cc:276] 0709 13:09:07.350067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.377004 (+ 26937us) service_pool.cc:224] Handling call
0709 13:09:08.435018 (+1058014us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54002f8ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:08.435148 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702827776}
I20260709 13:09:08.564100 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.362824 22577 rpcz_store.cc:276] 0709 13:09:06.543997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.069106 (+1525109us) service_pool.cc:224] Handling call
0709 13:09:08.069454 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.343464 (+274010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.344248 (+   784us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003c91d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:08.344423 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257613184}
I20260709 13:09:08.564700 22500 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:09:08.437142 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75789.3us
I20260709 13:09:08.312064 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3357) took 3384 ms. Trace:
W20260709 13:09:08.441519 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 145909us
W20260709 13:09:08.378400 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 270479us
I20260709 13:09:08.566205 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:08.361068 27462 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:08.306067 27478 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:09:08.447935 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 107441us
W20260709 13:09:08.451129 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 393876us
I20260709 13:09:08.441208 27356 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:08.452720 27423 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:08.519423 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 56817.9us
I20260709 13:09:08.490715 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.445927 27288 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:08.591993 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.521472 22498 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:08.534229 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.592962 22497 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:08.458401 27420 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:08.528475 22501 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:08.438877 27354 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.454200 27450 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:08.534021 27265 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.002s
I20260709 13:09:08.519474 27427 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.611460 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.613212 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.490397 27447 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:08.475354 27379 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:08.309583 27469 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:08.361232 27376 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:08.566103 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 262537us
I20260709 13:09:08.625610 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:08.572906 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:08.549412 26903 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.013s
I20260709 13:09:08.631008 26903 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.633916 26903 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.565620 22575 rpcz_store.cc:276] 0709 13:09:04.927685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.927823 (+   138us) service_pool.cc:224] Handling call
0709 13:09:07.972766 (+3044943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.054314 (+ 81548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.311762 (+257448us) spinlock_profiling.cc:243] Waited 3.01 s on lock 0x7b54003cc8d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:08.311955 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6932385664}
W20260709 13:09:08.638850 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 164249us
I20260709 13:09:08.612205 27450 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.576395 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.590659 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.591087 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.592103 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.666235 22579 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:09:08.458698 27235 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.601120 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.620724 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.592046 27464 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:09:08.620474 27176 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:08.628194 27376 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.629297 22650 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:08.621704 27333 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.670147 22580 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:08.594807 27288 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.585304 27462 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.599524 27349 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:09:08.668496 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.677219 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.600587 26999 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
W20260709 13:09:08.697901 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 72383.5us
I20260709 13:09:08.701903 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.721904 22578 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
W20260709 13:09:08.705902 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 129617us
I20260709 13:09:08.714257 22573 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:08.711898 22497 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:08.668888 27260 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:08.621471 27265 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:08.711776 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71591.5us
I20260709 13:09:08.734386 23263 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:08.626623 27447 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.645805 27429 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:08.762228 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 120128us
W20260709 13:09:08.741000 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet e0b8b09cbd5c4d81a0453f8ca6e8b7d4: Illegal state: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:08.741125 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 802) took 1266 ms. Trace:
I20260709 13:09:08.741917 27480 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:08.742944 27386 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.743898 27323 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:08.747974 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:08.750288 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.750465 27484 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:09:08.751461 27475 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:09:08.790289 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:08.791127 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:08.791790 23262 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:08.753693 27479 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:09:08.518467 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:08.748008 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:08.762483 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.675544 27176 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:08.793090 22505 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:08.722004 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:08.778059 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 352345us
I20260709 13:09:08.780220 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.793823 22650 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:08.793959 22496 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:08.794217 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.794658 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.704181 27483 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.765165 22572 rpcz_store.cc:276] 0709 13:09:07.474917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.795662 (+320745us) service_pool.cc:224] Handling call
0709 13:09:07.817125 (+ 21463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.833851 (+ 16726us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:08.282210 (+448359us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b18001c3a80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec263150bf 00007fec26315038
0709 13:09:08.557848 (+275638us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.738930 (+181082us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.739451 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.739615 (+   164us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:08.739650 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.739721 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.740786 (+  1065us) raft_consensus.cc:1685] finished
0709 13:09:08.740919 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.741061 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28332,"prepare.queue_time_us":172082,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":29771,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":18993,"spinlock_wait_cycles":14253824,"thread_start_us":412078,"threads_started":2,"wal-append.queue_time_us":156184}
I20260709 13:09:08.794973 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.795819 22496 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:08.795439 27483 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.796415 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.793915 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 941) took 1616 ms. Trace:
I20260709 13:09:08.797580 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.798398 22496 raft_consensus.cc:2368] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11.
I20260709 13:09:08.784118 22573 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.797528 22502 rpcz_store.cc:276] 0709 13:09:07.177941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.178145 (+   204us) service_pool.cc:224] Handling call
0709 13:09:07.182986 (+  4841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.251629 (+ 68643us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:08.098474 (+846845us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b18000728e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b
0709 13:09:08.100108 (+  1634us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18000728e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec263150bf
0709 13:09:08.100273 (+   165us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.444540 (+344267us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.449937 (+  5397us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.450136 (+   199us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:08.450184 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.450313 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.793705 (+343392us) raft_consensus.cc:1685] finished
0709 13:09:08.793724 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.793844 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12802,"prepare.queue_time_us":41075,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":42,"raft.queue_time_us":104961,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":19254,"spinlock_wait_cycles":52983296,"thread_start_us":418595,"threads_started":3,"wal-append.queue_time_us":445546}
I20260709 13:09:08.799227 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.799986 22496 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:08.799901 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.800784 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.800922 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.801393 22496 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:08.801469 22502 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:08.802317 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.802434 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.803063 22502 raft_consensus.cc:2410] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:08.783535 27323 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:08.803808 22496 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:08.803972 22502 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:08.768780 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:08.787093 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 65629.2us
I20260709 13:09:08.809994 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.810670 22646 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:08.741525 27120 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.793030 27176 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:08.794987 22505 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:08.736590 27260 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.825313 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:08.827893 23262 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:08.810700 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.814030 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.636979 27465 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.840371 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:08.789419 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.820559 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:08.841823 22497 raft_consensus.cc:2393] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:08.670439 27356 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.829310 22648 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:08.844902 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.831755 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.832175 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.838804 22573 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:08.779951 27386 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:08.847939 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.848852 22573 raft_consensus.cc:2368] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:08.850271 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:08.843617 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 270673us
I20260709 13:09:08.851101 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:08.850133 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.852406 22505 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:08.852659 26999 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:08.853117 26999 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.853471 26999 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.854112 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 803) took 1348 ms. Trace:
I20260709 13:09:08.854480 22571 rpcz_store.cc:276] 0709 13:09:07.505887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.820340 (+314453us) service_pool.cc:224] Handling call
0709 13:09:07.837990 (+ 17650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.838375 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.838407 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.866136 (+ 27729us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.191847 (+325711us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:08.191883 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.191947 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.557449 (+365502us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4800002dd8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:09:08.853802 (+296353us) raft_consensus.cc:1685] finished
0709 13:09:08.853825 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.854035 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":685,"raft.run_cpu_time_us":4135,"raft.run_wall_time_us":708933,"spinlock_wait_cycles":8836864,"thread_start_us":290218,"threads_started":1,"wal-append.queue_time_us":557098}
W20260709 13:09:08.856309 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.857348 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.858153 22579 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:08.858916 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.859427 22579 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:08.859992 27215 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:08.860527 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:08.861529 27120 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:08.862061 27120 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:08.862950 27120 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.865787 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.866111 27462 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.866603 27462 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.825522 27473 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:08.867007 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.868737 27447 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.869472 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.870126 22647 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:08.871019 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.871542 22647 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:08.871644 27439 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:09:08.872080 27439 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.873454 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.873780 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.874228 27439 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.874786 27439 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:08.875092 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:08.876085 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:08.878072 27423 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:08.878731 27423 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:08.879040 27423 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:08.879383 27423 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:08.873488 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.882907 27354 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.885325 27480 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:08.856330 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.888626 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.889247 22571 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:09:08.889945 27265 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.890769 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:08.891012 27492 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.003s
I20260709 13:09:08.891685 27386 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.893006 27386 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.845431 27489 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:09:08.894595 27489 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:08.894992 27489 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:08.895771 27489 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:08.897576 27487 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:08.897933 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.898412 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.891148 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:08.899118 22648 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.842540 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.850095 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.901976 27483 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.902213 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.902839 22580 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.890059 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.820513 27460 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.904790 22571 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.906200 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.909466 27429 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:08.909881 22572 raft_consensus.cc:2368] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:08.910339 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.910745 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.910928 22577 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:08.912074 22572 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 13:09:08.839776 27260 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.905516 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:08.918241 22653 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:08.856576 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.867221 27473 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:08.907636 27379 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:08.909615 27485 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:08.953830 27485 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:08.954351 27485 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.955147 27450 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.956606 22503 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:08.948323 27176 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.958729 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:08.959342 22503 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.856422 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.960566 22645 raft_consensus.cc:2368] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:08.961499 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.962359 22645 raft_consensus.cc:2410] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:08.962538 22575 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:09:08.963196 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.964378 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:08.969219 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.971146 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:08.804382 27323 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.922734 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:08.923039 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:08.994894 22653 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:08.875206 27439 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.929011 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:08.930287 22579 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:08.933852 27470 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:08.934216 22505 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:08.935075 27491 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:09:08.940038 26932 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:08.942096 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:08.943364 27474 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:09:08.944676 27338 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:08.825641 27419 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
W20260709 13:09:08.945088 27481 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.329s	user 0.000s	sys 0.002s
I20260709 13:09:08.950275 27464 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:08.951097 27421 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:08.867033 27462 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:08.975780 27473 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:08.977993 27489 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.979287 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:09.048238 22497 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.983652 22571 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:08.984097 27355 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:08.987556 22647 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:08.989259 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:08.992240 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.993746 22500 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:09:09.050858 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.051230 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:09.052018 22500 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:09.052838 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:09.053582 22500 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:08.920126 22499 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:09.053683 22503 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:08.994264 22573 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.998771 22580 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
W20260709 13:09:08.921087 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45073.2us
I20260709 13:09:09.000072 22502 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:08.992512 22648 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:09:08.994524 22498 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:08.904636 27356 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:09.001850 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 80253.5us
I20260709 13:09:09.059121 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:09.059305 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.060998 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.003034 22578 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:09.008812 22468 leader_election.cc:400] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:09.062146 22468 leader_election.cc:403] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:09:09.009732 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 168629us
W20260709 13:09:08.923633 27220 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.002s
I20260709 13:09:09.012526 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:09.016475 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:09.064522 22579 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:09.016649 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.029127 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:09.017765 27338 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.029839 27464 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:09.069765 22505 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:09.070761 22503 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:09:09.030970 27490 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.004s
I20260709 13:09:09.031478 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3387) took 1311 ms. Trace:
W20260709 13:09:09.032049 27497 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 13:09:09.032456 27323 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:09.005350 27470 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:09.033697 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 181487us
W20260709 13:09:09.034264 27494 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:09:09.034334 27379 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:09.116381 27379 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.116835 27379 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:09.037021 27426 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260709 13:09:09.121170 27426 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:09.041314 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.114621 23264 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:09.070137 27427 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:09.127429 27464 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:09.128748 27464 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:09.076205 27501 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:09:09.133975 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.022078 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:09.048496 22653 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:09:09.065816 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57182.3us
I20260709 13:09:09.136284 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:09.137521 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.138607 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.066692 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:09.140304 22648 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:09.141530 22648 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:09.074577 22573 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:09.074487 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.075371 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:09.143395 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:09.143716 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 68411.8us
I20260709 13:09:09.144567 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.145716 27498 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.068485 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:09.146492 27498 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:09.146663 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 78212.3us
I20260709 13:09:09.147140 27498 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:09.147367 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.148699 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:09.149418 27467 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:09.149515 27426 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:09.150050 27426 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:09.150082 27467 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:09.150616 27426 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.077989 22651 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:09.042671 27421 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:09.016695 27423 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:09.076828 22576 rpcz_store.cc:276] 0709 13:09:07.720128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.999868 (+279740us) service_pool.cc:224] Handling call
0709 13:09:08.000904 (+  1036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.001733 (+   829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.001776 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.123684 (+121908us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.463390 (+339706us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:08.463450 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.463548 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.944273 (+480725us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:09.031136 (+ 86863us) raft_consensus.cc:1685] finished
0709 13:09:09.031158 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.031401 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1481,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9576,"spinlock_wait_cycles":30266112,"thread_start_us":339127,"threads_started":1,"wal-append.queue_time_us":420281}
I20260709 13:09:09.083233 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.085347 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:09.082603 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:09.090193 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:09.087198 22649 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:09:09.084038 23263 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:09.081563 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.084530 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.192020 22575 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:09.099298 27376 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:09.078378 27220 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:09.073086 27355 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.080720 27473 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:09.107242 27450 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:09.112329 27439 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:09.114414 27462 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:09.011042 26847 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:09.151724 22468 leader_election.cc:400] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:09.271266 22468 leader_election.cc:403] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:09.271771 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 120224us
I20260709 13:09:09.033565 27288 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:09.032680 27260 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:09.273188 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:09.134621 22504 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:09.148767 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:09:09.280690 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 131984us
I20260709 13:09:09.281495 23261 raft_consensus.cc:2368] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12.
I20260709 13:09:09.132643 27379 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:09.140611 22497 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:09.069404 26903 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:09.170845 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:09.069167 27338 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.016880 26999 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:09.193972 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.076494 27442 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:09.198190 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115019us
I20260709 13:09:09.297852 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:09.299328 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:09.300158 22468 leader_election.cc:400] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
W20260709 13:09:09.213569 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.301687 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:09.246858 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 224859us
I20260709 13:09:09.303131 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:09.235126 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.152539 27470 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:09.312117 22645 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:09.259856 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 169781us
I20260709 13:09:09.313969 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:09.143749 27419 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:09.260423 22501 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:09.166051 27349 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:09.323207 22650 raft_consensus.cc:2368] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
I20260709 13:09:09.322965 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.262558 22505 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:09.268078 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:09.201256 27501 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
W20260709 13:09:09.327253 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 156495us
I20260709 13:09:09.334086 22653 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 10. Ops: []
I20260709 13:09:09.276460 22651 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:09.253463 27235 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.257694 26932 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:09.340793 22578 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:09.293252 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.295192 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:09.187628 27168 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 13:09:09.309306 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.320127 22645 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:09.278394 27445 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:09.257161 27403 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:09:09.322609 22646 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:09.276224 27417 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:09.326956 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.169711 27447 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:09.328030 22577 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:09.335711 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:09.337492 22571 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:09.342201 22573 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:09.279570 27429 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:09:09.374042 22580 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:09.291262 27450 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:09.350206 22576 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 6: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:09.312121 27442 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.311872 27215 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.357900 22652 raft_consensus.cc:2368] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9.
I20260709 13:09:09.321280 27326 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:09.361497 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.323740 27333 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:09.263240 27498 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:09:09.364429 27502 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.177s
I20260709 13:09:09.365403 27284 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:09.288959 27460 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:09.382673 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:09.405119 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69545.3us
I20260709 13:09:09.414628 22545 leader_election.cc:400] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11.
I20260709 13:09:09.406040 22572 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:09.326618 27323 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:09:09.354990 27244 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:09.355188 26903 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:09.358671 27324 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:09.359401 27445 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:09.421154 22645 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
W20260709 13:09:09.432797 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.424144 22573 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
W20260709 13:09:09.400830 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66458.3us
I20260709 13:09:09.425864 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:09.321238 27421 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:09.422505 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 92743.5us
I20260709 13:09:09.382609 27137 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.405542 27442 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:09.428315 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 112387us
W20260709 13:09:09.432524 27492 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:09:09.457682 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75080.4us
I20260709 13:09:09.297057 27467 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:09.429080 27447 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:09.423503 27486 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:09.429088 27450 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:09.466279 27458 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:09.442364 27460 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:09.409181 27215 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:09.429488 27419 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:09.472998 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:09.474578 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:09.462049 27244 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:09.477699 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:09.481516 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3377) took 1121 ms. Trace:
I20260709 13:09:09.754514 27244 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:09.754761 22504 rpcz_store.cc:276] 0709 13:09:08.359929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.360081 (+   152us) service_pool.cc:224] Handling call
0709 13:09:09.481233 (+1121152us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54001a8954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:09.481401 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489090944}
I20260709 13:09:09.482710 27323 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:09:09.483533 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57793.2us
I20260709 13:09:09.757802 22652 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:09:09.758260 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:09.759676 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:09.484030 27472 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:09.484998 27506 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:09.485320 27423 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:09.489368 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:09.489634 27379 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:09.490469 27500 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:09:09.490674 26999 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:09.408110 27482 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:09:09.442807 27445 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.469419 27176 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:09.498656 22580 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:09.451814 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:09.715405 27417 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.609400 27450 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:09.707264 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2741) took 1075 ms. Trace:
W20260709 13:09:09.794198 27489 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.000s
W20260709 13:09:09.582926 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 87830.7us
W20260709 13:09:09.664278 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.682662 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:09.847651 23255 raft_consensus.cc:2368] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13.
W20260709 13:09:09.677033 27476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.001s	sys 0.006s
W20260709 13:09:09.653614 27485 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.002s
I20260709 13:09:09.457890 27326 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:09.502817 27421 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:09.590929 22577 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:09.612913 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:09.857358 22651 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:09.680475 27120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.004s	sys 0.004s
I20260709 13:09:09.717653 27215 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:09.445559 27503 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:09.606834 27515 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:09:09.677634 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 376047us
I20260709 13:09:09.879855 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.465515 27420 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:09.602067 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:09.652367 27288 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:09.713434 27508 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:09:09.637127 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43686.6us
I20260709 13:09:09.886801 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:09.589144 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:09.722206 27333 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:09.651393 27260 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:09.582170 27356 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.518s	user 0.001s	sys 0.009s
I20260709 13:09:09.602886 27137 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.650956 27464 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:09:09.645013 27376 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:09.905639 23257 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:09:09.906381 23257 pending_rounds.cc:85] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 13
I20260709 13:09:09.906810 23257 pending_rounds.cc:107] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:09:09.907063 23257 raft_consensus.cc:2889] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.653887 27447 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:09.736508 22399 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:09.754357 22650 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:09.762593 22649 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:09.762197 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.757133 27323 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:09.776932 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.918272 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:09.781731 27419 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:09.811082 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:09.775293 27483 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:09.819805 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 368049us
I20260709 13:09:09.933477 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:09.820716 22646 rpcz_store.cc:276] 0709 13:09:08.632372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.811388 (+179016us) service_pool.cc:224] Handling call
0709 13:09:09.703515 (+892127us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400298bd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:09.707172 (+  3657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970592000}
I20260709 13:09:09.643046 26903 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:09.852159 22618 leader_election.cc:400] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12.
I20260709 13:09:09.854146 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:09:09.825598 27465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.014s	sys 0.006s
I20260709 13:09:09.857875 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:09.866276 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.849609 27476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.003s	sys 0.007s
W20260709 13:09:09.877290 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.853150 27506 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:09:09.890878 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:09.849457 26999 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:10.094230 22651 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:09.844789 27523 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:09.861739 27120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.006s	sys 0.005s
I20260709 13:09:09.861451 27427 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:09.855997 27379 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.077385 27465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.016s	sys 0.006s
I20260709 13:09:09.860247 27220 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:09.903990 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:09.867982 27503 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:09.911293 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 149170us
I20260709 13:09:10.072643 27482 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:10.081437 27486 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:10.146628 22647 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:09:09.941043 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.945195 22618 leader_election.cc:403] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:10.147578 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2436) took 1525 ms. Trace:
I20260709 13:09:10.144562 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:09.861254 27485 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.040666 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:10.049502 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 113169us
I20260709 13:09:09.897451 27349 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:09:10.063078 22646 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:10.158820 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 306845us
I20260709 13:09:09.917124 27324 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:10.066505 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:09.917671 27168 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.849220 27417 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:10.073114 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 219044us
W20260709 13:09:10.073691 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.932579 27483 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.075213 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 971) took 1216 ms. Trace:
I20260709 13:09:10.077731 22504 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:10.053501 27423 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.945031 27527 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:10.059650 27386 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:10.115918 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 212017us
I20260709 13:09:10.146070 27503 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.077081 27176 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.079213 27471 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:09.931185 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:10.213855 27331 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:10.214568 22572 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:09.920595 27460 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:10.148129 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 207232us
I20260709 13:09:10.217460 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:10.218113 27531 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:09:10.218739 27471 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:10.219322 27471 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:09.868606 27235 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:10.220265 27471 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.148144 22653 rpcz_store.cc:276] 0709 13:09:08.621901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.135391 (+513490us) service_pool.cc:224] Handling call
0709 13:09:09.135697 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.334672 (+198975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.147243 (+812571us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002bff54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:10.147501 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455688576}
I20260709 13:09:10.222940 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:10.172595 27265 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:10.150139 22649 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:10.097631 26999 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:10.170888 22618 leader_election.cc:400] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13.
I20260709 13:09:10.157071 27464 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:10.180649 27417 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.239612 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:10.095754 27326 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.182049 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:10.182327 27498 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:10.182783 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 980) took 1033 ms. Trace:
I20260709 13:09:10.184731 22499 rpcz_store.cc:276] 0709 13:09:08.859108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.054221 (+195113us) service_pool.cc:224] Handling call
0709 13:09:09.054641 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.064369 (+  9728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.064399 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.077617 (+ 13218us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.342615 (+264998us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:09.342654 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.342714 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.074948 (+732234us) raft_consensus.cc:1685] finished
0709 13:09:10.074978 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.075143 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2092,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":19913,"spinlock_wait_cycles":102656,"thread_start_us":245351,"threads_started":1,"wal-append.queue_time_us":409737}
I20260709 13:09:10.256423 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:10.146368 27120 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.174311 27426 consensus_meta.cc:287] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.995s	user 0.015s	sys 0.007s
I20260709 13:09:09.906220 27137 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:10.185676 27530 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:09:10.143735 27533 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:10.223796 22501 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:10.215256 27509 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.769s	user 0.004s	sys 0.000s
I20260709 13:09:10.227586 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:10.233438 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 60138.9us
I20260709 13:09:10.307261 22504 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:10.307801 22498 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:10.174587 27465 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:10.235615 22618 leader_election.cc:403] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:09:10.311225 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 147115us
I20260709 13:09:10.080025 27354 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:09:10.189780 27483 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.097812 27323 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.141392 27379 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.213899 27176 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.257385 22500 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:09:10.333339 27542 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:09:10.333480 27545 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:10.334007 27545 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:10.334338 27379 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.334935 27545 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.336380 27545 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:10.256094 22496 rpcz_store.cc:276] 0709 13:09:09.149814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.341286 (+191472us) service_pool.cc:224] Handling call
0709 13:09:09.371694 (+ 30408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.583514 (+211820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.583570 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.584126 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.889952 (+305826us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:09.890001 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.890081 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.182543 (+292462us) raft_consensus.cc:1685] finished
0709 13:09:10.182565 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.182716 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":279990,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":406122,"threads_started":2,"wal-append.queue_time_us":491771}
I20260709 13:09:10.337603 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:10.319481 27520 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.338961 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:10.095301 27333 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.318111 27465 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.274812 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:10.265306 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:10.141630 27523 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:10.297466 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 146898us
I20260709 13:09:10.233722 27423 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.241106 27324 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.239459 26999 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:10.188357 27168 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:10.305833 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 123869us
I20260709 13:09:10.247469 27420 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:10.284794 27535 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.390s	user 0.002s	sys 0.000s
I20260709 13:09:10.255939 27498 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:10.293267 27120 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.275826 27464 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:10.342921 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:10.292779 27426 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.389462 22505 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:10.390630 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45836.8us
I20260709 13:09:10.394829 22496 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:10.397746 27537 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:09:10.398612 27426 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.360980 27419 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:10.384843 27473 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.117s	user 0.009s	sys 0.006s
I20260709 13:09:10.360688 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:10.311024 27527 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:10.369716 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:10.419871 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:10.420688 22499 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.401547 27323 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:10.373229 22618 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 813ede727198414390a20d5845e75e07. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.426554 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 113753us
I20260709 13:09:10.378566 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:10.429400 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 50968.4us
I20260709 13:09:10.156347 23263 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:09:10.403612 27176 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.405332 27523 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.408075 27483 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.412613 22496 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:10.390436 27379 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.355571 22501 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:10.370081 22500 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:10.375391 27423 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.448064 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:10.385147 27420 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.452764 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:10.443408 27538 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:09:10.456498 22505 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:10.439599 27501 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.440333 27486 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:10.452064 22499 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:10.483857 22500 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:10.453033 27521 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.455549 27485 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.450968 27518 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:10.452561 27550 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.516786 22505 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:10.498037 27521 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.517274 22505 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:10.518106 22505 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.519014 27521 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.519073 22505 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:10.521226 27486 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.521999 27483 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.525589 27420 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:10.522711 27442 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.031s	user 0.005s	sys 0.006s
I20260709 13:09:10.507946 27465 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.510423 27550 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.509326 27549 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:10.499670 27552 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.457280 27464 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.499960 27518 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.480924 27501 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.424525 27527 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.534570 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2450) took 1672 ms. Trace:
I20260709 13:09:10.553977 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:10.556808 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.566885 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.579484 22647 rpcz_store.cc:276] 0709 13:09:08.862228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.189053 (+326825us) service_pool.cc:224] Handling call
0709 13:09:09.263766 (+ 74713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.147161 (+883395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.534243 (+387082us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54004308d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:10.534494 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029732096}
W20260709 13:09:10.564988 27548 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:09:10.549162 27546 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:09:10.530813 27338 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.197s	user 0.013s	sys 0.000s
W20260709 13:09:10.527060 27470 consensus_meta.cc:287] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.184s	user 0.011s	sys 0.000s
I20260709 13:09:10.552278 27168 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.565968 27423 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.538889 27550 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.566656 27137 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:10.587097 26847 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13.
I20260709 13:09:10.592974 27427 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.557619 27518 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:10.560117 27501 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:10.602301 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:10.645419 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:10.603035 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:10.610193 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:10.582319 27503 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.593243 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:10.543746 26999 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:10.645550 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 275940us
I20260709 13:09:10.578306 27220 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:10.650352 27220 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.650662 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:10.651377 26999 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:10.655802 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 52856.2us
I20260709 13:09:10.535616 27442 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:10.616643 27445 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.004s
I20260709 13:09:10.656932 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:10.615535 27483 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:10.663940 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:10.666661 22578 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:10.673480 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:10.676168 22498 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:10.677732 22646 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:10.679297 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:10.687340 22649 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:10.687672 22571 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:10.537683 27552 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.601985 27470 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.683301 22654 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:09:10.601809 27338 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.664885 26903 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:10.680070 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:10.657981 27550 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.690398 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:10.690397 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:10.692835 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:10.694665 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:10.671867 27445 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:10.649042 27427 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.691231 23227 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:10.695089 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:10.690397 27376 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:10.710565 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:10.714046 27552 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.715233 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:10.729696 22647 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:10.692627 27176 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:10.719259 27421 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.000s
W20260709 13:09:10.721589 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.678753 27483 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.698673 27265 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12.
I20260709 13:09:10.726253 22575 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:10.690987 27120 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.723449 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 630) took 1832 ms. Trace:
I20260709 13:09:10.734030 22645 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:10.736716 23257 rpcz_store.cc:276] 0709 13:09:08.890731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.891986 (+  1255us) service_pool.cc:224] Handling call
0709 13:09:08.892254 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.917053 (+1024799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.723111 (+806058us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400680954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:10.723371 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324753664}
I20260709 13:09:10.709321 27220 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:10.734179 27284 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:10.752302 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.754349 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:10.737345 27379 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.750365 27543 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.428s	user 0.002s	sys 0.001s
I20260709 13:09:10.744272 27552 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:10.458532 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:10.807902 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:10.818396 22580 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:10.808776 22573 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:10.809108 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:10.821887 22574 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:10.816659 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:10.824661 22571 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:10.837710 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 147399us
I20260709 13:09:10.841572 22650 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:10.808195 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:10.786664 22399 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 11 to 12, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 12 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:09:10.849195 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 167873us
W20260709 13:09:10.853369 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.854326 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.769793 27284 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.862800 22571 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:10.862984 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:10.810796 27427 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.878415 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:10.802690 27423 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:10.811831 27483 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.837307 27476 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:10.894512 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:10.856570 27260 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:10.869186 27284 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:10.906816 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 955) took 1122 ms. Trace:
I20260709 13:09:10.911916 22649 rpcz_store.cc:276] 0709 13:09:09.784069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.255793 (+471724us) service_pool.cc:224] Handling call
0709 13:09:10.262539 (+  6746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.691122 (+428583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.906366 (+215244us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54002daad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:10.906724 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972961152}
I20260709 13:09:10.908090 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2758) took 1322 ms. Trace:
I20260709 13:09:10.913547 22652 rpcz_store.cc:276] 0709 13:09:09.585367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.765940 (+180573us) service_pool.cc:224] Handling call
0709 13:09:09.766342 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.906684 (+140342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.906719 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.906770 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:09.906804 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.907765 (+1000961us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54002dafd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:10.907835 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.908013 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322183552}
I20260709 13:09:10.882759 27521 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.877779 27527 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.813154 27379 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.866879 27552 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:10.928113 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 234391us
I20260709 13:09:10.960484 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 985) took 1115 ms. Trace:
I20260709 13:09:10.948990 27442 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.900199 27423 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.959164 27516 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.943034 27521 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:10.926307 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 963) took 1008 ms. Trace:
I20260709 13:09:10.973434 27503 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:10.990077 27338 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:10.972314 27562 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:09:11.029306 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:11.029623 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:11.031450 27523 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:11.033391 27450 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.034314 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.716s (SENT) [suppressed 9 similar messages]
W20260709 13:09:10.902660 27568 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.002s
W20260709 13:09:10.975296 27559 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:09:11.038681 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:10.993342 22502 rpcz_store.cc:276] 0709 13:09:09.844894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.846619 (+  1725us) service_pool.cc:224] Handling call
0709 13:09:09.849661 (+  3042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.855980 (+  6319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.856017 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.868037 (+ 12020us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.101278 (+233241us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:10.101325 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.101395 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.725207 (+623812us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:10.949369 (+224162us) raft_consensus.cc:1685] finished
0709 13:09:10.949400 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.960409 (+ 11009us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23,"raft.queue_time_us":52971,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":29782,"spinlock_wait_cycles":20075776,"thread_start_us":178782,"threads_started":1,"wal-append.queue_time_us":308419}
I20260709 13:09:10.945629 27260 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:10.972759 27048 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:11.033942 27450 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.041069 27048 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:11.041342 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:11.041539 27284 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:11.042543 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.042155 27048 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.043040 27450 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.043242 27048 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:11.043599 27284 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.045509 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2745) took 2320 ms. Trace:
I20260709 13:09:11.045938 22648 rpcz_store.cc:276] 0709 13:09:08.724920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.142239 (+417319us) service_pool.cc:224] Handling call
0709 13:09:09.142557 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.615583 (+473026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.615614 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.639027 (+ 23413us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.785402 (+146375us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:09.785450 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.021060 (+1235610us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b5400168d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.021145 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.021212 (+    67us) raft_consensus.cc:1685] finished
0709 13:09:11.021233 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.045443 (+ 24210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2735,"raft.queue_time_us":6603,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":15225,"spinlock_wait_cycles":1088753408,"thread_start_us":138729,"threads_started":1,"wal-append.queue_time_us":829088}
I20260709 13:09:11.052917 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:11.053668 23264 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:11.010747 22580 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:11.012737 22574 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:11.015640 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:10.964104 26903 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:10.976069 27470 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.057050 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 952) took 1293 ms. Trace:
I20260709 13:09:11.057463 22651 rpcz_store.cc:276] 0709 13:09:09.764434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.116353 (+351919us) service_pool.cc:224] Handling call
0709 13:09:10.168430 (+ 52077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.335323 (+166893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.335350 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.335821 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.489877 (+154056us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:10.489916 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.035396 (+545480us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400235d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.035429 (+    33us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.035461 (+    32us) raft_consensus.cc:1685] finished
0709 13:09:11.035468 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.056980 (+ 21512us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5341,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":20625,"spinlock_wait_cycles":382772096,"thread_start_us":153659,"threads_started":1,"wal-append.queue_time_us":278987}
I20260709 13:09:11.016909 22652 rpcz_store.cc:276] 0709 13:09:09.917526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.925096 (+1007570us) service_pool.cc:224] Handling call
0709 13:09:10.925575 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.925848 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.925884 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.925943 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:10.925990 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.926070 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.926224 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:10.942310 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 962) took 1039 ms. Trace:
I20260709 13:09:11.058861 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:10.975049 27527 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.023306 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:11.024533 27560 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 13:09:11.026475 27545 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.690s	user 0.014s	sys 0.000s
W20260709 13:09:11.018508 27566 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:09:11.037009 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.032322 27523 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.059291 22649 rpcz_store.cc:276] 0709 13:09:09.902492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.929128 (+1026636us) service_pool.cc:224] Handling call
0709 13:09:10.941630 (+ 12502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.941872 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.941905 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.941960 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:10.942005 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.942074 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.942230 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.014840 27445 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:11.056459 23257 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:09:11.084030 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:11.097112 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.060649 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:11.091616 22501 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:11.092370 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.076442 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:11.100633 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:11.101461 22571 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:11.051638 27450 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:11.100764 22498 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:11.101310 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:11.109781 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.110682 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:11.081300 27442 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:11.041039 27521 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:11.114658 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:11.119942 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:11.122684 22649 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:11.125422 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.115788 22648 raft_consensus.cc:2368] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9.
I20260709 13:09:11.098006 27338 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.136464 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:11.141009 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:11.142545 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:11.019604 27516 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.146376 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:11.102119 27578 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:11.148617 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.148447 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:11.060338 27518 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.087466 27503 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:09:11.150835 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.113889 26847 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:11.094986 27527 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.154207 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.157404 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:11.152395 27578 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.160101 26847 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:11.160276 27578 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.161253 26847 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:11.163661 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.163935 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 958) took 1379 ms. Trace:
I20260709 13:09:11.164361 22654 rpcz_store.cc:276] 0709 13:09:09.792319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.412707 (+620388us) service_pool.cc:224] Handling call
0709 13:09:10.415249 (+  2542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.693887 (+278638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.163679 (+469792us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400169254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.163877 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615677312}
I20260709 13:09:11.135257 27326 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:11.134116 27445 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:11.133469 27427 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:11.166647 22572 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:09:11.173913 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 139616us
I20260709 13:09:11.168073 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.174729 22580 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:11.175218 23255 raft_consensus.cc:2368] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:11.170182 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.115474 27450 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.180188 23263 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:11.152127 27471 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:11.185374 22654 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:11.151881 27244 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:11.191582 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 959) took 1301 ms. Trace:
I20260709 13:09:11.192373 22647 rpcz_store.cc:276] 0709 13:09:09.890414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.856187 (+965773us) service_pool.cc:224] Handling call
0709 13:09:10.860561 (+  4374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.040673 (+180112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.040702 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.040744 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:11.040790 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.191254 (+150464us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400325d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.191325 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.191506 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413751552}
I20260709 13:09:11.139287 27421 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:09:11.199512 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:11.203150 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:11.200928 22574 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:09:11.205180 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.206739 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.208177 22574 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:11.149435 27521 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:11.168999 27326 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:11.151971 27338 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.134704 27552 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.212288 22647 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:11.216753 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:11.160471 27498 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.221272 22574 raft_consensus.cc:2368] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9.
I20260709 13:09:11.198575 27260 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:11.218000 27569 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 13:09:11.231143 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:11.234807 22499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.018s
W20260709 13:09:11.235318 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.008s	sys 0.018s
I20260709 13:09:11.210189 27244 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:11.177947 27445 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:11.221428 27570 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:09:11.218145 27326 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.248162 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.152264 26903 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.276007 22574 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:11.277370 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.278302 22574 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:11.186568 27427 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.281297 27427 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:11.235464 27323 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.785s	user 0.014s	sys 0.000s
I20260709 13:09:11.213752 27471 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:11.247550 27498 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:11.283171 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.253409 27583 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:09:11.254145 27582 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:09:11.257692 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:11.258713 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 961) took 1361 ms. Trace:
I20260709 13:09:11.293654 22650 rpcz_store.cc:276] 0709 13:09:09.897277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.934382 (+ 37105us) service_pool.cc:224] Handling call
0709 13:09:11.258516 (+1324134us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001c84d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:11.258631 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315321216}
I20260709 13:09:11.258607 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.295658 22580 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:11.260134 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:11.261237 22571 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 13:09:11.261987 27423 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.262495 22652 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:11.265044 27244 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.210286 27420 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:11.248817 22647 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:11.270738 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:11.252641 22646 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:11.229125 27447 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:11.282727 22572 raft_consensus.cc:2410] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:11.274017 27379 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:11.301162 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:11.317488 27518 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.304615 26999 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:11.305478 27442 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:11.306936 27447 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:11.309231 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:11.310384 27423 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:11.319516 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:11.325596 27423 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.326165 27423 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:11.312194 27527 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.313750 27450 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.333598 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:11.282037 27427 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.297201 27574 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:09:11.337888 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.347556 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3400) took 1104 ms. Trace:
I20260709 13:09:11.355502 22499 rpcz_store.cc:276] 0709 13:09:10.243441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.481966 (+238525us) service_pool.cc:224] Handling call
0709 13:09:10.482393 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.482825 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:10.710131 (+227306us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.346769 (+636638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.346828 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.346877 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.346949 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.347487 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34466,"prepare.queue_time_us":269810,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":57,"raft.queue_time_us":74352,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":840034,"threads_started":3,"wal-append.queue_time_us":616163}
I20260709 13:09:11.356364 27476 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:11.359843 27476 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:11.369639 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2759) took 1783 ms. Trace:
I20260709 13:09:11.370244 22645 rpcz_store.cc:276] 0709 13:09:09.585792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.889511 (+303719us) service_pool.cc:224] Handling call
0709 13:09:09.891056 (+  1545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.737621 (+846565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.369299 (+631678us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540017d254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.369545 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938225408}
I20260709 13:09:11.373904 27338 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.328351 27442 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.375281 27442 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:11.383602 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 784) took 1742 ms. Trace:
I20260709 13:09:11.388716 27447 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.390767 27447 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.393286 27516 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.402668 22399 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 5, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:11.404748 22399 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 8 to 12, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 12 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:11.406504 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 824) took 1473 ms. Trace:
I20260709 13:09:11.406937 22575 rpcz_store.cc:276] 0709 13:09:09.933608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.936061 (+  2453us) service_pool.cc:224] Handling call
0709 13:09:09.936503 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.736535 (+800032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.406218 (+669683us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54003c91d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.406440 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815672576}
I20260709 13:09:11.409106 27445 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.410108 27445 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:11.410853 27445 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:11.411942 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.415151 27518 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:11.415757 27518 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.416982 22498 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:11.415978 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.417909 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.418222 22497 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:11.419332 27523 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.417933 27518 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.423064 27518 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.423511 27518 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.424244 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:11.425012 27523 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:11.425693 27260 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:11.427433 27464 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:11.428439 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:11.430797 27584 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.272s	user 0.005s	sys 0.000s
I20260709 13:09:11.431340 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:11.433205 27288 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:11.425611 27523 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.433753 22505 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:11.435606 27523 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.384197 23261 rpcz_store.cc:276] 0709 13:09:09.641060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.641231 (+   171us) service_pool.cc:224] Handling call
0709 13:09:09.641564 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.320273 (+678709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.320315 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.330591 (+ 10276us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.810785 (+480194us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:10.810848 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.383024 (+572176us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54005fb9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.383094 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.383174 (+    80us) raft_consensus.cc:1685] finished
0709 13:09:11.383194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.383512 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":498,"raft.queue_time_us":2991,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":16630,"spinlock_wait_cycles":1559847936,"thread_start_us":462796,"threads_started":1,"wal-append.queue_time_us":579318}
I20260709 13:09:11.433293 27260 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:11.438798 27518 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:11.439677 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:11.441401 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:11.442203 22647 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:11.442674 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:11.444074 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.445205 27260 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:11.445789 27260 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:11.447021 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:11.446833 27260 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.448302 27470 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.433475 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3383) took 1214 ms. Trace:
I20260709 13:09:11.336102 27471 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.328310 27379 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:11.424494 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:11.471361 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.473204 22503 rpcz_store.cc:276] 0709 13:09:10.219237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.228458 (+  9221us) service_pool.cc:224] Handling call
0709 13:09:10.228914 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.386625 (+157711us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:10.603014 (+216389us) log.cc:844] Serialized 14 byte log entry
0709 13:09:10.856946 (+253932us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.857006 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:10.857059 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.432231 (+575172us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b18004a92c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:09:11.433179 (+   948us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001b9754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:11.433252 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.433407 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7426,"prepare.queue_time_us":319241,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":7542,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":12594,"spinlock_wait_cycles":378491392,"thread_start_us":439755,"threads_started":2,"wal-append.queue_time_us":415238}
I20260709 13:09:11.348109 27427 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.486892 22652 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
W20260709 13:09:11.492851 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68428.8us
I20260709 13:09:11.494961 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:11.496402 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.497720 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:11.503554 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.504604 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.505774 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.507820 22503 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:11.510711 22647 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:11.510715 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:11.510999 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.511646 22499 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.513098 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:11.488390 27595 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:11.523319 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:11.524667 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.529939 27427 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:11.548642 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 345575us
I20260709 13:09:11.533576 22497 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:09:11.549839 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.549721 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.534906 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.551119 22498 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:11.533668 22544 leader_election.cc:400] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:11.476006 27483 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.574736 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:11.575453 22503 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:11.537349 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:11.537729 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3401) took 1293 ms. Trace:
I20260709 13:09:11.580718 22505 rpcz_store.cc:276] 0709 13:09:10.243974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.531504 (+287530us) service_pool.cc:224] Handling call
0709 13:09:11.433399 (+901895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.434314 (+   915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.537538 (+103224us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54001b9750. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:11.537675 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073334144}
I20260709 13:09:11.484655 27516 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:11.485523 27379 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.549829 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:11.553242 22504 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:11.582020 27379 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:11.495060 27550 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.003s
I20260709 13:09:11.582702 27550 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:11.556939 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.584004 22572 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:11.557634 22499 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:11.554363 22500 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:11.487915 26999 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:09:11.476581 27470 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:11.615345 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 355298us
I20260709 13:09:11.618896 22496 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:11.587116 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:11.602952 23255 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:11.623319 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:11.516636 27598 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:11.519582 27523 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:09:11.586767 27450 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:11.647574 22399 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 11, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 11 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.578263 26847 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:11.586443 27591 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:11.624253 27048 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:11.620383 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 122726us
I20260709 13:09:11.677964 27498 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.679383 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 108771us
W20260709 13:09:11.679864 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 130136us
I20260709 13:09:11.751875 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:11.680295 27550 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:11.686760 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.701948 27596 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:09:11.734606 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 114628us
I20260709 13:09:11.761818 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:11.588469 27483 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:11.747093 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 223882us
I20260709 13:09:11.749115 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:11.758739 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:11.770538 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:11.772097 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:11.785712 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.745491 27445 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:11.793918 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 303463us
I20260709 13:09:11.747109 27048 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.797071 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:11.797608 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48602.6us
I20260709 13:09:11.801455 22498 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:11.756744 27338 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.804950 22496 raft_consensus.cc:2410] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:11.759321 27323 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.808355 22468 leader_election.cc:400] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9.
W20260709 13:09:11.814491 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46872.4us
I20260709 13:09:11.819082 22544 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:11.821264 22503 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:11.776304 27472 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:11.793458 27552 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:11.793183 27598 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:11.802618 27331 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:11.825281 22499 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:11.707813 27442 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.807737 27048 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:11.750108 26847 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.806097 27578 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:11.759569 27498 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:11.849766 27423 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.004s
W20260709 13:09:11.829653 27244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.031s	sys 0.048s
I20260709 13:09:11.822890 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:11.865859 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:11.869516 22573 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:11.879549 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2770) took 1017 ms. Trace:
I20260709 13:09:11.880133 22654 rpcz_store.cc:276] 0709 13:09:10.862112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.186948 (+324836us) service_pool.cc:224] Handling call
0709 13:09:11.187504 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.187920 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.187963 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.195985 (+  8022us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.322952 (+126967us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:11.323008 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.323111 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.879254 (+556143us) raft_consensus.cc:1685] finished
0709 13:09:11.879285 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.879472 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44544,"thread_start_us":103623,"threads_started":1,"wal-append.queue_time_us":353354}
I20260709 13:09:11.873001 22574 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:11.807143 27550 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:09:11.884909 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 73924.7us
I20260709 13:09:11.887722 22468 leader_election.cc:400] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9.
I20260709 13:09:11.890893 23263 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:11.891058 22503 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:09:11.891484 22503 pending_rounds.cc:85] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 10
I20260709 13:09:11.891759 22503 pending_rounds.cc:107] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:09:11.892057 22503 raft_consensus.cc:2889] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.812271 27338 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:11.862329 27552 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:11.817334 27577 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:11.809129 26903 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:09:11.896636 22498 pending_rounds.cc:85] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 7
I20260709 13:09:11.911365 22498 pending_rounds.cc:107] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:09:11.840668 27324 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:09:11.822450 27323 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.893904 22496 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:09:11.886619 27244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.031s	sys 0.049s
I20260709 13:09:11.888703 27598 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:11.894392 27288 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:11.911854 22498 raft_consensus.cc:2889] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.946441 27483 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:11.886547 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66135.2us
I20260709 13:09:11.887941 27423 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:11.955193 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.888522 22468 leader_election.cc:403] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.886411 27575 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:11.845232 27386 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:09:11.930102 22496 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:09:11.896674 27326 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
W20260709 13:09:11.885156 27476 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 13:09:11.896112 27516 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:11.894248 27472 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:09:11.893605 27581 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:11.919817 27485 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:11.924201 27549 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:11.919541 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 77747.2us
W20260709 13:09:11.960100 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 72563.8us
I20260709 13:09:12.006210 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:11.896721 27501 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:09:11.961256 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:11.963126 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:11.952508 26999 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:09:11.967900 27421 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:11.970813 27244 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:11.973198 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.977041 27333 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:12.021134 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:11.978055 27376 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.979089 27423 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.979686 22502 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:11.981822 26847 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.938208 27580 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:11.982550 27450 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9.
I20260709 13:09:11.983144 27442 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:11.984524 27593 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.951212 27465 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:09:11.984990 27523 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:11.986451 27338 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:11.987268 27599 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 13:09:11.987723 27498 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.951581 27470 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:11.990839 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:11.996641 27476 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.033155 27607 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:11.994774 27575 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.072070 22574 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:09:12.008136 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 192589us
I20260709 13:09:12.057824 27421 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:09:12.018424 22500 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
W20260709 13:09:12.024782 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61791.6us
I20260709 13:09:11.951212 27288 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:12.040244 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.997011 27326 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.047173 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.082381 22573 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:12.042827 27580 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.030433 27471 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:12.021236 27333 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.051383 27501 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:12.037465 27376 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.046414 27523 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.105784 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:12.106462 23263 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:12.087136 26847 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:09:12.107705 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.056928 22651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:12.108649 23255 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:12.046608 27593 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.057492 27521 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:12.030157 27120 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:09:12.043147 27611 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:12.110884 27611 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:12.091912 27623 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.111855 27611 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.112601 27623 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.113255 27611 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:12.114530 27523 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:12.117287 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 111170us
I20260709 13:09:12.118013 27450 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:12.119083 27598 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.119297 27427 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.119575 27598 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.119998 27427 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.120687 27423 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:12.121963 27598 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.122493 27598 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.122606 27427 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.123090 27598 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.123770 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.124203 22501 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:12.124379 22649 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:12.124835 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:12.056128 27048 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.126124 22500 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:12.027449 27591 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:12.083117 22499 raft_consensus.cc:2410] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:12.007550 22646 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:09:12.086603 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.076493 27442 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:12.069018 27516 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.129040 27442 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:12.129593 27376 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.129959 27442 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.093806 27235 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:09:12.131438 27235 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:12.131616 27442 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:12.132021 27235 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:12.094955 22497 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:12.095602 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:12.092085 22399 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 9, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 9 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.073500 27607 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:12.104983 27471 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:12.070178 27284 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:09:12.106974 27580 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.097493 27465 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:09:12.112468 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.125728 27561 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:12.149994 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.127728 27048 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:12.133437 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.105585 27333 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.026737 27323 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.057744 27609 raft_consensus.cc:2955] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:09:12.078919 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:12.076332 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 102531us
I20260709 13:09:12.140401 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.141328 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.180065 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.149322 22579 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:12.150712 22503 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 5.
I20260709 13:09:12.153605 27501 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:09:12.192968 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116809us
W20260709 13:09:12.153061 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57490.7us
W20260709 13:09:12.155716 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.157224 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.210031 23255 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:12.158330 27326 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.158643 27445 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:12.159749 27598 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.150197 27561 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.160395 27593 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.115352 27623 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.162142 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.165071 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:12.138775 22576 raft_consensus.cc:2955] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
W20260709 13:09:12.247218 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 61219.4us
I20260709 13:09:12.248232 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:12.165872 27575 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.190466 22399 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 8 to 11, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 11 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:12.211185 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:12.219789 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.175951 27288 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:12.226176 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:12.226265 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 73959.8us
W20260709 13:09:12.174191 27379 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.005s
I20260709 13:09:12.264753 27379 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.134207 27607 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:12.233915 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.235838 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.236965 22648 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:12.244112 23263 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:12.245312 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:12.332964 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75076.8us
W20260709 13:09:12.246464 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60630.3us
W20260709 13:09:12.246165 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 167337us
I20260709 13:09:12.171051 27176 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:12.250113 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.221319 22650 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:12.334762 22645 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:12.169494 27450 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.169497 27476 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:12.247367 22502 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:12.361407 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.218766 27580 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:09:12.238551 27561 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:12.257921 27324 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:12.229995 27235 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.280911 27623 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:12.191593 27501 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:12.258134 27465 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:12.331591 22653 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:09:12.330844 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82713.6us
I20260709 13:09:12.409293 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:12.250777 23264 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:12.361604 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:12.365463 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:12.373281 23263 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:09:12.362756 27600 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.674s	user 0.004s	sys 0.005s
I20260709 13:09:12.415211 23260 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:12.344594 27516 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:12.336714 27176 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:12.167181 27471 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:12.403756 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.404332 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:12.407930 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.428165 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 172215us
I20260709 13:09:12.404054 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.337952 27483 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:12.390033 27625 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 13:09:12.415215 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:12.391978 27624 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.137s	user 0.000s	sys 0.013s
W20260709 13:09:12.417181 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51792.1us
I20260709 13:09:12.418740 23263 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:12.421761 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.455680 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.376214 27521 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:09:12.422673 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:12.407243 27447 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.016s	user 0.008s	sys 0.011s
I20260709 13:09:12.429426 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:12.336880 27578 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:12.437492 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:12.423799 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 271081us
I20260709 13:09:12.362330 27450 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.442054 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.445678 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:12.450557 23258 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:09:12.451719 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:12.428099 27575 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:12.253414 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:12.452704 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:12.460798 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:12.482331 22497 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:12.465293 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.467576 22573 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:12.390831 27244 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:09:12.469381 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.425662 27550 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.472160 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.423044 27516 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:12.473443 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44084.2us
I20260709 13:09:12.450090 27465 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:12.496676 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:12.474917 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.475489 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.476379 22579 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:12.424757 27616 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:09:12.458500 27623 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.480456 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.479641 22653 raft_consensus.cc:2410] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:12.483930 22502 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:12.486044 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.486706 27450 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.431936 27483 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:12.512953 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 259591us
I20260709 13:09:12.514051 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:12.514783 27613 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:12.515460 27613 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:12.515949 27613 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:12.481385 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:12.477982 27578 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:12.518054 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.518666 22500 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:12.518807 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.519536 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:12.519851 27427 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:12.520340 22468 leader_election.cc:400] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9.
I20260709 13:09:12.520581 27427 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:12.520991 27427 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:12.478873 27593 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:12.521371 27427 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:12.521514 27593 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.522344 27379 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:12.524062 27593 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.501571 27288 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:12.525331 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:12.476116 27386 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.526432 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:12.526779 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.526737 27386 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.528208 27523 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:12.528811 27427 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.529532 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:12.530181 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.530921 22575 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:12.531124 27427 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.531996 22575 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:12.533300 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.507328 27324 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:12.534837 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.536206 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:12.536479 27606 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:12.536981 27606 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:12.537284 27597 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.857s	user 0.000s	sys 0.004s
I20260709 13:09:12.537537 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.537909 27623 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.539103 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.540369 27623 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.541566 22652 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:12.513475 27483 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:12.517666 27137 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:12.502206 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.563833 23258 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:12.564414 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 62270.9us
I20260709 13:09:12.565845 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.480093 27338 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:12.537597 27580 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:09:12.510569 22651 raft_consensus.cc:606] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:12.572394 22651 raft_consensus.cc:614] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:12.498689 22469 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:12.573261 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 74633.6us
I20260709 13:09:12.573720 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.544179 27486 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:12.545159 27523 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:12.511539 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.545190 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.549425 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.549953 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.549425 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:12.481173 26999 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:12.481840 27575 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.489862 27550 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.491083 27476 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:12.481084 27598 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.478245 27577 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.488809 27501 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.553369 27613 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.503010 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:12.585371 27333 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:12.566634 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:12.584998 27288 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:12.570176 22497 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:12.591809 27379 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:12.574087 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:12.526432 27620 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:09:12.558087 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 216418us
I20260709 13:09:12.580504 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.589903 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.590312 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.590649 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.591073 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:12.591272 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.666355 22500 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:12.591763 23256 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:12.595049 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:12.668190 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 94203us
W20260709 13:09:12.668710 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 78487.5us
I20260709 13:09:12.616824 27575 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.537328 27606 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:12.622552 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.572379 27503 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:12.565128 26847 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 13:09:12.529390 27632 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:09:12.650092 27613 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.640792 27598 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.644989 27577 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.630133 26755 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.655071 27501 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:12.646088 22575 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:12.645496 22577 raft_consensus.cc:2376] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11. Re-sending same reply.
I20260709 13:09:12.730301 22652 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:09:12.657063 27578 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.557895 27420 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:09:12.592952 27523 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:12.670401 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.597477 27623 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.673590 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82564.1us
I20260709 13:09:12.625099 27450 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:12.625524 27550 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.593227 27137 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:12.633033 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 87910.5us
I20260709 13:09:12.578112 27244 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:09:12.719825 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:12.719480 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:12.637171 27386 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.642693 27472 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:12.707020 27260 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:09:12.679833 27442 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.010s
I20260709 13:09:12.677834 27498 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:12.521626 27516 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.666258 27333 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.706501 27338 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:12.677600 27527 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:12.720757 27379 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:12.768225 27324 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.774641 23258 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:12.718586 23262 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:12.760149 27523 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:12.783720 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119215us
W20260709 13:09:12.792117 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 122316us
I20260709 13:09:12.804443 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.754500 26755 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.779245 27427 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:09:12.793121 27338 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:12.769644 27623 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.731890 27465 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:12.792402 27333 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:12.799440 27643 ts_tablet_manager.cc:933] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.844082 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:12.800405 27516 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:12.827749 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 247323us
I20260709 13:09:12.830868 22469 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:12.792728 27498 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:12.855615 22497 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:12.791527 27639 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:09:12.889784 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.889950 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.823480 27338 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:12.895522 23262 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:12.842536 27450 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:12.801805 27324 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.903070 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:12.884191 27442 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:12.888299 27607 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.000s
I20260709 13:09:12.886932 27547 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.884455 27379 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.908989 22498 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:12.893514 27331 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.935441 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:12.939719 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:12.954566 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.952135 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:12.910558 27609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37474 (request call id 20) took 4039 ms. Trace:
I20260709 13:09:12.964155 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:12.841652 27137 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.965925 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:12.946015 27641 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:09:12.931524 27323 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:12.937160 27658 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:12.993427 22498 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:12.995018 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:12.937461 27447 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:12.934772 27442 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.938453 27607 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.947494 27379 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:12.973721 26999 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:12.978066 27598 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.983348 27578 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:12.984261 27593 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:12.980755 27471 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:12.944146 27547 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.033198 27547 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.035207 27324 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:12.983692 27658 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:12.979975 27420 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:09:13.042784 23261 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:13.017248 27642 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:09:13.000149 27659 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:13.026962 27645 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:09:12.968820 27498 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.021137 27657 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:13.027313 27577 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:13.059813 27650 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.173s	user 0.001s	sys 0.001s
I20260709 13:09:12.966195 27609 rpcz_store.cc:276] 0709 13:09:08.864422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.351099 (+486677us) service_pool.cc:224] Handling call
0709 13:09:09.588230 (+237131us) log.cc:844] Serialized 513 byte log entry
0709 13:09:09.719212 (+130982us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003f90a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:09.741528 (+ 22316us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b18003f90a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:12.904083 (+3162555us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34882,"raft.run_cpu_time_us":2691,"raft.run_wall_time_us":84101,"spinlock_wait_cycles":55755008}
W20260709 13:09:13.077927 27655 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:13.081297 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:13.082944 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:13.083627 22576 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.048506 27593 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:13.066183 27647 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:09:13.096338 27550 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:13.097755 27663 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:13.098881 22580 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:13.099220 27651 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:09:13.099581 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38438 (request call id 54) took 1045 ms. Trace:
I20260709 13:09:13.099956 22651 rpcz_store.cc:276] 0709 13:09:12.054656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.056769 (+  2113us) service_pool.cc:224] Handling call
0709 13:09:13.099367 (+1042598us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f5853 00007fec2b2c360a 00007fec248497d4 00007fec24849762 00007fec24849691 00007fec2484960c 00007fec248488c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:13.099494 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923085184}
I20260709 13:09:13.101473 27550 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:13.102062 27653 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:09:13.101503 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:13.070375 27652 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:09:13.114485 22571 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:13.128451 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:13.063570 27623 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:13.065560 27657 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:13.158236 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:13.192394 27561 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.791s	user 0.005s	sys 0.012s
I20260709 13:09:13.192902 27561 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.201118 27333 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.205657 23259 raft_consensus.cc:2410] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:13.206534 22504 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:13.204069 27333 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.186321 27593 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.195601 27561 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.222972 22576 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:13.223347 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:13.262624 23263 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:09:13.273401 27646 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
W20260709 13:09:13.275319 27606 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.003s
I20260709 13:09:13.275803 27606 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:13.143793 27658 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.277359 27447 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.278038 27447 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:13.278662 27674 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:09:13.234089 27442 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:13.330641 27523 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.524s	user 0.001s	sys 0.011s
W20260709 13:09:13.437266 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.010s	sys 0.020s
W20260709 13:09:13.437855 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.011s	sys 0.020s
W20260709 13:09:13.438676 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 768297us
I20260709 13:09:13.290920 27607 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:13.434489 27653 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:09:13.214148 27657 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:13.567512 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2796) took 1108 ms. Trace:
I20260709 13:09:13.518589 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:13.569144 22496 rpcz_store.cc:276] 0709 13:09:12.458764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.493553 (+ 34789us) service_pool.cc:224] Handling call
0709 13:09:12.493944 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.494356 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.494396 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.495177 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.043907 (+548730us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:13.043965 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.044070 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.567286 (+523216us) raft_consensus.cc:1685] finished
0709 13:09:13.567311 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.567454 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":12195,"thread_start_us":424392,"threads_started":1,"wal-append.queue_time_us":773693}
I20260709 13:09:13.565416 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3455) took 1426 ms. Trace:
W20260709 13:09:13.569952 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51446.6us
I20260709 13:09:13.573689 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:13.438928 27379 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.572638 22572 rpcz_store.cc:276] 0709 13:09:12.138715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.138892 (+   177us) service_pool.cc:224] Handling call
0709 13:09:12.144623 (+  5731us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:12.336240 (+191617us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:12.495913 (+159673us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.783187 (+287274us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:12.790654 (+  7467us) log.cc:844] Serialized 52 byte log entry
0709 13:09:12.790848 (+   194us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:12.903434 (+112586us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.931238 (+ 27804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.931359 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.565078 (+633719us) raft_consensus.cc:1685] finished
0709 13:09:13.565114 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.565335 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382996,"prepare.queue_time_us":154343,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":246956,"raft.run_cpu_time_us":503,"raft.run_wall_time_us":29753,"thread_start_us":369174,"threads_started":3,"wal-append.queue_time_us":333821}
I20260709 13:09:13.565205 27420 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:13.516821 27643 tablet_copy_client.cc:323] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.131:35857
I20260709 13:09:13.583082 27420 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:13.566718 27447 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.486581 27442 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:13.487478 27593 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:13.576390 27427 raft_consensus.cc:2764] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:09:13.565639 27338 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.009s
I20260709 13:09:13.587797 22501 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:13.562243 27606 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:13.576220 27333 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:13.584895 22502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.031s	sys 0.043s
W20260709 13:09:13.629491 22502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.032s	sys 0.043s
I20260709 13:09:13.621310 22501 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:13.632748 27427 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:13.633173 27420 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:13.633427 27427 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.636265 27427 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.608974 27338 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:13.640015 27338 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:13.604509 27575 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.880s	user 0.014s	sys 0.000s
I20260709 13:09:13.641048 27575 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.529371 27527 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:09:13.607160 23264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.013s	sys 0.030s
W20260709 13:09:13.646799 23264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.013s	sys 0.030s
I20260709 13:09:13.645396 22577 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:13.629194 27333 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:13.657068 27498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.033s	sys 0.060s
I20260709 13:09:13.500761 27523 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:13.608933 27442 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:13.656241 27333 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:13.656785 27609 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:13.657785 27447 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:13.682696 22498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.114s	sys 0.167s
W20260709 13:09:13.683344 22498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.114s	sys 0.167s
W20260709 13:09:13.660243 27498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.033s	sys 0.060s
I20260709 13:09:13.684324 22497 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:09:13.620819 27593 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:13.689214 27420 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.719329 27676 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:13.683045 27609 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.667593 27575 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:13.714318 27465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.037s
I20260709 13:09:13.697283 27447 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.733422 27447 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:13.729415 27465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.038s
W20260709 13:09:13.738503 27137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.025s	sys 0.025s
I20260709 13:09:13.728336 27379 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.760120 27137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.025s	sys 0.026s
I20260709 13:09:13.761919 22647 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:13.720789 27420 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.773890 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:13.774713 23264 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:13.775067 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:13.775326 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:13.775873 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:13.776526 23262 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:13.777143 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:13.761785 27442 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:13.800248 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:13.786273 27688 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:13.766110 27379 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:13.802826 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:13.791922 27609 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:13.785485 27465 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:09:13.803839 27688 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:13.902961 27593 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:13.954948 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 178651us
W20260709 13:09:13.985283 27687 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.136s	user 0.004s	sys 0.005s
I20260709 13:09:14.000379 27523 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:13.999315 27420 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:14.003588 27682 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:09:13.898392 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:14.005610 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 186729us
I20260709 13:09:14.006631 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:14.007890 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:14.008833 27593 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:14.008383 27176 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.009562 27593 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:14.009770 27176 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:14.010164 27593 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:14.011905 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:14.012773 27523 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:14.014572 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:13.878743 27680 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:13.971357 27681 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.153s	user 0.007s	sys 0.000s
W20260709 13:09:14.020228 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.05607e+06us
I20260709 13:09:14.021278 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2798) took 1093 ms. Trace:
I20260709 13:09:14.021806 22496 rpcz_store.cc:276] 0709 13:09:12.927427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.579104 (+651677us) service_pool.cc:224] Handling call
0709 13:09:13.579630 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.580054 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:13.580110 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.605051 (+ 24941us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.788004 (+182953us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:13.788064 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.788169 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.021050 (+232881us) raft_consensus.cc:1685] finished
0709 13:09:14.021071 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.021219 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52483,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":136820,"threads_started":1,"wal-append.queue_time_us":372826}
I20260709 13:09:14.023806 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:13.980202 23256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 646) took 1577 ms (client timeout 1857 ms). Trace:
I20260709 13:09:14.024282 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3433) took 1118 ms. Trace:
I20260709 13:09:13.978413 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 762) took 1706 ms. Trace:
I20260709 13:09:14.025413 23261 rpcz_store.cc:276] 0709 13:09:12.272185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.343844 (+ 71659us) service_pool.cc:224] Handling call
0709 13:09:12.344264 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.046066 (+701802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.978111 (+932045us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400837554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:13.978330 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605969280}
I20260709 13:09:13.982699 27659 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:13.969336 27527 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.987069 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3428) took 1100 ms. Trace:
I20260709 13:09:14.027571 22504 rpcz_store.cc:276] 0709 13:09:12.886686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.886908 (+   222us) service_pool.cc:224] Handling call
0709 13:09:12.902008 (+ 15100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.207039 (+305031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.986715 (+779676us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001a8954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:13.986996 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699532672}
I20260709 13:09:13.991366 27288 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:14.024588 23256 rpcz_store.cc:269] 0709 13:09:12.402965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.403387 (+   422us) service_pool.cc:224] Handling call
0709 13:09:13.979955 (+1576568us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54006d1854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:13.980089 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375698816}
I20260709 13:09:13.997874 27688 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:14.015839 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3431) took 1120 ms. Trace:
I20260709 13:09:14.036850 22503 rpcz_store.cc:276] 0709 13:09:12.895321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.981298 (+ 85977us) service_pool.cc:224] Handling call
0709 13:09:12.983666 (+  2368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.012227 (+ 28561us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:13.012263 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.012690 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.207703 (+195013us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:13.207770 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.207866 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.002884 (+795018us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:14.015467 (+ 12583us) raft_consensus.cc:1685] finished
0709 13:09:14.015494 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.015775 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40040,"raft.queue_time_us":30440,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":26152,"spinlock_wait_cycles":5435264,"thread_start_us":148330,"threads_started":1,"wal-append.queue_time_us":606332}
I20260709 13:09:14.039531 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.040315 23256 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:14.014485 27483 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:14.016743 22653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2471) took 1640 ms (client timeout 1696 ms). Trace:
W20260709 13:09:14.043900 22653 rpcz_store.cc:269] 0709 13:09:12.376675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.415375 (+ 38700us) service_pool.cc:224] Handling call
0709 13:09:14.016501 (+1601126us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:14.016678 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5184896}
I20260709 13:09:14.020327 27556 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:14.024698 22498 rpcz_store.cc:276] 0709 13:09:12.905447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.996908 (+ 91461us) service_pool.cc:224] Handling call
0709 13:09:12.997340 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.997609 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.997647 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.011770 (+ 14123us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.685211 (+673441us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:13.685298 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.685384 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.024068 (+338684us) raft_consensus.cc:1685] finished
0709 13:09:14.024090 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.024227 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":634778,"threads_started":1,"wal-append.queue_time_us":768626}
I20260709 13:09:14.036240 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 841) took 1265 ms. Trace:
I20260709 13:09:13.852353 27664 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.045897 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.048254 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3436) took 1073 ms. Trace:
I20260709 13:09:14.050086 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.053939 22504 rpcz_store.cc:276] 0709 13:09:12.974686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.032471 (+1057785us) service_pool.cc:224] Handling call
0709 13:09:14.047667 (+ 15196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.047899 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.047925 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.047971 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.048005 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.048063 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.048188 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.984449 27379 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.047611 22579 rpcz_store.cc:276] 0709 13:09:12.770455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.773634 (+  3179us) service_pool.cc:224] Handling call
0709 13:09:12.773941 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.774177 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:12.902910 (+128733us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.035907 (+1132997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.035963 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:14.036007 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.036071 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.036190 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1062559,"prepare.queue_time_us":42327,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":1057603,"thread_start_us":183369,"threads_started":2,"wal-append.queue_time_us":118831}
I20260709 13:09:14.029860 27659 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:14.059151 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44640.6us
I20260709 13:09:14.047052 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:14.060446 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:14.031646 26847 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:14.063714 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:14.035847 27656 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.032336 27288 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:14.035655 27386 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.061174 27680 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:14.070502 22650 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:14.070248 26847 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:14.072083 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.096755 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.073259 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:14.083146 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:14.097851 23255 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.035462 27639 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:14.048285 27547 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:14.035686 27527 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.087911 27657 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.084703 27523 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:09:14.089807 27658 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:14.091683 27470 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.125267 27470 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:14.127601 27470 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:14.128135 27470 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.131177 27579 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:14.093144 27606 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.131795 27579 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.132128 27606 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.093397 27420 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:14.134294 27556 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.134572 27420 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.134985 27556 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.137189 27338 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.137859 27338 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.137279 27547 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.138808 27420 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:14.062920 27664 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.128578 27470 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.141873 27664 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:14.117537 27639 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.143707 23255 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:14.144929 27561 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:14.145401 27639 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:14.145783 27561 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.147804 27591 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.148073 27527 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.148578 27591 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:14.094609 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 47649.6us
I20260709 13:09:14.150269 27575 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.150817 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:14.150934 27575 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.117087 27689 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:14.121542 27657 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.122591 27523 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:14.123696 27593 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:14.133201 27288 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.149035 22496 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:14.094365 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1016) took 1096 ms. Trace:
I20260709 13:09:14.155735 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.156031 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:14.162956 22503 rpcz_store.cc:276] 0709 13:09:12.997917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.092604 (+1094687us) service_pool.cc:224] Handling call
0709 13:09:14.093864 (+  1260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.094047 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.094073 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.094114 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:14.094147 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.094199 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.094310 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.163734 22648 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:14.164477 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:14.165261 22503 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.156327 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.157102 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:14.167512 22652 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.161087 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:14.168341 22649 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:14.174733 22651 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:14.175537 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:14.177783 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.178660 22579 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:14.179591 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.179991 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.180794 22576 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:14.181509 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.181918 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:14.183086 22573 raft_consensus.cc:2368] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13.
I20260709 13:09:14.184056 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:14.185235 22580 raft_consensus.cc:2368] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:14.186312 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.189023 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.189918 22572 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:14.174443 27420 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:09:14.100644 27386 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.195775 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:14.196147 27386 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:14.196550 22576 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.199365 22573 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:14.202683 27486 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.202867 26755 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:14.203369 27486 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.203740 22578 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:14.204427 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:14.205054 27581 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.206055 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2377) took 1731 ms (client timeout 2086 ms). Trace:
I20260709 13:09:14.205719 27581 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:14.206467 22578 rpcz_store.cc:269] 0709 13:09:12.474468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.474573 (+   105us) service_pool.cc:224] Handling call
0709 13:09:14.205906 (+1731333us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54003acfd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:14.206005 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3923884928}
I20260709 13:09:14.208469 27581 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:14.231483 22576 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:14.234838 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:14.235678 22578 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:14.217775 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.210171 27527 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.210638 27586 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:14.153164 27689 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.160791 27639 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:14.156898 27696 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:14.230101 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45413.9us
I20260709 13:09:14.231645 27176 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.265381 22503 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 6.
I20260709 13:09:14.280560 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:14.281301 22503 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:14.085386 27656 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.253123 23257 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:14.262208 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.239176 27527 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:14.264557 22653 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:14.265046 22578 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:14.267019 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:14.267136 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.171716 27579 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.272488 22572 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:14.274811 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.162117 27523 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:14.276590 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.255931 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.254803 27324 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.262369 27586 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:14.316815 22504 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.314325 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.326488 22571 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:14.304828 22649 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:14.317838 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.313222 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3434) took 1374 ms. Trace:
I20260709 13:09:14.331064 22503 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
W20260709 13:09:14.312690 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.341951 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:14.343602 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.341372 23255 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:14.331074 22501 rpcz_store.cc:276] 0709 13:09:12.938686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.631232 (+692546us) service_pool.cc:224] Handling call
0709 13:09:13.632037 (+   805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.649478 (+ 17441us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:13.787477 (+137999us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.076716 (+289239us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.087843 (+ 11127us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.088033 (+   190us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:14.088073 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.088150 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.312928 (+224778us) raft_consensus.cc:1685] finished
0709 13:09:14.312957 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.313142 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32637,"prepare.queue_time_us":369367,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":37852,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":12702,"thread_start_us":373552,"threads_started":2,"wal-append.queue_time_us":509706}
W20260709 13:09:14.379933 23227 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.227.190:45599, user_credentials={real_user=slave}} blocked reactor thread for 64325.6us
I20260709 13:09:14.413581 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:14.412629 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:14.422700 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:14.379745 27421 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:14.426616 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:14.312325 27176 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:14.425719 27695 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 13:09:14.451103 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.451823 22653 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:14.289497 27639 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.417829 27579 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:14.424752 27485 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:14.427985 27607 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:14.486378 22652 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:09:14.494025 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.495718 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.497323 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.510583 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.512576 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2792) took 1601 ms. Trace:
I20260709 13:09:14.513118 22647 rpcz_store.cc:276] 0709 13:09:12.910733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.928978 (+ 18245us) service_pool.cc:224] Handling call
0709 13:09:12.929279 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.762358 (+833079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.512321 (+749963us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b5400169c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:14.512505 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914452224}
I20260709 13:09:14.514705 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.515872 22647 raft_consensus.cc:2410] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:09:14.454133 27333 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.771s	user 0.018s	sys 0.000s
I20260709 13:09:14.452401 27498 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:14.429286 27575 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.524395 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:14.380543 27324 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.494076 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3435) took 1525 ms. Trace:
I20260709 13:09:14.528074 22502 rpcz_store.cc:276] 0709 13:09:12.968452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.732601 (+764149us) service_pool.cc:224] Handling call
0709 13:09:13.732927 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.733146 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:14.051877 (+318731us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.493685 (+441808us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.493735 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:14.493794 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.493877 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.494021 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286009,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":299,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":19690,"thread_start_us":758995,"threads_started":2}
I20260709 13:09:14.320019 27523 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:14.543853 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43823.2us
W20260709 13:09:14.500204 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 378262us
I20260709 13:09:14.421295 22664 tablet_copy_service.cc:140] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Received BeginTabletCopySession request for tablet 813ede727198414390a20d5845e75e07 from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:37482)
I20260709 13:09:14.510784 22652 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:14.550004 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.442886 27577 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:14.456688 26847 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.451294 27137 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:14.536954 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:14.554167 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44459.3us
I20260709 13:09:14.443421 27527 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.493914 22504 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:14.493849 27579 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.551218 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:14.500147 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.001s	sys 0.014s
I20260709 13:09:14.537981 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.557693 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:14.527127 27333 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.523443 27586 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:14.622582 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75935.6us
I20260709 13:09:14.613674 23263 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:09:14.564543 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 317123us
W20260709 13:09:14.643972 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 86946.8us
I20260709 13:09:14.645136 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:14.641213 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.010s	sys 0.019s
I20260709 13:09:14.648959 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.650522 22652 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:14.651788 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.608551 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:14.586386 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.597744 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.576232 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.649931 23263 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:14.662807 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:14.553560 27486 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:14.556516 27523 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.616039 27527 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.563877 27607 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:14.581974 27577 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:14.655386 27552 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:14.661573 27284 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:14.662940 27137 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:14.675117 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:14.610062 27657 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:14.666018 27593 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.667703 27656 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:14.678947 27609 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:09:14.662377 27658 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:14.586122 22664 tablet_copy_service.cc:161] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Beginning new tablet copy session on tablet 813ede727198414390a20d5845e75e07 from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:37482: session id = fa2f181263f446a6962b649f9348c15f-813ede727198414390a20d5845e75e07
W20260709 13:09:14.686507 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 225858us
I20260709 13:09:14.564584 26755 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
W20260709 13:09:14.718808 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.667953 27586 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:14.741353 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 78626us
I20260709 13:09:14.743142 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:14.667261 27700 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:14.754093 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:14.756342 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:14.741914 27676 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:09:14.708747 27689 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.721313 26847 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:14.686769 27552 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.745558 27284 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:14.711575 27593 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:14.784471 27486 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:14.853588 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 98797.7us
I20260709 13:09:14.741178 27658 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.810480 27639 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.743681 27607 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.707782 27701 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.124s
W20260709 13:09:14.846237 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 103202us
I20260709 13:09:14.821422 27689 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:14.865700 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:14.867163 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.868937 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.869750 23262 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:14.872819 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.874655 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.874446 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:14.876696 22651 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:14.878867 23229 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:14.880821 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:14.862075 27656 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:14.861486 27724 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.887861 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:14.878805 27703 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:09:14.889110 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:14.895889 22572 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:14.868311 27593 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:14.857312 27700 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:14.870100 27689 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:14.820243 27577 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.878448 27486 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:14.915220 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.859046 27284 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.884405 27656 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:14.892069 27644 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 2.157s	user 0.007s	sys 0.007s
W20260709 13:09:14.891829 27708 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:09:14.919476 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.923506 22578 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:14.896243 27710 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
W20260709 13:09:14.928323 27705 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:09:14.928900 27658 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:14.929602 27717 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
W20260709 13:09:14.930136 27706 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:09:14.929139 27713 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:09:14.909761 27707 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:09:14.933210 27333 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:14.933450 27714 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:09:14.928373 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:14.917357 27702 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:09:14.925297 27724 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.937801 27579 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.938454 27734 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:14.911274 27689 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.932430 27284 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:14.963140 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.986685 22572 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
W20260709 13:09:14.963310 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80524.2us
W20260709 13:09:14.963538 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 98569.3us
W20260709 13:09:14.963857 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 207625us
I20260709 13:09:14.925614 27593 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.934300 27656 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:14.926242 27137 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:14.977602 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2797) took 2069 ms. Trace:
I20260709 13:09:14.989455 22468 leader_election.cc:400] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13.
I20260709 13:09:14.995850 22468 leader_election.cc:403] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:14.970152 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:14.997359 22578 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:14.944245 27550 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.995726 22500 rpcz_store.cc:276] 0709 13:09:12.908453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.344369 (+435916us) service_pool.cc:224] Handling call
0709 13:09:13.344927 (+   558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.428880 (+ 83953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.428933 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.429563 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.006817 (+577254us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b180041b780. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:14.441283 (+434466us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.441331 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.441407 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.977282 (+535875us) raft_consensus.cc:1685] finished
0709 13:09:14.977303 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.977538 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89052,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":4828,"spinlock_wait_cycles":4825856,"thread_start_us":434184,"threads_started":1,"wal-append.queue_time_us":1159500}
W20260709 13:09:14.995476 27483 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.943s	user 0.014s	sys 0.000s
I20260709 13:09:15.022756 27550 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:14.992242 27734 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:15.025444 27734 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:14.996152 27708 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:09:15.012773 27659 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.930s	user 0.005s	sys 0.005s
I20260709 13:09:15.029536 27659 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.030470 27486 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.031942 27659 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:14.970075 27700 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:15.032753 27700 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:15.033304 27737 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.034276 27552 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.033860 27700 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.035394 27700 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.969508 27730 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:15.038743 27730 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:15.039214 27730 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:14.987593 27688 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.939s	user 0.002s	sys 0.009s
I20260709 13:09:15.040086 27688 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.041433 22645 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:15.046217 27688 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.054034 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:15.057394 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3426) took 2173 ms. Trace:
I20260709 13:09:15.057868 22497 rpcz_store.cc:276] 0709 13:09:12.884336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.886105 (+  1769us) service_pool.cc:224] Handling call
0709 13:09:12.905645 (+ 19540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.685001 (+779356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.056966 (+1371965us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54001b9754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:15.057277 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789690752}
I20260709 13:09:15.058895 22664 tablet_copy_source_session.cc:215] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:15.003727 27741 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:15.005541 27672 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.793s	user 0.003s	sys 0.009s
I20260709 13:09:15.000118 27333 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:14.999657 27593 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.020144 27729 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13.
I20260709 13:09:15.021420 27137 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:14.977216 27724 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:15.071715 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73232.2us
I20260709 13:09:15.073554 27697 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.093192 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 130751us
I20260709 13:09:15.099604 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 842) took 2324 ms. Trace:
I20260709 13:09:15.100274 22574 rpcz_store.cc:276] 0709 13:09:12.775308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.777408 (+  2100us) service_pool.cc:224] Handling call
0709 13:09:12.777791 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.934605 (+156814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.934635 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.934677 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:12.934710 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.099204 (+2164494us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54003c82d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:15.099282 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.099512 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360112896}
I20260709 13:09:15.083232 27591 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:15.106083 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 116809us
I20260709 13:09:15.122429 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.033874 27737 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.123765 22468 leader_election.cc:400] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:15.124109 22469 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:15.124161 22468 leader_election.cc:403] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.078907 27333 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.074338 27741 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.138334 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.139329 22574 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:15.142851 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.107491 27550 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.088269 27697 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.177417 27593 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.178761 27697 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.088392 27744 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:09:15.133595 27659 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:15.129739 27658 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:15.170534 27724 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:15.173596 27747 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:15.125485 27729 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:15.160926 27686 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.176040 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.179951 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 839) took 2415 ms. Trace:
I20260709 13:09:15.210956 22577 rpcz_store.cc:276] 0709 13:09:12.764794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.772315 (+  7521us) service_pool.cc:224] Handling call
0709 13:09:12.786233 (+ 13918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.649397 (+863164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.179728 (+1530331us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54003bd154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:15.179894 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975231360}
I20260709 13:09:15.180294 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:15.212579 22573 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:15.180826 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.182142 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.213929 22572 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:09:15.184508 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:15.202527 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:15.186753 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3423) took 2335 ms. Trace:
I20260709 13:09:15.215734 22499 rpcz_store.cc:276] 0709 13:09:12.851615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.852734 (+  1119us) service_pool.cc:224] Handling call
0709 13:09:12.853068 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.853484 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.853512 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.854003 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.990008 (+136005us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:12.990038 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.990089 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.004904 (+2014815us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:15.180634 (+175730us) raft_consensus.cc:1685] finished
0709 13:09:15.180658 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.186684 (+  6026us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99410,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10105,"spinlock_wait_cycles":3287808,"thread_start_us":62286,"threads_started":1,"wal-append.queue_time_us":260721}
I20260709 13:09:15.218080 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:15.186292 23256 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:15.210122 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:15.220712 27724 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:15.221520 27685 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.345s	user 0.007s	sys 0.007s
I20260709 13:09:15.221429 27724 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:15.223767 27724 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.231236 27741 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.189610 27527 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:15.237592 27527 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.237921 27338 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.241842 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:15.243325 27753 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:15.244383 27753 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:15.244908 27753 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:15.245360 27753 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.247706 27470 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.210238 27729 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.249487 27729 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.250262 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:15.252004 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:15.255837 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.256909 22579 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 10: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:15.241925 27235 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.257815 27741 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:15.258247 27741 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.258579 27741 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.261881 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:15.181906 27697 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.263315 27697 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.267876 27427 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:15.269426 27421 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.269534 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:15.270290 27689 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.204116 27658 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.271304 27288 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.271646 27658 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:15.273022 27689 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.273669 27689 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:15.278489 27697 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.278880 27737 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.281255 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:15.282335 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.283468 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:15.284415 27338 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:15.283958 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.269977 27421 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.287961 27333 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.252097 27686 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:15.290164 22574 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:15.281112 27527 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.293856 27470 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:15.294473 27470 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:15.295476 27470 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:15.285602 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.211899 27523 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.002s
I20260709 13:09:15.302990 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.268549 27427 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:15.304520 22579 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.314599 27750 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:09:15.315068 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.315343 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.315730 22577 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:15.316061 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 2803) took 1280 ms. Trace:
I20260709 13:09:15.302835 27753 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.316421 22498 rpcz_store.cc:276] 0709 13:09:14.035280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.315105 (+1279825us) service_pool.cc:224] Handling call
0709 13:09:15.316001 (+   896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.181581 27656 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.322628 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.330195 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.330933 22573 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:15.334575 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.335263 22497 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 6.
I20260709 13:09:15.307350 27338 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:15.338418 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.339365 22500 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:15.340910 22572 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:15.312469 27689 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.333221 27586 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.001s
I20260709 13:09:15.352365 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:15.353020 22577 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.353173 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.354503 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.320168 27606 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:15.350433 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 245426us
I20260709 13:09:15.355131 22500 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:15.331614 27659 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:15.335292 27333 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:15.372031 22496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 1018) took 1600 ms (client timeout 1534 ms). Trace:
I20260709 13:09:15.354185 27338 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:15.357405 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:15.379025 22399 catalog_manager.cc:5697] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 5, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 5 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:15.361204 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.359048 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:15.372753 22496 rpcz_store.cc:269] 0709 13:09:13.771822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.023504 (+251682us) service_pool.cc:224] Handling call
0709 13:09:15.371741 (+1348237us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001a8454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:15.371939 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286232832}
I20260709 13:09:15.382612 22502 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:15.314211 27724 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.385251 22399 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 9, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 9 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.390220 27421 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.398175 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:15.391325 27427 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.392699 27741 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.397425 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:15.397663 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:15.402441 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.398217 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.415038 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.417089 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2776) took 3445 ms. Trace:
I20260709 13:09:15.354977 27689 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.401571 27754 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:15.369001 27659 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.450344 22499 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:15.455097 22503 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:15.456715 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.371778 27333 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.417779 22654 rpcz_store.cc:276] 0709 13:09:11.954197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.957192 (+  2995us) service_pool.cc:224] Handling call
0709 13:09:11.957466 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.104085 (+146619us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:12.238138 (+134053us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.464848 (+226710us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.479571 (+ 14723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.479657 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:12.482485 (+  2828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.121103 (+638618us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18003f8f80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:14.298950 (+1177847us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b18003f8f80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:14.825428 (+526478us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18003f8f80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:09:15.399673 (+574245us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400167e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:15.399719 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.399829 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14167,"prepare.queue_time_us":983967,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":83,"raft.queue_time_us":15588,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":10591,"spinlock_wait_cycles":425600128,"thread_start_us":359770,"threads_started":2,"wal-append.queue_time_us":268913,"wal-append.run_cpu_time_us":1304,"wal-append.run_wall_time_us":1001336}
I20260709 13:09:15.425308 27755 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:15.403621 27737 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:15.462091 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:15.461544 22501 raft_consensus.cc:2376] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11. Re-sending same reply.
I20260709 13:09:15.465854 27561 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.467691 27556 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.473845 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:09:15.475793 23259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 641) took 3164 ms (client timeout 3053 ms). Trace:
W20260709 13:09:15.488904 23259 rpcz_store.cc:269] 0709 13:09:12.311146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.341342 (+ 30196us) service_pool.cc:224] Handling call
0709 13:09:12.526361 (+185019us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5c0035018c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec29c65161 00007fec29e06a79 00007fec2b2c09b6 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:15.475481 (+2949120us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400437454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:15.475652 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506676480}
I20260709 13:09:15.489601 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:15.477663 27176 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.481834 27658 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.457571 22503 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:15.485426 22571 raft_consensus.cc:2410] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:15.497457 22577 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:15.498587 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:15.499840 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.501847 22503 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:15.504638 27338 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.508685 27741 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.507650 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:15.504132 27578 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.511053 27578 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.467707 27421 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.512405 27741 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:15.513042 27741 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:15.513531 27741 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.515137 27658 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.522224 27730 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.523501 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.534366 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:15.539418 27734 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:09:15.541141 27730 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.542593 27730 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:15.543581 27730 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:15.546478 27741 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.462935 27755 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.503654 27680 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.530864 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.558203 22503 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:15.559398 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.560500 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.526556 27659 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.540069 27734 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.507304 27750 raft_consensus.cc:2764] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:15.562599 22503 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:15.564670 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:15.554961 27700 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.003s
I20260709 13:09:15.565300 22503 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:15.529685 27523 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:15.577590 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.579203 22503 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:15.557361 27658 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:15.541175 27656 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.581000 22504 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:15.557641 27755 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:15.581012 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.497556 27737 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.577427 27659 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.596463 27659 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.602424 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3464) took 1356 ms. Trace:
I20260709 13:09:15.602238 27729 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.602804 22576 rpcz_store.cc:276] 0709 13:09:14.246319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.262446 (+ 16127us) service_pool.cc:224] Handling call
0709 13:09:15.062047 (+799601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.062299 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:15.062648 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.373952 (+311304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.374009 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:15.374060 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.374124 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.601524 (+227400us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18004766e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4
0709 13:09:15.602228 (+   704us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540027abd0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:15.602359 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1954,"prepare.queue_time_us":172,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":16845,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7274,"spinlock_wait_cycles":1843182208,"thread_start_us":293203,"threads_started":1,"wal-append.queue_time_us":420285}
I20260709 13:09:15.549196 27527 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:15.585996 22503 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:15.605166 22498 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:15.577827 27697 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.578722 27523 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:15.544776 27730 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.594111 27498 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:15.594972 27737 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.605458 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.582653 27689 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.616575 22503 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:15.624290 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.625169 22503 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:15.557947 27680 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:15.606853 27659 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.608703 27333 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.614497 27523 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:15.634025 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.623943 27498 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.626374 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.611431 27658 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:15.611254 27578 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.638618 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.629153 27680 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.651202 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.614006 27697 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.664752 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.670243 27753 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:15.674875 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:15.675958 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:15.683257 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.677032 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:15.685490 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:15.707152 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.717097 27658 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.757541 27523 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.691747 27498 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:15.785081 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.821544 22498 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:15.827176 27753 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:15.827841 27753 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:15.830405 27753 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:15.842350 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 308052us
I20260709 13:09:15.843343 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:15.845106 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.846776 22500 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:15.847007 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:15.849862 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.849866 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:15.850664 22500 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:15.841243 27526 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.863416 27689 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:15.851245 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.867717 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.869837 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.872045 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:15.874265 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.874877 22577 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:15.885260 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:15.886267 22500 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:15.890311 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:15.890223 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 428201us
I20260709 13:09:15.898751 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:15.899732 22576 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:15.899744 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:15.900072 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:15.866235 27753 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:15.901316 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:15.904456 22577 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.870687 27326 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:15.864280 27750 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.864279 27486 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:15.865617 27498 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.888643 27556 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.888332 27376 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:15.889289 27235 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.888975 27472 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:15.864023 27526 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.908677 27737 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.953435 27235 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.953270 27556 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:15.953927 27472 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:15.864068 27689 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.903788 27697 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:15.912202 27326 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.046403 27235 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:15.990327 27763 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:15.917050 27753 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:16.045794 27556 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.954618 27376 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.045485 27472 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.050477 27737 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.029340 27766 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:16.054894 27326 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:16.116375 27767 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.162s	user 0.000s	sys 0.008s
I20260709 13:09:16.117126 27680 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.117682 27753 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.119150 27526 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.120002 27547 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:16.120595 27659 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:16.121735 27689 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:16.027774 27755 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:15.928119 27750 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.124529 27376 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:16.152570 27659 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:16.135783 27766 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.184922 27766 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.185767 27737 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:16.186686 27755 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.187569 27750 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.189270 27680 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.259794 27376 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.196520 27472 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.305923 27472 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:16.396508 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.397949 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.406433 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:16.409175 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:16.410666 22500 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:16.415617 22502 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.030s	sys 0.060s
W20260709 13:09:16.416471 22502 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.031s	sys 0.060s
I20260709 13:09:16.416765 22503 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:15.907979 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:16.417771 22500 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:16.418632 22576 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.421978 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:16.423252 22573 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.425863 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:16.426218 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:16.426647 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.427075 22579 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:16.427611 22572 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:16.429371 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:16.431857 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:16.436534 22571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3472) took 1549 ms (client timeout 1557 ms). Trace:
W20260709 13:09:16.437227 22571 rpcz_store.cc:269] 0709 13:09:14.887230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.887559 (+   329us) service_pool.cc:224] Handling call
0709 13:09:16.436039 (+1548480us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003b3b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:16.436310 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364929920}
I20260709 13:09:16.438938 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:16.440608 22575 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 7: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:16.441630 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:16.441866 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 1024) took 1044 ms. Trace:
I20260709 13:09:16.442471 22501 rpcz_store.cc:276] 0709 13:09:15.397039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.397188 (+   149us) service_pool.cc:224] Handling call
0709 13:09:16.441259 (+1044071us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b540030bbd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:16.441619 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112463232}
I20260709 13:09:16.443624 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:16.445869 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:16.450578 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.001s	sys 0.009s
W20260709 13:09:16.451385 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.001s	sys 0.009s
W20260709 13:09:16.451853 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 603653us
I20260709 13:09:16.453542 23255 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:16.455250 22574 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:16.457413 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 1.46746e+06us
I20260709 13:09:16.460525 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:16.463495 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:16.466853 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2808) took 2178 ms. Trace:
I20260709 13:09:16.473073 22652 rpcz_store.cc:276] 0709 13:09:14.288674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.669640 (+380966us) service_pool.cc:224] Handling call
0709 13:09:14.670727 (+  1087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.670973 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:14.715523 (+ 44550us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.451820 (+1736297us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b1800233500. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:09:16.452312 (+   492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.465955 (+ 13643us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:16.466126 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.466293 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.466591 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40858,"prepare.queue_time_us":75320,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":2814720,"thread_start_us":244155,"threads_started":1,"wal-append.queue_time_us":281928,"wal-append.run_cpu_time_us":2536,"wal-append.run_wall_time_us":1220416}
I20260709 13:09:16.475399 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:16.470093 22503 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:16.482471 27326 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.484349 27659 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.485342 27680 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:16.515038 27659 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.516024 27680 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.517478 22572 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:09:16.477737 22580 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:16.487512 27750 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:16.450613 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:16.499581 27421 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:16.500114 27376 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.500587 27442 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:16.506963 27526 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:16.507297 22498 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:16.508136 27338 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.509524 27470 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.513568 27688 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:16.590428 27556 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.591130 27688 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:16.593173 27688 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.596205 27688 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:16.597198 27421 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.601704 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:16.602984 22498 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 14 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:09:16.602550 27750 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.486312 27689 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.589488 27442 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.622040 27750 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.621448 27470 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.623034 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:16.594316 22577 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.689s	user 0.005s	sys 0.010s
W20260709 13:09:16.664368 27235 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.007s
I20260709 13:09:16.665026 27235 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.677807 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:16.678237 27235 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.679117 22503 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:16.604212 27526 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:16.684090 27689 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:16.687734 27689 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.689617 27556 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.604212 27338 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:16.693269 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70643us
I20260709 13:09:16.694818 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:16.695719 22573 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:16.696933 27753 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:16.697564 27753 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:16.698101 27753 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:16.701076 22543 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.611s (SENT) [suppressed 11 similar messages]
I20260709 13:09:16.701541 27743 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:16.653126 22577 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:16.710124 22576 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:09:16.713241 22571 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:16.714800 22578 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:16.716086 22575 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:16.678267 27326 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.692687 27338 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.705838 27743 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.757304 22498 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:16.726568 22579 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:09:16.837028 22650 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:09:16.953601 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.932391 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.943889 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 198525us
I20260709 13:09:16.761035 27639 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.726282 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813ede727198414390a20d5845e75e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:16.988562 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:16.705682 27235 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:16.840389 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3450) took 1388 ms. Trace:
W20260709 13:09:16.994308 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 327697us
W20260709 13:09:16.837040 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85095.2us
I20260709 13:09:16.982236 22579 pending_rounds.cc:85] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 10
I20260709 13:09:16.994793 22502 rpcz_store.cc:276] 0709 13:09:15.396544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.396663 (+   119us) service_pool.cc:224] Handling call
0709 13:09:15.397036 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.397250 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:16.433587 (+1036337us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.708016 (+274429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.713796 (+  5780us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:16.723265 (+  9469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.751610 (+ 28345us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.784959 (+ 33349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30658,"prepare.queue_time_us":177297,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":37629,"raft.run_cpu_time_us":577,"raft.run_wall_time_us":21931,"thread_start_us":1197313,"threads_started":2,"wal-append.queue_time_us":483155}
I20260709 13:09:17.000699 27235 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.005301 27639 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.007355 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:16.996953 22579 pending_rounds.cc:107] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:16.727087 27680 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:16.754449 27556 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.028715 22503 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:16.878298 27711 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 2.165s	user 0.012s	sys 0.011s
I20260709 13:09:16.743770 27779 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:17.032560 22579 raft_consensus.cc:2889] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.909590 26847 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:16.752673 27421 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:16.983654 27743 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.727401 27659 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.980559 27442 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:16.743161 27470 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:16.727381 27691 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.953673 27689 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:17.041128 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49361.2us
I20260709 13:09:17.098776 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:16.999140 27750 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:17.052266 27235 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:17.053408 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 175111us
I20260709 13:09:17.055101 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:17.053486 22650 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:17.057473 27753 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.058866 27523 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.061249 27338 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.061467 27639 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.062986 27686 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:17.065941 27734 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.074851 22503 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:17.074493 27779 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:17.075299 22499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3447) took 1716 ms (client timeout 1845 ms). Trace:
I20260709 13:09:17.075546 26847 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.119170 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:17.119706 27689 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.120663 27235 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:17.120775 26847 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.121184 27235 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:17.082178 22497 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:17.091370 27724 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:17.093978 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.101485 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:16.834822 27731 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.266s
I20260709 13:09:17.109858 22646 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
W20260709 13:09:17.110473 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55699.7us
W20260709 13:09:17.116300 22499 rpcz_store.cc:269] 0709 13:09:15.358439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.358730 (+   291us) service_pool.cc:224] Handling call
0709 13:09:17.074830 (+1716100us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b540042a9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:17.075106 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159479680}
I20260709 13:09:17.118798 27691 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.089031 27741 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.124449 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2814) took 1430 ms. Trace:
I20260709 13:09:17.129810 27755 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:17.130380 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:17.130885 27755 consensus_queue.cc:1243] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:17.130995 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:17.131521 27755 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:17.132019 27755 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:17.132917 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.133193 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:17.133419 27689 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.122826 27235 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.134330 27689 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:17.135022 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.135823 22650 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:17.112242 27581 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:17.138170 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.128562 22504 rpcz_store.cc:276] 0709 13:09:15.550250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.435812 (+885562us) service_pool.cc:224] Handling call
0709 13:09:16.436276 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.436709 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:16.622944 (+186235us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.928095 (+305151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.928193 (+    98us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:16.980671 (+ 52478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.980751 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.980914 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39244,"prepare.queue_time_us":230250,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":22530,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":13571,"spinlock_wait_cycles":36619136,"thread_start_us":282036,"threads_started":1,"wal-append.queue_time_us":421493}
I20260709 13:09:17.137588 27734 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:17.137595 27581 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.141712 27734 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.142393 27734 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.144280 27581 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.146499 27753 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.132431 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:17.148512 22573 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:17.149367 22579 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:17.140412 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.154148 27750 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.154619 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:17.156621 27750 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.147746 27755 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.225677 22503 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:17.388831 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:17.245169 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:17.243685 22499 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:17.391755 23258 raft_consensus.cc:2410] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:17.216892 27338 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.393934 22578 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: [14.10-17.11]
I20260709 13:09:17.244416 22575 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:17.382685 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1029) took 1983 ms. Trace:
W20260709 13:09:17.314606 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 85855.4us
I20260709 13:09:17.250222 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.181382 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:17.224958 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46001.6us
I20260709 13:09:17.208197 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:17.389829 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 262942us
I20260709 13:09:17.202934 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:17.244114 22576 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:17.396389 22497 rpcz_store.cc:276] 0709 13:09:15.399249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.429344 (+ 30095us) service_pool.cc:224] Handling call
0709 13:09:17.081541 (+1652197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.124482 (+ 42941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.382356 (+257874us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540042a9d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:17.382594 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3798433536}
I20260709 13:09:17.405381 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2816) took 1843 ms. Trace:
I20260709 13:09:17.414031 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:17.395506 27772 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.065s	user 0.016s	sys 0.013s
I20260709 13:09:17.414898 22573 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:17.158293 27779 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:17.415428 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 267628us
I20260709 13:09:17.135025 27689 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:17.417243 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:17.126176 27556 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.178968 27526 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.312134 27659 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:17.263509 27324 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.420128 22503 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:09:17.419469 22577 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.403878 27581 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.194716 27691 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:17.428689 22650 raft_consensus.cc:2410] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:17.264340 27235 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.430297 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:17.300966 27743 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.244683 27765 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.178s
I20260709 13:09:17.277851 27731 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:17.431834 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 434718us
I20260709 13:09:17.437282 22574 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:17.211905 27699 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.214s
I20260709 13:09:17.423950 27788 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:17.442672 23255 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:09:17.445941 22579 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:17.412261 22501 rpcz_store.cc:276] 0709 13:09:15.562114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.444118 (+882004us) service_pool.cc:224] Handling call
0709 13:09:16.444788 (+   670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.664703 (+219915us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:16.979491 (+314788us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.404666 (+425175us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.404947 (+   281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.405010 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:17.405079 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.405168 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.405304 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54529,"prepare.queue_time_us":101044,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":46176,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":20486,"thread_start_us":597371,"threads_started":3,"wal-append.queue_time_us":71455}
I20260709 13:09:17.449846 22499 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:17.442191 27581 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.456722 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.458055 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.458094 22577 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:17.458755 22650 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.449175 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:17.449921 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3458) took 1986 ms. Trace:
I20260709 13:09:17.444469 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:17.451823 27755 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.449404 27659 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:17.474628 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:17.462237 27788 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:17.456773 27581 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:17.476791 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 88386.9us
I20260709 13:09:17.464304 22500 rpcz_store.cc:276] 0709 13:09:15.463906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.420684 (+956778us) service_pool.cc:224] Handling call
0709 13:09:16.513283 (+ 92599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.513813 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:16.989384 (+475571us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.447412 (+458028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.447465 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:17.447508 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.447573 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.449863 (+  2290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119721,"prepare.queue_time_us":251569,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":19409,"thread_start_us":653633,"threads_started":2}
I20260709 13:09:17.461522 27338 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.471827 27699 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:17.473827 27731 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.495643 27471 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:17.498576 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:17.499862 27471 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:17.490898 27324 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:17.504014 27427 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.509800 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:17.514429 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.515249 22654 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:17.516218 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.502084 27471 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.516803 22654 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
W20260709 13:09:17.523172 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100826us
I20260709 13:09:17.493494 27699 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.525262 22648 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:17.526549 27686 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.533622 27686 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.534296 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.535075 22648 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:17.535941 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.536077 27686 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.526662 26847 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:17.527115 22544 connection.cc:256] RPC call timeout handler was delayed by -1.0453020049999395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 13:09:17.538889 22544 connection.cc:256] RPC call timeout handler was delayed by -1.0030020049999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 13:09:17.528004 27526 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:17.536620 22648 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.536793 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:17.540263 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100550us
I20260709 13:09:17.547346 27465 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.548041 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:17.548693 23256 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:17.549580 27731 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:17.548087 27465 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.541432 26847 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:17.551676 27465 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.551354 26847 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:17.550223 27235 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.552995 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.554842 22650 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:17.554950 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.555977 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.556833 22650 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.557137 23262 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.558842 22654 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:17.560329 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:17.560827 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:17.561009 23255 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:09:17.566061 27788 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.567937 27235 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:17.566532 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:17.541704 27526 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:17.572120 22646 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.568962 27743 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.511554 27689 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:17.580027 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:17.588024 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 117391us
I20260709 13:09:17.589879 26847 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.590059 27526 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.571180 27556 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.584496 27688 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.595638 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.591523 27526 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.560415 27691 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:17.594305 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:17.594774 27731 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:17.604543 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 67826.3us
I20260709 13:09:17.604192 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:17.603811 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62008us
I20260709 13:09:17.614179 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.620682 23262 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
W20260709 13:09:17.608577 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 395912us
I20260709 13:09:17.571301 27659 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.589800 27737 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:09:17.625356 27731 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:17.598327 27235 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:17.631361 27731 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:17.631456 27235 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:17.632246 27235 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:17.596983 27465 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:09:17.635331 27691 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:17.635708 27691 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:17.636636 27691 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.637941 27691 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:17.642313 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.640615 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 74191.5us
I20260709 13:09:17.651202 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:17.655282 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66992us
I20260709 13:09:17.640375 27235 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.660746 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:17.639881 27324 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:17.593676 27686 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:09:17.663443 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.669589 22618 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:09:17.669854 22618 leader_election.cc:403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:09:17.676115 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.654654 27737 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:17.681198 22496 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:09:17.681298 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 57766us
I20260709 13:09:17.680423 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:17.683470 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 58794.8us
I20260709 13:09:17.605921 27556 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:09:17.692659 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:17.695758 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:17.692101 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.687335 27688 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:17.698693 27759 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.737s	user 0.017s	sys 0.017s
I20260709 13:09:17.700913 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.701843 22649 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 13:09:17.702327 27782 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.629s	user 0.000s	sys 0.004s
I20260709 13:09:17.702836 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.704134 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.706146 27235 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.682323 27680 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:17.707718 27680 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.709029 27527 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.709309 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 856) took 1270 ms. Trace:
I20260709 13:09:17.709595 27527 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.710037 27680 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.709811 22571 rpcz_store.cc:276] 0709 13:09:16.438622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.438982 (+   360us) service_pool.cc:224] Handling call
0709 13:09:16.702725 (+263743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.718705 (+ 15980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.709066 (+990361us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540027a6d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:17.709193 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605182720}
I20260709 13:09:17.678875 27465 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:17.711261 27465 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:17.711858 27465 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.711760 27235 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:17.713402 27471 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.721854 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:17.708027 27779 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:17.725102 27779 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:17.725562 27779 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:17.737527 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 65800.6us
I20260709 13:09:17.738888 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:17.745678 27699 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.683256 27737 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.749331 27737 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.720599 27691 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.753455 27691 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:17.753765 27795 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:09:17.754230 27691 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.758543 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.759486 22645 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:09:17.759912 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 997) took 1005 ms. Trace:
I20260709 13:09:17.760336 22648 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:17.761178 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.761828 22647 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:17.762276 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 995) took 1010 ms. Trace:
I20260709 13:09:17.762662 22647 rpcz_store.cc:276] 0709 13:09:16.752415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.790931 (+ 38516us) service_pool.cc:224] Handling call
0709 13:09:17.760929 (+969998us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:09:17.762218 (+  1289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4985728}
I20260709 13:09:17.763473 22650 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:17.763929 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.764385 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.765801 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2829) took 2030 ms. Trace:
I20260709 13:09:17.766167 22505 rpcz_store.cc:276] 0709 13:09:15.734889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.497370 (+762481us) service_pool.cc:224] Handling call
0709 13:09:16.498153 (+   783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.689353 (+191200us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:16.689395 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.689458 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:16.689517 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.765450 (+1075933us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54001b8854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:17.765498 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.765640 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6579,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":411,"spinlock_wait_cycles":438582528}
I20260709 13:09:17.769155 27754 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:17.769428 27471 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.769632 27754 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:17.764581 22647 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:17.770876 27754 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.771620 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:17.773368 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.760229 22645 rpcz_store.cc:276] 0709 13:09:16.754055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.755944 (+  1889us) service_pool.cc:224] Handling call
0709 13:09:17.758252 (+1002308us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:09:17.759849 (+  1597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6165760}
I20260709 13:09:17.781380 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.788717 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1036) took 1386 ms. Trace:
I20260709 13:09:17.802942 22654 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:17.773643 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.796191 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:17.797338 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 199974us
I20260709 13:09:17.802980 22498 rpcz_store.cc:276] 0709 13:09:16.401849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.982407 (+580558us) service_pool.cc:224] Handling call
0709 13:09:16.997887 (+ 15480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.182265 (+184378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.182299 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.202158 (+ 19859us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:17.202223 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.788330 (+586107us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000f9954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:17.788403 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.788625 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371070336}
I20260709 13:09:17.795806 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:17.797435 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.808277 22499 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:09:17.810019 22646 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:17.813835 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:17.807976 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 113609us
W20260709 13:09:17.776010 27734 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.633s	user 0.000s	sys 0.013s
I20260709 13:09:17.815368 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:17.772831 27754 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.822624 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.829330 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.809830 22647 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:17.853346 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:17.852155 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:17.852368 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:17.860054 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 182097us
I20260709 13:09:17.860648 22501 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:09:17.855583 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 131115us
I20260709 13:09:17.856359 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:17.794554 27427 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.793773 27743 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.783111 27741 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.781795 27593 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:17.866029 27427 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.866114 27593 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.869692 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:17.869863 27741 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:17.870280 22496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 1023) took 2473 ms (client timeout 1590 ms). Trace:
W20260709 13:09:17.870729 22496 rpcz_store.cc:269] 0709 13:09:15.396694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.398006 (+  1312us) service_pool.cc:224] Handling call
0709 13:09:17.870040 (+2472034us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b540033e5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:17.870183 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5214713216}
I20260709 13:09:17.801360 27680 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.872035 27741 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.871963 27680 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.872709 27743 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.874245 27680 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.874918 27743 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.874812 27779 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.875730 22498 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:17.782994 27753 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.876685 27753 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:17.877282 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55540.7us
I20260709 13:09:17.877887 27805 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:17.878490 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:17.879045 27753 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.879592 27805 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:17.880020 27805 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.880199 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:17.870324 22499 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:17.881142 27699 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:17.881604 27699 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:17.881994 27699 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.882301 27527 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.882380 27774 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:17.882956 27805 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.883426 27774 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:17.883728 27137 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:17.884006 27774 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:17.820190 27471 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.884759 27755 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:17.885231 27755 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:17.863787 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:17.861130 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 165445us
I20260709 13:09:17.862179 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:17.886616 22654 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:17.887509 22573 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
W20260709 13:09:17.864303 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49634.2us
I20260709 13:09:17.852626 22646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:17.865350 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:17.865556 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.887787 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:17.886612 22571 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:17.888428 22646 raft_consensus.cc:606] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:17.893929 22646 raft_consensus.cc:614] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:17.895844 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:17.896461 22576 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.896615 27688 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:09:17.897205 27737 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.898962 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.899392 27737 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.899824 22504 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:17.900350 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.900993 22503 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:17.902127 27755 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.903131 27731 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.903921 22576 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:17.904299 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:17.868701 27427 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.905292 27731 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:17.905663 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.906275 22504 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:17.907200 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:17.908036 22504 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:17.852032 27734 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:17.910122 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.910642 27734 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.910769 22645 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:09:17.911190 22645 pending_rounds.cc:85] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 11
I20260709 13:09:17.911409 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.911904 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.912036 22497 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:09:17.907298 27643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46820 (request call id 640) took 5667 ms. Trace:
W20260709 13:09:17.890926 22468 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.696s (SENT)
I20260709 13:09:17.912598 22500 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:17.917302 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38438 (request call id 55) took 1060 ms. Trace:
I20260709 13:09:17.885432 27593 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:17.903438 27755 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:17.913240 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.914677 22574 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:17.917394 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:17.911453 22645 pending_rounds.cc:107] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:09:17.920313 22645 raft_consensus.cc:2889] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.921325 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2491) took 1017 ms. Trace:
I20260709 13:09:17.921681 22645 rpcz_store.cc:276] 0709 13:09:16.920312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.853611 (+933299us) service_pool.cc:224] Handling call
0709 13:09:17.864679 (+ 11068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.921073 (+ 56394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.921273 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.908847 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.914796 22505 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.919292 22649 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:17.894486 22578 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:17.916795 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:17.921404 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:17.917687 22646 rpcz_store.cc:276] 0709 13:09:16.834393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.810613 (+976220us) service_pool.cc:224] Handling call
0709 13:09:17.894311 (+ 83698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.926133 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:17.918335 22497 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:09:17.927256 22647 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:17.927637 22654 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:17.929819 22498 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.929709 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:17.930143 22649 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:17.931545 27729 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:17.944231 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64095.6us
I20260709 13:09:17.939584 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.937355 22574 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:17.943536 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.935060 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:17.918547 27779 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:17.948195 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:17.946105 22503 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
W20260709 13:09:17.954264 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 215507us
I20260709 13:09:17.957391 22648 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:17.965201 22576 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:17.968470 22499 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:17.923924 27765 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:09:17.973601 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37474 (request call id 21) took 1124 ms. Trace:
I20260709 13:09:17.974658 22646 rpcz_store.cc:276] 0709 13:09:16.834884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.931669 (+1096785us) service_pool.cc:224] Handling call
0709 13:09:17.958948 (+ 27279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.953141 27427 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.977027 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:17.984477 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:17.985191 27802 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.986261 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:17.947456 27774 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:17.987139 22651 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:17.987917 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 1001) took 1231 ms. Trace:
W20260709 13:09:17.989066 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.990008 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 99109us
I20260709 13:09:17.950861 27526 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:09:17.988301 22651 rpcz_store.cc:276] 0709 13:09:16.756270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.757001 (+   731us) service_pool.cc:224] Handling call
0709 13:09:17.939015 (+1182014us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:09:17.987813 (+ 48798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5200256}
I20260709 13:09:18.001241 27137 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:17.973697 27799 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.016799 27730 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:18.024000 22502 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.984477 27779 raft_consensus.cc:2764] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:18.031749 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:17.974442 27773 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:09:18.040215 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65469.8us
W20260709 13:09:18.040948 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 153827us
I20260709 13:09:18.039047 27801 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:09:18.002038 27427 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:18.045964 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 132412us
I20260709 13:09:18.056727 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:18.058876 22501 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:18.044806 27235 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.061391 27235 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.061790 27235 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.060387 27802 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.059743 27773 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:18.067255 22505 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:18.067761 22498 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:18.045192 27659 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:17.916486 27643 rpcz_store.cc:276] 0709 13:09:12.252964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.297657 (+ 44693us) service_pool.cc:224] Handling call
0709 13:09:12.886645 (+588988us) ts_tablet_manager.cc:934] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
0709 13:09:16.481476 (+3594831us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:17.554493 (+1073017us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:17.560585 (+  6092us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:17.906397 (+345812us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:17.906703 (+   306us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:17.907090 (+   387us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:17.907191 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":267183,"tablet-copy.queue_time_us":378311,"thread_start_us":382833,"threads_started":2}
I20260709 13:09:18.040231 27737 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:09:18.065950 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:18.073217 27593 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:18.024317 27730 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.084021 22653 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:18.087554 27691 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.093132 27810 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:18.094285 22650 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:18.098196 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1038) took 1695 ms. Trace:
I20260709 13:09:18.099474 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:18.101073 27731 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.102033 27731 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:18.102823 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:18.103770 27806 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:18.104103 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:18.105042 26847 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.105505 26847 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:18.105912 26847 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.106403 27427 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:18.104264 27806 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:18.108916 27806 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.103269 27731 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:18.109663 27338 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:18.109853 27731 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:18.110163 27338 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:18.111204 27731 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:18.113607 27731 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.111223 27338 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.114734 27338 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.088578 27465 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.098659 22502 rpcz_store.cc:276] 0709 13:09:16.402901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.123904 (+721003us) service_pool.cc:224] Handling call
0709 13:09:17.158737 (+ 34833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.035571 (+876834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.097913 (+ 62342us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540007b554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:18.098127 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982572800}
I20260709 13:09:18.100765 27643 tablet_copy_client.cc:806] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:18.069411 27773 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:18.121855 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 159003us
I20260709 13:09:18.125031 27471 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:09:18.135650 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 70197us
I20260709 13:09:18.130147 27773 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.074514 27659 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.133325 27810 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:18.174252 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2498) took 1205 ms. Trace:
I20260709 13:09:18.174827 22653 rpcz_store.cc:276] 0709 13:09:16.968603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.691743 (+723140us) service_pool.cc:224] Handling call
0709 13:09:18.174063 (+482320us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002986d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:18.174173 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461795584}
I20260709 13:09:18.177959 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:18.155026 27737 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:09:18.179557 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:18.148047 27643 tablet_copy_client.cc:670] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:18.194289 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:18.192406 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 126339us
W20260709 13:09:18.197881 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57109us
I20260709 13:09:18.194307 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.182538 27471 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:09:18.201766 27526 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:18.202261 27526 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.202410 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:18.202730 27526 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.202924 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.203567 22648 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:18.205173 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.205847 27659 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:18.201787 27471 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:18.206701 27471 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:18.207358 27730 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:18.196561 27799 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.208818 27821 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:18.211689 27807 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 13:09:18.175386 27810 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:18.217808 27810 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.218277 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:18.148397 27815 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.225597 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:18.219365 27810 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.182706 27812 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:18.243929 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:18.252645 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 221016us
W20260709 13:09:18.249230 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 50578.8us
W20260709 13:09:18.243309 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48901.9us
I20260709 13:09:18.219193 27699 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:18.249773 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89899.1us
I20260709 13:09:18.253418 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.254689 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.260488 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.258931 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:18.259469 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:18.262251 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:18.261155 22649 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:18.242420 27815 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:18.266263 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:18.268580 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:18.271863 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 232635us
I20260709 13:09:18.268067 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:18.273171 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.274689 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:18.290659 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.317546 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.319698 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.324676 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.325330 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.325680 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.320852 27822 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:18.321084 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 103146us
I20260709 13:09:18.252580 27812 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:18.262167 27803 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.273442 27818 consensus_queue.cc:1059] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:09:18.323236 23257 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:18.328536 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:18.328800 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:18.331599 22649 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:18.263878 27465 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:18.341480 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.341656 27465 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:18.343596 22399 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 11, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 11 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:18.266553 27801 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:18.345124 27235 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.333423 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:18.337061 22648 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:18.271814 27581 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.320511 27805 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.329648 27691 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:18.339226 22646 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:18.357765 22399 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 13, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 13 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.268376 27815 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.345950 23255 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:18.380594 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:18.382752 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.449641 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 114458us
I20260709 13:09:18.384689 27818 consensus_queue.cc:1243] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:18.398512 23256 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 6.
I20260709 13:09:18.389158 27800 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:18.336243 22651 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.410748 27699 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:18.373696 27821 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:18.332376 27799 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.412091 27806 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.359858 27324 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:18.507229 22652 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:18.450250 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.374835 27801 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:18.450557 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 117202us
W20260709 13:09:18.505795 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237448us
I20260709 13:09:18.530092 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:18.556205 22504 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:18.446830 27581 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.583549 27581 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.591679 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.596437 27581 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.597563 27526 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.598980 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:18.599972 22498 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:18.600309 27526 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:18.392249 27812 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.583106 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:18.598853 27581 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:18.601570 27812 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.609431 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.611974 27799 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:18.614500 27235 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:18.513609 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.614979 27799 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:18.739912 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:18.741156 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 360628us
I20260709 13:09:18.670378 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.617404 22647 raft_consensus.cc:2410] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:09:18.732298 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 397291us
W20260709 13:09:18.615790 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 356873us
I20260709 13:09:18.674564 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:18.671416 23257 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:18.666810 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:18.749675 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.742334 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:18.751243 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:18.740128 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:18.755326 22652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2818) took 2011 ms (client timeout 1702 ms). Trace:
I20260709 13:09:18.513927 27556 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.756166 22652 rpcz_store.cc:269] 0709 13:09:16.751352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.757298 (+  5946us) service_pool.cc:224] Handling call
0709 13:09:17.939424 (+1182126us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:09:18.755027 (+815603us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:18.755220 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294633216}
I20260709 13:09:18.757721 23259 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:18.754575 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:18.762153 27788 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:18.762462 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.766860 23261 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:18.768110 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.772997 27688 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:18.775684 27806 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:18.782809 27773 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.775806 27471 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:18.785490 26847 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.001s
I20260709 13:09:18.786224 27471 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:18.787276 27338 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.004s
I20260709 13:09:18.788206 27803 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:18.759464 27593 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.789747 27593 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.790148 27593 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.790042 27765 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:18.790899 27765 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:18.529779 27822 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:18.786132 26847 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.750272 27799 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:18.793279 27799 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:18.794198 27799 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.797765 27788 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:18.798727 22504 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:18.801158 26847 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:18.551523 27324 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:18.652464 27731 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.577286 27800 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.764729 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:18.545305 27821 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:18.643322 27801 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.826709 27821 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.828687 27821 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.826687 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:18.792153 27765 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.670843 27825 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:18.887428 27825 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:18.888031 27825 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.795004 27691 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:09:18.762153 27581 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.806875 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.894816 23259 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:18.807279 27556 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.670852 27659 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.895695 27806 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:18.896365 27659 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:18.831761 27800 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.897043 27659 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.903347 27818 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:09:18.906294 27765 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.584352 27805 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:18.804354 23261 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:18.908128 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:18.780624 22469 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:18.920097 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 139609us
I20260709 13:09:18.922329 22469 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:18.841435 27802 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:18.957711 27802 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:18.958984 27802 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.960189 27802 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.798760 27788 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:18.962134 27788 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.843274 23263 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:18.843390 27324 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:18.845675 27810 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.007s
I20260709 13:09:18.853477 23255 raft_consensus.cc:2368] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:18.855734 27427 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:18.978360 23262 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:09:18.978881 27427 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:18.870217 22651 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:18.879715 27731 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.886221 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:18.909116 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75673.4us
I20260709 13:09:18.834095 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:18.989043 22654 raft_consensus.cc:2368] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16.
I20260709 13:09:18.989375 27821 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.913058 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:18.794100 27822 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.838430 27824 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:18.994514 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108385us
I20260709 13:09:18.994918 27824 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:18.840713 27827 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 13:09:18.996251 27824 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.942488 22399 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 13, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 13 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.944988 27805 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:19.001427 27805 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:19.003160 27824 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.002681 27805 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:18.923300 27689 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:18.950537 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:18.951608 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:18.994535 23264 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:18.947626 27691 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:19.006595 22579 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:19.007380 27471 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:19.007964 27471 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:19.009131 27471 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.012215 27689 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.014217 27689 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:19.088517 22543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.031s	sys 0.106s
W20260709 13:09:19.089238 22543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.031s	sys 0.106s
W20260709 13:09:19.094254 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.095631 27779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.079s	sys 0.112s
W20260709 13:09:19.096199 27779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.079s	sys 0.112s
W20260709 13:09:19.119971 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.207581 22619 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
W20260709 13:09:19.209257 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.209714 27471 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.214421 27836 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:19.215235 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 460704us
W20260709 13:09:19.216357 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 294150us
W20260709 13:09:19.217485 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66983.8us
I20260709 13:09:19.002117 22399 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 12, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 12 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:19.210453 27731 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:19.208513 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.001s	sys 0.005s
W20260709 13:09:19.223949 22544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.000s	sys 0.012s
W20260709 13:09:19.225209 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.002s	sys 0.005s
W20260709 13:09:19.225435 22544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.000s	sys 0.012s
W20260709 13:09:19.225782 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 642701us
I20260709 13:09:19.228063 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.226637 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:19.232702 22650 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:19.233011 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.233131 27829 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:09:19.234140 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet ea7bfa694a734e68806da48189a7e004: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:19.233803 27818 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:19.233728 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.233697 27829 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:19.237404 27829 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.238691 27829 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.232527 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.239435 22576 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:19.241490 27427 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:19.244056 22576 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:19.245314 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:19.245673 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.246111 22579 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:19.247555 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:19.250025 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:19.251672 22618 leader_election.cc:400] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:19.252025 22618 leader_election.cc:403] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:19.261024 22499 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:19.260459 22399 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 10, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 10 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.262458 22399 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 7 to 9, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 9 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.263430 22497 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:19.263844 27800 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:19.280987 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0508859170000733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:09:19.265504 22499 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:19.295784 27235 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:19.295910 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.266626 22505 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:19.296535 27235 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:19.296839 22574 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:09:19.297470 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.297703 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.298393 22505 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:19.298470 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.298702 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:19.299491 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.298079 22502 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:19.300171 27471 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:19.301292 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:19.302038 27838 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:19.303275 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:19.304092 22578 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:19.304262 27838 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:19.298313 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:19.305970 27659 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.307612 27774 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:19.270428 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.216387 27801 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.309769 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.310388 22504 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:19.310773 27801 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:19.311229 22498 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:19.312034 22505 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.313099 22575 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:19.270895 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.216375 27836 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.313946 27836 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:19.273581 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 743616us
W20260709 13:09:19.314154 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87613.4us
I20260709 13:09:19.274297 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.314991 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:19.296437 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.316041 22500 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:19.316836 22499 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:19.317420 22500 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:19.299315 22497 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:19.275583 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.318578 22496 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:19.281584 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:19.269070 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:19.285941 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.264148 22399 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 13, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 13 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:19.299387 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:19.333966 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:19.332963 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 51434us
I20260709 13:09:19.336668 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:19.336971 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:19.282513 27731 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:19.321491 27836 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:19.327809 27815 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.003s
I20260709 13:09:19.351812 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.354837 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.355224 22500 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:09:19.355438 22651 raft_consensus.cc:2376] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11. Re-sending same reply.
I20260709 13:09:19.324767 27659 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:19.352974 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:19.360261 23256 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:19.360287 22646 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:19.354432 22505 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:19.328353 27799 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:19.356981 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:19.325804 27688 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.357784 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.357793 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.340364 27818 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:19.364183 22498 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:19.364758 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.361068 22544 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:19.362496 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:19.361694 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46794.5us
I20260709 13:09:19.366019 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:19.366289 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:19.366400 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.367977 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.369279 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.369287 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.369468 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.370817 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.363894 27803 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:19.371368 22645 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:19.283452 27841 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:09:19.341990 27526 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:19.357784 22399 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 10 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.342125 27731 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.365978 22647 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:19.349458 27338 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:19.368326 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.351394 27324 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:19.380764 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.381673 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.382452 22653 raft_consensus.cc:2376] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13. Re-sending same reply.
I20260709 13:09:19.383843 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.383944 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.384999 22647 raft_consensus.cc:2410] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:19.356307 27779 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:19.390424 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.391223 22650 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 7: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:19.389431 22645 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
I20260709 13:09:19.391621 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.388477 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.358891 27819 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:19.331416 27831 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:19.393138 22399 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 7 to 8, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.297698 27235 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.372776 27824 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:19.363345 27799 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:19.376113 27754 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.372347 27818 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.381016 27731 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.402712 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.400583 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.403776 22646 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.389349 27643 tablet_copy_client.cc:538] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:19.408572 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.401398 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.358704 27815 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.396795 27779 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.423990 27815 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:19.404929 23256 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:19.425043 23258 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:09:19.426632 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.427591 22652 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:19.397091 27810 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:09:19.430107 22496 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:19.405452 22645 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:19.407558 22648 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:19.385656 27834 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.399507 27427 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:09:19.413610 27471 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:19.414469 27799 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.402626 27818 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:19.399746 27819 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:19.417214 22402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 310) took 29188 ms (client timeout 15000 ms). Trace:
I20260709 13:09:19.409086 27686 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:19.419234 27689 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:19.420832 27773 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.000s
I20260709 13:09:19.421527 27691 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:19.408121 27754 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.432425 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.428753 22652 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:19.433216 22645 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.438045 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.627763 22648 raft_consensus.cc:2376] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16. Re-sending same reply.
I20260709 13:09:19.441778 22649 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:19.628724 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.373090 27688 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.376220 27806 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:09:19.470091 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 117221us
I20260709 13:09:19.397418 27338 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.482679 22501 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:19.539968 27824 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:19.540416 27846 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:19.545626 27803 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:19.620388 27822 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.551769 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 229558us
I20260709 13:09:19.594501 27556 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:19.591199 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 225216us
I20260709 13:09:19.654577 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:19.602468 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:19.602681 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:19.553239 22399 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 8, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 8 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:09:19.603447 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237142us
I20260709 13:09:19.606024 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:19.426570 27774 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.468708 27465 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.445878 22502 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:19.643085 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 830) took 1357 ms. Trace:
W20260709 13:09:19.606163 27593 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.815s	user 0.007s	sys 0.006s
I20260709 13:09:19.645274 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:19.648051 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.665161 22651 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:09:19.667320 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:19.617355 27471 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.660490 23258 rpcz_store.cc:276] 0709 13:09:18.263647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.263842 (+   195us) service_pool.cc:224] Handling call
0709 13:09:19.620527 (+1356685us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54004367d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:19.620661 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532805376}
I20260709 13:09:19.655798 23264 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.656702 22399 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 10 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:19.668612 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:19.671613 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.475247 27788 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
W20260709 13:09:19.657037 27825 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.762s	user 0.012s	sys 0.000s
W20260709 13:09:19.700305 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.702811 22646 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
W20260709 13:09:19.701565 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44765.3us
W20260709 13:09:19.685326 27845 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:09:19.710366 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.673043 27686 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:19.649047 27846 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:19.682654 27581 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.788s	user 0.015s	sys 0.002s
I20260709 13:09:19.666189 27779 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:19.715788 22646 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:19.682276 27806 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:19.716116 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.710516 27831 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:19.719141 22501 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:09:19.720063 22399 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:19.682515 27691 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:19.695719 27471 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.746851 27526 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:19.722963 22499 pending_rounds.cc:85] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 4
I20260709 13:09:19.748396 22499 pending_rounds.cc:107] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:09:19.748688 22499 raft_consensus.cc:2889] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.682301 27593 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.748776 27471 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:19.749361 22650 raft_consensus.cc:2376] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12. Re-sending same reply.
I20260709 13:09:19.726233 27686 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.729179 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.750766 22504 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:19.750994 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 105853us
I20260709 13:09:19.658838 27822 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:19.604918 22402 rpcz_store.cc:269] 0709 13:08:50.267704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.308755 (+ 41051us) service_pool.cc:224] Handling call
0709 13:09:19.408000 (+29099245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:05.476137 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:05.477820 (+  1683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:05.477873 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:09:05.477897 (+    24us) tablet.cc:662] Decoding operations
0709 13:09:05.486175 (+  8278us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:05.486262 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:05.486305 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:05.488825 (+  2520us) tablet.cc:701] Row locks acquired
0709 13:09:05.490238 (+  1413us) write_op.cc:260] PREPARE: finished
0709 13:09:05.496656 (+  6418us) write_op.cc:270] Start()
0709 13:09:05.498974 (+  2318us) write_op.cc:276] Timestamp: P: 1783602545496291 usec, L: 0
0709 13:09:05.499010 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:09:05.500314 (+  1304us) log.cc:844] Serialized 8311 byte log entry
0709 13:09:05.920761 (+420447us) op_driver.cc:464] REPLICATION: finished
0709 13:09:06.421529 (+500768us) write_op.cc:301] APPLY: starting
0709 13:09:06.421701 (+   172us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:06.671257 (+249556us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:06.671387 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:07.344232 (+672845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:07.526401 (+182169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:09:07.531155 (+  4754us) write_op.cc:312] APPLY: finished
0709 13:09:07.573022 (+ 41867us) log.cc:844] Serialized 188 byte log entry
0709 13:09:07.816354 (+243332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:07.887413 (+ 71059us) write_op.cc:454] Released schema lock
0709 13:09:07.894357 (+  6944us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:07.894865 (+   508us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:07.894900 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3294615,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":424440,"apply.run_cpu_time_us":54438,"apply.run_wall_time_us":1505751,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91991,"num_ops":21,"prepare.queue_time_us":301526,"prepare.run_cpu_time_us":11075,"prepare.run_wall_time_us":205467,"raft.queue_time_us":219623,"raft.run_cpu_time_us":52135,"raft.run_wall_time_us":320958,"replication_time_us":421483,"spinlock_wait_cycles":11648,"thread_start_us":1090597,"threads_started":5,"wal-append.queue_time_us":323853,"wal-append.run_cpu_time_us":38240,"wal-append.run_wall_time_us":2629884}]]}
I20260709 13:09:19.722645 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.729967 27689 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:19.654805 27815 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:09:19.734370 22654 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
W20260709 13:09:19.731837 27821 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.742s	user 0.016s	sys 0.013s
W20260709 13:09:19.737363 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.719146 27800 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:19.767624 22498 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:19.768467 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.673558 27774 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.737739 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.709107 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:19.739477 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:19.741014 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.742432 27754 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:19.672778 27465 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:19.742815 27837 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:19.744968 27691 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:19.745810 27799 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.747766 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.729662 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:19.758669 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.752439 22500 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:19.792099 22501 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.759711 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:19.737360 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 384342us
I20260709 13:09:19.711545 27824 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:19.773223 22399 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 10 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:19.793460 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.779495 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.779624 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:19.787789 22645 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:19.736578 27581 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:19.788069 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.788300 23263 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:19.704898 27825 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.792425 22646 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:19.794526 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.795342 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.796576 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.797861 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.798905 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.810410 22575 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:19.734930 27773 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:09:19.813126 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:19.813333 22580 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:19.809276 22572 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:09:19.812681 22505 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:19.764166 27779 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.813107 22574 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:19.819006 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 150480us
I20260709 13:09:19.821580 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:19.825244 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:19.825521 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:19.826238 22573 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:19.773741 27821 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:19.827656 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:19.829202 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 77520.8us
I20260709 13:09:19.791370 27837 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:19.838419 27852 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:09:19.841310 27838 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:19.845079 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.982613 22650 raft_consensus.cc:2410] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:09:19.982573 22572 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:19.825940 22399 catalog_manager.cc:5697] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 4 to 7, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:19.984077 22399 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 8 to 10, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:19.985669 22399 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:19.986954 22399 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 11, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 11 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:19.987635 27773 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:19.988282 27773 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:19.797405 27691 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:19.989053 27802 consensus_meta.cc:287] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.028s	user 0.019s	sys 0.003s
I20260709 13:09:19.989734 27802 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.989992 22653 raft_consensus.cc:2410] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:19.851222 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:19.814620 27806 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.828902 27593 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:19.855161 27765 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.948s	user 0.010s	sys 0.004s
I20260709 13:09:19.990269 27802 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.993296 27819 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:19.959463 27866 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:19.846390 27805 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:19.994747 27774 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:19.732345 27803 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:19.830603 23258 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
W20260709 13:09:19.963171 27829 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.724s	user 0.013s	sys 0.000s
I20260709 13:09:19.963943 22571 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:19.963891 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:19.965006 22578 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:19.965168 22574 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:19.965597 23264 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:19.966307 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:19.966958 22579 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:19.967492 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 258333us
I20260709 13:09:19.840955 27689 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:19.969353 22505 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:19.971005 22501 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:19.841634 27864 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:09:19.830065 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:19.842346 27846 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:19.971843 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 178411us
I20260709 13:09:19.839377 27779 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:19.997301 22503 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:09:20.064743 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 234785us
I20260709 13:09:19.988458 22399 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 14, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 14 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:19.825591 27754 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.014918 22573 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:20.050083 22645 raft_consensus.cc:2376] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14. Re-sending same reply.
I20260709 13:09:20.053319 22646 raft_consensus.cc:2376] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18. Re-sending same reply.
I20260709 13:09:19.981986 27581 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:20.075054 27805 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:20.075577 27805 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:20.078442 27691 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.082425 27691 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:20.087133 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 110159us
I20260709 13:09:20.088127 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.090015 27822 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:20.097208 27857 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:20.098650 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.101361 27556 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:20.101708 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.102370 27526 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:20.102849 27526 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:20.102392 27556 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:20.103399 27857 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:20.103875 27854 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:20.104456 27854 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:20.107196 27731 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.000s
I20260709 13:09:20.105743 27854 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.107733 27731 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.108989 27854 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.104844 27754 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.114763 27802 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:20.117053 27779 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:20.117548 27779 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:20.118631 27779 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.120187 27779 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.121816 27773 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.123704 27773 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.127115 27846 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.126138 27465 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:20.058226 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:20.059827 22647 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:19.987600 27643 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:09:19.999032 27866 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.066095 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:20.070194 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:20.142892 22653 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:20.069475 22544 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:20.067005 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:20.144696 23264 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:20.071866 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:20.146226 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:20.147475 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 81476.7us
I20260709 13:09:20.131845 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:20.133719 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75556.9us
I20260709 13:09:20.048180 27765 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.104300 27774 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:20.151575 23227 leader_election.cc:336] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.561s (SENT)
I20260709 13:09:20.148566 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:20.158085 23264 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:09:20.160163 23227 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.590s (SENT)
I20260709 13:09:20.059396 27688 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:20.169173 22650 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:09:20.169842 22650 pending_rounds.cc:85] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 12
I20260709 13:09:20.170492 22650 pending_rounds.cc:107] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:09:20.171139 22650 raft_consensus.cc:2889] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.015698 27831 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:09:20.148307 27581 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:20.175462 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:20.174288 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44175.4us
I20260709 13:09:20.076527 27805 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.176656 27556 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:20.205085 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:20.244239 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 422735us
I20260709 13:09:20.163044 27774 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.147051 27866 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:20.159526 27829 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:20.266166 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:20.266963 22574 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:09:20.250663 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.255228 22497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.026s	sys 0.025s
W20260709 13:09:20.267995 22497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.027s	sys 0.025s
I20260709 13:09:20.245711 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:20.066954 27801 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:09:20.257146 22543 leader_election.cc:400] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16.
W20260709 13:09:20.247586 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72234.3us
I20260709 13:09:20.279723 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:20.172111 27848 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.202375 27689 raft_consensus.cc:2764] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:20.269306 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:20.283097 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:20.283807 22577 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:09:20.283591 23230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.032s	sys 0.029s
I20260709 13:09:20.264715 22579 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:20.284387 23230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.033s	sys 0.029s
I20260709 13:09:20.270623 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:20.271231 22573 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:09:20.285511 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.207154 27688 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:20.213074 27581 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.103896 27526 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.266258 27774 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:20.314525 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:20.287081 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 226004us
I20260709 13:09:20.313472 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:20.317183 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.325736 22503 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:20.325965 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:20.317770 27691 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:20.277784 27324 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:20.313555 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 241737us
I20260709 13:09:20.318377 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:20.318353 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:20.330581 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:20.322137 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:20.322633 22501 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:20.319887 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:20.281267 27830 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:09:20.324386 22574 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:20.319479 27819 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:20.326681 22573 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:20.201550 27834 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:09:20.276280 27857 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:20.327966 22543 leader_election.cc:403] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:09:20.326406 22647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:20.164168 27765 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.277000 27802 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.343918 23263 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.269616 27829 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.320029 27581 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.280396 27471 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:09:20.354197 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:20.326838 27688 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:20.380792 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.156553 27837 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.323045 27825 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:20.432916 27869 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:09:20.433243 27867 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:09:20.264832 27465 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:09:20.382525 27526 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:20.442039 27873 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:20.445353 27870 consensus_queue.cc:1175] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fa2f181263f446a6962b649f9348c15f" responder_term: 12 status { last_received { term: 11 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:20.384671 22647 raft_consensus.cc:606] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.286749 27822 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.449635 22647 raft_consensus.cc:614] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:20.449807 27822 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.450980 27848 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:20.452332 27822 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:20.452019 27848 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.343591 27754 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:20.453248 27822 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:20.381850 27235 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:09:20.454723 27874 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.455991 27868 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:09:20.383777 27819 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:20.456609 27731 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:20.394810 27836 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.030s	user 0.013s	sys 0.001s
I20260709 13:09:20.457365 27819 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.458149 27836 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.431299 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:20.358470 27324 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:20.455458 27874 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:20.430440 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 76330.1us
W20260709 13:09:20.393325 27799 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:09:20.471174 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:20.396530 27806 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:20.498631 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70014us
I20260709 13:09:20.472636 23255 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
W20260709 13:09:20.499632 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.396812 27829 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:20.501964 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 183692us
I20260709 13:09:20.380302 27689 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:09:20.510072 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:20.512825 23261 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.502043 23255 pending_rounds.cc:85] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 10
I20260709 13:09:20.514091 23255 pending_rounds.cc:107] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 11.11
W20260709 13:09:20.474696 27818 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.002s
I20260709 13:09:20.509480 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.539868 23255 raft_consensus.cc:2889] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:20.515811 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 267818us
I20260709 13:09:20.513958 22571 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:20.461314 27788 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:20.423264 27802 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.512084 27338 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:20.510195 27834 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:20.440497 27688 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:20.586711 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 259350us
I20260709 13:09:20.512449 27836 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:20.594039 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 251914us
I20260709 13:09:20.631719 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:20.632480 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.554780 23261 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 7.
I20260709 13:09:20.556295 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:20.555204 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45842.8us
I20260709 13:09:20.634909 23262 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:20.559711 23263 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
W20260709 13:09:20.635978 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 164975us
I20260709 13:09:20.638288 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.639089 22505 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:20.632627 23259 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:20.644739 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.645469 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:20.577986 27821 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:20.648187 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.649233 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:20.654573 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.654629 22498 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
W20260709 13:09:20.656822 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.576408 27825 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:20.561285 27802 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:20.575704 27831 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:20.663836 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 121156us
I20260709 13:09:20.647292 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.668844 22504 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:20.566720 27874 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:20.663813 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 344392us
I20260709 13:09:20.586067 27338 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:20.679553 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.546813 27806 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:20.637887 27805 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:20.637995 27799 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:20.695035 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.546938 27877 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:20.688515 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.693660 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.696213 22498 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:20.696722 22504 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:20.697711 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.698436 27765 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:20.699196 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53841.3us
I20260709 13:09:20.700654 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:20.700968 27863 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.778s	user 0.002s	sys 0.003s
I20260709 13:09:20.698329 22500 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
W20260709 13:09:20.703814 27878 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:09:20.704245 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:20.705662 27800 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:20.706588 27556 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:20.707278 27800 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:20.707558 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1068) took 1088 ms. Trace:
I20260709 13:09:20.707693 27800 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:20.709380 27877 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.710052 27877 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:20.709489 27806 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.713744 27731 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:20.714033 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:20.714316 27731 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:20.714857 22650 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:20.707980 22496 rpcz_store.cc:276] 0709 13:09:19.618999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.619195 (+   196us) service_pool.cc:224] Handling call
0709 13:09:19.619720 (+   525us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:19.647673 (+ 27953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.647699 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:19.658910 (+ 11211us) log.cc:844] Serialized 52 byte log entry
0709 13:09:19.999247 (+340337us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:20.059921 (+ 60674us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.060315 (+   394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.060394 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.705346 (+644952us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b240017a1b8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324cfb0 00007fec25ec3488 00007fec25ec3be8 00007fec25e9b398 00007fec25e9676a 00007fec25e95bb6
0709 13:09:20.707224 (+  1878us) raft_consensus.cc:1685] finished
0709 13:09:20.707340 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.707500 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13842,"prepare.queue_time_us":59603,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":43604,"raft.queue_time_us":46368,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":50696,"spinlock_wait_cycles":67574144,"thread_start_us":292869,"threads_started":1,"wal-append.queue_time_us":495966}
I20260709 13:09:20.715330 27731 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.715797 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:20.717777 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:20.724705 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:20.719408 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:20.726300 22646 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:20.719992 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:20.727663 22645 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.723068 22648 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:20.726223 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:20.724195 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3480) took 1395 ms. Trace:
I20260709 13:09:20.555681 27818 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:20.734241 23262 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
W20260709 13:09:20.735560 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.744588 22503 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:20.666026 27825 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:20.763326 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 129521us
I20260709 13:09:20.680156 27831 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:20.722200 27846 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.004s
I20260709 13:09:20.729696 22497 rpcz_store.cc:276] 0709 13:09:19.328681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.328942 (+   261us) service_pool.cc:224] Handling call
0709 13:09:19.329269 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.630444 (+301175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.630550 (+   106us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.681333 (+ 50783us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.268407 (+587074us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:20.268445 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.269046 (+   601us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.724021 (+454975us) raft_consensus.cc:1685] finished
0709 13:09:20.724038 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.724147 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12202,"raft.queue_time_us":9348,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9930,"thread_start_us":783528,"threads_started":2,"wal-append.queue_time_us":633078}
I20260709 13:09:20.692070 27691 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:20.744092 27803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.012s	sys 0.020s
I20260709 13:09:20.716820 27731 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:20.723260 27799 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.776940 22505 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:20.777734 23227 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.016s	sys 0.008s
I20260709 13:09:20.748108 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:20.731081 27802 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:20.796749 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66375.9us
I20260709 13:09:20.832142 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:20.800979 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:20.796103 27788 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:20.743535 27556 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:09:20.816841 22544 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.819701 22501 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260709 13:09:20.826180 23227 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.016s	sys 0.008s
I20260709 13:09:20.813905 22469 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:20.834038 22652 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:20.849074 22503 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:09:20.853040 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 691662us
W20260709 13:09:20.853956 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.855389 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:20.832589 22504 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:20.814986 27803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.012s	sys 0.020s
I20260709 13:09:20.679960 27324 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:20.746762 27870 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:09:20.708758 27800 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:20.876313 23227 leader_election.cc:336] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.820s (SENT)
I20260709 13:09:20.834009 27799 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.878670 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:20.876783 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:20.880556 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48523.5us
I20260709 13:09:20.914726 22651 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:20.914880 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:20.850977 27822 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:20.814440 27801 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:09:20.821782 27471 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:09:20.925637 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:20.917080 22578 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:20.925235 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 224052us
I20260709 13:09:20.938154 22468 leader_election.cc:400] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
I20260709 13:09:20.938588 22468 leader_election.cc:403] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:20.939080 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:20.852255 27873 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:09:20.912031 27773 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:20.944255 22654 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:20.916491 27819 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:20.947176 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 146327us
I20260709 13:09:20.921860 27686 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.959062 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.959730 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:20.945228 27888 raft_consensus.cc:2764] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:20.929863 27688 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.961282 22543 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:20.937279 27874 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.937143 27803 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:20.975777 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:21.007830 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46619.3us
W20260709 13:09:21.009454 27891 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:09:20.976974 27822 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:21.010844 27526 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.569s	user 0.002s	sys 0.007s
W20260709 13:09:21.032212 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 218442us
I20260709 13:09:21.033170 22469 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:21.012989 27874 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.013764 27556 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:21.014845 27897 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:21.015650 27779 consensus_meta.cc:287] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.895s	user 0.003s	sys 0.008s
I20260709 13:09:21.017509 27800 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.047560 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:21.023720 27857 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.003s
I20260709 13:09:21.023801 27877 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.024160 27686 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:21.031306 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56100us
I20260709 13:09:21.030800 27834 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16.
I20260709 13:09:20.956763 27765 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:21.043980 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 167682us
I20260709 13:09:20.969002 27870 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:21.051757 27838 consensus_meta.cc:287] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.056s	user 0.014s	sys 0.002s
I20260709 13:09:21.050766 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:21.050659 22647 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:09:20.974742 27773 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:21.044034 27556 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.920892 27338 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.055245 27888 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:20.930142 27831 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.033541 27822 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.044137 27897 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.063196 22647 pending_rounds.cc:85] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 4
I20260709 13:09:21.061585 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:21.029495 27688 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.084329 22647 pending_rounds.cc:107] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 9.5
W20260709 13:09:21.079265 27889 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:21.060469 27526 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.055945 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 273360us
I20260709 13:09:21.073335 27556 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:21.077730 27894 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.078073 27338 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.052655 27896 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:21.078178 27883 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:21.066290 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:21.059167 27779 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:21.088198 22504 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:20.974177 27691 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.060765 27870 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:21.068387 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.062667 27818 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:21.133764 27870 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:21.080662 27581 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.002s
I20260709 13:09:21.084694 22647 raft_consensus.cc:2889] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:21.056356 27857 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:21.116459 27915 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:21.073778 27838 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:21.057794 27819 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:09:21.080345 27834 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:09:21.101651 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.133973 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.059711 27904 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:21.086403 27897 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:21.145709 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 213606us
I20260709 13:09:21.086735 27822 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.156482 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:21.133139 27779 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.089792 27801 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:09:21.135829 22645 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:21.143842 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 77630.3us
W20260709 13:09:21.149464 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.149207 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:21.118561 27836 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:21.161417 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:21.120258 27883 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:21.127890 27788 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:21.141000 27915 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.162289 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:21.163220 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:21.138239 27854 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.173137 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:21.167323 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 192700us
I20260709 13:09:21.141846 27803 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:21.181599 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:21.172192 27593 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11.
I20260709 13:09:21.190219 23264 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: [11.12-13.13]
I20260709 13:09:21.145313 27896 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:21.127663 27888 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:09:21.140259 27907 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:21.182821 23261 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.183374 23263 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:21.118227 27526 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.134446 27581 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:21.164862 22501 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:21.185253 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:21.192519 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47462.8us
I20260709 13:09:21.163770 27779 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.205719 23255 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:21.200301 23262 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.179937 27837 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.203047 22502 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:21.179594 27883 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.179952 27915 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:21.212189 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.179760 27857 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:09:21.254944 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:21.258285 22502 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:21.207329 27907 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:21.257143 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48436.1us
W20260709 13:09:21.283138 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.305204 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.216465 27866 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.930s	user 0.009s	sys 0.000s
W20260709 13:09:21.213759 27902 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:09:21.188725 27854 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:21.213136 27880 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
W20260709 13:09:21.213091 27898 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:09:21.325105 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.357955 22573 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:21.325330 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.175431 27773 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.356851 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3511) took 1150 ms. Trace:
I20260709 13:09:21.217166 27887 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:21.360652 22571 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:21.212980 27911 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.362354 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.363859 22577 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:09:21.212400 27884 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.359906 22578 rpcz_store.cc:276] 0709 13:09:20.206093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.206274 (+   181us) service_pool.cc:224] Handling call
0709 13:09:20.277537 (+ 71263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.931674 (+654137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.356581 (+424907us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400256f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:21.356786 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470087424}
W20260709 13:09:21.364462 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 179296us
I20260709 13:09:21.212766 27892 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.256654 27873 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:21.322300 27689 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:21.213907 27848 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 13:09:21.376278 22579 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:21.378450 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:21.403246 22577 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:21.379009 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.385044 27918 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:21.388991 27884 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.390156 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:21.393319 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.421888 22573 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
W20260709 13:09:21.422163 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 258998us
I20260709 13:09:21.422847 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.423660 22575 raft_consensus.cc:2410] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:21.424455 23255 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:21.404448 22578 raft_consensus.cc:2368] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8.
W20260709 13:09:21.430227 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 241447us
I20260709 13:09:21.418043 22502 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:21.393424 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.401835 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.435886 22571 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:21.438403 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:21.439891 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 6f5719028ca945b2b6c1a1f140b05146: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:21.373037 27874 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:21.212395 27906 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.275s
W20260709 13:09:21.450984 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.404029 27877 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:21.352133 27866 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.468506 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:21.469035 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.351438 27788 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.454125 27810 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.469779 22574 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
W20260709 13:09:21.479027 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56129.4us
I20260709 13:09:21.474732 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.486025 22578 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:21.486330 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:21.376456 27887 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.488091 22649 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:21.463897 27686 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:21.446425 27689 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:09:21.505402 22652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d23ea829d43140beb6a88079029d865b"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:21.506175 22652 raft_consensus.cc:606] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:21.474454 27917 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:21.474890 27886 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.469611 27688 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:21.506585 22652 raft_consensus.cc:614] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:21.538578 22577 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:21.378405 27911 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.543413 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:21.541883 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:21.547209 22497 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.469735 27873 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:09:21.544150 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:21.553304 22499 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:21.556265 27688 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.562404 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:21.474993 27912 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.191s
I20260709 13:09:21.556897 27688 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.535334 27686 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.493919 27810 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.573028 27923 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.573858 27926 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:21.574909 27922 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:21.410195 27896 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.493804 27907 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.616776 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.617172 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.617961 22580 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:21.618361 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.618736 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.619767 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:21.537796 27917 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.601847 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:21.607147 27887 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:21.609009 27911 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:21.579946 27831 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.620354 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.622844 22574 raft_consensus.cc:2368] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8.
I20260709 13:09:21.667101 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:21.551880 27918 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:21.624002 22576 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:09:21.588778 27883 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.581275 27581 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:21.659957 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:21.623431 27774 consensus_meta.cc:287] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.272s	user 0.010s	sys 0.000s
I20260709 13:09:21.666288 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:21.681224 23262 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:21.623034 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:21.667991 23255 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:21.670485 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.667616 22580 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:21.646565 27917 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:21.670778 27556 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.529s	user 0.003s	sys 0.013s
I20260709 13:09:21.614813 27810 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:21.548573 27886 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.666842 27854 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:21.695971 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:21.696240 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:21.670766 27933 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.698345 27934 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.602914 27686 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.738626 22571 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:21.703166 27779 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:21.703760 27822 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.000s
I20260709 13:09:21.736927 22577 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:21.705457 27920 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:09:21.710659 27883 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:21.711742 27866 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:21.693674 27324 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:09:21.717664 27800 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.666s	user 0.001s	sys 0.011s
I20260709 13:09:21.719740 27806 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:21.623118 27923 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:21.744475 27799 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.000s
I20260709 13:09:21.625905 27870 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.735850 22497 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:21.700091 22503 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:21.741088 22498 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:21.738656 22654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:09:21.741554 22578 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:21.683584 27887 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:21.750249 23227 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 2.777s (SENT) [suppressed 39 similar messages]
I20260709 13:09:21.751660 23258 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:21.760375 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70862.9us
W20260709 13:09:21.740224 27922 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:21.763211 22501 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:21.764247 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.727399 27731 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.897s	user 0.011s	sys 0.010s
I20260709 13:09:21.694936 27556 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.745867 27934 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.849483 27556 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:21.687427 27774 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.851665 27774 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:21.647089 27926 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.747726 27822 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.743135 27933 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.930141 27857 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:21.846113 27765 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.763957 27806 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:21.844517 27873 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.085745 27883 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.107868 27915 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.004s
I20260709 13:09:22.123874 27915 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.126674 27915 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:21.940537 27866 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.128085 27866 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:21.949851 27918 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.130800 27866 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.120666 27688 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:21.849511 27934 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.094107 27857 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:22.115980 27765 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.122129 27927 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.127404 22645 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:22.051720 27937 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.138736 27829 consensus_meta.cc:287] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.597s	user 0.010s	sys 0.005s
I20260709 13:09:22.139277 27857 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.139710 27829 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.140708 27857 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.141214 27856 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:22.141644 27856 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:22.141513 27927 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.142812 27856 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:21.854727 27799 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.147459 27822 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.148717 27886 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:22.157929 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 407662us
I20260709 13:09:22.140863 27884 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.165318 22650 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:22.144270 27856 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.136082 27873 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.168475 27829 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.168323 27806 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.169521 27873 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.170668 27526 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:22.173266 27927 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.173689 27926 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:22.167634 27938 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:22.172219 27923 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:22.175134 27941 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:09:22.149333 27799 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.177531 27324 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.136181 27932 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.188154 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.200809 22574 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
W20260709 13:09:22.147548 27897 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.973s	user 0.012s	sys 0.000s
W20260709 13:09:22.186774 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.191063 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2862) took 1473 ms. Trace:
I20260709 13:09:22.136940 27883 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:22.289417 27837 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.078s	user 0.009s	sys 0.003s
I20260709 13:09:22.200244 27917 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:22.285737 27836 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:22.311523 27890 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.311992 27917 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:22.306046 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:22.192788 27324 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:22.312244 27890 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:22.314769 27324 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:22.255789 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:22.291684 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2871) took 1107 ms. Trace:
W20260709 13:09:22.230116 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.316190 22645 rpcz_store.cc:276] 0709 13:09:21.184373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.184550 (+   177us) service_pool.cc:224] Handling call
0709 13:09:21.184831 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.137281 (+952450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.291300 (+154019us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400393d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:22.291605 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167187712}
I20260709 13:09:22.318645 22652 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.319185 22650 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.335315 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:22.202549 22653 rpcz_store.cc:276] 0709 13:09:20.718062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.718179 (+   117us) service_pool.cc:224] Handling call
0709 13:09:20.718494 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:20.796401 (+ 77907us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:20.850589 (+ 54188us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.151797 (+301208us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b18003ca720. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:09:21.491511 (+339714us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:21.502771 (+ 11260us) log.cc:844] Serialized 52 byte log entry
0709 13:09:21.502971 (+   200us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:21.503022 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.503097 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.670154 (+167057us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b18003ca720. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:22.190713 (+520559us) raft_consensus.cc:1685] finished
0709 13:09:22.190743 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.190946 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128008,"prepare.queue_time_us":65017,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3329,"raft.queue_time_us":215775,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":16447,"spinlock_wait_cycles":23710720,"thread_start_us":335017,"threads_started":2,"wal-append.queue_time_us":530277}
I20260709 13:09:22.312680 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:22.338945 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:22.340049 22648 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:22.337004 27897 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.195813 27870 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.311256 27836 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.228302 27857 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.353036 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.358361 22574 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.285486 27779 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.317179 27874 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.252542 27933 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.194999 27932 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:22.381690 23227 connection.cc:256] RPC call timeout handler was delayed by -1.2326783770000702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 13:09:22.382266 23227 connection.cc:256] RPC call timeout handler was delayed by -1.211016225000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4978s for a response
I20260709 13:09:22.163633 27937 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.386618 22572 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:22.387615 22645 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
W20260709 13:09:22.382736 23227 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.573s (SENT)
I20260709 13:09:22.386085 22650 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:22.389293 22653 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:22.370488 27890 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.371829 27774 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:22.396134 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.397178 27937 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.397945 27926 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:22.395754 23227 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.772s (SENT)
I20260709 13:09:22.398234 27917 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.386554 27526 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.387243 27837 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:22.416638 22572 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:22.425297 22574 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:22.426345 22648 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:22.426476 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:22.427098 22651 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.397079 27932 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.364338 27857 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.419696 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:22.413928 27905 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.377590 27874 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.435420 27905 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.430651 27837 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.437955 27905 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:22.439464 27837 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.418210 27774 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.429975 27235 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.441717 27235 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.442513 27774 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.427554 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:22.443570 22648 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:22.443991 27831 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.002s
I20260709 13:09:22.444056 27235 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:22.423892 27765 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:22.449234 27905 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:22.449491 27887 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:22.450299 27887 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:22.450661 27887 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:22.450867 27857 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.451728 27887 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.453791 27887 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.429003 27526 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.459180 27526 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:22.461865 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:22.460440 27825 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.463349 27825 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:22.463493 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:22.467571 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2871) took 1184 ms. Trace:
I20260709 13:09:22.468053 22501 rpcz_store.cc:276] 0709 13:09:21.283345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.283566 (+   221us) service_pool.cc:224] Handling call
0709 13:09:21.283967 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.856751 (+572784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.467307 (+610556us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540033f9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:22.467500 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101712256}
I20260709 13:09:22.471884 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.472587 22572 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:22.473976 27894 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.329s	user 0.010s	sys 0.004s
I20260709 13:09:22.474443 27894 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:22.478196 27806 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:22.431531 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.481702 22571 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.432528 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.427744 27917 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.428040 22646 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:09:22.483592 22646 pending_rounds.cc:85] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 9
I20260709 13:09:22.483857 22646 pending_rounds.cc:107] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:09:22.484148 22646 raft_consensus.cc:2889] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:22.485991 22572 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:22.486609 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:22.487202 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.487673 22653 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:22.488150 22652 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
W20260709 13:09:22.487512 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.489730 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:22.490463 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 94738.1us
I20260709 13:09:22.491954 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:22.492635 23256 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
W20260709 13:09:22.490896 23227 connection.cc:256] RPC call timeout handler was delayed by -1.0331552149999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 13:09:22.493937 23227 connection.cc:256] RPC call timeout handler was delayed by -1.0082190530000616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 13:09:22.494503 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.495810 22646 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:22.497031 22648 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:22.500449 22651 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:22.502966 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:22.503954 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:22.503808 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:22.504043 22651 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:22.503865 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 864) took 1178 ms. Trace:
I20260709 13:09:22.504977 22646 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:22.505944 23262 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.507114 22646 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:22.507906 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:22.508548 22648 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:22.485793 27802 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:22.504984 22576 rpcz_store.cc:276] 0709 13:09:21.325284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.325569 (+   285us) service_pool.cc:224] Handling call
0709 13:09:22.503688 (+1178119us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54003edad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:22.503809 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580981120}
I20260709 13:09:22.429723 27937 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:22.512765 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.514130 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:22.514640 22572 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:22.514886 22652 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:22.513255 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.518359 22571 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:22.517408 22543 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.519905 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.520511 22571 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:22.520768 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.492841 27526 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:22.493569 27765 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:22.522260 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.527179 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.522291 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.522655 22653 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:22.524001 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.523900 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.516139 27802 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:22.529438 27856 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:22.550146 27856 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.509723 27338 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:22.504165 27837 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:22.551183 27837 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:22.551529 27831 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:22.552166 27837 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.553653 27917 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.545416 27765 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.549120 22575 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:22.532085 23262 raft_consensus.cc:2410] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:22.557968 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.558459 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.559080 22573 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:22.550623 27856 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.566538 22573 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:22.550580 27876 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.568006 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.569094 22573 raft_consensus.cc:2410] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:09:22.572067 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.572681 22571 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:22.531112 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.501977 27904 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:22.574750 27338 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:22.526412 27888 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:22.585006 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:22.585493 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54460.1us
I20260709 13:09:22.525759 27854 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:22.573077 27918 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:22.590466 22571 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:09:22.590693 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.586591 22573 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:22.575361 27324 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:22.591356 27765 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.592938 27834 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:22.592706 27338 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:22.594403 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.595098 27836 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.601951 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.591603 27888 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.530081 27923 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:09:22.605124 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.524772 27803 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:09:22.588483 27890 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:22.603384 22573 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:22.602728 27324 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:22.606261 27940 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.470s	user 0.005s	sys 0.000s
I20260709 13:09:22.523871 27937 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.612355 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:22.609999 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.611267 27836 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:22.613662 27765 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:22.614481 27906 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:22.614811 27802 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.616457 22576 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
W20260709 13:09:22.618378 27953 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:09:22.585695 27876 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.611860 27888 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:22.619258 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.662839 27876 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:22.607280 27918 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:22.664878 27918 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.604969 27854 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:22.619479 22574 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:22.623559 27883 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:22.624491 22572 raft_consensus.cc:2410] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:22.630069 22573 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:22.605707 27834 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:22.655148 27956 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:22.676542 27834 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.628345 27890 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.677743 27890 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.639379 27324 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.642761 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 789) took 1486 ms. Trace:
I20260709 13:09:22.644721 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1027) took 1768 ms. Trace:
I20260709 13:09:22.648918 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.608325 27897 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.652097 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:22.625432 27892 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:22.652900 27931 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:22.651743 27906 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:22.673169 27802 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.795810 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2869) took 1993 ms. Trace:
I20260709 13:09:22.803826 22647 rpcz_store.cc:276] 0709 13:09:20.802210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.802444 (+   234us) service_pool.cc:224] Handling call
0709 13:09:20.802881 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.134659 (+331778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.690748 (+1556089us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54001c7ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:22.795726 (+104978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569017728}
W20260709 13:09:22.796949 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.685206 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.807585 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 155570us
W20260709 13:09:22.807859 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 1.32148e+06us
I20260709 13:09:22.808480 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:22.681249 23258 rpcz_store.cc:276] 0709 13:09:21.156374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.171743 (+ 15369us) service_pool.cc:224] Handling call
0709 13:09:21.751476 (+579733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.923947 (+172471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.642245 (+718298us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54006d9cd0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:22.642401 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295260544}
W20260709 13:09:22.814311 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 165502us
I20260709 13:09:22.682173 22649 rpcz_store.cc:276] 0709 13:09:20.875875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.882079 (+  6204us) service_pool.cc:224] Handling call
0709 13:09:20.913659 (+ 31580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:21.494922 (+581263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.644375 (+1149453us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54002f8ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:22.644647 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320368512}
I20260709 13:09:22.801999 27892 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.820116 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:22.822628 23227 leader_election.cc:400] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 7 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8.
I20260709 13:09:22.824013 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:22.825740 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:22.828274 27799 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.828842 27929 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:22.829066 27923 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.829912 27923 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.832376 27874 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:22.833014 27765 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:22.833437 27765 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.833807 27765 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.838776 27686 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:22.878103 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56428.2us
I20260709 13:09:22.878362 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 865) took 1542 ms. Trace:
W20260709 13:09:22.878844 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53232.1us
I20260709 13:09:22.880034 27819 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:22.880255 27876 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:22.880126 27831 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.881333 27831 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:22.883865 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:22.884179 27831 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:22.877956 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.905828 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:22.810201 27956 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:22.807154 27931 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:22.908309 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.828935 27799 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:22.912659 27848 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:22.878798 22579 rpcz_store.cc:276] 0709 13:09:21.336469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.336688 (+   219us) service_pool.cc:224] Handling call
0709 13:09:21.371475 (+ 34787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.406742 (+ 35267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.842594 (+1435852us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b54003c87d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:22.878296 (+ 35702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10632576}
I20260709 13:09:22.977492 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2878) took 1239 ms. Trace:
I20260709 13:09:22.956518 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:22.803058 27909 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:22.845713 27892 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.986210 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:22.986941 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:22.914171 27643 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:22.887125 27883 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:22.987996 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.003486 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.003670 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.004125 22497 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.913339 27917 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.018725 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.002926 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.022168 23256 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:22.877956 27897 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:22.996978 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:23.052347 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55478.7us
I20260709 13:09:22.998106 22572 raft_consensus.cc:2376] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16. Re-sending same reply.
W20260709 13:09:23.053289 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 244858us
I20260709 13:09:23.053535 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.054164 22505 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.024140 22574 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:23.025019 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.055764 22499 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:22.907749 27870 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:09:22.915972 27819 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:09:23.029528 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:23.032197 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.061543 23261 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:23.032338 27888 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.022176 22501 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
I20260709 13:09:23.065598 27897 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:23.065987 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.066576 27897 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:23.067910 22501 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:23.002063 27593 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.069020 27955 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:23.069151 27593 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.072000 27593 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.034085 27923 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.034085 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.017648 27883 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.073789 27883 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.073359 23259 raft_consensus.cc:2410] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:09:23.023517 27848 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:23.034895 27904 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:23.035262 27910 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:23.037310 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.041615 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.043138 27836 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:23.046096 27803 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:23.048992 27887 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:23.050282 27799 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.051162 27894 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:22.959966 27854 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.054056 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:23.001907 22578 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:22.994024 27856 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.128291 27856 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:23.073331 23263 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:23.075773 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75672.5us
I20260709 13:09:23.129171 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:23.131440 27799 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:23.131806 27937 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:23.101789 27887 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.133165 27904 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:23.133342 27887 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.133746 27904 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.099567 27803 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:23.137346 27803 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.137988 27799 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.138568 27799 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.099877 27910 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.141024 27931 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.143998 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:22.951620 27906 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.033336 27801 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:23.152796 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:22.993774 22498 rpcz_store.cc:276] 0709 13:09:21.737769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.083072 (+345303us) service_pool.cc:224] Handling call
0709 13:09:22.083394 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.083755 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:22.352617 (+268862us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.976998 (+624381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.977086 (+    88us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:22.977146 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.977262 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.977415 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623497,"prepare.queue_time_us":315285,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1217,"thread_start_us":268168,"threads_started":1}
I20260709 13:09:23.079763 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:22.988015 27876 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:09:23.027901 27806 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.003s
I20260709 13:09:23.077064 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.095362 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.018693 27926 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.100821 22497 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:23.113449 27836 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:23.165683 23263 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:23.166436 22654 raft_consensus.cc:606] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.116706 22505 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:23.166863 22654 raft_consensus.cc:614] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:23.166962 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:23.167881 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.167816 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:23.101294 27837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.035s
W20260709 13:09:23.124347 27825 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.001s
I20260709 13:09:23.179596 27235 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.125118 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 71161.4us
I20260709 13:09:23.180219 27235 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.182065 27923 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.182194 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:23.183014 27923 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.183846 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:23.072234 27834 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.184712 27788 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:23.185199 22580 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:23.018646 27956 raft_consensus.cc:2764] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:09:23.185493 27788 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:23.185643 27923 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.185958 27788 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:23.186369 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.146203 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:23.187079 22499 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:23.155043 22501 raft_consensus.cc:2410] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:09:23.160638 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.161536 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:23.052419 27917 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.153491 27593 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:23.092516 27954 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:23.176595 27526 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:23.136008 27904 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.167847 23261 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:23.174979 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.187175 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.188781 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38438 (request call id 58) took 1450 ms. Trace:
I20260709 13:09:23.188458 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.199505 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.196661 22497 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 7.
W20260709 13:09:23.197106 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 120143us
I20260709 13:09:23.177578 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.203131 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.199020 22654 rpcz_store.cc:276] 0709 13:09:21.738215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.738501 (+   286us) service_pool.cc:224] Handling call
0709 13:09:23.188582 (+1450081us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001c89d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f5853 00007fec2b2c360a 00007fec248497d4 00007fec24849762 00007fec24849691 00007fec2484960c 00007fec248488c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:23.188695 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492659584}
I20260709 13:09:23.188036 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.188800 23259 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:23.144672 27894 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.192014 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.206769 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3498) took 1703 ms. Trace:
I20260709 13:09:23.208027 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:23.199851 22501 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:23.210315 22647 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:23.212405 22654 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
W20260709 13:09:23.175040 27837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.035s
I20260709 13:09:23.149415 27799 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.143451 27910 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.246765 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:23.247969 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.248692 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.249920 22498 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:23.186357 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:23.216643 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:23.217213 22500 rpcz_store.cc:276] 0709 13:09:21.503214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.504221 (+  1007us) service_pool.cc:224] Handling call
0709 13:09:21.549261 (+ 45040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.549449 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:21.570699 (+ 21250us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.206446 (+1635747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.206500 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:23.206547 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.206613 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.206716 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1383794,"prepare.queue_time_us":23138,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":1342591,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":17029,"thread_start_us":320142,"threads_started":1}
I20260709 13:09:23.234115 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.235477 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.265344 22505 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:23.265317 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48801.9us
I20260709 13:09:23.267159 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:09:23.273406 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.186384 27788 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.190050 27593 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:23.204229 27890 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.004s
I20260709 13:09:23.277365 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.287150 22497 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:09:23.278396 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 92100.1us
I20260709 13:09:23.280189 27910 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:23.190927 27917 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:23.166002 27838 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
W20260709 13:09:23.281133 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 1.78304e+06us
W20260709 13:09:23.191246 27324 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:09:23.287555 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.195127 27526 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.288410 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.252061 27923 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.277776 27904 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:23.277150 27643 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:09:23.308815 22571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.004s	sys 0.024s
I20260709 13:09:23.311020 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:23.281505 27922 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:23.163553 27876 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.318859 22501 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:23.318794 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.319373 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3527) took 1110 ms. Trace:
I20260709 13:09:23.399668 22580 rpcz_store.cc:276] 0709 13:09:22.209032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.209236 (+   204us) service_pool.cc:224] Handling call
0709 13:09:22.286228 (+ 76992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.185590 (+899362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.313897 (+128307us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54003f4b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:23.319310 (+  5413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066651392}
I20260709 13:09:23.232364 27846 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:09:23.191672 27836 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.289739 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.408229 23259 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:23.286460 27801 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:23.282347 27929 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:23.328836 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:23.388559 22571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.005s	sys 0.024s
W20260709 13:09:23.390169 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.174916 27926 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.402892 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.405987 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.233060 27956 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.142s
I20260709 13:09:23.287827 27686 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:09:23.417459 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.419253 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.322839 27910 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:23.420006 22498 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:23.420806 23262 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:09:23.307161 27890 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:23.421133 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 132522us
I20260709 13:09:23.434665 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.283486 27920 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:23.356189 22505 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:23.423393 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.281442 27799 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:23.232636 27848 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.421128 22497 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:23.438889 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.444774 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.445123 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.442709 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.446084 22500 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:23.414976 27801 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.373301 27526 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.414821 27904 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.328616 27324 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.470871 27904 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:23.470948 27324 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:23.439116 27806 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:09:23.471601 27593 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.473531 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:23.457819 27802 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 13:09:23.474740 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.475908 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.468782 27801 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.476193 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.446167 27799 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.477068 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:23.487993 23263 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:23.489675 22648 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:23.477159 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.477329 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.422472 27917 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:23.492951 23256 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:23.496999 23261 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:09:23.497256 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.497834 23256 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:23.418664 27955 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:23.485749 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.495190 23264 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:23.477963 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.500663 22498 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:23.476842 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.493567 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.502287 22497 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:23.433812 27908 raft_consensus.cc:2764] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:09:23.485821 27959 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:23.495931 27802 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.506582 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61551.7us
I20260709 13:09:23.486258 27799 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:23.522389 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.524422 22501 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:23.532094 22545 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.540426 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.544112 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:23.512655 27920 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:23.546028 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:23.545974 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.014s	sys 0.020s
I20260709 13:09:23.535466 23263 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:23.569167 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.571559 22544 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.575285 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.554883 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.559237 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.560361 27882 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:23.565029 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.020s
W20260709 13:09:23.592519 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 593229us
I20260709 13:09:23.604116 23264 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:23.552960 27324 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:23.554054 27338 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:23.505342 27917 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.620324 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:23.563746 27904 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:23.575632 27923 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:23.618283 23256 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:23.606181 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:23.622437 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67645.6us
I20260709 13:09:23.639098 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.625792 22579 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:23.626464 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:23.627121 22576 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:23.525712 27802 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.578238 27857 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:23.606667 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.677778 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.630748 27932 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:23.677570 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.623631 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.641620 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:23.683039 22580 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:23.634008 22500 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:23.508689 27929 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.656538 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.616647 27961 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:23.661706 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 227097us
I20260709 13:09:23.672907 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:23.686079 22505 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 7.
I20260709 13:09:23.632810 27894 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:23.691633 22498 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:23.699558 22505 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:23.700264 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:23.592239 27910 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:23.688071 27803 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.001s
I20260709 13:09:23.751307 22505 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:23.744905 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:23.751597 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.690076 27857 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.756681 22500 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
W20260709 13:09:23.757469 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57284.9us
I20260709 13:09:23.627390 27882 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:23.746578 27643 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:23.747326 27806 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:23.709492 27819 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:23.689750 27968 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:23.760471 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:23.748332 27876 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:23.793305 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48583.2us
I20260709 13:09:23.698911 27837 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:09:23.766845 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 449766us
I20260709 13:09:23.745024 27593 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:23.695851 27919 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:09:23.811630 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:23.764599 27932 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:23.765359 27857 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.812723 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:23.793746 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 277910us
I20260709 13:09:23.746366 27956 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:09:23.744521 27967 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
W20260709 13:09:23.833467 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.792218 27836 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:23.837970 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:23.847535 23229 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:23.827035 27892 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.764s	user 0.006s	sys 0.005s
I20260709 13:09:23.792222 27979 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.832576 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.025s	sys 0.015s
W20260709 13:09:23.832227 27931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.009s	sys 0.031s
I20260709 13:09:23.656828 27955 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.853626 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:23.760905 27803 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:23.859030 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.025s	sys 0.015s
W20260709 13:09:23.856092 27788 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:09:23.833909 27926 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:23.832657 27526 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:23.890626 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 676536us
I20260709 13:09:23.854283 27894 raft_consensus.cc:2764] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
W20260709 13:09:23.866338 27931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.031s
W20260709 13:09:23.912405 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65034.4us
I20260709 13:09:23.865072 27908 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:23.913733 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:09:23.920275 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66759.6us
I20260709 13:09:23.921244 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:23.843861 27593 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.906873 27836 raft_consensus.cc:2764] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:23.866598 27892 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.927307 27908 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:23.976481 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62838.3us
W20260709 13:09:23.977911 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56735.9us
I20260709 13:09:23.984608 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:23.980795 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:23.965417 27960 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 13:09:23.985786 22645 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:23.986377 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:23.873554 27979 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:23.904261 27788 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:23.988580 22647 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.958611 27966 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:24.004691 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:23.994194 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:24.005618 22573 raft_consensus.cc:2368] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:09:23.990083 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:23.990720 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:24.008126 22579 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:23.986860 27972 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:09:23.995270 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.014482 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:24.017446 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:24.018345 22579 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:24.023205 27926 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.023411 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2875) took 2478 ms. Trace:
I20260709 13:09:24.023768 27926 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.024276 27926 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.025041 27888 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.023933 22504 rpcz_store.cc:276] 0709 13:09:21.544914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.721857 (+176943us) service_pool.cc:224] Handling call
0709 13:09:21.722214 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.966751 (+1244537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.966798 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.988715 (+ 21917us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.200387 (+211672us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b1800375640. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:23.674620 (+474233us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.674663 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.674732 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.023061 (+348329us) raft_consensus.cc:1685] finished
0709 13:09:24.023083 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.023323 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1277218,"raft.queue_time_us":1252285,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7302,"spinlock_wait_cycles":46743296,"thread_start_us":474035,"threads_started":1,"wal-append.queue_time_us":986104}
I20260709 13:09:24.027153 22504 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:09:24.027268 27979 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.029055 22501 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:09:24.018599 27969 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:09:24.030884 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3552) took 1140 ms. Trace:
I20260709 13:09:23.994400 27991 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.031420 27991 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.031665 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3530) took 1650 ms. Trace:
I20260709 13:09:24.031986 27991 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.031251 22577 rpcz_store.cc:276] 0709 13:09:22.890160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.891319 (+  1159us) service_pool.cc:224] Handling call
0709 13:09:22.891775 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.903476 (+ 11701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.903508 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.904013 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.439912 (+535899us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.439964 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.440032 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.030663 (+590631us) raft_consensus.cc:1685] finished
0709 13:09:24.030683 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.030817 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11194,"raft.queue_time_us":21668,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":24284,"thread_start_us":466098,"threads_started":1,"wal-append.queue_time_us":684717}
I20260709 13:09:24.032545 22571 rpcz_store.cc:276] 0709 13:09:22.381396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.605194 (+223798us) service_pool.cc:224] Handling call
0709 13:09:22.612939 (+  7745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.647816 (+ 34877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.647848 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.648469 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.415786 (+767317us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:23.415838 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.415911 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.031477 (+615566us) raft_consensus.cc:1685] finished
0709 13:09:24.031497 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.031612 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15886,"raft.queue_time_us":34486,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3576,"thread_start_us":746505,"threads_started":1,"wal-append.queue_time_us":880732}
I20260709 13:09:24.029103 27643 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.034693 22504 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:24.025238 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:24.044750 22505 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:24.015702 22618 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:24.047889 27526 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.048998 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:24.051221 27593 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:24.024797 27887 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.891s	user 0.012s	sys 0.000s
I20260709 13:09:24.055667 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.059015 23259 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:24.060070 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:23.991237 27919 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:09:24.004019 27836 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:09:24.060469 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:24.342824 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:24.343151 27526 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.343696 27526 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:24.344709 28002 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:09:24.345017 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2892) took 1192 ms. Trace:
I20260709 13:09:24.345122 27887 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.345417 22648 rpcz_store.cc:276] 0709 13:09:23.152409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.152546 (+   137us) service_pool.cc:224] Handling call
0709 13:09:24.344807 (+1192261us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400169c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:24.344958 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738259840}
I20260709 13:09:24.346349 22573 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:24.346727 22572 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:24.346829 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:24.064889 22647 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:24.343521 22579 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
W20260709 13:09:24.350801 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.141247 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.202033 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:24.355365 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 299761us
I20260709 13:09:24.356427 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:24.356516 22580 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.001s
I20260709 13:09:24.357501 22580 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:09:24.358275 22576 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [14.10-18.12]
W20260709 13:09:24.428162 22468 connection.cc:256] RPC call timeout handler was delayed by -4.6113294469998891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
I20260709 13:09:24.117753 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:24.431062 22571 raft_consensus.cc:2410] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:09:24.039781 27765 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.206s	user 0.011s	sys 0.002s
W20260709 13:09:24.023800 27883 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.002s
W20260709 13:09:24.236701 27980 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 13:09:24.237337 27986 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:09:24.432832 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:24.239425 27987 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:09:24.053035 27979 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:24.206096 27876 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:24.431826 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:24.362205 27643 tablet_bootstrap.cc:492] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
W20260709 13:09:24.177248 27974 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.414s	user 0.000s	sys 0.001s
W20260709 13:09:24.238801 27984 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260709 13:09:24.237941 27989 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 13:09:24.208847 27978 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.383s	user 0.001s	sys 0.001s
W20260709 13:09:24.139962 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 232501us
W20260709 13:09:24.235666 27977 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
I20260709 13:09:24.018502 27837 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:24.044328 27888 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.188423 27975 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
I20260709 13:09:24.252530 27819 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:24.468717 22572 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:24.471244 27931 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:09:23.987839 27981 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:24.235383 27801 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.759s	user 0.005s	sys 0.006s
W20260709 13:09:24.447201 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 92499.8us
I20260709 13:09:24.091012 27897 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:24.577649 27981 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.581139 27897 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.581350 27981 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:24.581602 27897 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:24.205873 27803 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:24.248795 27834 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.064s	user 0.007s	sys 0.004s
I20260709 13:09:24.436440 27779 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:24.224771 27882 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:24.477288 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46592.1us
I20260709 13:09:24.440743 27854 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.480581 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 490539us
W20260709 13:09:24.481453 23257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.003s	sys 0.018s
I20260709 13:09:24.038233 27870 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.433s
I20260709 13:09:24.164278 27926 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.617532 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:24.618431 22497 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:24.605841 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2891) took 1453 ms. Trace:
I20260709 13:09:24.058684 27994 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.421s
I20260709 13:09:24.481540 27802 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:24.479908 27876 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.529613 27643 ts_tablet_manager.cc:1403] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 4.542s	user 0.066s	sys 0.058s
I20260709 13:09:24.530712 27996 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.472810 27968 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:09:24.481727 27979 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:24.474581 27997 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:09:24.533864 27998 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:24.536330 27857 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.002s
I20260709 13:09:24.474364 27918 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.541343 22544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.017s	sys 0.052s
W20260709 13:09:24.681756 22544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.018s	sys 0.052s
I20260709 13:09:24.549686 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.551849 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.555382 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.684020 22648 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:24.556823 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.559340 27917 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.482625 27937 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:24.177277 27908 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.465706 27883 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.450871 27765 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:24.667776 27848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.020s
W20260709 13:09:24.560286 27846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.018s	sys 0.047s
I20260709 13:09:24.513242 27892 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:24.585071 27801 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:24.566272 27992 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.367s	user 0.001s	sys 0.001s
I20260709 13:09:24.592005 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3502) took 2132 ms. Trace:
W20260709 13:09:24.717947 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 112404us
W20260709 13:09:24.565649 27961 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.009s
I20260709 13:09:24.593146 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:24.615113 22468 connection.cc:256] RPC call timeout handler was delayed by -4.5169705590000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:09:24.722150 22468 connection.cc:256] RPC call timeout handler was delayed by -4.0714705589999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:09:24.722549 22468 connection.cc:256] RPC call timeout handler was delayed by -4.0696705589999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 13:09:24.722323 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:24.722958 22468 connection.cc:256] RPC call timeout handler was delayed by -4.0372705589999214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
I20260709 13:09:24.723188 22498 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:24.723264 22468 connection.cc:256] RPC call timeout handler was delayed by -3.9472705590000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 13:09:24.723686 22468 connection.cc:256] RPC call timeout handler was delayed by -3.8950705589999188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:09:24.723868 22468 connection.cc:256] RPC call timeout handler was delayed by -3.6115705589999152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2535s for a response
W20260709 13:09:24.724206 22468 connection.cc:256] RPC call timeout handler was delayed by -3.4378705589999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27280000000000004s for a response
W20260709 13:09:24.724363 22468 connection.cc:256] RPC call timeout handler was delayed by -3.3507433289998971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:09:24.724512 22468 connection.cc:256] RPC call timeout handler was delayed by -2.9421433289999186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:09:24.615958 23257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.004s	sys 0.023s
I20260709 13:09:24.577744 27819 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.572733 27788 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.621057 22500 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:24.651511 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2894) took 1442 ms. Trace:
I20260709 13:09:24.730147 22652 rpcz_store.cc:276] 0709 13:09:23.208949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.209099 (+   150us) service_pool.cc:224] Handling call
0709 13:09:23.277280 (+ 68181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.279019 (+  1739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.279060 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.286334 (+  7274us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.695955 (+409621us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.696004 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.696090 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.651277 (+955187us) raft_consensus.cc:1685] finished
0709 13:09:24.651301 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.651452 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1168,"raft.queue_time_us":1882,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7992,"thread_start_us":297433,"threads_started":1,"wal-append.queue_time_us":522583}
I20260709 13:09:24.619491 22651 rpcz_store.cc:276] 0709 13:09:23.151999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.152166 (+   167us) service_pool.cc:224] Handling call
0709 13:09:23.152581 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.161682 (+  9101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.161730 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.162294 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.643972 (+481678us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.644032 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.644122 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.605545 (+961423us) raft_consensus.cc:1685] finished
0709 13:09:24.605577 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.605758 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1107,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5585,"thread_start_us":411149,"threads_started":1,"wal-append.queue_time_us":624174}
I20260709 13:09:24.734637 27643 raft_consensus.cc:359] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:24.735731 27643 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:09:24.578104 27967 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:24.737296 27967 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:24.655745 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.742293 27801 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.743031 27801 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.743139 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:24.743542 27801 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:24.745538 28008 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:09:24.746801 27982 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.783s	user 0.000s	sys 0.000s
I20260709 13:09:24.668391 27996 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.571480 27888 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.568958 27999 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:09:24.748680 27999 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:24.749101 27999 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:24.603508 27825 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:09:24.651482 28006 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.196s	user 0.004s	sys 0.000s
I20260709 13:09:24.617662 27838 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.618585 28011 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.679845 22497 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:24.683938 22645 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:24.555959 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.770897 22653 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:24.684770 22646 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:24.771203 22498 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:24.687453 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1085) took 1686 ms. Trace:
I20260709 13:09:24.651180 27876 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:24.666858 27991 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.003s
I20260709 13:09:24.696918 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:24.573904 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 217566us
I20260709 13:09:24.647724 27854 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.783214 27825 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:24.783648 27825 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:24.788322 27937 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.788909 27937 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.789829 27892 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.790382 27892 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.791303 27937 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.791847 27937 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:24.686990 27857 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.718106 22503 rpcz_store.cc:276] 0709 13:09:22.459102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.464662 (+  5560us) service_pool.cc:224] Handling call
0709 13:09:22.465108 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.001113 (+536005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.001140 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.001624 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.445070 (+443446us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.445108 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.445172 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.591780 (+1146608us) raft_consensus.cc:1685] finished
0709 13:09:24.591802 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.591943 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535613,"raft.queue_time_us":577398,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":443073,"threads_started":1,"wal-append.queue_time_us":650117}
I20260709 13:09:24.725925 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:24.725613 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 709) took 1253 ms. Trace:
I20260709 13:09:24.794564 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:24.795435 27857 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.794734 23257 rpcz_store.cc:276] 0709 13:09:23.471899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.491093 (+ 19194us) service_pool.cc:224] Handling call
0709 13:09:23.508040 (+ 16947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.508276 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:23.807374 (+299098us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.725265 (+917891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.725333 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:24.725383 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.725447 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.725553 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4296,"prepare.queue_time_us":457774,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":2833,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":29327,"thread_start_us":1199233,"threads_started":2,"wal-append.queue_time_us":778632}
I20260709 13:09:24.796003 22503 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:24.796366 22503 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:24.796759 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:24.797130 22578 raft_consensus.cc:2368] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
W20260709 13:09:24.712224 27846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.293s	user 0.019s	sys 0.048s
I20260709 13:09:24.797489 23257 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:24.798470 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:24.798941 28016 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:09:24.799062 23257 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:24.792608 27892 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:24.800323 27788 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:24.714022 27799 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.187s	user 0.009s	sys 0.006s
I20260709 13:09:24.800735 27788 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:24.801210 27788 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.801020 27799 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.803258 27799 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.691704 27918 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:24.794597 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69754.4us
W20260709 13:09:24.805588 28014 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:09:24.806142 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:24.806707 27918 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:24.713217 27908 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:24.808195 27801 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.808337 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:24.809078 27910 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.809497 27910 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:24.809859 27910 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.750502 22574 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:24.750995 23255 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:24.814335 22503 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.815694 22503 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:24.817142 27689 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:24.821616 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:24.822523 27593 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:24.774269 28011 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.827864 28011 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:24.828699 27970 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.066s	user 0.001s	sys 0.003s
I20260709 13:09:24.831528 27854 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.832911 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:24.834913 27883 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:24.835067 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.836328 27924 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.836730 27926 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.842159 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:24.772636 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:24.773267 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:24.850445 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 696) took 1706 ms. Trace:
W20260709 13:09:24.850574 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 78033us
I20260709 13:09:24.850906 23262 rpcz_store.cc:276] 0709 13:09:23.143918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.153842 (+  9924us) service_pool.cc:224] Handling call
0709 13:09:24.850190 (+1696348us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54007021d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:24.850376 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578281856}
I20260709 13:09:24.851524 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:24.771744 22502 rpcz_store.cc:276] 0709 13:09:23.000997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.002109 (+  1112us) service_pool.cc:224] Handling call
0709 13:09:23.002405 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.052204 (+ 49799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.052242 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.052686 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.545707 (+493021us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.545752 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.545860 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.687221 (+1141361us) raft_consensus.cc:1685] finished
0709 13:09:24.687249 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.687392 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49404,"raft.queue_time_us":55677,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":16652,"thread_start_us":433037,"threads_started":1,"wal-append.queue_time_us":616038}
I20260709 13:09:24.743674 27890 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:24.853000 28011 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:24.853346 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 853) took 1210 ms. Trace:
I20260709 13:09:24.853439 28011 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:24.853981 28011 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.853842 23256 rpcz_store.cc:276] 0709 13:09:23.643079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.643238 (+   159us) service_pool.cc:224] Handling call
0709 13:09:24.852040 (+1208802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.852211 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.852235 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.852279 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:24.852308 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.852360 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.853186 (+   826us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54007021d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:24.853289 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2779072768}
I20260709 13:09:24.782147 22648 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:24.682858 27998 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.775257 27838 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.746824 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 848) took 1169 ms. Trace:
I20260709 13:09:24.856894 27998 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.856020 23263 rpcz_store.cc:276] 0709 13:09:23.577681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.577840 (+   159us) service_pool.cc:224] Handling call
0709 13:09:23.578738 (+   898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.895857 (+317119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.895904 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.896561 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.143131 (+246570us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:24.143195 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.143298 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.746558 (+603260us) raft_consensus.cc:1685] finished
0709 13:09:24.746596 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.746765 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":376331,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":8800,"thread_start_us":476095,"threads_started":2,"wal-append.queue_time_us":657715}
I20260709 13:09:24.727475 27961 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.716545 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2884) took 1765 ms. Trace:
I20260709 13:09:24.736506 27643 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:24.849046 27235 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:24.854696 28010 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:09:24.858750 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:24.849188 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:24.859656 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.859804 22653 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:24.858378 27765 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.853852 28009 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:24.861152 27765 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:24.861531 27765 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.861917 27765 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.858816 22650 rpcz_store.cc:276] 0709 13:09:22.951268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.955397 (+  4129us) service_pool.cc:224] Handling call
0709 13:09:22.955866 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.956306 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.956346 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.973448 (+ 17102us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.435706 (+462258us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.498266 (+ 62560us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.498525 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.498660 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.716329 (+1217669us) raft_consensus.cc:1685] finished
0709 13:09:24.716354 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.716484 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62567,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4854,"raft.queue_time_us":3727,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":27834,"thread_start_us":397680,"threads_started":1,"wal-append.queue_time_us":630553}
W20260709 13:09:24.862555 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.775494 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:24.863250 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:24.864296 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:24.815667 28020 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
W20260709 13:09:24.866549 27993 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.335s	user 0.003s	sys 0.001s
I20260709 13:09:24.867656 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2886) took 1724 ms. Trace:
I20260709 13:09:24.867779 27897 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.857972 27838 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:24.869130 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 71076.8us
I20260709 13:09:24.868040 22649 rpcz_store.cc:276] 0709 13:09:23.143290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.143437 (+   147us) service_pool.cc:224] Handling call
0709 13:09:23.143832 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.472959 (+329127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.490133 (+ 17174us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.490593 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.655035 (+164442us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.655083 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.812453 (+1157370us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:24.812508 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.866126 (+ 53618us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b24001df408. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324d09d 00007fec25e7f10e 00007fec25e9688c 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221
0709 13:09:24.867453 (+  1327us) raft_consensus.cc:1685] finished
0709 13:09:24.867475 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.867602 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":726,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":744117248,"thread_start_us":164065,"threads_started":1,"wal-append.queue_time_us":974282}
I20260709 13:09:24.870394 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.870419 27870 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:24.871163 27870 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.871320 27890 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:24.871587 27870 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.871719 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:24.872599 27890 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:24.873016 27890 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.872934 27926 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:24.873596 27890 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:24.874020 27643 ts_tablet_manager.cc:1434] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.221s	user 0.008s	sys 0.000s
I20260709 13:09:24.877424 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 2887) took 1775 ms. Trace:
I20260709 13:09:24.877846 22499 rpcz_store.cc:276] 0709 13:09:23.101893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.187780 (+ 85887us) service_pool.cc:224] Handling call
0709 13:09:24.877213 (+1689433us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b540033efd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:24.877363 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124414336}
I20260709 13:09:24.878607 27976 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:24.879040 27976 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:24.879962 27976 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.881496 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2873) took 3399 ms. Trace:
I20260709 13:09:24.881899 22496 rpcz_store.cc:276] 0709 13:09:21.482147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.482303 (+   156us) service_pool.cc:224] Handling call
0709 13:09:21.497986 (+ 15683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.312250 (+1814264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.312292 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.422262 (+109970us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.661143 (+238881us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.661176 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.265478 (+604302us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4800080358. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:09:24.881177 (+615699us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54001d97d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:24.881226 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.881271 (+    45us) raft_consensus.cc:1685] finished
0709 13:09:24.881286 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.881436 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1315272,"raft.queue_time_us":1342314,"raft.run_cpu_time_us":9684,"raft.run_wall_time_us":1349089,"spinlock_wait_cycles":210418688,"thread_start_us":628879,"threads_started":2,"wal-append.queue_time_us":425838}
I20260709 13:09:24.882272 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.885278 27593 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:24.885731 27593 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:24.886113 27593 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:24.887027 27996 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.887795 27991 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.881510 27961 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:24.890208 27991 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.759954 27887 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:24.888491 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 113142us
I20260709 13:09:24.869145 22647 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:24.895017 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.777612 27856 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.765892 27968 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.904192 23261 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:24.905077 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:24.906543 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:24.767537 27802 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:24.749828 27888 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:24.758857 27967 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.792292 27937 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.922739 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:24.923600 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.948292 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:24.898391 27890 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.949256 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.950613 27890 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:24.951244 27890 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:24.951445 27819 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.920603 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.932586 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2891) took 1782 ms. Trace:
I20260709 13:09:24.954197 22505 rpcz_store.cc:276] 0709 13:09:23.150042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.755287 (+605245us) service_pool.cc:224] Handling call
0709 13:09:23.755574 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.045242 (+289668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.932303 (+887061us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54001b8854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:24.932512 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664630016}
I20260709 13:09:24.937016 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 692) took 2029 ms. Trace:
I20260709 13:09:24.931905 22504 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:24.951869 27890 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:24.955483 22504 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:24.955317 23258 rpcz_store.cc:276] 0709 13:09:22.930275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.973109 (+ 42834us) service_pool.cc:224] Handling call
0709 13:09:24.936718 (+1963609us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400719b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:24.936935 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3940157824}
I20260709 13:09:24.955325 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.963304 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:24.917904 27976 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.919775 27920 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.917521 27856 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.920594 27689 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:24.956372 22504 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:24.922344 27924 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.969339 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:24.969521 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 693) took 1995 ms. Trace:
I20260709 13:09:24.983780 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:24.984596 22648 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:24.985091 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.985983 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.987177 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.987804 22646 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:24.970074 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3555) took 1372 ms. Trace:
I20260709 13:09:24.919968 27874 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:24.928925 27324 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:24.977849 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:24.977916 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:24.999682 22577 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:24.784502 27825 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.001497 27825 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.973984 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:24.979449 22619 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.006095 22573 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:24.973392 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 68390.7us
I20260709 13:09:24.979596 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:24.980450 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:25.000640 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:24.981387 22579 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:24.990283 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:24.995005 22648 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:24.946868 27883 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:25.043104 22650 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:24.989230 22574 rpcz_store.cc:276] 0709 13:09:23.598023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.600219 (+  2196us) service_pool.cc:224] Handling call
0709 13:09:23.619495 (+ 19276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.813117 (+1193622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.969856 (+156739us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000e7254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:24.970020 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600395136}
I20260709 13:09:24.983062 23255 rpcz_store.cc:276] 0709 13:09:22.974283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.974442 (+   159us) service_pool.cc:224] Handling call
0709 13:09:23.018476 (+ 44034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.813433 (+1794957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.969290 (+155857us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400834d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:24.969465 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3914886528}
I20260709 13:09:24.871291 27765 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:24.947027 27802 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.961838 27917 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:25.036887 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.046360 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:25.046622 22653 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:25.046983 22578 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
W20260709 13:09:25.047679 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.040740 22576 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:24.922668 27910 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.041872 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:25.042050 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.057999 23258 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:25.008169 22572 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:09:25.040606 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 55601.9us
I20260709 13:09:24.976609 22504 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.963742 27890 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:25.044718 27235 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.045614 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66234.5us
W20260709 13:09:25.060986 22544 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:25.061434 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 62956.3us
I20260709 13:09:25.062808 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:24.756155 27979 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.048341 22576 pending_rounds.cc:85] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 6
I20260709 13:09:25.082297 22576 pending_rounds.cc:107] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:25.007544 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.082731 22576 raft_consensus.cc:2889] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.041136 22577 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
W20260709 13:09:25.048516 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.084316 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.084748 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.085821 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.086266 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:24.979758 27686 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.087703 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.088763 22497 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:25.089154 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.089787 22498 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:25.089833 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.090888 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.091293 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:24.963137 27961 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:09:24.998847 27324 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:24.974598 27856 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.054661 27802 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:25.055191 27765 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.054750 27806 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:24.971527 28021 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:24.946147 27908 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:09:24.929001 27968 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:24.922788 27788 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:25.063911 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85606.5us
I20260709 13:09:25.065052 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:24.981348 27920 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.054674 27819 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:25.059521 27235 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.092543 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:24.968031 27870 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.091878 22498 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:25.095324 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.098960 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.144266 22502 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.093003 22497 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:25.095485 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 177711us
I20260709 13:09:25.147053 22468 leader_election.cc:400] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:09:25.147535 22468 leader_election.cc:403] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.056301 27998 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:25.046737 27892 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:25.056903 28030 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:24.997489 27981 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:25.115756 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 53046.9us
I20260709 13:09:25.166807 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.116369 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.167858 22500 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:25.041657 27926 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:09:25.095492 28014 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:25.066731 27883 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:25.118237 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 110786us
I20260709 13:09:25.041247 27931 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:09:25.081336 27890 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:25.126888 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.193053 22496 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.135941 22580 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:24.980485 27888 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.105023 27324 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:25.113927 27846 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:25.151245 23255 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:25.151885 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:25.154124 27235 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:25.126716 27834 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:25.162669 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.097831 27686 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.099787 27838 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:09:25.164019 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:25.164268 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71808.1us
I20260709 13:09:25.170303 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.133917 27806 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:25.178290 22502 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:09:25.192350 27998 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:25.194795 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.194985 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:25.195580 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.120365 28031 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:09:25.222574 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.171047 27831 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:25.213826 22498 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:25.186005 27779 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:25.215109 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.215770 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.218185 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:25.218719 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54786.8us
I20260709 13:09:25.230423 22502 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:25.174204 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:25.221369 22497 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
W20260709 13:09:25.202399 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50604.4us
W20260709 13:09:25.198603 28018 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.424s	user 0.000s	sys 0.002s
I20260709 13:09:25.185555 27854 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:25.222150 22499 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:25.231171 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.222848 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:25.227519 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:25.236851 23261 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:25.233120 22498 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:25.238199 27967 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:25.239089 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:25.239200 27919 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:25.240154 27919 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:25.241240 27919 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.242312 27686 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.242960 22496 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:25.244045 23258 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:25.244572 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.245383 27593 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.247601 27593 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:25.248828 27890 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.249462 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.250108 27788 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.250756 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.251335 22500 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:25.251737 27890 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:25.253070 27937 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:25.269227 27788 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:25.253450 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 79320.7us
I20260709 13:09:25.210803 27846 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.270838 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.208691 27848 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:25.271716 27848 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.272074 27848 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:25.272006 27856 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.251554 27806 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.273234 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:25.273844 23258 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 7.
I20260709 13:09:25.274508 27876 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.275775 27956 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:25.208268 27897 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:25.276707 27955 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:25.277552 27854 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.278378 27788 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:25.279773 27854 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.254529 27910 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.280463 22500 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:25.281621 23255 raft_consensus.cc:2410] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:25.278951 27788 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.283854 27788 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.280983 23227 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:25.286178 28032 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:09:25.288368 27991 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:25.288841 27991 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:25.289283 27991 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:25.258191 27324 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.262735 27883 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:25.295478 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.016s	sys 0.016s
W20260709 13:09:25.295851 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.016s	sys 0.016s
I20260709 13:09:25.263427 28037 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:25.297292 27593 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:25.265602 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:25.297670 27593 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:25.266390 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:25.266496 27929 raft_consensus.cc:2764] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:09:25.267280 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:25.237529 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.268170 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.298885 23261 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:25.268548 22468 leader_election.cc:400] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
W20260709 13:09:25.299835 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70835.8us
I20260709 13:09:25.300567 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.301501 27929 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:25.301571 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:25.301944 27929 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:25.302373 27929 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.302554 22579 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:25.303120 27836 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:25.303519 27836 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:25.303910 27836 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:25.304383 27788 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:25.300845 27593 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:25.306777 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 950630us
I20260709 13:09:25.217010 28028 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:25.228329 27779 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.225765 27908 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:25.255882 28033 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:09:25.319301 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 93242.5us
I20260709 13:09:25.320293 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.306605 27892 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:25.316689 27834 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:25.335611 27834 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:25.298806 27991 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.203192 27888 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.288552 28015 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:25.343048 28026 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:09:25.311069 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.343042 27888 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.343762 22500 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:09:25.344345 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 79680.1us
I20260709 13:09:25.345171 22500 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:09:25.345810 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77702.2us
I20260709 13:09:25.345963 27854 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:25.346531 27854 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:25.346882 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.345220 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:25.347510 27854 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.348304 22544 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:25.313666 22504 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:09:25.349746 22504 pending_rounds.cc:85] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 12
I20260709 13:09:25.350157 22504 pending_rounds.cc:107] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:09:25.350566 22504 raft_consensus.cc:2889] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.351647 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3534) took 1432 ms. Trace:
I20260709 13:09:25.352027 22504 rpcz_store.cc:276] 0709 13:09:23.919320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.342503 (+423183us) service_pool.cc:224] Handling call
0709 13:09:24.342864 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.931807 (+588943us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b54001f39a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec26272dc0 00007fec262fd1c0 00007fec262fe231 00007fec262fad8f 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c
0709 13:09:25.351402 (+419595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.351591 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216029056}
I20260709 13:09:25.171589 28036 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:09:25.193094 28030 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.317035 27779 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.315579 27937 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:25.336596 27834 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.341153 27324 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:25.342135 27920 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:25.269138 28035 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:25.314471 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:25.373046 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 58699.5us
I20260709 13:09:25.373191 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.353768 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.333205 27593 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:25.354431 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 99929.9us
I20260709 13:09:25.376097 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.354547 22578 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:25.337868 27892 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.390563 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.390882 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:25.391773 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:25.410233 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.409781 22574 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:25.393749 23229 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:25.413340 22577 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:25.355050 27910 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.421711 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.422468 28028 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:25.371192 27831 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:25.370922 27686 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:25.428993 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55097.9us
W20260709 13:09:25.430958 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75003.2us
I20260709 13:09:25.436295 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.436586 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.437943 22578 raft_consensus.cc:2368] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:25.437980 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:25.439781 22543 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:25.434257 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3530) took 1896 ms. Trace:
I20260709 13:09:25.447526 22501 rpcz_store.cc:276] 0709 13:09:23.537835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.029945 (+492110us) service_pool.cc:224] Handling call
0709 13:09:24.030203 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.040372 (+ 10169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.040435 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.091969 (+ 51534us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.471554 (+379585us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:24.471609 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.471709 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.433959 (+962250us) raft_consensus.cc:1685] finished
0709 13:09:25.433991 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.434178 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1458,"raft.queue_time_us":9692,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7784,"spinlock_wait_cycles":655744,"thread_start_us":379168,"threads_started":1,"wal-append.queue_time_us":682128}
I20260709 13:09:25.450078 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:25.391127 27838 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:25.465049 22468 leader_election.cc:400] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:25.465453 22468 leader_election.cc:403] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.416949 27892 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:25.411121 28015 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:25.432047 27831 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.463759 27834 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.470438 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:25.419250 27819 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:25.419201 27888 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.480499 22574 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:25.476253 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.412496 27937 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:25.429829 27920 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:25.483951 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 135719us
I20260709 13:09:25.497718 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.479810 27874 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:25.468263 27887 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:25.466220 27907 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:25.510871 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 117179us
I20260709 13:09:25.499141 23264 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:25.473193 27324 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:25.478464 27686 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:25.501763 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:25.511559 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46622.4us
I20260709 13:09:25.512053 27686 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.512475 27686 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:25.502501 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.477748 27831 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.427196 28036 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:09:25.486639 27961 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:25.447058 27910 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.490229 27888 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.509379 27998 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:25.514858 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:25.548760 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.548324 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:25.533676 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.548408 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.552484 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:25.552259 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:25.555997 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.557013 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.558722 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.560560 22646 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:25.561719 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:25.561980 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.562471 22654 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:25.563710 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.564396 22654 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:25.565697 23264 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:25.571007 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.571183 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.571900 22646 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.508832 27887 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.572546 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.509979 27819 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:25.510537 27976 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:25.516614 27324 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:25.554005 28036 consensus_queue.cc:1243] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:25.593045 27324 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:25.605516 27526 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.261s	user 0.005s	sys 0.009s
I20260709 13:09:25.606091 27526 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.545511 27788 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:09:25.606966 27819 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.545209 28028 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.611581 28030 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.507985 27920 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.639675 22646 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:09:25.514642 27890 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:09:25.606549 22653 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:25.618204 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.641522 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.618901 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.642807 22652 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:25.606547 22649 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:25.639197 23263 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 8: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:25.608512 27526 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.581297 27887 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:25.601295 28011 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.006s
W20260709 13:09:25.605594 28049 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:09:25.567361 27874 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:09:25.648802 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.650704 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.642477 22646 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:25.652894 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.665452 22500 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:25.647374 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.666190 22652 raft_consensus.cc:2368] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:25.647805 22649 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:25.639904 28036 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:25.670629 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.612907 27976 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:25.675379 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.678331 22652 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:25.679123 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.680037 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.680655 22652 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:25.675524 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.683470 22649 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:25.684674 22649 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:25.604884 27929 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.707952 27917 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:25.708500 27917 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:25.709458 28056 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:25.709825 27917 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.711308 27917 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:25.713886 28046 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:09:25.675264 27526 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:25.723174 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 221466us
I20260709 13:09:25.676283 27991 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:25.725536 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.727393 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.727990 22500 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:25.729321 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:25.729894 22500 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.663977 28011 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.639271 27937 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.749084 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:25.750033 27907 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:25.750588 27981 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.752151 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.753651 22574 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:25.758504 22651 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:09:25.771767 23261 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:25.720351 28036 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:25.726552 27802 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.774875 27976 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.752346 27689 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:25.753391 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 238018us
I20260709 13:09:25.800465 22646 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:25.814265 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:25.816278 22498 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:25.817548 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:25.701145 27998 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.779138 28071 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.742136 27526 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.820809 28057 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.136s
I20260709 13:09:25.788331 28054 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:25.844595 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.794546 27806 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.783996 22664 tablet_copy_service.cc:342] P 5e72fb99f5ee4943a91cf8e6dd73e80e: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-813ede727198414390a20d5845e75e07 received from {username='slave'} at 127.0.0.1:37482
W20260709 13:09:25.842787 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 122901us
W20260709 13:09:25.819123 28058 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:09:25.798575 27888 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:25.821642 27848 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.007s
I20260709 13:09:25.810779 27689 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:25.873988 28011 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.874085 27689 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.875322 27689 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:25.875617 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.876631 22577 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:25.846495 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:25.864658 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:25.771534 27907 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.864182 28071 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.869306 27920 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.903527 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:25.869596 28036 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.873057 27526 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.893066 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:25.917117 22577 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:25.901211 22646 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
W20260709 13:09:25.848716 28050 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 13:09:25.869498 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:25.934741 28054 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:25.935214 28054 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.935289 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:25.936153 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.936463 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.905696 28077 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:25.902292 27848 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.902614 28056 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:25.879084 28064 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:09:25.911417 27836 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.001s
I20260709 13:09:25.878409 27831 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.877657 27929 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.914968 27892 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.915356 27961 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:25.917287 22498 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:25.862450 22501 raft_consensus.cc:2955] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:09:25.918463 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:25.928364 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63761.7us
I20260709 13:09:25.902988 27806 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.858054 27910 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:25.931485 28072 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:25.931833 27876 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:25.932127 28057 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:25.968928 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:25.931860 22664 tablet_copy_service.cc:434] P 5e72fb99f5ee4943a91cf8e6dd73e80e: ending tablet copy session fa2f181263f446a6962b649f9348c15f-813ede727198414390a20d5845e75e07 on tablet 813ede727198414390a20d5845e75e07 with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:09:25.877954 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:25.939699 22500 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
W20260709 13:09:25.881902 28060 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:25.942080 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:25.794541 27802 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:25.882278 28055 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:25.956568 27856 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:25.956168 27686 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:25.964887 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:25.944842 27956 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:09:25.970127 22649 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:26.318468 22576 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:09:26.356608 22579 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:26.013290 22650 raft_consensus.cc:2368] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:26.353996 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:26.354898 22571 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:26.359997 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:26.157017 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 307776us
W20260709 13:09:26.362799 22468 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.618s (SENT)
I20260709 13:09:26.360649 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:26.365206 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2917) took 1168 ms. Trace:
I20260709 13:09:26.365917 22504 rpcz_store.cc:276] 0709 13:09:25.197062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.430270 (+233208us) service_pool.cc:224] Handling call
0709 13:09:25.468103 (+ 37833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.468329 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.468365 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.479436 (+ 11071us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.669914 (+190478us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:25.669966 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.670061 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.364904 (+694843us) raft_consensus.cc:1685] finished
0709 13:09:26.364943 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.365131 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":159266,"threads_started":1,"wal-append.queue_time_us":287377}
I20260709 13:09:26.368271 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:26.066087 28056 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:26.369442 22504 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:26.369575 28056 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:26.361919 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:26.371150 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:26.372362 22504 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:26.374250 22504 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:26.375360 22654 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:09:26.037479 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:26.379177 22504 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:25.970315 22580 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13.
W20260709 13:09:26.396255 23262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.024s	sys 0.024s
I20260709 13:09:26.397039 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2919) took 1128 ms. Trace:
I20260709 13:09:26.372269 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:26.397878 22500 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:26.365286 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:26.121982 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.400223 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.953286 27836 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:26.407685 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:26.157703 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:26.388831 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:26.363418 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:26.411206 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48474.5us
I20260709 13:09:26.411420 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:26.413014 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:26.413205 27937 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:26.414072 27937 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:26.414405 27907 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:26.414676 27937 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:26.416234 27920 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.417469 28076 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:09:26.418895 27961 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.419456 27848 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:26.419580 27961 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:26.339831 27779 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.969s	user 0.008s	sys 0.005s
W20260709 13:09:26.420838 28081 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:26.421128 27779 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:26.397208 23262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.024s	sys 0.024s
I20260709 13:09:26.426072 28057 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:26.427318 28057 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:26.396250 22645 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:26.429831 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3549) took 1106 ms. Trace:
I20260709 13:09:26.429956 27920 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:26.430375 22502 rpcz_store.cc:276] 0709 13:09:25.323239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.769876 (+446637us) service_pool.cc:224] Handling call
0709 13:09:25.770455 (+   579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.770868 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.770895 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.790279 (+ 19384us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.953613 (+163334us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:25.953949 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.954072 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.429625 (+475553us) raft_consensus.cc:1685] finished
0709 13:09:26.429645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.429763 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50606,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":51230,"thread_start_us":163008,"threads_started":1,"wal-append.queue_time_us":410764}
I20260709 13:09:26.431463 23227 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:26.432117 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:26.413043 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:26.432688 22502 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:26.215464 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.030994 27834 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:26.036827 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:26.402815 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.415104 27907 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:26.422633 27961 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:26.397511 22501 rpcz_store.cc:276] 0709 13:09:25.268587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.450844 (+182257us) service_pool.cc:224] Handling call
0709 13:09:25.451616 (+   772us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:25.452694 (+  1078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.452766 (+    72us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:25.485370 (+ 32604us) log.cc:844] Serialized 539 byte log entry
0709 13:09:25.823017 (+337647us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:26.396206 (+573189us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.396683 (+   477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.396765 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.396809 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:26.396822 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.396985 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10419,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1931,"thread_start_us":269740,"threads_started":1,"wal-append.queue_time_us":367364}
W20260709 13:09:26.400915 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.459271 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.828040 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.807391 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:26.803388 22579 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:26.832726 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3569) took 1111 ms. Trace:
I20260709 13:09:26.631906 27836 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:26.442688 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:26.806913 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 393913us
I20260709 13:09:26.406299 27854 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:26.627920 27686 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:26.809281 27997 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.587997 22502 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:26.372408 28056 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:26.501071 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:26.434211 28039 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:26.633723 28060 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:26.536778 27892 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:26.792850 22578 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:26.691926 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 811) took 1488 ms. Trace:
I20260709 13:09:26.670714 28059 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:26.813383 27802 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:26.549026 27917 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.002s
W20260709 13:09:26.692672 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2457) took 1340 ms (client timeout 1763 ms). Trace:
W20260709 13:09:26.922299 22576 rpcz_store.cc:269] 0709 13:09:25.352196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.352321 (+   125us) service_pool.cc:224] Handling call
0709 13:09:26.692518 (+1340197us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001e5ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:26.692616 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337871616}
I20260709 13:09:26.685824 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:26.815375 22496 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:26.679549 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 715) took 1716 ms. Trace:
I20260709 13:09:26.534034 22499 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:26.925052 22505 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:26.422652 28071 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:26.833369 22579 rpcz_store.cc:276] 0709 13:09:25.723695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.877659 (+153964us) service_pool.cc:224] Handling call
0709 13:09:26.832639 (+954980us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:26.686451 27593 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.270s	user 0.012s	sys 0.000s
W20260709 13:09:26.477208 27887 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.816s	user 0.005s	sys 0.005s
W20260709 13:09:26.666579 27976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.013s	sys 0.032s
I20260709 13:09:26.838836 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:26.571805 28067 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:09:26.467639 27929 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:26.615720 28080 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:26.882303 27920 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:26.610940 27831 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:26.865412 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:26.871515 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:26.467098 28055 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.396s
I20260709 13:09:26.878741 23255 rpcz_store.cc:276] 0709 13:09:25.203683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.219760 (+ 16077us) service_pool.cc:224] Handling call
0709 13:09:26.691644 (+1471884us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b54004367d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:26.691845 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95638400}
I20260709 13:09:26.924481 23262 rpcz_store.cc:276] 0709 13:09:24.963509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.964334 (+   825us) service_pool.cc:224] Handling call
0709 13:09:24.982408 (+ 18074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.080402 (+ 97994us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:25.115933 (+ 35531us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.871520 (+755587us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b18000b15e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:09:26.424749 (+553229us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.425356 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:09:26.425490 (+   134us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:26.425523 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.425613 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.679106 (+253493us) raft_consensus.cc:1685] finished
0709 13:09:26.679248 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.679459 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20020,"prepare.queue_time_us":44972,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":7301,"raft.queue_time_us":56448,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":12523,"spinlock_wait_cycles":10818432,"thread_start_us":636121,"threads_started":2,"wal-append.queue_time_us":1532284}
I20260709 13:09:26.830986 27848 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:09:26.831964 27834 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:26.931327 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:26.873440 28066 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.872130 27836 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.936165 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:26.873260 28056 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.939108 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:26.978132 22496 raft_consensus.cc:2410] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:26.941862 22500 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:09:26.978669 22500 pending_rounds.cc:85] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 13
I20260709 13:09:26.979002 22500 pending_rounds.cc:107] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:09:26.979408 22500 raft_consensus.cc:2889] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:26.877692 27937 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:26.943614 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2460) took 1590 ms. Trace:
W20260709 13:09:26.943822 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 105116us
I20260709 13:09:26.920256 28059 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:26.658461 28079 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.857090 27854 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:26.858083 27997 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:26.939052 27976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.017s	sys 0.043s
I20260709 13:09:26.949693 22502 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:26.961890 22505 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:26.969735 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3582) took 1110 ms. Trace:
I20260709 13:09:26.988328 22576 rpcz_store.cc:276] 0709 13:09:25.859672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.930951 (+1071279us) service_pool.cc:224] Handling call
0709 13:09:26.969636 (+ 38685us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.947026 27593 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:26.991544 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.012s
W20260709 13:09:26.994669 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.004s	sys 0.012s
I20260709 13:09:26.984535 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:26.980917 22572 rpcz_store.cc:276] 0709 13:09:25.353360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.353477 (+   117us) service_pool.cc:224] Handling call
0709 13:09:25.353783 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.410403 (+ 56620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.410451 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.419405 (+  8954us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.643778 (+224373us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:25.661887 (+ 18109us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.662148 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.662262 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.943365 (+1281103us) raft_consensus.cc:1685] finished
0709 13:09:26.943389 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.943553 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56722,"prepare.queue_time_us":17777,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":13267,"raft.queue_time_us":154452,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16334,"spinlock_wait_cycles":21431552,"thread_start_us":101149,"threads_started":1,"wal-append.queue_time_us":279384}
I20260709 13:09:27.000008 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:27.000794 22572 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:26.986369 22498 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:26.994738 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:27.002329 22579 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:09:26.942972 27887 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:27.003022 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 571612us
I20260709 13:09:26.983645 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3536) took 2328 ms. Trace:
I20260709 13:09:27.015476 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:27.016451 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 902) took 1003 ms. Trace:
I20260709 13:09:27.015328 22503 rpcz_store.cc:276] 0709 13:09:24.655327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.795596 (+140269us) service_pool.cc:224] Handling call
0709 13:09:24.795882 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.904629 (+108747us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:24.926658 (+ 22029us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.693568 (+1766910us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b18004ba2a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:09:26.982434 (+288866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.983368 (+   934us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:26.983424 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.983483 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.983591 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1206,"prepare.queue_time_us":21371,"raft.queue_time_us":29197,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":6972,"spinlock_wait_cycles":156140160,"thread_start_us":288631,"threads_started":1}
I20260709 13:09:27.009020 22498 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:27.016920 22579 rpcz_store.cc:276] 0709 13:09:26.013404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.980600 (+967196us) service_pool.cc:224] Handling call
0709 13:09:27.016389 (+ 35789us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.013252 22502 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:27.019233 22572 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:27.020284 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:27.020701 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2468) took 1507 ms. Trace:
I20260709 13:09:27.021183 22572 rpcz_store.cc:276] 0709 13:09:25.513141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.018674 (+1505533us) service_pool.cc:224] Handling call
0709 13:09:27.019012 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.020331 (+  1319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.020636 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.024432 22577 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
W20260709 13:09:27.025439 23230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.000s	sys 0.018s
W20260709 13:09:27.025915 23230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.018s
I20260709 13:09:27.029168 22571 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:26.949693 28080 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.022264 27929 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:27.036069 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:26.985095 27836 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.022270 28005 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:26.981810 28066 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.054117 23256 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:27.050264 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.055388 23258 raft_consensus.cc:2410] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:27.055563 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.049409 23262 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 12 LEARNER]: Advancing to term 14
I20260709 13:09:27.050571 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.058139 23257 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:27.049849 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:27.026068 27956 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:26.989547 28056 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:26.990664 28079 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.061723 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:27.025794 27976 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:27.038023 23263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.012s
I20260709 13:09:27.070885 27976 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:27.071712 27976 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.072731 28080 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.076160 27834 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.078485 28066 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:27.068612 23263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.008s	sys 0.012s
I20260709 13:09:27.078625 28079 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.068027 28055 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.087983 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.082087 27876 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.092345 27854 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.093369 27846 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.093653 27997 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.102202 27870 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:27.103104 28089 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:09:27.104334 28088 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:09:27.067516 27956 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.174872 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3570) took 1450 ms. Trace:
I20260709 13:09:27.202025 27856 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:27.183300 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:27.162843 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:27.198064 27998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.007s	sys 0.015s
W20260709 13:09:27.247850 27998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.009s	sys 0.021s
I20260709 13:09:27.247483 27856 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.248384 22502 raft_consensus.cc:2410] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:09:27.158563 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.157843 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.252768 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.254184 23259 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 14: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:27.019069 22498 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.256388 22498 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:27.257364 28036 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:27.258474 27929 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:27.258755 28036 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:27.259672 27929 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.178524 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 895) took 2194 ms. Trace:
I20260709 13:09:27.261826 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:27.162302 22543 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.552s (SENT) [suppressed 4 similar messages]
I20260709 13:09:27.261045 22573 rpcz_store.cc:276] 0709 13:09:24.984203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.046988 (+ 62785us) service_pool.cc:224] Handling call
0709 13:09:25.047301 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.114410 (+ 67109us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:25.134860 (+ 20450us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.679983 (+1545123us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b180037d620. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:09:26.988386 (+308403us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.994049 (+  5663us) log.cc:844] Serialized 26 byte log entry
0709 13:09:26.995926 (+  1877us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:27.067627 (+ 71701us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.177556 (+109929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.177734 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.177983 (+   249us) raft_consensus.cc:1685] finished
0709 13:09:27.178007 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.178283 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":203187,"prepare.queue_time_us":121879,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":91,"raft.queue_time_us":199909,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":17383,"spinlock_wait_cycles":4333440,"thread_start_us":377979,"threads_started":2,"wal-append.queue_time_us":1916134}
W20260709 13:09:27.263945 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101870us
I20260709 13:09:27.181453 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:27.090945 28055 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.193893 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1061) took 1229 ms. Trace:
I20260709 13:09:27.187870 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:27.197300 27686 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.200052 27801 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:27.285183 22503 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:27.284535 22647 rpcz_store.cc:276] 0709 13:09:25.964181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.965382 (+  1201us) service_pool.cc:224] Handling call
0709 13:09:25.965768 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.966248 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.966289 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.976894 (+ 10605us) log.cc:844] Serialized 26 byte log entry
0709 13:09:26.566839 (+589945us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:26.566896 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.566983 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.193071 (+626088us) raft_consensus.cc:1685] finished
0709 13:09:27.193127 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.193548 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2930,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":40812,"thread_start_us":389654,"threads_started":1,"wal-append.queue_time_us":875475}
I20260709 13:09:27.286232 27801 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.204450 27932 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:27.290807 27932 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.115777 28056 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:27.292388 27870 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:27.207749 27831 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:27.293278 27870 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:27.293795 27831 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:27.211846 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2456) took 1860 ms (client timeout 1842 ms). Trace:
W20260709 13:09:27.296005 22580 rpcz_store.cc:269] 0709 13:09:25.351692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.351823 (+   131us) service_pool.cc:224] Handling call
0709 13:09:27.211031 (+1859208us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54003abbd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:27.211471 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287101696}
I20260709 13:09:27.214500 27836 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.216902 22504 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:27.221200 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2552) took 1652 ms. Trace:
I20260709 13:09:27.299917 22654 rpcz_store.cc:276] 0709 13:09:25.568715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.568989 (+   274us) service_pool.cc:224] Handling call
0709 13:09:25.569311 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.376015 (+806704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.220483 (+844468us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540017d9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:27.220997 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852790528}
W20260709 13:09:27.225575 22650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2543) took 1677 ms (client timeout 1812 ms). Trace:
I20260709 13:09:27.285328 27686 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:27.301393 22650 rpcz_store.cc:269] 0709 13:09:25.547854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.547978 (+   124us) service_pool.cc:224] Handling call
0709 13:09:27.224972 (+1676994us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400394254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:27.225368 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993380608}
I20260709 13:09:27.225718 27956 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:27.112676 28054 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.177s	user 0.007s	sys 0.008s
I20260709 13:09:27.306469 28054 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.033285 28059 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.155539 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:27.247629 22496 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:27.309907 22573 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:27.310731 27836 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.245671 22576 rpcz_store.cc:276] 0709 13:09:25.723973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.024327 (+1300354us) service_pool.cc:224] Handling call
0709 13:09:27.024677 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.024957 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.024995 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.028083 (+  3088us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.173935 (+145852us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:27.174071 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.174225 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.174304 (+    79us) raft_consensus.cc:1685] finished
0709 13:09:27.174321 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.174609 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":145118,"threads_started":1,"wal-append.queue_time_us":63842}
I20260709 13:09:27.311462 27836 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:27.313951 27836 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.314956 27932 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.262935 27806 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.310968 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3579) took 1511 ms. Trace:
W20260709 13:09:27.309863 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 294929us
I20260709 13:09:27.317209 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 865) took 1352 ms. Trace:
I20260709 13:09:27.318343 27801 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.318584 22576 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:27.319418 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2469) took 1475 ms. Trace:
I20260709 13:09:27.304543 27686 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.320163 22468 leader_election.cc:400] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:27.320766 28054 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:27.246380 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52894.2us
I20260709 13:09:27.310840 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3573) took 1551 ms. Trace:
I20260709 13:09:27.294912 27870 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.319824 22576 rpcz_store.cc:276] 0709 13:09:25.843587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.311809 (+1468222us) service_pool.cc:224] Handling call
0709 13:09:27.318115 (+  6306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.319081 (+   966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.319323 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.322701 22573 rpcz_store.cc:276] 0709 13:09:25.759914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.267236 (+1507322us) service_pool.cc:224] Handling call
0709 13:09:27.309588 (+ 42352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.310508 (+   920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.310762 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.317446 22580 rpcz_store.cc:276] 0709 13:09:25.800066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.297526 (+1497460us) service_pool.cc:224] Handling call
0709 13:09:27.298422 (+   896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.310517 (+ 12095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.310553 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.310631 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:27.310692 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.310763 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.310890 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1572,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":162}
I20260709 13:09:27.326594 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:27.329363 28055 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.332274 27976 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.333777 28036 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.334988 27961 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:27.335454 27976 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.337153 27929 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.338220 27593 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:27.339321 27906 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:27.339177 27593 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.341450 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:27.343492 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3571) took 1619 ms. Trace:
I20260709 13:09:27.343775 27806 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:27.344753 27806 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:27.344038 22572 rpcz_store.cc:276] 0709 13:09:25.724203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.024734 (+1300531us) service_pool.cc:224] Handling call
0709 13:09:27.025067 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.174023 (+148956us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:27.174752 (+   729us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.246782 (+ 72030us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.325734 (+ 78952us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.325945 (+   211us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:27.325977 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.326090 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.343055 (+ 16965us) raft_consensus.cc:1685] finished
0709 13:09:27.343085 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.343297 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147812,"prepare.queue_time_us":35444,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":173081,"raft.run_cpu_time_us":590,"raft.run_wall_time_us":592,"thread_start_us":70452,"threads_started":1,"wal-append.queue_time_us":161578}
I20260709 13:09:27.346340 27806 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.347532 27999 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.350195 28066 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:27.317790 23263 rpcz_store.cc:276] 0709 13:09:25.964581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.964726 (+   145us) service_pool.cc:224] Handling call
0709 13:09:26.031585 (+ 66859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.032312 (+   727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:26.032357 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.375162 (+342805us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.080170 (+705008us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:27.080213 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.080305 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.096876 (+ 16571us) raft_consensus.cc:1685] finished
0709 13:09:27.096914 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.316953 (+220039us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":868,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":79908,"thread_start_us":583969,"threads_started":1,"wal-append.queue_time_us":668395}
I20260709 13:09:27.372269 27919 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:27.375973 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2467) took 1957 ms. Trace:
I20260709 13:09:27.376490 22574 rpcz_store.cc:276] 0709 13:09:25.418610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.483292 (+ 64682us) service_pool.cc:224] Handling call
0709 13:09:25.494989 (+ 11697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.771751 (+276762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.375419 (+1603668us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54000e6354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:27.375765 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592810880}
I20260709 13:09:27.381050 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3581) took 1551 ms. Trace:
I20260709 13:09:27.384660 22577 rpcz_store.cc:276] 0709 13:09:25.829780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.500691 (+670911us) service_pool.cc:224] Handling call
0709 13:09:27.380631 (+879940us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003cbed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:27.380833 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383182208}
I20260709 13:09:27.388293 27856 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:27.391708 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61578.2us
I20260709 13:09:27.385304 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3587) took 1433 ms. Trace:
I20260709 13:09:27.399844 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3586) took 1449 ms. Trace:
I20260709 13:09:27.400349 22573 rpcz_store.cc:276] 0709 13:09:25.950811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.332369 (+1381558us) service_pool.cc:224] Handling call
0709 13:09:27.332897 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.333304 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:27.334737 (+  1433us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.399433 (+ 64696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.399503 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:27.399556 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.399628 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.399761 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":919,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":137,"thread_start_us":64146,"threads_started":1}
I20260709 13:09:27.402460 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3589) took 1438 ms. Trace:
I20260709 13:09:27.402982 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 900) took 1390 ms. Trace:
I20260709 13:09:27.403077 22577 rpcz_store.cc:276] 0709 13:09:25.963897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.388519 (+1424622us) service_pool.cc:224] Handling call
0709 13:09:27.389024 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.389580 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:27.389961 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.401888 (+ 11927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.401969 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:27.402082 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.402179 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.402390 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1911,"raft.queue_time_us":121,"thread_start_us":11403,"threads_started":1}
I20260709 13:09:27.403512 22573 rpcz_store.cc:276] 0709 13:09:26.012704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.401860 (+1389156us) service_pool.cc:224] Handling call
0709 13:09:27.402325 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.402659 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.402682 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.402740 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:27.402775 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.402825 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.402913 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:27.406888 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.407696 23263 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:27.410679 28036 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:27.412025 28036 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:27.413317 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3572) took 1627 ms. Trace:
I20260709 13:09:27.413930 22579 rpcz_store.cc:276] 0709 13:09:25.737335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.030786 (+1293451us) service_pool.cc:224] Handling call
0709 13:09:27.049141 (+ 18355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.186280 (+137139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.186340 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.187425 (+  1085us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.267295 (+ 79870us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:27.267342 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.284464 (+ 17122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.351807 (+ 67343us) raft_consensus.cc:1685] finished
0709 13:09:27.351827 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.364064 (+ 12237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136235,"raft.queue_time_us":149898,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":224,"thread_start_us":79294,"threads_started":1,"wal-append.queue_time_us":160555}
I20260709 13:09:27.416074 22575 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:27.416908 27996 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.417429 27996 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.397537 22572 rpcz_store.cc:276] 0709 13:09:25.952187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.346842 (+1394655us) service_pool.cc:224] Handling call
0709 13:09:27.347344 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.347800 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:27.351135 (+  3335us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.384890 (+ 33755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.384942 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:27.385008 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.385081 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.385233 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2819,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":21303,"thread_start_us":17941,"threads_started":1}
I20260709 13:09:27.412590 28036 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:27.533443 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.535634 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.503357 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 111654us
W20260709 13:09:27.539400 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.539239 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 53457.8us
I20260709 13:09:27.496176 27976 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:27.423795 28066 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.544095 22577 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:27.553648 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 904) took 1539 ms. Trace:
I20260709 13:09:27.554101 22577 rpcz_store.cc:276] 0709 13:09:26.014067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.404628 (+1390561us) service_pool.cc:224] Handling call
0709 13:09:27.449042 (+ 44414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.553325 (+104283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.553562 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.550848 28037 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:09:27.533828 27924 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.540778 28055 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.567440 27593 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.574792 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.580281 27924 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.583225 27924 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.585024 27929 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:27.585207 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.585602 27929 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:27.587050 27929 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.589088 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:27.589146 27910 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:09:27.591825 27929 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:27.592113 28031 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:27.592911 22505 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:27.593094 28031 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:27.594493 28096 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:27.595466 28096 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.597736 27926 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:27.598659 27926 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.599131 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.599947 28096 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.600095 23262 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:27.602509 27968 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.604133 27910 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:27.604702 27910 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:27.605697 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:27.608125 28009 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:27.641667 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:27.591836 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:27.637800 27926 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.650694 22498 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:09:27.651283 22498 pending_rounds.cc:85] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 7
I20260709 13:09:27.567160 28066 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.620497 27976 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.606040 27910 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.672497 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:27.673187 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:27.666765 22498 pending_rounds.cc:107] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:09:27.667748 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3585) took 1719 ms. Trace:
I20260709 13:09:27.678318 22576 rpcz_store.cc:276] 0709 13:09:25.948843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.353077 (+1404234us) service_pool.cc:224] Handling call
0709 13:09:27.413013 (+ 59936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.546550 (+133537us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:27.596409 (+ 49859us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.667262 (+ 70853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.667347 (+    85us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:27.667425 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.667538 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.667687 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36273,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":4319,"thread_start_us":66382,"threads_started":1}
I20260709 13:09:27.681361 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:27.684283 27324 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.685285 27324 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.685966 27910 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:27.687119 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3556) took 1284 ms. Trace:
I20260709 13:09:27.687521 22500 rpcz_store.cc:276] 0709 13:09:26.402952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.404164 (+  1212us) service_pool.cc:224] Handling call
0709 13:09:26.404454 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.979818 (+575364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.686661 (+706843us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54001da1d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:27.686912 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234801408}
I20260709 13:09:27.687953 27324 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.690222 27955 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:27.668043 27836 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:27.692613 27788 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:27.693594 28031 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.693425 27788 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.675414 22498 raft_consensus.cc:2889] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:27.701352 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58714.4us
I20260709 13:09:27.702913 27831 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.703203 28096 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:27.673905 27926 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.659332 28055 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.704677 27926 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.706784 28055 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:27.709926 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 118485us
I20260709 13:09:27.710995 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:09:27.715842 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.708724 22505 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:09:27.714605 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1107) took 1781 ms. Trace:
I20260709 13:09:27.721096 28096 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:27.722512 27838 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.722980 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:27.723205 27838 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.724203 28015 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.724272 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 181585us
I20260709 13:09:27.724797 28015 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.715502 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 905) took 1701 ms. Trace:
I20260709 13:09:27.717963 22499 rpcz_store.cc:276] 0709 13:09:25.933292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.933430 (+   138us) service_pool.cc:224] Handling call
0709 13:09:25.933779 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.925150 (+991371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.714062 (+788912us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54000f9954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:27.714392 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379848960}
I20260709 13:09:27.729252 27831 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.729511 27924 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.729799 28015 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.726941 22573 rpcz_store.cc:276] 0709 13:09:26.014354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.405917 (+1391563us) service_pool.cc:224] Handling call
0709 13:09:27.563364 (+157447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.600967 (+ 37603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.601008 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.601749 (+   741us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.657569 (+ 55820us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:27.657621 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.657688 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.715286 (+ 57598us) raft_consensus.cc:1685] finished
0709 13:09:27.715306 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.715444 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1501,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"thread_start_us":55359,"threads_started":1,"wal-append.queue_time_us":105508}
I20260709 13:09:27.707793 27926 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.753166 27961 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.753520 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:27.754015 27961 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.755255 28013 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:27.755857 28013 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:27.699492 27788 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.730225 27924 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.717021 27324 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.774052 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.780036 27857 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:27.781908 27857 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.782334 22501 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:09:27.782838 22501 pending_rounds.cc:85] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 11
I20260709 13:09:27.783164 22501 pending_rounds.cc:107] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:09:27.783411 22501 raft_consensus.cc:2889] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:27.784185 28116 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:27.784834 27876 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.785916 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 863) took 2484 ms. Trace:
I20260709 13:09:27.786656 28102 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.786409 23261 rpcz_store.cc:276] 0709 13:09:25.301365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.301495 (+   130us) service_pool.cc:224] Handling call
0709 13:09:25.301807 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.772460 (+470653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.785346 (+2012886us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54007021d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:27.785706 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080386816}
I20260709 13:09:27.787477 28102 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.789762 27991 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:27.790300 27991 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:27.790593 27838 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.794083 27779 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:27.796907 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.771507 28053 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.908s	user 0.004s	sys 0.031s
W20260709 13:09:27.805516 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52157.6us
I20260709 13:09:27.762418 28024 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:27.804838 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3561) took 1136 ms. Trace:
I20260709 13:09:27.813284 27961 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.800935 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:27.802850 28053 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.076s	user 0.004s	sys 0.032s
I20260709 13:09:27.807296 22501 rpcz_store.cc:276] 0709 13:09:26.668340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.831904 (+163564us) service_pool.cc:224] Handling call
0709 13:09:26.832237 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.784015 (+951778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.784820 (+   805us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54000f8f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:27.804759 (+ 19939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177843968}
I20260709 13:09:27.784893 27857 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.731455 28036 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:27.829979 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 50777.7us
I20260709 13:09:27.838302 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:27.838590 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:27.839561 22645 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:27.844853 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:27.845139 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 122450us
W20260709 13:09:27.845402 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.842617 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:27.855294 22645 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:27.833304 27324 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.851531 27968 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:27.867187 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:27.867312 27968 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.871014 27968 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.872831 27324 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.877796 27924 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:27.861218 27961 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:27.885814 27765 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:27.886639 27765 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.886987 27924 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:27.888103 27788 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:27.888581 27788 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:27.889410 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:27.890190 23261 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 8.
I20260709 13:09:27.890220 27788 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.857237 27991 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.892254 27788 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:27.882222 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75859.9us
W20260709 13:09:27.884614 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 215056us
I20260709 13:09:27.894173 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:27.894798 28125 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:09:27.896570 28119 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:09:27.885304 27857 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:27.897243 27857 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.897682 27857 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.899402 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:27.899888 27801 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:27.901780 27831 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:27.902261 27831 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:27.902666 27831 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:27.903028 27906 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:27.903484 27906 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:27.904551 27906 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:27.905431 28031 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:27.905946 27906 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:27.908768 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.909863 27996 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:27.910565 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.910557 27848 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:09:27.913602 27765 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.914376 22469 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:27.827654 28013 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.916066 28059 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:27.886853 28126 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:09:27.917569 27887 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:27.892803 27991 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.910989 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:27.937717 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 77132us
I20260709 13:09:27.853538 27870 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.861210 27976 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:27.941818 27882 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:27.849637 28024 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:27.886121 27961 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.932658 27788 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:27.994243 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.033799 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.940408 28066 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:28.035470 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 138902us
I20260709 13:09:28.036015 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:27.942310 27882 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.039021 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:28.010696 27961 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:28.036777 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 91685.7us
I20260709 13:09:28.044359 27870 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.046586 27870 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:28.040889 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 93493.7us
I20260709 13:09:28.010573 27788 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.041994 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 201664us
I20260709 13:09:28.055662 22646 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:28.057093 28069 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.053078 22618 connection.cc:256] RPC call timeout handler was delayed by -1.29169317100002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 13:09:28.057849 28069 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.058274 27801 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.058423 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.058921 27801 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.060281 28069 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.064603 27801 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.082296 28024 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:28.057215 28123 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:09:28.043169 27882 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:28.049496 27887 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:28.091265 27765 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:28.091504 27831 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.092377 27838 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:28.093317 28097 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:28.053683 27788 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.101775 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.110617 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.111392 27857 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.118328 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.119314 28019 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.127097 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.132755 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:28.106117 27887 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.162184 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.165902 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:28.157389 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:28.168622 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58136.8us
I20260709 13:09:28.165668 22580 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
W20260709 13:09:28.154630 27929 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.005s
I20260709 13:09:28.153906 27887 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:28.176155 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.171523 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.184370 27801 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:28.166409 27838 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:28.147346 28019 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.185076 27801 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.187152 27801 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:28.188298 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:28.189133 22646 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
W20260709 13:09:28.189338 22571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3568) took 2363 ms (client timeout 2334 ms). Trace:
W20260709 13:09:28.189790 22571 rpcz_store.cc:269] 0709 13:09:25.720915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.412720 (+691805us) service_pool.cc:224] Handling call
0709 13:09:28.028855 (+1616135us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54003b2c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:28.084085 (+ 55230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414718720}
I20260709 13:09:28.190474 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:28.191591 28011 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:28.192016 28011 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.192394 28011 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.193657 28036 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.203514 27857 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:28.206158 28121 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.543s	user 0.004s	sys 0.016s
I20260709 13:09:28.209460 28011 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.212073 28102 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:28.213678 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 283662us
I20260709 13:09:28.187152 28019 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.214618 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:28.215860 27765 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.216089 27976 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:28.216463 27765 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.217599 27976 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:28.218456 27976 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:28.218693 27765 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.219978 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:28.220682 22649 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.218798 27976 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:28.202891 22501 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:28.222265 27976 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.224120 27976 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:28.210621 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3588) took 2249 ms. Trace:
I20260709 13:09:28.225159 22574 rpcz_store.cc:276] 0709 13:09:25.961675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.377515 (+1415840us) service_pool.cc:224] Handling call
0709 13:09:27.378042 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.409757 (+ 31715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.409798 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.410308 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.430889 (+ 20581us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:27.431156 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.431418 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.205592 (+774174us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:28.210268 (+  4676us) raft_consensus.cc:1685] finished
0709 13:09:28.210289 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.210540 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6601,"raft.queue_time_us":12377,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":18404,"spinlock_wait_cycles":67845376,"thread_start_us":15533,"threads_started":1,"wal-append.queue_time_us":239050}
I20260709 13:09:28.228667 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:28.229285 22498 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:28.220083 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:28.237341 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.239843 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:28.240142 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:28.251019 22649 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:28.253336 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:28.237938 28011 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.256155 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:28.245893 28019 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:28.258898 28127 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.429s	user 0.004s	sys 0.008s
I20260709 13:09:28.258973 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.259573 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:28.261333 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62493.1us
I20260709 13:09:28.282449 22499 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:28.291749 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.291175 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.300987 22496 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:28.302006 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.286617 27857 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:28.303103 22574 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:28.287451 28097 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:28.310667 28097 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:28.315471 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.316553 22503 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:28.308063 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.326400 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:28.330066 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.303195 27838 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:28.335803 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51987.9us
I20260709 13:09:28.343887 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.349318 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.349522 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.353546 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.354372 22574 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:28.355589 22499 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:09:28.333755 27857 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:28.357900 27857 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.312063 28097 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.364040 27831 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.372641 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.373544 27887 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.373595 22580 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:28.373987 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:28.374424 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.330642 28053 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:09:28.381632 22574 raft_consensus.cc:2393] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:28.384517 27887 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:28.287631 27956 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:09:28.385360 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:28.391535 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.397675 28011 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:28.398401 28011 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.398869 28011 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.409567 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3557) took 4810 ms (client timeout 2857 ms). Trace:
W20260709 13:09:28.410179 22575 rpcz_store.cc:269] 0709 13:09:23.598735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.601076 (+  2341us) service_pool.cc:224] Handling call
0709 13:09:28.409277 (+4808201us) spinlock_profiling.cc:243] Waited 3.75 s on lock 0x7b54003c96d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:28.409456 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8635749760}
I20260709 13:09:28.418171 27686 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:28.418494 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 297121us
I20260709 13:09:28.418730 27686 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:28.423301 27926 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.425415 27926 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:28.427943 28031 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:28.428354 28031 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:28.429708 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 371399us
I20260709 13:09:28.430047 28031 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.431110 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:28.431321 27968 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:28.432117 27968 consensus_queue.cc:1243] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer fa2f181263f446a6962b649f9348c15f log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:09:28.432771 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 243502us
I20260709 13:09:28.433957 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.435333 28066 raft_consensus.cc:2764] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:09:28.436303 28066 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:28.436743 28066 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:28.437477 27910 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.437829 28066 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.438341 27910 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.439709 28066 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:28.445109 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71180.6us
W20260709 13:09:28.446142 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 114503us
I20260709 13:09:28.449368 27910 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.449698 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.450826 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.375568 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.452603 22571 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:28.332913 28036 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.451932 23261 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
W20260709 13:09:28.455881 22468 connection.cc:256] RPC call timeout handler was delayed by -1.2546272080001017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:09:28.458217 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1835272080001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:09:28.441074 27929 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.345925 27838 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.326270 28102 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.402536 27961 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:28.498009 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.491863 27838 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.507386 27887 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:28.508266 27788 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.510848 27788 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:28.511420 27788 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.511914 27788 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.512985 28102 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.514397 27961 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:28.515105 27961 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.515339 28102 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.515676 27961 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.517117 23255 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:28.460764 28062 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:28.455085 27836 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:28.459919 27924 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.492241 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.522470 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.494362 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.526279 22500 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:28.526587 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.531006 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.459026 27870 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:09:28.463569 28036 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:28.551988 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.521910 28062 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.556631 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 203062us
I20260709 13:09:28.560708 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.556072 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:28.562340 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 100679us
I20260709 13:09:28.563860 23255 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:09:28.563995 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:28.532063 27906 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:28.569384 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.570390 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.576311 22503 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:09:28.578747 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.555892 27883 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:28.521405 27882 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.566816 28062 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:28.589174 23259 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:09:28.599727 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.569021 27801 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.609573 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:28.610088 28129 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.751s	user 0.002s	sys 0.000s
I20260709 13:09:28.600737 22575 raft_consensus.cc:1217] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.11->[11.12-14.13]   Dedup: 11.12->[14.13-14.13]
I20260709 13:09:28.610357 23264 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.574214 27929 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.610704 22575 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: [11.12-14.13]
I20260709 13:09:28.611728 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:28.611824 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.573664 27887 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:28.613099 27887 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.613591 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:28.608480 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:28.601907 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.606446 28140 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.349s	user 0.002s	sys 0.000s
I20260709 13:09:28.607125 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:28.607926 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.608335 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:28.608659 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.616808 27686 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.617007 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.633900 22579 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
W20260709 13:09:28.635085 28135 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.397s	user 0.002s	sys 0.000s
I20260709 13:09:28.635358 22579 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:28.613123 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.621105 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.622219 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.645030 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:28.646409 22544 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.625880 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.630194 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.630883 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:28.612846 22575 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:28.623976 22576 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:28.631196 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.618203 22571 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:28.665170 23263 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:28.617127 22500 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:28.657742 23255 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:28.659034 22503 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:28.569885 27906 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.669248 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.687348 22496 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:28.685222 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.690613 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.691376 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.627955 27999 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:28.693176 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.613636 27887 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:28.699574 23259 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:28.571585 27836 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.637179 27883 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:28.716650 23264 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:28.698413 27825 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:28.705415 28030 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:28.709237 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.679626 27801 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.709100 28056 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:28.713063 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 225284us
I20260709 13:09:28.678248 27906 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.735064 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:28.735513 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 300631us
I20260709 13:09:28.622421 27838 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:28.590325 27924 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.725560 22503 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
W20260709 13:09:28.752410 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 159189us
I20260709 13:09:28.627374 28062 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:28.736289 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 903) took 2606 ms (client timeout 1519 ms). Trace:
I20260709 13:09:28.735764 23261 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:28.740061 22499 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:09:28.747293 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.698995 28059 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.744539 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54689.4us
I20260709 13:09:28.718395 27929 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:28.716890 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 256717us
I20260709 13:09:28.721145 27825 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.753356 22578 rpcz_store.cc:269] 0709 13:09:26.013720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.033226 (+ 19506us) service_pool.cc:224] Handling call
0709 13:09:28.619422 (+2586196us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54000e6d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:28.619712 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808842112}
W20260709 13:09:28.777074 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45597us
I20260709 13:09:28.783588 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:28.783957 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.784588 23258 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:28.784521 22498 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:28.785668 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.786289 22503 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:28.787256 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:28.782972 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:28.791378 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.794138 27836 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.799120 27838 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:28.801313 22468 leader_election.cc:400] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13.
I20260709 13:09:28.801699 27961 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:28.779539 27825 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:28.787873 22503 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:28.748613 27926 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:28.807504 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:28.801864 22468 leader_election.cc:403] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.818354 22504 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:28.816108 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.782390 27788 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:28.824616 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:28.835866 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:28.789001 28011 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:28.843772 22501 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:28.829808 28031 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.825803 27836 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13.
I20260709 13:09:28.836668 28036 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:28.835667 28154 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:28.857407 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.823470 28059 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:28.870206 22505 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260709 13:09:28.850508 27788 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.870839 22505 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:28.863835 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:28.872167 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 71046.8us
I20260709 13:09:28.872340 22501 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:28.864428 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 54154.5us
I20260709 13:09:28.850908 28153 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.877696 22505 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:28.873590 27918 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:28.841333 27926 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:09:28.885807 22499 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:09:28.875908 27976 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.651s	user 0.016s	sys 0.000s
I20260709 13:09:28.893915 28021 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:28.894025 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:28.899034 22505 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:28.901783 22651 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:28.904752 27779 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:28.857082 27883 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.906508 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:28.908061 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:28.908318 28036 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:28.899628 23262 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:28.915210 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:28.916683 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:28.883782 27918 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:28.898505 28150 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:28.876883 27788 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:28.895648 27882 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:28.938310 22468 leader_election.cc:400] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:28.947299 22468 leader_election.cc:403] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.945834 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:28.948393 22505 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:28.908803 27961 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:28.914165 28097 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:28.936255 27976 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:28.954926 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:28.938690 27918 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:28.957216 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 144803us
I20260709 13:09:28.948215 28153 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:28.997772 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:28.983711 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.003505 22647 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:29.002933 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:28.953503 27961 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:28.962154 27929 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:28.960397 27779 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:28.962648 27976 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:29.024222 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82279us
I20260709 13:09:28.987528 28097 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:29.016639 22576 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:29.015415 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.013518 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.031889 22578 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:29.032295 22580 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:29.019443 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:28.978475 28062 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:29.017957 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 136045us
I20260709 13:09:29.020777 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.033806 22571 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:29.021320 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.016238 22575 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:29.038324 22572 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:29.041672 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:29.042224 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.041836 22574 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:29.013458 27924 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.016578 27961 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:29.047461 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:29.052024 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.028968 27976 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.023638 27779 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:29.054494 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.051146 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.019840 28153 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:29.053133 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.067836 22576 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:29.055776 28102 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:29.070219 28102 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:29.070618 28158 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:09:29.070982 28170 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:29.071455 28170 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:29.071821 28170 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:29.075932 28024 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:29.077399 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.070662 28102 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:29.081351 27689 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:09:29.083351 27779 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.084671 27779 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:29.085263 28149 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:09:29.095697 28031 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:29.099440 27788 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.099923 28039 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:29.100389 28039 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:29.100630 28148 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:09:29.101686 27924 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:29.105724 27924 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.106236 27924 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:29.114593 28159 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:29.065945 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.146559 23260 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:09:29.147397 28057 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.147858 28057 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.153295 28069 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.154034 28069 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.156216 28069 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.049326 28011 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:29.164405 22501 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:29.156798 28066 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:29.177052 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.069460 22505 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:29.101229 27906 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.185494 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.171803 22504 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:29.192246 22648 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:29.175490 28066 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:29.195214 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:29.201123 23229 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:29.203001 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:29.199494 22579 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
W20260709 13:09:29.205441 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 128140us
I20260709 13:09:29.206228 22619 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.159194 28170 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.215766 28167 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:29.216246 28167 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:29.216647 28167 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.234356 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:29.236209 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:29.203675 28066 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:29.243351 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 260211us
I20260709 13:09:29.180424 27887 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.260421 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.216593 27825 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.275305 28176 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:09:29.276353 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73433.7us
I20260709 13:09:29.276101 28176 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.277525 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.278101 22651 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:29.275254 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.279322 22646 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:29.279315 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.280184 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:29.280457 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:29.280668 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.281013 22497 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:29.281641 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.242605 28153 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.281319 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.284999 27836 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.291309 27836 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.291960 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.201895 28039 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.293501 27836 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.285403 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:29.285760 22649 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:29.286640 27825 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:29.293596 22652 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:29.262542 28019 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:29.260900 27956 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:29.311554 22647 raft_consensus.cc:2368] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:29.311384 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:29.315462 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:29.316224 22500 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.260084 28172 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:29.318536 28172 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:29.312039 28019 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.319177 28019 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.319248 22652 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:09:29.319757 27836 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.319895 22652 pending_rounds.cc:85] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 9
I20260709 13:09:29.321399 22652 pending_rounds.cc:107] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:09:29.321820 22652 raft_consensus.cc:2889] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:29.320510 27836 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.254997 27924 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.327504 22651 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:29.319044 28172 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:29.333918 28069 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.338675 27836 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:29.337673 28069 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.344343 28069 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:29.312738 27956 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:29.368752 22649 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:29.295324 28102 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.380987 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.295787 28177 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:09:29.381847 22647 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:29.393857 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.366711 27956 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.402802 22502 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:09:29.407987 28166 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:09:29.433034 22501 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:29.434211 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:29.405798 28169 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:09:29.450021 28170 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:29.455924 28179 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.457481 27906 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.462431 22649 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:29.465039 28102 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.466185 27924 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:29.469501 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:29.469799 22501 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:09:29.417879 27961 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.474009 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:29.472010 27976 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.486888 27961 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.487291 27976 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:29.487684 22497 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:29.474265 28066 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.475863 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.489705 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.469149 22500 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:29.490360 22652 raft_consensus.cc:2368] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15.
I20260709 13:09:29.494242 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.495564 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.496433 22649 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
W20260709 13:09:29.470081 28154 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.002s
I20260709 13:09:29.497689 28154 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:29.498977 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:29.499671 28157 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.437s	user 0.001s	sys 0.003s
I20260709 13:09:29.500344 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:29.501356 28161 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 13:09:29.501675 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:29.502687 23260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 869) took 2452 ms (client timeout 1900 ms). Trace:
I20260709 13:09:29.502779 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.491153 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:29.504194 22652 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.513321 28171 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:29.503191 23260 rpcz_store.cc:269] 0709 13:09:27.050697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.055306 (+  4609us) service_pool.cc:224] Handling call
0709 13:09:29.502452 (+2447146us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54007d28d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:29.502590 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4807014144}
I20260709 13:09:29.517293 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:29.518097 22501 raft_consensus.cc:2368] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:09:29.518931 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:29.496704 28057 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:29.521667 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52306.5us
I20260709 13:09:29.491856 28066 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:29.491153 22500 pending_rounds.cc:85] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 7
I20260709 13:09:29.523093 22500 pending_rounds.cc:107] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:09:29.523394 22500 raft_consensus.cc:2889] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:29.524415 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:29.525393 22575 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:29.480222 27956 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.528306 27956 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:29.534835 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.535831 22645 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:09:29.539085 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3569) took 1088 ms. Trace:
I20260709 13:09:29.539708 22499 rpcz_store.cc:276] 0709 13:09:28.450354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.860465 (+410111us) service_pool.cc:224] Handling call
0709 13:09:28.877895 (+ 17430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.886320 (+  8425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.538696 (+652376us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b54001db0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:29.538994 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7333760}
I20260709 13:09:29.456620 28179 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.548938 28179 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:29.462436 27918 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.560173 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:29.561667 23260 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:29.515643 27686 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.564116 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.524317 22496 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:29.503495 22647 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:29.567539 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.581036 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.593765 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.595494 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.578243 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:29.600116 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:29.600919 22572 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.603850 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.606704 22578 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:29.607198 22498 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:09:29.615008 22646 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:29.670171 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:29.671878 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.673866 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:29.674477 22571 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.577287 27906 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.684654 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 90952us
I20260709 13:09:29.598646 28102 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:29.692438 27906 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:29.700634 28102 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.701095 28102 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:29.702350 27906 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.702989 27906 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:29.703352 27906 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:29.703706 27906 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:29.692637 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:29.600948 28059 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:29.602425 28069 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:29.704842 28069 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.705295 28069 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.694080 27836 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:29.706413 22498 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:29.690999 27825 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:29.609350 27976 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:29.468827 28167 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:29.601832 27956 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 13:09:29.577996 27961 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
W20260709 13:09:29.709129 22468 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.552s (SENT)
I20260709 13:09:29.710263 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:29.711896 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:29.720077 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.726075 22571 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:29.732087 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.709350 28172 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.696328 27857 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:29.730046 22647 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:09:29.734993 22575 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:29.736266 22576 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:29.737574 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.741576 22648 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:29.737782 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:29.717149 27976 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.709668 27836 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.753767 27924 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:29.761525 22652 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:29.750811 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.752605 22501 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:29.757630 27976 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:29.755163 28172 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:29.785180 22647 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:29.770925 28062 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:29.788638 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 232379us
I20260709 13:09:29.757783 27836 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:29.796200 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 86998.8us
I20260709 13:09:29.756968 28167 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:29.745306 27825 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.828498 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.828281 22578 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:29.803046 28069 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.773962 28066 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:29.846297 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.825881 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.834187 22578 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:29.840718 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.812337 28062 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:29.845744 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:29.862591 22575 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:29.863765 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 193673us
I20260709 13:09:29.868366 22652 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:29.836272 27918 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:29.876701 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 133859us
W20260709 13:09:29.860904 28019 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.006s
I20260709 13:09:29.882130 23264 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:29.886459 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.887785 22575 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 16. Ops: []
I20260709 13:09:29.887285 22579 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:29.888408 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:29.892398 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:29.896157 22575 raft_consensus.cc:2393] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:29.899390 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.900481 22619 leader_election.cc:400] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:09:29.900852 22619 leader_election.cc:403] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:09:29.870718 28154 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:29.929405 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:29.929301 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61219.5us
I20260709 13:09:29.900353 28177 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:29.944566 22572 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
W20260709 13:09:29.953380 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 50763.8us
I20260709 13:09:29.911260 28175 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.906329 27857 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:29.888273 28019 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.897974 28152 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:09:29.957594 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.903808 27918 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:09:29.954927 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 59037.9us
I20260709 13:09:29.928885 28179 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.901666 28153 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:29.961596 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.956895 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.964690 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:29.972502 22653 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:29.910315 28154 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:29.956782 28177 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:29.982995 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:29.977312 28202 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:29.908216 28183 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 13:09:29.977495 28189 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:29.974181 28069 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:30.003116 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68594.8us
I20260709 13:09:30.002431 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.008703 23260 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:30.021464 22572 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:30.000476 28185 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:09:30.023844 22502 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:30.022830 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:30.027863 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.028200 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:30.030517 22504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 2952) took 1445 ms (client timeout 1581 ms). Trace:
I20260709 13:09:30.029821 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:30.030926 22504 rpcz_store.cc:269] 0709 13:09:28.578265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.608087 (+ 29822us) service_pool.cc:224] Handling call
0709 13:09:30.023312 (+1415225us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54001a9854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:30.023427 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452881664}
I20260709 13:09:30.033890 22651 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:30.016893 27918 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:29.978245 28179 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.046478 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:30.047896 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:30.051055 22572 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:29.957540 28062 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.054970 22576 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:30.028712 27825 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.013159 27906 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.036818 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:30.023125 27857 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:30.040243 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.040978 22577 raft_consensus.cc:2410] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:09:30.041712 28187 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:30.042034 28102 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.069308 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:30.069969 23264 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:30.064594 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:30.067107 22543 connection.cc:256] RPC call timeout handler was delayed by -1.0882923339999024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:09:30.070782 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.070942 28210 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:30.071528 28210 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:30.071712 22543 leader_election.cc:336] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.552s (SENT)
I20260709 13:09:30.072198 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:30.045454 27918 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.072472 28210 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:30.073211 22543 connection.cc:256] RPC call timeout handler was delayed by -1.0193671370000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 13:09:30.074975 22653 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:30.075341 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:30.076141 23260 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:30.082882 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.064373 28211 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:30.065523 28202 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:30.087939 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.088006 28211 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:30.089195 28211 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.090494 28211 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:30.091804 28208 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:30.097548 22573 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:30.099500 27906 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.100070 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:30.100983 28069 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.101565 28069 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.103894 28069 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.111238 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:30.116385 28196 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:30.116915 28196 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:30.117285 28196 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.064955 28198 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.122222 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:30.123157 23260 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:30.129845 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.132369 28059 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.133034 28059 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:30.134088 28059 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.086025 28213 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:30.108556 28177 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.141634 27961 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:30.142381 27961 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:30.143548 28184 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.444s	user 0.002s	sys 0.000s
I20260709 13:09:30.125190 28202 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:30.144800 27961 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.145018 27918 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.150315 27918 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:30.157047 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:30.157249 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:30.157514 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:30.158085 23259 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:30.158666 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:30.162814 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2955) took 1548 ms. Trace:
I20260709 13:09:30.163277 22503 rpcz_store.cc:276] 0709 13:09:28.614850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.181431 (+566581us) service_pool.cc:224] Handling call
0709 13:09:29.197847 (+ 16416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.198266 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:29.198304 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.198817 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.392069 (+193252us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:29.392134 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.392241 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.142853 (+750612us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:30.162541 (+ 19688us) raft_consensus.cc:1685] finished
0709 13:09:30.162562 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.162755 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1442,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4350,"spinlock_wait_cycles":11921280,"thread_start_us":179632,"threads_started":1,"wal-append.queue_time_us":412200}
I20260709 13:09:30.146358 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:30.167601 27968 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:30.106004 28171 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:30.179968 23259 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
W20260709 13:09:30.169358 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 121523us
W20260709 13:09:30.192718 22543 leader_election.cc:336] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.558s (SENT)
I20260709 13:09:30.193360 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:30.201589 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.203483 22646 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:30.145928 28202 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.146525 28152 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:09:30.146648 28153 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:30.146415 28198 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.216338 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.207847 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.194252 28171 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:30.146888 28167 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:09:30.191177 28213 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:30.219051 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:30.226934 22543 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.663s (SENT)
I20260709 13:09:30.237782 22503 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:30.239481 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:30.241498 22543 leader_election.cc:336] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.762s (SENT)
I20260709 13:09:30.204854 28069 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:30.251828 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.252614 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:30.251993 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:30.255543 22571 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:30.258039 22572 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:30.264556 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.265803 22571 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:30.265182 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:30.266659 22579 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
W20260709 13:09:30.254340 28201 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:09:30.251634 27906 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:30.273041 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.277726 22572 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:30.275547 23262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 831) took 1815 ms (client timeout 1777 ms). Trace:
I20260709 13:09:30.276364 27870 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:30.276455 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.278363 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.280455 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:30.278347 23262 rpcz_store.cc:269] 0709 13:09:28.460107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.460323 (+   216us) service_pool.cc:224] Handling call
0709 13:09:30.275269 (+1814946us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54005fb9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:30.275420 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860157824}
W20260709 13:09:30.282145 22543 leader_election.cc:336] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.943s (SENT)
I20260709 13:09:30.282672 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:30.281936 22575 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:30.248143 28193 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:09:30.254997 28069 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:30.297255 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.298786 27906 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:30.299809 27906 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.322942 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.323674 22503 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
W20260709 13:09:30.324369 22543 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.009s (SENT)
I20260709 13:09:30.324915 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.325474 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.326015 22579 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:30.281447 27870 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.322480 28206 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:30.302783 28153 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:09:30.330552 28177 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:30.331352 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.341584 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.342847 22500 raft_consensus.cc:2410] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:30.341323 22651 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:30.290798 28179 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.273945 27976 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.346800 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:30.347576 22543 leader_election.cc:336] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.066s (SENT)
I20260709 13:09:30.353330 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.348631 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.354578 22505 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:30.354825 27870 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.356372 27870 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:30.357110 28214 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:30.357605 28214 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.357961 28214 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:30.360728 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3578) took 1093 ms. Trace:
I20260709 13:09:30.346203 28213 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.361172 22502 rpcz_store.cc:276] 0709 13:09:29.267834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.408628 (+140794us) service_pool.cc:224] Handling call
0709 13:09:30.023500 (+614872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.029590 (+  6090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.360525 (+330935us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54001a9850. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:30.360665 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403278592}
I20260709 13:09:30.361909 28069 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:30.351528 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.350785 22572 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:09:30.301988 28175 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:09:30.396389 22651 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:09:30.402673 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55265.1us
I20260709 13:09:30.405289 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.412256 23257 raft_consensus.cc:2368] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:09:30.375814 27968 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.417487 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:30.418005 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 141095us
I20260709 13:09:30.395382 28193 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:30.394447 28167 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:30.424916 28167 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.428052 28167 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.429744 28167 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:30.432101 28219 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:09:30.439775 28218 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:30.443650 22499 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:30.332508 28171 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.453889 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.380023 28152 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:09:30.466351 27976 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.491063 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.495682 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:30.495887 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 467800us
I20260709 13:09:30.496335 22649 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:30.497164 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.506325 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.508298 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.510854 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.511557 22651 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:30.513258 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.515825 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.514794 22654 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:30.525156 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.526751 22649 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:09:30.493141 28196 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.534965 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.532881 28225 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:30.563778 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.510671 28214 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.569236 22579 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:30.577366 22572 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:30.578338 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.564765 22499 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:30.565659 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.583256 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.584093 22574 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:30.585249 28151 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.560s	user 0.004s	sys 0.000s
I20260709 13:09:30.590065 22572 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:30.590341 22580 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:30.591313 22572 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:30.591743 22580 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:30.594745 27924 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:30.595295 27924 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:30.559880 28152 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.598451 28152 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.599176 22649 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:30.599634 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2918) took 1399 ms. Trace:
I20260709 13:09:30.600008 22648 rpcz_store.cc:276] 0709 13:09:29.200408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.200568 (+   160us) service_pool.cc:224] Handling call
0709 13:09:29.210540 (+  9972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.742229 (+531689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.599406 (+857177us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:30.599570 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220604800}
W20260709 13:09:30.601667 28228 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:30.600628 28152 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.607475 28102 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.610110 28196 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.521250 27968 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.620115 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:30.622157 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.623262 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.625929 22572 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:30.626971 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:30.627610 22572 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:30.631019 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:30.633919 22543 leader_election.cc:336] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.392s (SENT)
I20260709 13:09:30.659994 22572 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:30.661988 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:30.664263 22572 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:30.667104 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:30.652832 28152 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:30.667868 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.690196 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.670703 22572 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:30.676644 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.677421 27887 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.678231 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.679152 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:30.666054 27836 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.840s	user 0.007s	sys 0.007s
I20260709 13:09:30.660352 28196 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:30.708011 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.710602 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.694804 27686 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:30.722919 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:30.723929 27918 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:30.724053 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.706874 27765 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:30.725090 27918 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:30.725766 27918 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:30.726291 27918 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.726578 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.727070 28031 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:30.727401 28021 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:30.727478 28031 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.728760 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.729607 28021 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:30.733242 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.734912 28039 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:30.739032 22505 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:30.740398 22505 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:30.741078 28154 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:30.741724 28176 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:30.742105 22502 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:30.750391 22651 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:09:30.725153 28152 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.749614 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.705796 28227 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:30.744933 28196 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.757226 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.775130 22505 raft_consensus.cc:2368] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16.
I20260709 13:09:30.776021 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.725153 27765 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:30.776871 22505 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:30.728469 28031 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.777691 27765 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.778676 28031 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.712579 28167 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:30.785837 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.786597 22499 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:30.754560 28021 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:30.760135 28223 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:09:30.761286 28175 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:30.757226 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.767817 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.752475 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:30.714002 28225 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:09:30.706931 27836 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.757566 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:30.784914 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 162095us
I20260709 13:09:30.792014 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.800599 22499 raft_consensus.cc:2368] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14.
I20260709 13:09:30.798669 22645 raft_consensus.cc:2368] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:30.800401 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.789058 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.806089 22505 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:30.803340 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:30.811551 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:30.815543 22497 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:09:30.803637 28229 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:09:30.812662 28102 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:30.818967 28102 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.819705 28195 raft_consensus.cc:1064] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:09:30.797897 28227 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:09:30.822139 28195 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.822953 28227 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:30.823292 28227 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.824183 28227 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.828501 28102 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.829981 28214 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.830315 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.830000 22654 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:30.798039 27825 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:30.831938 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.831880 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.837085 22645 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:30.801397 27765 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:30.787719 28154 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:30.839975 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.814774 28177 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:30.853448 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:30.856094 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 110825us
I20260709 13:09:30.856433 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.859961 22653 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:30.862681 22505 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:30.864259 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.871313 22649 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:30.872830 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:30.881143 27870 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:30.882139 27870 consensus_queue.cc:1243] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:30.882349 28196 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.882826 27870 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:30.812383 28213 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:30.893622 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:30.894603 22575 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
W20260709 13:09:30.895555 28242 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:09:30.896178 22580 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:30.897461 28245 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:30.897684 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.899224 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:30.893652 28021 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:30.899876 22501 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:09:30.901283 23229 leader_election.cc:400] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16.
I20260709 13:09:30.901409 28021 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:30.901687 23229 leader_election.cc:403] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.901921 28021 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.902827 28021 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.903642 27924 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.904299 28021 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.909123 22501 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:09:30.909197 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:30.910557 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.911257 22501 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:30.912593 22501 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:30.914561 27924 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.924021 28021 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:30.924888 28021 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:30.926251 27836 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:30.861248 27825 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:30.861452 27906 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.929673 27906 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.930850 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.931183 27968 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.931542 22654 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:30.931912 27906 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:30.931704 27968 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.932490 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.933146 22654 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:30.933934 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.925855 28021 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:30.935416 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.936502 23229 leader_election.cc:400] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14.
I20260709 13:09:30.892925 22653 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:30.867522 28227 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:30.934545 22645 raft_consensus.cc:2376] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13. Re-sending same reply.
I20260709 13:09:30.934604 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:30.943992 23229 leader_election.cc:403] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.949661 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:30.942195 22503 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:30.945930 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:30.885207 28220 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.589s	user 0.003s	sys 0.000s
I20260709 13:09:30.957681 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:30.885044 28238 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:09:30.886391 28177 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:30.944043 22647 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:30.956398 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:30.958541 22652 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:30.950690 27848 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14.
I20260709 13:09:30.963763 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:30.943069 28225 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.975183 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.946765 28171 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:30.975862 22654 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:30.976675 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.977546 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:30.871809 28152 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:09:30.889951 28214 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:09:30.984385 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.995684 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.006723 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 195243us
I20260709 13:09:30.985800 22503 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:30.961179 27976 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.961102 28172 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:30.925879 27918 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:30.944021 27870 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:09:30.971328 28102 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:30.966661 28057 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.014216 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:31.032579 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.009598 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:30.979054 28167 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:31.046137 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:30.962200 28229 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:09:31.022104 22648 raft_consensus.cc:2368] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:09:31.047683 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:31.060103 22652 raft_consensus.cc:2376] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13. Re-sending same reply.
I20260709 13:09:30.976289 28097 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:31.049739 28167 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.050459 28196 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.023458 28172 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.022658 27924 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:09:31.071530 28097 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:31.087504 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.088289 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:31.092378 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.093571 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:31.093870 28196 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:31.094406 28196 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:31.094866 28196 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:31.044948 27976 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:31.097043 28243 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:31.080082 28167 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.087936 28172 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:31.104892 27918 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:31.050467 28057 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.107303 28170 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:31.107895 28170 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:31.108780 28057 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:31.110244 27968 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:31.111552 28190 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.147s	user 0.001s	sys 0.001s
I20260709 13:09:31.021876 27825 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.011039 28225 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.021937 27876 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:31.008838 28224 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:09:31.112233 23263 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:31.129448 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:31.138031 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:31.138669 22572 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.134553 22574 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:31.140055 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:31.118058 28251 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:09:31.143429 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:31.158771 22469 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:31.145253 28019 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:31.146875 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 885) took 1078 ms. Trace:
I20260709 13:09:31.113972 28097 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:31.162072 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115995us
I20260709 13:09:31.160040 23257 rpcz_store.cc:276] 0709 13:09:30.068250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.068396 (+   146us) service_pool.cc:224] Handling call
0709 13:09:31.146624 (+1078228us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54007d28d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:31.146801 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687412480}
I20260709 13:09:31.169744 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:31.170142 22469 leader_election.cc:400] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:09:31.170565 22469 leader_election.cc:403] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:31.172788 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:31.174817 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.175649 22648 raft_consensus.cc:2368] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15.
I20260709 13:09:31.177718 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:31.163614 27968 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:31.179893 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:31.072742 28177 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.189944 22500 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:31.190714 23255 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.198411 22572 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:31.199105 22647 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:31.198411 23255 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:31.205888 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:31.207154 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:31.208065 28259 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:31.208666 28259 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:31.209373 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:31.206513 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:31.210187 22498 raft_consensus.cc:2410] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:31.200268 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:31.213420 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.214150 22653 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:09:31.141413 28170 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:31.200567 27968 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.218869 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:31.219503 22653 raft_consensus.cc:2376] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14. Re-sending same reply.
I20260709 13:09:31.209218 27924 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:09:31.219702 27968 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:31.237710 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:31.238076 28261 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:31.238706 28261 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:31.239660 28261 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.221560 28170 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.248309 22653 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:31.249560 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.250288 22648 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:31.251164 28059 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.251998 28152 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:31.252420 28152 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:31.246949 28258 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:09:31.255649 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55621.5us
W20260709 13:09:31.256078 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63209.4us
I20260709 13:09:31.231575 28253 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.258360 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:31.259307 22572 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:31.256848 27765 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.265156 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.265394 27765 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.265946 22652 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:31.266353 28167 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.267422 27765 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:31.269084 28262 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:31.269711 28262 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:31.269902 28223 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:31.271222 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.271656 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.254671 27924 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.256361 28225 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:31.277405 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 70976.9us
I20260709 13:09:31.276667 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:31.278553 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:31.268594 28167 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:31.280531 22499 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:09:31.283491 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 110815us
I20260709 13:09:31.286608 22572 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.289326 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:31.289954 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.298663 22652 raft_consensus.cc:2376] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14. Re-sending same reply.
I20260709 13:09:31.293473 22574 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:31.270661 28262 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.300271 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:31.301146 28261 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:31.301837 28261 raft_consensus.cc:2764] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:31.302312 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:31.302438 28261 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:31.271574 28259 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.296555 22572 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:31.296942 27870 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:31.313028 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:31.316354 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.317565 22652 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:31.329504 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.287086 27924 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.319485 27870 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.332352 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1092) took 1824 ms. Trace:
I20260709 13:09:31.321952 28224 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:31.335446 28171 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16.
W20260709 13:09:31.349025 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46777.2us
W20260709 13:09:31.349831 28267 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:09:31.349949 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:31.356042 28021 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:31.357868 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:31.362689 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:31.365005 22502 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:09:31.366564 27924 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:31.355053 28246 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.540s	user 0.003s	sys 0.000s
W20260709 13:09:31.371459 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.373407 22573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 931) took 1636 ms (client timeout 1730 ms). Trace:
W20260709 13:09:31.373864 22573 rpcz_store.cc:269] 0709 13:09:29.737002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.737212 (+   210us) service_pool.cc:224] Handling call
0709 13:09:31.373241 (+1636029us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540027a6d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:31.373353 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818047360}
I20260709 13:09:31.374531 23264 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
W20260709 13:09:31.378731 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.384093 22647 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:31.315603 28167 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:09:31.375974 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:31.386332 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.389503 28265 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:31.395232 22647 raft_consensus.cc:2376] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18. Re-sending same reply.
I20260709 13:09:31.332129 28270 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.308233 28152 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:31.389962 22618 connection.cc:256] RPC call timeout handler was delayed by -2.2827391920000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:09:31.328248 28227 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:09:31.396992 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:31.400892 28274 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:31.406086 28097 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.335420 22650 rpcz_store.cc:276] 0709 13:09:29.506999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.167484 (+660485us) service_pool.cc:224] Handling call
0709 13:09:30.167785 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.167995 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:30.168223 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:09:31.215004 (+1046781us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b1800442c00. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:09:31.331237 (+116233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:31.331320 (+    83us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:31.331398 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.331499 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.331691 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":212,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":7787,"raft.queue_time_us":1225,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":1899,"spinlock_wait_cycles":3817728,"thread_start_us":115892,"threads_started":1}
I20260709 13:09:31.410508 22650 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:31.411899 22650 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:31.412165 27968 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:31.413522 28196 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:31.419855 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:31.420559 22500 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:31.427755 22496 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:31.429137 22650 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:31.430508 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:31.431257 22618 connection.cc:256] RPC call timeout handler was delayed by -1.953339192000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 13:09:31.431764 22500 raft_consensus.cc:2410] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:31.431938 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:31.336086 27870 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:31.430604 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:31.432992 28170 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:31.431382 22654 raft_consensus.cc:2376] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16. Re-sending same reply.
I20260709 13:09:31.433677 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:31.408627 28097 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:31.549721 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.570386 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 182842us
W20260709 13:09:31.571192 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 182625us
I20260709 13:09:31.444110 28224 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:31.748195 28224 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.750841 28031 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:31.751614 28031 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.788673 28170 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.802423 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 368779us
I20260709 13:09:31.801939 28262 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.835870 28262 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:31.826903 28031 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:31.837307 28031 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:31.838343 28262 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:31.838274 28031 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.432358 28270 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:31.807401 28172 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.002s
I20260709 13:09:31.790199 28227 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:31.864424 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:31.802682 28167 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:31.788554 28196 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:31.827509 28170 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:31.890185 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 1105) took 1595 ms. Trace:
I20260709 13:09:31.890691 22646 rpcz_store.cc:276] 0709 13:09:30.295174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.295403 (+   229us) service_pool.cc:224] Handling call
0709 13:09:31.889934 (+1594531us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400236254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:31.890107 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311319936}
I20260709 13:09:31.894362 27976 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:31.874531 27968 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:31.911229 28205 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.911936 28205 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:31.912492 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.895743 28227 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:31.912827 23261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 891) took 1756 ms (client timeout 1503 ms). Trace:
I20260709 13:09:31.913195 28227 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:31.913347 23261 rpcz_store.cc:269] 0709 13:09:30.156560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.156691 (+   131us) service_pool.cc:224] Handling call
0709 13:09:31.912623 (+1755932us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54007a30d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:31.912757 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150375296}
I20260709 13:09:31.914065 28205 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:31.914700 28205 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:31.867141 28172 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.915141 28205 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.872762 28167 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.925511 23259 raft_consensus.cc:2368] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:31.915618 28227 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:31.917845 27976 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.940232 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 207790us
W20260709 13:09:31.940143 27926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.012s	sys 0.049s
W20260709 13:09:31.948134 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 202055us
W20260709 13:09:31.946259 27926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.012s	sys 0.049s
I20260709 13:09:31.957587 28097 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.958671 28097 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:31.959415 28270 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:31.957867 28172 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:31.944728 27976 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:31.975272 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.975785 28031 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:31.986963 28170 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:31.988238 27870 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260709 13:09:31.988758 28167 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:31.993325 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.997102 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 1.49806e+06us
I20260709 13:09:31.997995 28205 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:32.002411 28278 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:09:32.005165 28264 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:32.005661 28264 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:32.006675 28264 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.007963 28264 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.010568 27976 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:32.010831 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3596) took 1540 ms. Trace:
I20260709 13:09:32.011400 22497 rpcz_store.cc:276] 0709 13:09:30.470682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.605597 (+134915us) service_pool.cc:224] Handling call
0709 13:09:30.606074 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.837207 (+231133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.010456 (+1173249us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001db0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:32.010747 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481052032}
W20260709 13:09:32.017316 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2473) took 3413 ms (client timeout 1627 ms). Trace:
W20260709 13:09:32.017903 22577 rpcz_store.cc:269] 0709 13:09:28.603446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.607627 (+  4181us) service_pool.cc:224] Handling call
0709 13:09:32.017035 (+3409408us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003c82d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:32.017221 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3261753216}
W20260709 13:09:32.019239 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 211318us
I20260709 13:09:32.020495 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3601) took 1085 ms. Trace:
I20260709 13:09:32.020931 22503 rpcz_store.cc:276] 0709 13:09:30.935564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.010683 (+ 75119us) service_pool.cc:224] Handling call
0709 13:09:31.010972 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.011162 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:31.051216 (+ 40054us) log.cc:844] Serialized 14 byte log entry
0709 13:09:31.051570 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 13:09:31.815890 (+764320us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b18004ba780. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:31.901561 (+ 85671us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18004ba780. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:32.020051 (+118490us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18004ba780. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287
0709 13:09:32.020153 (+   102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.020207 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:32.020261 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.020329 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.020443 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10629,"prepare.queue_time_us":836478,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":108,"raft.queue_time_us":37078,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":10514,"spinlock_wait_cycles":20725120,"thread_start_us":27694,"threads_started":1}
I20260709 13:09:32.022817 22580 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:32.024151 22579 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:32.024084 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.024518 28198 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:32.025025 22574 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:09:32.025113 28198 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:32.026067 28279 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:32.026782 27686 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:32.027978 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78532.1us
W20260709 13:09:32.030990 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.031894 23263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 841) took 2006 ms (client timeout 1888 ms). Trace:
W20260709 13:09:32.032377 23263 rpcz_store.cc:269] 0709 13:09:30.025587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.025749 (+   162us) service_pool.cc:224] Handling call
0709 13:09:32.031688 (+2005939us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54005ebd54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:32.031816 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415628160}
I20260709 13:09:32.026260 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:32.032070 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.032814 22399 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 316) took 33545 ms (client timeout 15000 ms). Trace:
I20260709 13:09:32.033691 28097 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:32.054216 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.033757 22572 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:32.056996 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.057919 22498 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:09:32.034806 22502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 1130) took 1287 ms (client timeout 1685 ms). Trace:
W20260709 13:09:32.058980 22502 rpcz_store.cc:269] 0709 13:09:30.747264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.749204 (+  1940us) service_pool.cc:224] Handling call
0709 13:09:32.034668 (+1285464us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540033f9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:32.034756 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375866752}
W20260709 13:09:32.035166 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 685252us
W20260709 13:09:32.049333 22399 rpcz_store.cc:269] 0709 13:08:58.487386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.487889 (+   503us) service_pool.cc:224] Handling call
0709 13:09:32.032433 (+33544544us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:20.937643 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:21.141537 (+203894us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:21.153392 (+ 11855us) write_op.cc:435] Acquired schema lock
0709 13:09:21.156456 (+  3064us) tablet.cc:662] Decoding operations
0709 13:09:21.219015 (+ 62559us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:21.219116 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:21.219147 (+    31us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:09:21.853481 (+634334us) tablet.cc:701] Row locks acquired
0709 13:09:21.853527 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:09:21.853703 (+   176us) write_op.cc:270] Start()
0709 13:09:21.853849 (+   146us) write_op.cc:276] Timestamp: P: 1783602561853636 usec, L: 0
0709 13:09:21.853888 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:09:22.123313 (+269425us) log.cc:844] Serialized 10648 byte log entry
0709 13:09:23.075381 (+952068us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b18003f4540. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:24.549537 (+1474156us) op_driver.cc:464] REPLICATION: finished
0709 13:09:24.744414 (+194877us) write_op.cc:301] APPLY: starting
0709 13:09:24.744526 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:25.252207 (+507681us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:25.252249 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:27.249617 (+1997368us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:27.250316 (+   699us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:09:27.250412 (+    96us) write_op.cc:312] APPLY: finished
0709 13:09:27.251347 (+   935us) log.cc:844] Serialized 236 byte log entry
0709 13:09:27.359238 (+107891us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:27.418806 (+ 59568us) write_op.cc:454] Released schema lock
0709 13:09:27.418910 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:27.419672 (+   762us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:27.419715 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9107973,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":171527,"apply.run_cpu_time_us":114203,"apply.run_wall_time_us":2675115,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117095,"num_ops":27,"prepare.queue_time_us":511373,"prepare.run_cpu_time_us":55528,"prepare.run_wall_time_us":1559335,"raft.queue_time_us":1279482,"raft.run_cpu_time_us":82119,"raft.run_wall_time_us":187906,"replication_time_us":2658480,"spinlock_wait_cycles":14482944,"thread_start_us":1318060,"threads_started":5,"wal-append.queue_time_us":510753,"wal-append.run_cpu_time_us":26416,"wal-append.run_wall_time_us":2690222}]]}
I20260709 13:09:32.060833 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:32.062317 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.040357 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3591) took 1833 ms. Trace:
I20260709 13:09:32.070336 22504 rpcz_store.cc:276] 0709 13:09:30.207148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.234798 (+ 27650us) service_pool.cc:224] Handling call
0709 13:09:30.235101 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.346770 (+111669us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:30.473147 (+126377us) log.cc:844] Serialized 14 byte log entry
0709 13:09:30.665593 (+192446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:30.665647 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:30.665694 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.039503 (+1373809us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b18004ba5a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:09:32.040015 (+   512us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400107f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:32.040062 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.040301 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86090,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":193,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3120,"spinlock_wait_cycles":263792640,"thread_start_us":301387,"threads_started":2,"wal-append.queue_time_us":255977,"wal-append.run_cpu_time_us":1459,"wal-append.run_wall_time_us":1028177}
I20260709 13:09:32.045069 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.073634 22500 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:32.046047 22469 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:32.036159 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:32.075322 22577 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.084837 22576 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:09:32.088379 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.093182 22574 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:32.063385 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.101976 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:32.108693 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.111281 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:32.112332 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49641.5us
W20260709 13:09:32.035331 28021 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.004s
I20260709 13:09:32.117741 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:32.119045 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.120404 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.121764 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:32.123361 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.125202 22576 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 8: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:32.127903 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.037709 28163 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:32.037379 28216 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:32.133525 22502 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:32.136459 23264 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:32.130015 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:32.137521 22652 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:32.098930 28261 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:32.105729 28270 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:32.130065 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:32.113613 28274 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:32.091634 28175 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:32.106112 28196 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:32.157949 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.179540 22576 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:32.114394 28059 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:32.159194 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.159636 23256 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:32.161487 23255 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.155748 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:32.150802 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:32.183446 23259 raft_consensus.cc:2368] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16.
I20260709 13:09:32.115734 28102 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:32.115836 28167 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.176023 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.125655 27836 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:31.997300 27870 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:32.180101 23261 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:32.125571 28069 raft_consensus.cc:2764] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:09:32.181674 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.186606 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.135521 28163 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:32.103370 28202 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:09:32.197512 22576 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:32.197786 22579 raft_consensus.cc:2410] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:09:32.187354 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:32.198469 22573 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:32.201159 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.135145 28225 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:09:32.207515 28102 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:32.184898 28059 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:32.208847 27870 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:32.144636 28170 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:09:32.209604 22653 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:09:32.199411 28167 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:32.211681 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:32.212387 28167 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:32.196717 27836 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:32.161952 28031 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:32.160779 28270 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.209247 28059 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.195515 22574 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:32.213177 23256 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:32.206250 23263 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
W20260709 13:09:32.214769 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 59136us
I20260709 13:09:32.246754 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:32.247486 22645 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
W20260709 13:09:32.217029 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.196540 28216 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:32.213155 27836 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.200487 28196 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:32.258478 22544 leader_election.cc:400] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:32.266451 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:32.262550 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:32.215343 28031 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.291917 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.248642 28270 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.248373 28250 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:32.222308 28279 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:32.253917 28170 consensus_queue.cc:1243] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:32.321936 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.322664 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:32.189177 28175 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:32.256338 28195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.380s	user 0.016s	sys 0.026s
I20260709 13:09:32.328239 23260 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
W20260709 13:09:32.329351 23227 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.730s (SENT) [suppressed 44 similar messages]
I20260709 13:09:32.331050 23256 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.208568 28102 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.336954 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.290275 28097 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.344930 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.348680 23263 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:32.348896 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:32.352339 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:32.318848 28031 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:32.376371 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.381599 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:32.382452 22654 raft_consensus.cc:2410] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:32.370996 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:32.315214 27999 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.327029 28250 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:32.340067 28195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.463s	user 0.016s	sys 0.026s
W20260709 13:09:32.356383 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 90041.4us
W20260709 13:09:32.392216 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 370242us
I20260709 13:09:32.398011 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.398711 22500 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:32.399533 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.400080 22500 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:32.400821 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:32.402498 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.377102 28193 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:32.415915 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:32.416522 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.417227 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:32.418694 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.420183 22580 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:32.395712 28250 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.428102 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:32.388480 22401 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 5 to 9, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 9 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.431545 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.432271 23262 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 8.
I20260709 13:09:32.345963 28279 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:32.371563 28097 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:32.437422 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.019s	sys 0.021s
W20260709 13:09:32.437820 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.019s	sys 0.021s
I20260709 13:09:32.439360 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:32.411221 28259 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:32.444940 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.416349 28229 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:32.416967 28193 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:32.447643 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.449612 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.393955 27999 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:32.451658 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:32.453568 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 323575us
W20260709 13:09:32.463544 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.464628 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:32.465173 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:32.466396 22401 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.472479 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:32.477144 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.478374 22468 leader_election.cc:400] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:09:32.481742 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.482471 22498 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:09:32.491655 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2977) took 1203 ms. Trace:
I20260709 13:09:32.447185 28265 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:32.452242 28193 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:32.497566 22580 raft_consensus.cc:1217] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Deduplicated request from leader. Original: 15.8->[17.9-17.9]   Dedup: 17.9->[]
I20260709 13:09:32.449250 28229 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.492132 22652 rpcz_store.cc:276] 0709 13:09:31.288505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.318413 (+ 29908us) service_pool.cc:224] Handling call
0709 13:09:32.491471 (+1173058us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400236c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:32.491593 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856159488}
I20260709 13:09:32.499270 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:32.507515 22578 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:32.508989 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:32.510593 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:32.512744 22580 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:09:32.447613 28295 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.517102 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:32.411448 28196 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:32.532003 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 87193.7us
W20260709 13:09:32.532639 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 203306us
I20260709 13:09:32.533208 22543 leader_election.cc:400] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:32.533691 22543 leader_election.cc:403] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:32.516499 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:32.537842 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.528723 22577 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
W20260709 13:09:32.526876 28291 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:09:32.505506 28301 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:32.448206 28259 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.496217 28205 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:32.565328 28205 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.566000 28205 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.565712 22401 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 8 to 11, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 11 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.519977 28261 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:32.569368 28261 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:32.570032 28261 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.571749 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.572553 22497 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:09:32.573699 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.574481 22497 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:32.575248 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.575985 22497 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:32.526911 28069 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:32.577330 28069 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.577759 28069 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:32.580570 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.527202 28021 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.581521 28021 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:32.586337 28292 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:32.515977 28229 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:32.589250 28170 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:32.590728 28288 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:32.591248 28288 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:32.592301 28288 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.593936 28288 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:32.554380 28301 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:32.603053 28301 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:32.607151 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2983) took 1215 ms. Trace:
I20260709 13:09:32.607573 22505 rpcz_store.cc:276] 0709 13:09:31.391429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.391587 (+   158us) service_pool.cc:224] Handling call
0709 13:09:31.392009 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.037512 (+645503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.037540 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.038017 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.410291 (+372274us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:32.410330 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.410396 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.606892 (+196496us) raft_consensus.cc:1685] finished
0709 13:09:32.606913 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.607082 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":645060,"raft.queue_time_us":647765,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":371902,"threads_started":1,"wal-append.queue_time_us":566819}
I20260709 13:09:32.614511 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3609) took 1212 ms. Trace:
I20260709 13:09:32.615103 22501 rpcz_store.cc:276] 0709 13:09:31.402396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.402557 (+   161us) service_pool.cc:224] Handling call
0709 13:09:31.402904 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.038572 (+635668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.038602 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.038992 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.414445 (+375453us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:32.414489 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.414555 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.614161 (+199606us) raft_consensus.cc:1685] finished
0709 13:09:32.614201 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.614420 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":635306,"raft.queue_time_us":637123,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":57,"thread_start_us":375009,"threads_started":1,"wal-append.queue_time_us":508634}
I20260709 13:09:32.618250 28152 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.521883 28295 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:32.620476 28295 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.621713 28213 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:32.622212 28213 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:32.630194 28213 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.631515 28213 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:32.626004 28296 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:09:32.657943 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.667482 22649 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:32.677090 28224 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:32.677759 28224 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.520759 27926 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:09:32.634308 27906 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:32.495713 28293 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:32.520520 28274 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:32.703518 28289 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.704140 28274 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:32.557050 28175 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:32.521107 28298 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:32.696497 28293 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.553972 27870 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.706353 28293 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.706523 27870 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:32.707134 27870 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.548787 28225 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:32.515631 27924 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:09:32.710019 22497 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:32.550594 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.710168 28069 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:32.711081 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 160612us
I20260709 13:09:32.712819 28069 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:32.713997 27918 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:32.714200 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:32.714608 27918 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:32.715468 27918 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:32.716171 28167 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.578610 22401 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 8 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:32.687577 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 154558us
I20260709 13:09:32.720274 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:32.663866 28170 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.722334 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:32.525744 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:32.723456 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 197793us
I20260709 13:09:32.724215 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:32.681140 28287 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.742316 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:32.732846 27686 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:32.716684 28167 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.718273 28097 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:32.790238 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:32.791024 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:32.794950 22645 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:32.796682 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:32.734949 28298 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:32.738490 28069 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.811657 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:32.802923 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 60707.3us
I20260709 13:09:32.750434 27906 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:32.806344 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:32.821354 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.750168 27924 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:32.823655 22401 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 10 to 11, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 11 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.810364 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:32.810580 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:32.810770 22648 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:32.826332 22543 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:32.805372 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:32.819988 23264 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:32.822556 23257 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:32.831669 23256 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:32.793656 27686 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.792392 28167 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.704180 28289 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.741236 28211 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:09:32.734688 28170 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.848610 23263 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:32.850435 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.860371 22543 leader_election.cc:400] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15.
I20260709 13:09:32.861037 22543 leader_election.cc:403] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:32.839077 27686 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:32.871184 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.874094 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:32.877590 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:32.877156 22401 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 4 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.880029 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:32.754431 28287 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.882467 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:32.887643 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.888952 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:32.889636 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:32.890407 22571 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.894357 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:32.888368 22573 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:09:32.874735 27906 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15.
I20260709 13:09:32.915623 22645 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:32.915495 22571 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:32.910580 22401 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 9 to 10, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.879334 28279 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:32.924830 22502 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.010s	sys 0.020s
W20260709 13:09:32.926353 22502 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.010s	sys 0.020s
W20260709 13:09:32.935519 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 457863us
I20260709 13:09:32.928829 28216 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:32.957237 22401 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:33.080364 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 364161us
W20260709 13:09:32.950052 28059 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.692s	user 0.025s	sys 0.000s
I20260709 13:09:32.968703 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:33.105836 23256 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:32.978729 27836 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.666s	user 0.021s	sys 0.004s
W20260709 13:09:32.963992 22575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.066s	sys 0.118s
W20260709 13:09:33.115231 22575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.067s	sys 0.119s
I20260709 13:09:32.862386 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:33.126873 28205 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
W20260709 13:09:33.128257 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 265931us
I20260709 13:09:32.961102 28175 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:33.130766 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:33.138763 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:33.108071 28059 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:32.974180 28224 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:33.141372 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 232090us
W20260709 13:09:33.146612 28193 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.003s
I20260709 13:09:33.115980 28195 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:33.158823 22496 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:33.143301 28170 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:33.163833 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:33.161022 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:33.127450 28167 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:33.154131 28308 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
W20260709 13:09:33.180349 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 315595us
I20260709 13:09:33.182997 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:33.187994 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:33.127497 28205 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.152108 28224 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.137733 27836 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.224850 28167 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:33.144589 28196 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:09:33.144790 28175 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.148164 28274 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:33.165901 28289 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:33.293754 28325 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:33.298393 28310 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 13:09:33.299934 28311 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:09:33.306813 28205 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:33.313068 28316 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:09:33.316211 28316 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:33.158169 28193 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.320350 28193 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:33.321098 22577 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
W20260709 13:09:33.322511 28297 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.828s	user 0.004s	sys 0.000s
I20260709 13:09:33.329810 28259 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:33.332991 28021 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:33.335105 28059 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:33.338873 27924 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.503s	user 0.002s	sys 0.013s
I20260709 13:09:33.249446 28321 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:33.261798 28287 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:33.342914 28167 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.343362 28170 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.343688 28193 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.344669 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1114) took 1142 ms. Trace:
I20260709 13:09:33.381830 22646 rpcz_store.cc:276] 0709 13:09:32.201958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.202152 (+   194us) service_pool.cc:224] Handling call
0709 13:09:32.209810 (+  7658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.383356 (+173546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.383395 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.383443 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:32.383478 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.344377 (+960899us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400169254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:33.344441 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.344596 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389642496}
I20260709 13:09:33.344615 27887 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:33.345779 28069 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.003s
I20260709 13:09:33.346240 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3626) took 2180 ms. Trace:
I20260709 13:09:33.348045 22645 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:33.159307 28195 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.364838 28259 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:33.365523 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 429179us
I20260709 13:09:33.341897 28316 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.370463 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:33.370201 27924 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:33.374688 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:33.428680 28069 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:33.436993 22498 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:33.436691 28163 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.437970 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:33.438815 22498 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 9: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:33.439632 28316 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:33.439828 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:33.440483 22498 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:33.440968 23263 raft_consensus.cc:2368] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:33.441211 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:33.374919 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:33.442162 22501 raft_consensus.cc:2410] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:09:33.372575 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:33.231712 28224 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.377043 23256 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 14 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:33.443590 22505 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:33.437970 28163 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:33.446707 27686 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.557s	user 0.013s	sys 0.000s
I20260709 13:09:33.416215 22575 rpcz_store.cc:276] 0709 13:09:31.165792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.165933 (+   141us) service_pool.cc:224] Handling call
0709 13:09:31.174861 (+  8928us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:31.180566 (+  5705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.180598 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:31.208535 (+ 27937us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.058091 (+849556us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b18003f26e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:33.115731 (+1057640us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.115795 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.115874 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.345824 (+229950us) raft_consensus.cc:1685] finished
0709 13:09:33.345856 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.346165 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3055,"raft.queue_time_us":5379,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":22771,"spinlock_wait_cycles":4733312,"thread_start_us":1057385,"threads_started":1,"wal-append.queue_time_us":1949802}
W20260709 13:09:33.383960 22574 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.015s
I20260709 13:09:33.384640 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:33.473446 22574 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.000s	sys 0.015s
I20260709 13:09:33.458300 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:33.473773 22497 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.421445 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:33.475449 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54132.8us
W20260709 13:09:33.445246 27870 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.003s
I20260709 13:09:33.477106 27870 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.383128 28321 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:33.425654 22618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.074s	sys 0.067s
W20260709 13:09:33.341449 28301 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.738s	user 0.016s	sys 0.005s
W20260709 13:09:33.480775 22618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.074s	sys 0.068s
W20260709 13:09:33.481263 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.481145 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:33.361754 28319 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:33.369168 28021 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.474364 22503 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:33.387298 27887 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:33.387802 28287 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:33.447189 27686 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.346462 28274 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.485312 28289 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.387099 28170 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.387234 28167 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:09:33.402347 28193 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:33.484313 27918 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.768s	user 0.014s	sys 0.002s
W20260709 13:09:33.524382 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.433913 28314 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:09:33.564206 22498 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:33.510322 27887 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:33.447885 28313 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:09:33.494174 28301 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:33.577378 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 413625us
I20260709 13:09:33.510432 28205 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.449910 28259 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.500908 28021 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:33.589179 28261 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.019s	user 0.008s	sys 0.008s
I20260709 13:09:33.613068 22543 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:33.589315 28335 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.498548 28319 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.597533 27926 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.548431 28287 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:33.617749 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.642828 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.659693 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 177249us
I20260709 13:09:33.664595 22504 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:33.675056 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.566546 28289 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:33.616351 28229 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.029s	user 0.012s	sys 0.005s
W20260709 13:09:33.683631 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 192525us
I20260709 13:09:33.684592 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:33.633315 28314 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:33.616928 28328 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:33.595501 27918 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.618639 28057 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:09:33.704703 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:33.723397 22654 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:33.724768 27918 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:33.727355 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:33.727859 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:33.672850 28335 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.731758 28335 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:33.733717 27918 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.734689 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:33.704895 28343 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:09:33.736354 28319 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:33.737896 28336 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:33.739346 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:33.740784 22650 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:33.748991 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:33.749541 27870 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:33.749785 23227 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:33.768956 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:33.769826 22646 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:33.772629 22618 leader_election.cc:400] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16.
I20260709 13:09:33.780797 28298 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:33.773759 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3641) took 1525 ms. Trace:
I20260709 13:09:33.769644 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:33.787355 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 174409us
I20260709 13:09:33.789582 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:33.690279 28175 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:33.692086 28314 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:33.783947 22574 rpcz_store.cc:276] 0709 13:09:32.248597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.249119 (+   522us) service_pool.cc:224] Handling call
0709 13:09:32.249518 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:32.316843 (+ 67325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.316933 (+    90us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:32.317942 (+  1009us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.686451 (+368509us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:33.478370 (+791919us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.773288 (+294918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.773411 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.773475 (+    64us) raft_consensus.cc:1685] finished
0709 13:09:33.773493 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.773685 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89287,"prepare.queue_time_us":793773,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":77436,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10635,"thread_start_us":1242276,"threads_started":3,"wal-append.queue_time_us":448816}
I20260709 13:09:33.671563 28261 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.710516 28211 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:33.734423 27918 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:33.768808 28057 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:33.802474 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 124791us
I20260709 13:09:33.783620 28341 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.802685 23256 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:33.804442 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:33.811935 22499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.026s
I20260709 13:09:33.768342 28335 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.683049 27926 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.839033 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:33.851344 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 46965.2us
I20260709 13:09:33.855686 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:33.856521 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.009s	sys 0.030s
I20260709 13:09:33.836726 22497 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:33.618234 27836 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:33.860735 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:33.687942 28229 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:33.873569 22502 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:33.876183 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57578.8us
W20260709 13:09:33.877957 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 128252us
W20260709 13:09:33.818329 28318 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.399s	user 0.001s	sys 0.001s
I20260709 13:09:33.880455 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:33.883546 23264 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.812217 27999 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:33.786306 27870 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:09:33.851482 28057 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.891222 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:33.880884 28205 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.893882 28057 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:33.867146 28352 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:09:33.980331 23264 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:33.980331 22503 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:33.873606 28335 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:33.896129 28347 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:33.898698 27686 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:33.962091 28366 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:33.961503 28342 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:33.957583 27999 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:33.878125 28341 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.001881 28321 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:34.034273 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 145711us
I20260709 13:09:34.062047 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:34.005030 28293 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.298s	user 0.017s	sys 0.000s
I20260709 13:09:33.907435 28353 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.045949 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1148) took 1719 ms. Trace:
I20260709 13:09:33.982343 27906 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:34.032305 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2991) took 1987 ms. Trace:
I20260709 13:09:33.998742 28167 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:33.999442 28193 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.008805 28313 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.976503 28205 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:34.062813 28031 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.667s	user 0.012s	sys 0.007s
I20260709 13:09:34.069788 28293 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.091071 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2608) took 1300 ms. Trace:
I20260709 13:09:34.063020 28345 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:34.097098 28358 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:34.097476 28354 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:34.098555 27918 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:34.051096 28347 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:34.099118 28370 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:34.099690 28229 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:33.898986 28314 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:34.106578 28363 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:09:34.066821 28021 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.065299 22544 leader_election.cc:400] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:34.348217 22544 leader_election.cc:403] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:09:34.348757 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 283608us
I20260709 13:09:34.038980 28301 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.038486 28170 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.358397 28368 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:34.359200 28368 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.362349 28368 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.363682 28265 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.035233 28360 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:09:34.365345 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:34.054456 28295 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.433s	user 0.012s	sys 0.005s
I20260709 13:09:34.366613 28295 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.367319 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:34.082748 28352 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:34.129676 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2515) took 1244 ms. Trace:
I20260709 13:09:34.369184 22579 rpcz_store.cc:276] 0709 13:09:32.884854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.885022 (+   168us) service_pool.cc:224] Handling call
0709 13:09:32.885516 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.130211 (+244695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.130257 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.147847 (+ 17590us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.609147 (+461300us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:33.609200 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.609308 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.129317 (+520009us) raft_consensus.cc:1685] finished
0709 13:09:34.129352 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.129572 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5525,"raft.queue_time_us":33771,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6832,"thread_start_us":620861,"threads_started":2,"wal-append.queue_time_us":966964}
I20260709 13:09:34.370424 23262 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 8.
I20260709 13:09:34.369890 28347 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:09:34.371680 23262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 845) took 1550 ms (client timeout 1758 ms). Trace:
I20260709 13:09:34.125629 28193 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.214s
I20260709 13:09:34.364269 28265 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.373359 28314 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:34.156771 28313 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.375257 28265 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.375733 28313 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.376493 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:34.378284 28293 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.378904 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:34.379290 28352 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:34.379709 28352 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:34.381027 27906 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:34.383355 28261 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:34.383694 28216 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.411s	user 0.011s	sys 0.003s
I20260709 13:09:34.066694 28350 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.276s
I20260709 13:09:34.253965 22647 rpcz_store.cc:276] 0709 13:09:32.790854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.792113 (+  1259us) service_pool.cc:224] Handling call
0709 13:09:32.792549 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.800362 (+  7813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.800408 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.805152 (+  4744us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.811669 (+1006517us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b180035e300. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:33.884468 (+ 72799us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:33.884519 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.884718 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.090733 (+206015us) raft_consensus.cc:1685] finished
0709 13:09:34.090755 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.090997 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12387,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":13874,"spinlock_wait_cycles":3265280,"thread_start_us":72584,"threads_started":1,"wal-append.queue_time_us":1172310}
W20260709 13:09:34.264901 22645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2610) took 1473 ms (client timeout 1695 ms). Trace:
W20260709 13:09:34.217582 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 356929us
W20260709 13:09:34.265407 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 355482us
W20260709 13:09:34.389844 22645 rpcz_store.cc:269] 0709 13:09:32.791545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.795511 (+  3966us) service_pool.cc:224] Handling call
0709 13:09:34.264695 (+1469184us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001c89d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:34.264799 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237167872}
I20260709 13:09:34.060030 28259 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:34.136654 28270 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.804s	user 0.019s	sys 0.000s
W20260709 13:09:34.156394 28288 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.562s	user 0.026s	sys 0.001s
W20260709 13:09:34.155220 28163 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.709s	user 0.004s	sys 0.007s
I20260709 13:09:34.294137 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 2996) took 1421 ms. Trace:
I20260709 13:09:34.160216 28167 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:34.397248 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.110119 28287 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.116277 27926 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.127002 28364 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:34.306744 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 429646us
W20260709 13:09:34.338672 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 456628us
I20260709 13:09:34.405872 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:34.407289 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:34.159421 27870 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:34.340169 23258 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:34.112373 28341 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:34.260006 28250 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.818s	user 0.015s	sys 0.004s
I20260709 13:09:34.417373 28250 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.418458 22649 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:34.420207 28250 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:34.298471 28198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.008s	sys 0.012s
I20260709 13:09:34.401414 28366 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:34.421500 28289 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.070632 27686 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.229s
I20260709 13:09:34.355032 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:34.425467 23260 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.355952 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:34.372184 23262 rpcz_store.cc:269] 0709 13:09:32.820831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.821039 (+   208us) service_pool.cc:224] Handling call
0709 13:09:34.371473 (+1550434us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400897454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:34.371608 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3560508672}
I20260709 13:09:34.429771 28328 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:34.430450 28328 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.384940 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.432497 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:34.293030 27887 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.002s
I20260709 13:09:34.064081 22500 rpcz_store.cc:276] 0709 13:09:32.326764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.407445 (+ 80681us) service_pool.cc:224] Handling call
0709 13:09:32.407860 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.408305 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:32.408335 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.408807 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.712493 (+303686us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b1800262480. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:33.086808 (+374315us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.086870 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.086989 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.033294 (+946305us) raft_consensus.cc:1685] finished
0709 13:09:34.033322 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.045862 (+ 12540us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11208,"raft.queue_time_us":104,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5898,"spinlock_wait_cycles":10488064,"thread_start_us":374043,"threads_started":1,"wal-append.queue_time_us":859242}
I20260709 13:09:34.433339 23261 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:34.068452 22496 rpcz_store.cc:276] 0709 13:09:32.051179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.058403 (+  7224us) service_pool.cc:224] Handling call
0709 13:09:32.112785 (+ 54382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.159424 (+1046639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.031972 (+872548us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540033e0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:34.032227 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405046528}
W20260709 13:09:34.269296 28152 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.650s	user 0.007s	sys 0.013s
I20260709 13:09:34.390719 23264 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:34.259817 28031 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.435034 28316 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:34.435187 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:34.435745 28316 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.394865 22504 rpcz_store.cc:276] 0709 13:09:32.873263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.873429 (+   166us) service_pool.cc:224] Handling call
0709 13:09:32.902013 (+ 28584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.674089 (+772076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.293782 (+619693us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b5400082ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:34.294042 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753103744}
I20260709 13:09:34.437927 28322 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:34.438526 27836 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.438469 28322 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.439064 27836 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.440577 28344 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:34.441089 28324 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:34.441702 28069 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.441774 28324 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:34.442497 28324 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.442405 28069 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.442782 28348 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.443387 28348 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.395830 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:34.345283 28264 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:34.384109 28216 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:34.384241 28229 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:34.292166 28345 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.409355 27870 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:34.411049 23258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 903) took 1619 ms (client timeout 1992 ms). Trace:
I20260709 13:09:34.412814 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:34.259614 28213 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.628s	user 0.018s	sys 0.000s
I20260709 13:09:34.441442 28344 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.397562 28167 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:34.446143 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:34.389997 28295 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.456794 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.469436 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:34.480309 22497 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:09:34.465396 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.074s
I20260709 13:09:34.467041 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:34.459473 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 63715.5us
W20260709 13:09:34.297202 28325 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.003s	user 0.013s	sys 0.000s
I20260709 13:09:34.466420 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.481241 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.483912 22503 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:34.485081 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.485968 23260 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:34.486593 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.477609 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:34.401628 28319 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.441324 28196 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.488162 22496 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:34.489189 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:34.489393 22503 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:34.509279 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:34.510846 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 78449.7us
I20260709 13:09:34.511489 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.511693 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:34.512414 22501 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:09:34.380487 28352 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:34.477268 23258 rpcz_store.cc:269] 0709 13:09:32.791970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.792847 (+   877us) service_pool.cc:224] Handling call
0709 13:09:34.410824 (+1617977us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54005fb9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:34.410988 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3481259264}
I20260709 13:09:34.474745 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:34.481878 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.010s	sys 0.075s
I20260709 13:09:34.502970 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:34.444710 28264 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:34.459268 28358 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:34.523082 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.522712 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.524056 22503 raft_consensus.cc:2410] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:09:34.512852 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:34.516728 22468 leader_election.cc:400] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:34.440431 28302 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:34.458493 28335 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.538307 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:34.518347 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 651154us
I20260709 13:09:34.471701 28152 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:34.487447 27870 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:34.520887 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 113658us
I20260709 13:09:34.543881 22572 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:34.515255 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.525025 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:34.519999 28368 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:34.400934 28270 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.516927 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.540827 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:34.548199 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.539497 22496 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:34.510128 28325 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:34.518446 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.483378 28057 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.544281 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:34.531752 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 48580.5us
I20260709 13:09:34.549249 22501 raft_consensus.cc:2410] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:34.550287 22503 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:34.520731 28031 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.512804 28321 raft_consensus.cc:2764] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:34.516270 28216 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:34.539757 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:34.552753 22504 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:09:34.538535 28382 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:34.421657 28366 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.565577 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:34.619078 23259 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:34.619729 22503 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.568099 28352 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:34.572463 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 59673.3us
W20260709 13:09:34.573541 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127467us
W20260709 13:09:34.573792 22649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2604) took 1784 ms (client timeout 2004 ms). Trace:
I20260709 13:09:34.538159 28360 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.592053 28069 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.566179 27999 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.586454 28375 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:34.587157 28344 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.588104 27836 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.645030 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.589031 28335 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:34.625505 28315 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:34.478008 28298 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.085s
W20260709 13:09:34.592262 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48102us
W20260709 13:09:34.609691 22543 connection.cc:256] RPC call timeout handler was delayed by -1.8818555739999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 13:09:34.542275 28250 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.554706 28364 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.511293 28319 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.594020 22496 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:34.546880 28368 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:34.612089 22500 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:34.526352 28163 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:34.515906 28196 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.542065 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:34.658699 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116696us
I20260709 13:09:34.645493 28341 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.611888 28370 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:34.626003 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:34.665840 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:34.627317 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 61906.8us
I20260709 13:09:34.477360 27887 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.590334 28274 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.625774 22649 rpcz_store.cc:269] 0709 13:09:32.789460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.792012 (+  2552us) service_pool.cc:224] Handling call
0709 13:09:34.573577 (+1781565us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400168854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:34.573720 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3686324608}
I20260709 13:09:34.612052 28165 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.547348 28359 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.073s
W20260709 13:09:34.637272 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 97621.1us
I20260709 13:09:34.641887 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:34.620360 28382 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.638530 28362 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.619504 28216 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:34.554507 28302 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.647429 22501 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:34.589192 27686 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:34.648604 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.694969 22502 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:34.696126 22502 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:34.633893 28360 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.650044 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:34.653571 28250 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:34.699188 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49231.6us
I20260709 13:09:34.635138 28348 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.577173 28167 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.663041 28031 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:34.641952 28322 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.566628 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:34.638310 28380 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:09:34.647567 28377 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:34.670130 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:34.673516 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:34.676519 22503 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:34.711022 28377 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.700644 28165 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:34.713790 28377 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.714144 28224 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.714944 28331 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:34.654062 28205 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.643252 27999 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.686697 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:34.751556 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64940.1us
W20260709 13:09:34.688064 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46292.3us
I20260709 13:09:34.662760 28289 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:34.691161 22574 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:34.693989 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:34.687433 28359 consensus_queue.cc:1243] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer fa2f181263f446a6962b649f9348c15f log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:09:34.709862 28167 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.661269 28163 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:34.716298 22572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2512) took 1834 ms (client timeout 1695 ms). Trace:
I20260709 13:09:34.680572 28341 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:34.772274 22572 rpcz_store.cc:269] 0709 13:09:32.881729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.882191 (+   462us) service_pool.cc:224] Handling call
0709 13:09:34.716096 (+1833905us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54003cb9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:34.716221 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3732955520}
W20260709 13:09:34.747905 28376 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:09:34.719434 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 152862us
I20260709 13:09:34.818964 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:34.720189 28195 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.720685 28165 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:09:34.729355 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.770669 28224 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:34.821297 28224 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:34.733027 28372 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:34.733489 28330 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:34.734376 28216 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:34.737879 28384 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:09:34.737543 22577 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:34.738408 28383 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.739176 28057 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:34.740664 28387 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:09:34.745544 28385 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:09:34.684454 28316 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:34.746979 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 76985.4us
I20260709 13:09:34.689366 27906 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:34.747830 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 76024.3us
I20260709 13:09:34.686522 28370 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:34.746891 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3000) took 1263 ms. Trace:
I20260709 13:09:34.687207 28382 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:34.752625 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:34.763556 22651 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:34.702030 28360 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.654264 28364 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.715621 28386 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:09:34.717445 28225 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:34.781931 27887 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.782940 28196 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:34.785813 28391 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:09:34.789667 28388 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:34.790629 28350 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:34.791326 28279 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:34.908340 28370 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.909211 28347 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:34.909456 28279 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:34.909765 22646 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:34.909847 28279 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:34.911201 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:34.794019 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.911834 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.910960 22650 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:34.914587 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:34.912418 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.915159 22650 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:34.915433 23259 raft_consensus.cc:2376] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16. Re-sending same reply.
I20260709 13:09:34.916244 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3653) took 1175 ms. Trace:
I20260709 13:09:34.916415 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.801011 23257 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:34.916615 22577 rpcz_store.cc:276] 0709 13:09:33.740904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.743292 (+  2388us) service_pool.cc:224] Handling call
0709 13:09:34.916072 (+1172780us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54003ca0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:34.916188 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2271514368}
I20260709 13:09:34.917519 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:34.917876 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 748) took 1117 ms. Trace:
I20260709 13:09:34.804064 28328 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.805930 28302 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.709039 27686 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:34.918162 23259 raft_consensus.cc:2368] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:34.805707 27870 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.920806 28328 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.921139 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:34.806466 28345 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.754273 28152 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:34.716298 28335 consensus_queue.cc:1175] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ca917eaada84bf38a5daae9f8ffa066" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 14 index: 13 } }
I20260709 13:09:34.806844 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:34.808359 28250 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.685038 28274 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.754841 28031 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.814147 27836 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.817293 28289 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:34.693411 28362 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.729703 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3620) took 2013 ms. Trace:
I20260709 13:09:34.822309 28288 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:34.823160 28163 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.824055 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:34.825337 28198 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:34.827773 28211 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:34.829922 28341 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.774230 28270 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:34.769675 28348 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.920323 27686 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.864959 28372 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:34.960996 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 137056us
I20260709 13:09:34.882586 28175 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.870208 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:34.871790 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.850021 28224 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:34.881330 22505 rpcz_store.cc:276] 0709 13:09:33.483543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.493991 (+ 10448us) service_pool.cc:224] Handling call
0709 13:09:33.494387 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.494677 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:33.500551 (+  5874us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.425328 (+924777us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b18003cc520. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:09:34.620437 (+195109us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.746421 (+125984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.746479 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:34.746543 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.746618 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.746738 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23848,"prepare.queue_time_us":227696,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":931676,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":20913,"spinlock_wait_cycles":16861056,"thread_start_us":301607,"threads_started":2,"wal-append.queue_time_us":241043}
I20260709 13:09:34.901423 28316 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:34.888417 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 135898us
I20260709 13:09:34.892495 28349 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:34.898209 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.898597 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:34.898316 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.902715 22649 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:34.909709 28347 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:34.905123 22648 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:34.986148 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.995436 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:34.996207 22649 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:34.902434 28380 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:34.910930 28279 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.791939 28377 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:34.899919 28225 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:34.918284 23257 rpcz_store.cc:276] 0709 13:09:33.800635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.800772 (+   137us) service_pool.cc:224] Handling call
0709 13:09:33.837972 (+ 37200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.917039 (+1079067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.917634 (+   595us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400837554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:34.917819 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213804288}
I20260709 13:09:34.912508 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:34.858964 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 186904us
I20260709 13:09:34.861207 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3001) took 1377 ms. Trace:
I20260709 13:09:34.967226 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:34.922646 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:34.969712 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 162928us
I20260709 13:09:34.965572 22499 rpcz_store.cc:276] 0709 13:09:32.717364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.717739 (+   375us) service_pool.cc:224] Handling call
0709 13:09:32.718147 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.718444 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:33.217788 (+499344us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.723405 (+1505617us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b180022cea0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec263150bf
0709 13:09:34.723580 (+   175us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.729281 (+  5701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.729343 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:34.729404 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.729491 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.729628 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":589087,"prepare.queue_time_us":781454,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":1339,"raft.queue_time_us":590506,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"spinlock_wait_cycles":45110656,"thread_start_us":1340161,"threads_started":3,"wal-append.queue_time_us":672868}
I20260709 13:09:34.887239 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:34.922560 27870 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:34.859447 28330 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:34.884845 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 184950us
I20260709 13:09:34.902768 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.981094 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.992470 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:34.981688 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:34.982046 22645 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:34.985168 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:34.996821 22651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 2981) took 3626 ms (client timeout 2103 ms). Trace:
I20260709 13:09:34.990108 23260 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:09:35.040746 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.989759 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:34.976351 28386 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:34.965497 28328 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:35.007628 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 302020us
W20260709 13:09:35.053200 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 166015us
I20260709 13:09:34.988664 28319 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:34.770154 28331 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:35.032665 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:35.060453 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:35.034829 22502 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:09:35.037235 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.864603 28383 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.024221 22498 rpcz_store.cc:276] 0709 13:09:33.483959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.593691 (+109732us) service_pool.cc:224] Handling call
0709 13:09:33.594066 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.594344 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:33.594692 (+   348us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.849882 (+1255190us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.850310 (+   428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.860717 (+ 10407us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:34.860812 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.860939 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.861121 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":582195,"prepare.queue_time_us":236948,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":6933,"raft.queue_time_us":582781,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":55131,"thread_start_us":672242,"threads_started":2,"wal-append.queue_time_us":362262}
I20260709 13:09:35.043545 22646 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:35.045641 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55963us
I20260709 13:09:35.046710 23255 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:35.041595 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:35.041846 28397 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:34.987251 27999 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:35.051074 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 83929.5us
I20260709 13:09:35.048360 23263 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:09:35.049240 22651 rpcz_store.cc:269] 0709 13:09:31.334975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.362305 (+ 27330us) service_pool.cc:224] Handling call
0709 13:09:34.961518 (+3599213us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b5400237b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:34.961688 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7070275328}
I20260709 13:09:34.967696 28198 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:35.189505 28198 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.191437 28198 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.980410 28211 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.058010 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:35.193949 23264 raft_consensus.cc:2410] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:35.064087 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:35.044687 22505 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:35.073702 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.074268 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.075017 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.072474 23256 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:09:35.078640 22618 leader_election.cc:400] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:35.082773 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:35.196818 22618 leader_election.cc:403] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:35.020161 28380 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.985239 27836 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:34.995869 28349 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:35.051520 28229 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:09:34.990202 28175 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:35.204636 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 140661us
I20260709 13:09:35.205282 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.205956 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:35.206913 23264 pending_rounds.cc:85] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 12
I20260709 13:09:35.207305 23264 pending_rounds.cc:107] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:09:35.207594 23264 raft_consensus.cc:2889] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.043226 28279 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.103384 28347 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.081815 28352 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:34.994576 28270 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:09:35.203778 28163 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:35.216360 27999 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:35.093922 28372 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.216789 27999 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.055895 28302 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:35.170750 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 95106.6us
I20260709 13:09:34.934353 28264 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:34.936563 28368 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.086773 22579 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:35.104362 28288 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:35.101662 28225 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.102633 28165 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:09:35.039613 28316 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:35.173842 22650 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:35.212735 28322 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:35.177480 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.091894 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:35.267706 23257 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:35.247381 28347 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.265735 28368 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:35.270965 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.250660 28196 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:35.198333 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.200524 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.275633 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.276443 22574 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:35.204298 23262 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 17 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:09:35.210177 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.171983 28152 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.213567 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.217710 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.283567 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.219377 22651 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:35.220237 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:35.220451 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:35.221062 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:35.198233 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 119792us
I20260709 13:09:35.217346 27999 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.286959 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:35.287096 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:35.287976 22651 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:35.288134 28167 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:35.288724 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:35.199481 27870 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.289827 28165 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:35.291086 28401 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:35.203930 28229 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13.
I20260709 13:09:35.291482 28401 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:35.291550 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.291690 28167 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:35.210110 28059 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:35.292954 28059 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.295895 28059 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:35.251583 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.297072 22579 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:35.298337 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.299086 22579 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:35.225440 28352 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.301334 28352 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:35.243428 28324 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.004s
I20260709 13:09:35.305387 28324 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.306936 22503 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:35.264633 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:34.985708 28289 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.265069 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:35.271942 22578 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:35.312793 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47806us
I20260709 13:09:35.313359 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.314790 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.315446 22578 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:35.221119 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:35.316708 22497 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:35.318035 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.244182 23263 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:35.319487 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.290524 27870 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.321043 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.321785 22578 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:35.322985 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.312037 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:35.325155 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.325836 28167 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:35.325191 22576 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:35.326732 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:35.326903 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:35.217463 28358 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:09:35.248904 28288 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.331456 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.366261 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.366935 22571 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:35.338114 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:35.343073 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:35.350932 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.352391 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:35.264083 28341 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:35.267421 28331 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.371817 22497 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:35.380211 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.384498 22578 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:35.381659 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.386080 22577 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:35.400900 22579 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:35.394408 22571 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:35.416184 22651 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:35.417244 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.419282 22579 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:35.328351 28225 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:35.322999 27870 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:35.424335 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.272317 28316 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.374091 28288 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:35.357393 28250 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:35.433907 23258 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:35.275470 28322 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.489483 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:35.490397 22505 raft_consensus.cc:2410] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:35.336202 28152 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:35.447901 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.382563 28274 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:35.266958 27906 consensus_queue.cc:1175] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ca917eaada84bf38a5daae9f8ffa066" responder_term: 13 status { last_received { term: 11 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:35.516806 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:35.328826 28196 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.527246 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:35.421690 28362 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.436169 28366 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:35.413244 28341 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.545933 28316 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.445048 28330 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:35.547010 28341 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.492724 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:09:35.494606 22498 raft_consensus.cc:2410] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:09:35.497762 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:35.551993 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54322.3us
I20260709 13:09:35.500949 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:35.553459 22504 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:35.503749 22500 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:35.530531 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:35.533195 28382 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.632s	user 0.001s	sys 0.009s
I20260709 13:09:35.493068 28059 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:35.564668 28059 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.566879 28059 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.567432 28059 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:35.567890 28059 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:35.499812 28165 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:35.541987 27836 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:35.534322 28360 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.627s	user 0.015s	sys 0.000s
I20260709 13:09:35.558022 22574 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:35.561669 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:35.529238 28324 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:35.576023 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:35.538482 27870 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:35.607164 22575 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:35.600580 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:35.619882 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.542047 28349 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:35.642665 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:35.668258 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:35.555158 28341 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:35.652797 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 449310us
W20260709 13:09:35.626212 28224 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.624s	user 0.005s	sys 0.005s
I20260709 13:09:35.537075 28377 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:09:35.573740 28380 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:35.569396 27686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.014s	sys 0.044s
I20260709 13:09:35.594781 28352 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:35.721252 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:35.597432 28163 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:35.589859 28370 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.627787 28330 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:35.618508 28196 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.718086 28341 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.596048 28322 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.776770 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:35.777603 23259 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:35.777765 28322 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:35.778280 28322 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.778561 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:35.780380 28322 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.655701 27926 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:35.740314 22572 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
W20260709 13:09:35.753511 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 381317us
I20260709 13:09:35.573061 28382 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.632560 28360 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.710357 27870 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:35.589587 28324 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.130s
W20260709 13:09:35.721318 27686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.015s	sys 0.045s
I20260709 13:09:35.772928 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:35.773614 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:35.616844 28152 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:35.755367 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:35.781210 28404 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:09:35.781538 28402 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 13:09:35.786473 28175 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:35.788976 28399 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.577s	user 0.001s	sys 0.000s
I20260709 13:09:35.789849 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1168) took 1032 ms. Trace:
I20260709 13:09:35.780819 27999 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.710625 28224 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:35.798017 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 508364us
I20260709 13:09:35.771591 28330 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.840996 23227 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:35.816947 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:35.568734 28059 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.771219 28225 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:09:35.818866 28211 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.004s
W20260709 13:09:35.829500 22653 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.021s	sys 0.001s
I20260709 13:09:35.829730 22571 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:09:35.846339 22653 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.021s	sys 0.001s
I20260709 13:09:35.811677 28312 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:35.831189 22573 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:35.831125 22503 rpcz_store.cc:276] 0709 13:09:34.757096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.757275 (+   179us) service_pool.cc:224] Handling call
0709 13:09:34.757597 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.307426 (+549829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.789510 (+482084us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540033e5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:35.789783 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262792448}
I20260709 13:09:35.717713 28349 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:35.832055 27870 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:35.768527 28370 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.857285 28370 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.843660 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:35.835095 28293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.014s	sys 0.005s
W20260709 13:09:35.828940 28393 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.015s
W20260709 13:09:35.858174 28293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.015s	sys 0.005s
W20260709 13:09:35.858389 28393 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.002s	sys 0.016s
W20260709 13:09:35.859624 22654 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.019s
W20260709 13:09:35.860042 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 952) took 1481 ms (client timeout 1894 ms). Trace:
W20260709 13:09:35.844745 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 492464us
W20260709 13:09:35.860170 22654 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.005s	sys 0.019s
W20260709 13:09:35.860455 22576 rpcz_store.cc:269] 0709 13:09:34.378430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.378577 (+   147us) service_pool.cc:224] Handling call
0709 13:09:35.859865 (+1481288us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54003f5554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:35.859983 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099904768}
I20260709 13:09:35.842475 28366 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:35.872974 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:35.875669 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.847713 28163 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:35.881809 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:35.888726 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.889681 22576 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:35.851542 28225 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:35.850525 22648 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:35.826399 28324 consensus_queue.cc:1243] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:35.821837 28319 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
W20260709 13:09:35.899350 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.838034 22650 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:35.896245 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:35.857630 28364 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:35.870389 28421 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.933372 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:35.915639 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.847340 28211 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.870414 27906 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.920692 22503 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:35.966459 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:35.853390 28312 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:35.881675 28163 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:35.937592 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 269436us
W20260709 13:09:35.942551 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 383370us
I20260709 13:09:35.984587 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2991) took 1080 ms. Trace:
I20260709 13:09:35.921780 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3001) took 1013 ms. Trace:
W20260709 13:09:35.970163 28288 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.003s
I20260709 13:09:35.988094 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:35.932600 28380 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:35.989235 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:35.990118 28302 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:35.990584 28302 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.990772 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:35.991050 28302 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:35.971077 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:35.993783 22653 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:35.994946 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:35.917815 27686 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.997153 28270 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:35.997390 27836 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:35.997942 28270 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:35.998138 27836 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:35.999276 28270 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.999356 27836 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.974975 22578 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 9: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:35.986861 22649 rpcz_store.cc:276] 0709 13:09:34.970662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.997138 (+ 26476us) service_pool.cc:224] Handling call
0709 13:09:35.005753 (+  8615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.022169 (+ 16416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.022199 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.022840 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.449105 (+426265us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:35.898962 (+449857us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.921359 (+ 22397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.921460 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.921521 (+    61us) raft_consensus.cc:1685] finished
0709 13:09:35.921541 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.921712 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16561,"prepare.queue_time_us":336678,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":32871,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11841,"thread_start_us":840610,"threads_started":2,"wal-append.queue_time_us":728868}
I20260709 13:09:35.970749 28352 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:35.987782 28288 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:35.985601 22654 rpcz_store.cc:276] 0709 13:09:34.903647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.903774 (+   127us) service_pool.cc:224] Handling call
0709 13:09:34.914108 (+ 10334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.914451 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.914477 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.914857 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.223793 (+308936us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:35.861479 (+637686us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.983868 (+122389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.984065 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.984146 (+    81us) raft_consensus.cc:1685] finished
0709 13:09:35.984159 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.984417 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38411,"prepare.queue_time_us":560999,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":40478,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":19976,"thread_start_us":1008590,"threads_started":3,"wal-append.queue_time_us":543331}
I20260709 13:09:35.975589 22576 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:36.013242 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.013743 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:35.996491 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.010541 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:35.982594 28198 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.001s
I20260709 13:09:36.018147 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.013916 22654 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:09:35.894989 28422 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:36.018839 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.011445 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.016513 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.021627 22573 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:35.970799 28360 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.028465 22580 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:09:36.009406 28250 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.004526 28211 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.004976 28163 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.033936 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.036648 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.051275 22575 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:36.051764 22649 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:36.051229 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:36.024111 23261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.032s
I20260709 13:09:36.037781 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:36.053480 23261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.010s	sys 0.032s
I20260709 13:09:36.006075 28341 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.056175 22654 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:35.973007 27906 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.051815 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2995) took 1145 ms. Trace:
I20260709 13:09:36.061120 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.062580 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.063230 22654 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:36.028339 28293 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:35.981889 27870 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.031738 28225 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.063403 27976 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:36.075874 22653 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:36.036165 28422 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:35.997201 27686 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.081702 22575 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:36.093196 22576 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:36.064199 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.094866 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.095757 22654 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:36.090577 28352 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.091073 28386 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:36.091652 27906 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.100594 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:36.102770 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45130us
I20260709 13:09:36.066905 27999 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.124325 28359 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:36.124794 28359 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:36.099025 28293 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.125519 22575 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:36.125748 28359 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.126748 28359 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:36.127256 28293 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.127698 22575 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:36.101511 28386 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.111475 28352 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.129338 28386 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.131016 28352 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.133822 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.134528 22504 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
W20260709 13:09:36.073747 28428 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:09:36.060657 28382 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.110400 22650 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 9.
I20260709 13:09:36.110813 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1165) took 1443 ms. Trace:
W20260709 13:09:36.100260 28368 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.830s	user 0.004s	sys 0.009s
I20260709 13:09:36.138499 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.140754 22496 rpcz_store.cc:276] 0709 13:09:34.667742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.679347 (+ 11605us) service_pool.cc:224] Handling call
0709 13:09:34.679789 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.997802 (+318013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.997860 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.008190 (+ 10330us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.366652 (+358462us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:35.366695 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.088722 (+722027us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400411754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:36.088774 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.088830 (+    56us) raft_consensus.cc:1685] finished
0709 13:09:36.088849 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.110722 (+ 21873us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3542,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":17725,"spinlock_wait_cycles":730380672,"thread_start_us":324454,"threads_started":1,"wal-append.queue_time_us":665418}
I20260709 13:09:36.147512 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.104729 22577 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:09:36.148758 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 307886us
I20260709 13:09:36.150110 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.093981 28288 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:36.069305 28330 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.084022 28312 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:36.140163 28405 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:36.156013 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.156718 22649 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:36.157760 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:36.170429 23259 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:36.159121 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.148965 28289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.008s	sys 0.012s
I20260709 13:09:36.154461 28421 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:36.101327 28349 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:36.152818 28352 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.184310 28422 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.112190 28302 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.156136 28437 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.197619 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:36.199842 27686 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.201691 28302 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.201931 28264 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.206017 28165 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.207441 28250 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:36.189061 28289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.009s	sys 0.013s
I20260709 13:09:36.190915 28421 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:36.230886 28165 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.237823 28421 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.197451 28349 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.197856 28352 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.255782 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 955) took 1046 ms. Trace:
W20260709 13:09:36.259262 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61727.9us
I20260709 13:09:36.256261 22573 rpcz_store.cc:276] 0709 13:09:35.209681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.032621 (+822940us) service_pool.cc:224] Handling call
0709 13:09:36.033089 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:36.035918 (+  2829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.035949 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.036575 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 13:09:36.208124 (+171549us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:36.208166 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.208238 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.255496 (+ 47258us) raft_consensus.cc:1685] finished
0709 13:09:36.255516 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.255714 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2302,"raft.queue_time_us":2707,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10069,"thread_start_us":135482,"threads_started":1,"wal-append.queue_time_us":180798}
I20260709 13:09:36.263403 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.267933 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.270454 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.278049 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.260324 28152 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:36.296625 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:36.298704 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 123661us
I20260709 13:09:36.300977 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:36.270428 28059 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:36.303870 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.304629 22574 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:36.312134 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.313210 22504 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:36.314154 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.313999 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.315162 22650 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:36.316007 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:36.316586 22504 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.314316 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.318379 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:36.320264 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.315003 22505 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:36.325781 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:36.326735 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48813.2us
I20260709 13:09:36.272531 28437 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.283943 28316 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.342965 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.336076 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.327021 22503 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:36.322587 22504 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:09:36.328475 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.343638 22497 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:36.328725 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.316329 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.280328 28302 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:36.301332 28152 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.349502 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:36.311304 28059 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:36.347759 22505 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:36.356775 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:36.357331 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.348049 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.358819 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.358846 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.360215 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:36.356696 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.360826 22504 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.363596 28417 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:36.364159 28417 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.364524 28417 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.354398 28368 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.365958 28368 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.327337 28274 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:36.367693 28274 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.384667 23256 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:36.386037 22649 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:36.373634 28352 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:36.376313 28442 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:36.364714 28330 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:36.347518 28316 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.381008 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 863) took 1455 ms. Trace:
I20260709 13:09:36.374662 28417 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:36.386565 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 50608.6us
I20260709 13:09:36.396299 23262 rpcz_store.cc:276] 0709 13:09:34.914346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.985894 (+ 71548us) service_pool.cc:224] Handling call
0709 13:09:36.369965 (+1384071us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54008359d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:36.370199 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471411072}
I20260709 13:09:36.395272 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.333905 28322 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:36.418927 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60238.3us
I20260709 13:09:36.420352 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.425244 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.426106 22650 raft_consensus.cc:2376] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19. Re-sending same reply.
I20260709 13:09:36.424706 22504 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
W20260709 13:09:36.432132 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.435006 22497 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:36.383170 28368 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.355389 28437 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:36.354736 27686 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.465502 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 70405.9us
I20260709 13:09:36.365972 28302 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:36.393756 28059 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.355172 28152 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:36.471779 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51501.7us
I20260709 13:09:36.494742 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.393713 28445 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.417070 28289 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:36.472378 28288 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:36.428236 28322 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:36.477802 28274 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.479400 28316 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.479629 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:36.480345 28454 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:09:36.380609 28165 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.515547 28165 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.486541 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.466506 28211 raft_consensus.cc:2764] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:36.414563 28360 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:09:36.516390 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:36.516978 28224 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:36.417243 28382 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:09:36.491412 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 134878us
I20260709 13:09:36.465360 28446 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.471446 28447 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.495330 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.526548 28447 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.527451 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.498564 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:36.500424 28448 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:09:36.500587 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.502030 28383 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:36.497808 27887 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.497756 28322 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:36.497044 28289 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.493316 28302 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:36.516535 22650 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:36.542171 28031 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.542415 28302 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:36.542776 28031 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.543181 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.544324 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.529565 28224 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.545450 22650 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:36.546394 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.546962 22650 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:36.547806 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.548369 22650 raft_consensus.cc:2376] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15. Re-sending same reply.
I20260709 13:09:36.396169 28319 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:09:36.519527 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2988) took 1618 ms. Trace:
I20260709 13:09:36.528174 28163 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.549204 22645 rpcz_store.cc:276] 0709 13:09:34.901239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.901438 (+   199us) service_pool.cc:224] Handling call
0709 13:09:34.901802 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.047379 (+145577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.519238 (+1471859us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b54002bff54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:36.519448 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183692544}
I20260709 13:09:36.550422 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.550928 28163 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.551263 28319 consensus_queue.cc:1243] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:36.551681 28163 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:36.552646 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.554536 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.555222 28360 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:36.555397 28382 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.555825 28360 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:36.556134 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2519) took 1483 ms. Trace:
I20260709 13:09:36.556746 28360 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.520758 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.533035 22574 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:36.536430 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:36.539016 28466 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:36.550995 22645 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
W20260709 13:09:36.559895 28403 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.136s	user 0.001s	sys 0.001s
I20260709 13:09:36.559898 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.562088 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2626) took 1202 ms. Trace:
I20260709 13:09:36.562510 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:36.562451 22647 rpcz_store.cc:276] 0709 13:09:35.360188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.933023 (+572835us) service_pool.cc:224] Handling call
0709 13:09:36.561911 (+628888us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400325d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:36.562035 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238276992}
I20260709 13:09:36.563022 27887 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:36.563704 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.564446 28316 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:36.530488 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:36.564927 28316 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:36.565387 28316 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.565557 23257 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:36.566380 28289 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.567176 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3661) took 1364 ms. Trace:
I20260709 13:09:36.567541 22571 rpcz_store.cc:276] 0709 13:09:35.202831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.425909 (+223078us) service_pool.cc:224] Handling call
0709 13:09:35.426336 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.846584 (+420248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.566925 (+720341us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003cafd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:36.567113 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927012224}
I20260709 13:09:36.565069 28211 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:36.529131 28352 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:09:36.564591 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 43916.5us
I20260709 13:09:36.529628 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:36.569360 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 2998) took 1661 ms. Trace:
I20260709 13:09:36.570953 22648 rpcz_store.cc:276] 0709 13:09:34.907497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.996229 (+ 88732us) service_pool.cc:224] Handling call
0709 13:09:34.996500 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.895715 (+899215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.569139 (+673424us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002da0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:36.569308 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963604224}
I20260709 13:09:36.572034 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.572873 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.573798 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.552810 28163 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:36.556519 22572 rpcz_store.cc:276] 0709 13:09:35.072956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.073369 (+   413us) service_pool.cc:224] Handling call
0709 13:09:36.555951 (+1482582us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54000e6354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:36.556080 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229278464}
I20260709 13:09:36.570277 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.574373 22500 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:36.576855 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.577142 22647 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:36.578341 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1169) took 1752 ms. Trace:
I20260709 13:09:36.579470 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:36.578811 22501 rpcz_store.cc:276] 0709 13:09:34.825909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.826109 (+   200us) service_pool.cc:224] Handling call
0709 13:09:34.826509 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.826954 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.826994 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.827662 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.031456 (+203794us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:35.031516 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.031618 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.559380 (+1527762us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:36.570504 (+ 11124us) raft_consensus.cc:1685] finished
0709 13:09:36.570524 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.578272 (+  7748us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":458,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":17911040,"thread_start_us":203276,"threads_started":1,"wal-append.queue_time_us":445669}
I20260709 13:09:36.582423 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.584630 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:36.588217 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.593537 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:36.593747 22647 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.529623 28417 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.557037 28059 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.528846 28447 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:36.578058 28274 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:36.565584 27926 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.499480 27686 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.529433 28421 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.601104 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 858) took 1688 ms. Trace:
I20260709 13:09:36.596150 28335 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:36.578811 28264 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:36.599203 28449 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.601263 28382 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.599030 28464 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:09:36.577973 28422 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:09:36.641443 28382 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.588830 28211 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:09:36.599711 28224 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:09:36.646806 28279 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:36.647203 28279 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:36.586052 28446 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.648036 28279 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.649770 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:36.615527 28274 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:36.589257 28319 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.548054 28386 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.569401 28352 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:36.613283 28163 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.604471 27836 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:36.601811 27887 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:36.601370 28437 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.634898 22647 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:36.625181 23261 rpcz_store.cc:276] 0709 13:09:34.912985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.052841 (+139856us) service_pool.cc:224] Handling call
0709 13:09:35.181760 (+128919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.193508 (+ 11748us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:35.436765 (+243257us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.054264 (+617499us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.058634 (+  4370us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.059149 (+   515us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:36.059204 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.059311 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.252707 (+193396us) raft_consensus.cc:1685] finished
0709 13:09:36.252732 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.600879 (+348147us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400813650. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:36.601032 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11330,"prepare.queue_time_us":250609,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":17008,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":16797,"spinlock_wait_cycles":295584000,"thread_start_us":795880,"threads_started":2,"wal-append.queue_time_us":788792}
W20260709 13:09:36.638402 28419 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.704s	user 0.004s	sys 0.000s
I20260709 13:09:36.600459 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:36.624197 27926 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.649529 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:36.649573 28279 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:36.657258 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:36.658262 23262 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:36.598946 28225 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:09:36.627900 28335 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.669425 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:36.648617 28446 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.669433 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:36.692986 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.707881 22544 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.630108 28264 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.697239 23259 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:36.694924 27887 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:36.651937 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:36.697882 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 97498.8us
I20260709 13:09:36.716895 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:36.699810 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.718176 22647 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:36.661110 28274 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.660303 28165 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:36.706629 23257 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:36.676206 27836 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.729220 27836 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.716374 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.730247 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.705327 28417 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:36.724612 28437 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:36.662250 28057 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:09:36.730907 22647 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:36.731352 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:36.723963 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:36.737139 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.662029 28319 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.705942 28335 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.713644 28163 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.737705 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:36.772626 22647 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:36.784106 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.782745 28315 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:36.784973 28315 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.785492 28315 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:36.782584 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44974.5us
I20260709 13:09:36.716650 28264 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.786631 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3002) took 1815 ms. Trace:
I20260709 13:09:36.719816 28359 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:36.720072 28382 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.790406 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:36.719616 27887 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.735852 28368 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:36.737627 28417 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.762420 27686 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.746562 27906 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:09:36.759910 28152 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.746420 28463 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:36.777000 28316 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.836376 28322 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.837297 27976 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.837812 27976 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.838760 28322 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.840111 28463 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:36.841075 28463 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:36.818799 28312 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:36.846275 27976 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.804157 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.745942 28165 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:36.735970 28437 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:36.807576 28417 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:36.805634 28360 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:36.787058 22646 rpcz_store.cc:276] 0709 13:09:34.971072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.084715 (+113643us) service_pool.cc:224] Handling call
0709 13:09:35.171884 (+ 87169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.172233 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.172261 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.180807 (+  8546us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.642419 (+461612us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:35.642466 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.642554 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.637669 (+995115us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:36.775245 (+137576us) raft_consensus.cc:1685] finished
0709 13:09:36.775275 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.786554 (+ 11279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6778,"raft.queue_time_us":5426,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":17624,"spinlock_wait_cycles":44299136,"thread_start_us":378562,"threads_started":1,"wal-append.queue_time_us":624274}
I20260709 13:09:36.760978 28352 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:09:36.851438 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 123802us
I20260709 13:09:36.853783 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.818621 28270 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:36.865188 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:36.803001 28445 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.816431 28289 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:36.871191 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 139886us
I20260709 13:09:36.849336 28059 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.870671 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:36.838792 28316 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:36.871713 22572 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:36.878373 22650 raft_consensus.cc:2368] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14.
I20260709 13:09:36.873945 22646 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
W20260709 13:09:36.879297 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 218887us
I20260709 13:09:36.881556 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:36.855525 28437 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:36.882329 23258 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:36.874775 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.859157 28360 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:36.883635 22571 raft_consensus.cc:2410] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:09:36.872251 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:36.860746 28319 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:36.891943 22645 raft_consensus.cc:2368] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16.
W20260709 13:09:36.887753 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 220259us
I20260709 13:09:36.893319 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:36.893982 22646 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.894273 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.895864 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.896560 22571 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:36.896608 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.898105 22572 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:09:36.898553 22572 pending_rounds.cc:85] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 11
I20260709 13:09:36.898861 22572 pending_rounds.cc:107] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:09:36.899151 22572 raft_consensus.cc:2889] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.899852 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.901780 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:36.902657 22575 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.903322 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:36.904160 22571 raft_consensus.cc:2376] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13. Re-sending same reply.
I20260709 13:09:36.912389 23257 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:36.914971 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:36.916029 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:36.916625 22573 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.825129 28401 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.889446 28360 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.922698 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:36.921120 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.924600 22579 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:36.926610 22577 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.929669 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:36.930053 23259 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:36.930382 23263 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:36.894011 28368 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:36.937207 22653 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
W20260709 13:09:36.948963 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 123014us
I20260709 13:09:36.951431 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:36.922809 28319 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:36.952644 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.955732 22571 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:36.888909 28175 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:09:36.961630 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:36.961042 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.939559 28368 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.964818 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:36.966679 22579 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:36.957362 28401 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.949725 28386 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:36.949205 28097 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:36.978616 22617 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:36.918678 28165 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:36.968757 28368 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:36.950327 27999 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:36.973649 28288 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:36.989877 28471 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:37.018589 28349 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:36.953540 28443 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:09:36.964329 28476 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:09:36.982875 28097 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.998697 22577 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:36.972993 27976 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.016126 27999 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:37.016616 28470 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:09:37.013734 28288 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:36.990500 28472 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:09:37.019474 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 864) took 2040 ms. Trace:
I20260709 13:09:37.046489 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1130) took 1826 ms. Trace:
I20260709 13:09:37.047115 22651 rpcz_store.cc:276] 0709 13:09:35.220100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.340916 (+120816us) service_pool.cc:224] Handling call
0709 13:09:35.341336 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.416739 (+ 75403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.046262 (+1629523us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b5400411c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:37.046438 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171607808}
I20260709 13:09:37.048772 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:37.002305 22579 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:09:37.023612 22573 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:37.024595 28152 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:36.969075 28302 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.031265 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:37.031594 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:37.056493 22577 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:37.034013 23259 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:36.987533 28319 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.040179 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:37.042132 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:37.061103 22575 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:37.032512 28097 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:37.046279 23264 rpcz_store.cc:276] 0709 13:09:34.979014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.206227 (+227213us) service_pool.cc:224] Handling call
0709 13:09:35.206641 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:35.214960 (+  8319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.215006 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.565756 (+1350750us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b2c000129d8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:09:36.566256 (+   500us) log.cc:844] Serialized 52 byte log entry
0709 13:09:36.799342 (+233086us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:36.816957 (+ 17615us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.817208 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.817294 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.019143 (+201849us) raft_consensus.cc:1685] finished
0709 13:09:37.019258 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.019403 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6721,"prepare.queue_time_us":19759,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":1720,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":31392,"spinlock_wait_cycles":14710016,"thread_start_us":232675,"threads_started":1,"wal-append.queue_time_us":301731}
I20260709 13:09:37.057366 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:37.058290 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:37.000805 28264 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.036934 27999 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:37.086050 27999 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.087347 27999 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.089814 28477 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:37.090412 28477 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:37.091398 28477 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.048342 28289 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.094219 28302 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.095148 22648 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:37.095541 28152 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:37.096117 28152 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:37.059437 28274 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.097013 28152 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.098248 28264 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:37.098995 28274 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.099691 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.102123 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:37.070899 22499 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:37.105775 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.064275 28422 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:37.053056 28225 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:37.063462 28293 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:37.046985 28288 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.078889 28059 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:37.079851 28316 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:37.080732 28482 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:37.083745 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 910) took 2026 ms. Trace:
I20260709 13:09:37.108259 22575 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:37.010900 28335 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.004823 27887 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.112759 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:37.066445 28165 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.027827 28315 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.130821 28316 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:37.131064 28485 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:09:37.141345 23256 rpcz_store.cc:276] 0709 13:09:35.056948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.209261 (+152313us) service_pool.cc:224] Handling call
0709 13:09:36.384260 (+1174999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.385826 (+  1566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.083511 (+697685us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54008359d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.083668 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2701390208}
I20260709 13:09:37.145740 22577 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:37.145728 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:37.147459 22646 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:09:37.149897 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3670) took 1719 ms (client timeout 1540 ms). Trace:
W20260709 13:09:37.179024 22578 rpcz_store.cc:269] 0709 13:09:35.430620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.619569 (+188949us) service_pool.cc:224] Handling call
0709 13:09:37.149701 (+1530132us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54001e5ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.149830 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677396864}
I20260709 13:09:37.151480 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:37.152357 22504 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.181341 22496 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:37.154255 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1131) took 1933 ms. Trace:
I20260709 13:09:37.182396 22654 rpcz_store.cc:276] 0709 13:09:35.220349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.104697 (+884348us) service_pool.cc:224] Handling call
0709 13:09:36.144350 (+ 39653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.144595 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.144633 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.144693 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:36.144739 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.144811 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.154075 (+1009264us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b5400235d50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.154197 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45263616}
I20260709 13:09:37.184085 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:37.155725 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.161530 22499 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
W20260709 13:09:37.163086 22543 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.103s (SENT)
I20260709 13:09:37.185374 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:37.168160 22501 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:37.169829 22647 raft_consensus.cc:2410] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:37.170917 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:37.187379 22500 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:37.188453 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:37.188943 22577 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:37.189414 22650 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:37.190305 22651 raft_consensus.cc:2368] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:37.190246 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:37.191883 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:37.193418 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.194096 22654 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:36.059710 22652 rpcz_store.cc:276] 0709 13:09:34.906391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.906556 (+   165us) service_pool.cc:224] Handling call
0709 13:09:34.907006 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:34.912824 (+  5818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.912877 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:34.913429 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:09:35.279119 (+365690us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:35.848739 (+569620us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.047120 (+198381us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.051087 (+  3967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.051374 (+   287us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.051446 (+    72us) raft_consensus.cc:1685] finished
0709 13:09:36.051487 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.051725 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120977,"prepare.queue_time_us":507051,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":167137,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":5663,"thread_start_us":952109,"threads_started":3,"wal-append.queue_time_us":640498}
I20260709 13:09:37.195535 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.142320 28293 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:37.151899 28443 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.206516 22577 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:37.165802 28313 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:37.172712 28330 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:37.121498 28422 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.166467 28316 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:37.188058 28163 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:37.125903 28225 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.139465 27836 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.224200 22500 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:37.222440 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:37.200618 28482 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:37.204468 28175 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:37.157737 27926 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.218290 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:37.218699 28487 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:09:37.172300 28165 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.214900 28313 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:37.247076 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.248113 22648 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:37.218097 28330 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:37.264195 22502 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:37.235378 28274 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:37.202790 28360 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.187994 28437 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.242851 28335 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.270601 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.251545 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.252215 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:37.275763 22498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3646) took 2055 ms (client timeout 1914 ms). Trace:
I20260709 13:09:37.240697 28163 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:37.225133 28349 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:09:37.280365 22498 rpcz_store.cc:269] 0709 13:09:35.220349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.220729 (+   380us) service_pool.cc:224] Handling call
0709 13:09:37.263809 (+2043080us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54001a9854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.275653 (+ 11844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399501184}
I20260709 13:09:37.243328 28175 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:37.285036 28302 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:37.285621 28302 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:37.272933 28487 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:37.291232 22650 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:37.295403 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:37.295333 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:37.261117 28417 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.301497 28490 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:37.302388 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.293875 28330 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.317797 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:37.310595 28175 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.310993 28313 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.283828 28274 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:37.310690 28489 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:37.454093 28422 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:37.449549 28386 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.459326 28386 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.319188 28436 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.461565 28386 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.461918 27836 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:37.457075 28495 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:09:37.321748 28335 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:37.457075 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:37.464910 22577 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:37.465364 28315 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.457329 28313 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.278695 28316 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.453033 28165 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.449245 28449 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.469579 28316 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:37.459654 27887 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.471381 28421 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:37.425781 22543 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.385s (SENT) [suppressed 13 similar messages]
W20260709 13:09:37.472335 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46595.7us
I20260709 13:09:37.289647 28293 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.456514 28288 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.478057 28437 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.318372 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.481340 22648 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:37.482363 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:37.498827 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:37.500631 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:37.504671 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:37.505359 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:37.507143 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:37.507936 22500 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:37.505491 22503 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:37.513695 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:37.517222 22503 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:09:37.517719 22503 pending_rounds.cc:85] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 9
I20260709 13:09:37.518020 22503 pending_rounds.cc:107] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:09:37.518347 22503 raft_consensus.cc:2889] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:37.520079 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:37.525908 22498 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:37.528971 22500 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:37.530227 22650 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:37.530570 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:37.534364 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:37.534993 22578 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:37.457453 28492 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:09:37.543855 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3020) took 1209 ms. Trace:
I20260709 13:09:37.545536 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:37.545469 22650 rpcz_store.cc:276] 0709 13:09:36.333996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.451916 (+1117920us) service_pool.cc:224] Handling call
0709 13:09:37.530032 (+ 78116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.532008 (+  1976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.543772 (+ 11764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:37.548260 22505 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:09:37.542829 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92420.8us
I20260709 13:09:37.457937 27926 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:37.537614 28488 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:09:37.562496 22654 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:09:37.568830 22578 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:37.576012 22654 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:09:37.538075 28330 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:37.532302 28382 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:37.537833 28288 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:37.587028 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3023) took 1016 ms. Trace:
I20260709 13:09:37.595036 22654 rpcz_store.cc:276] 0709 13:09:36.570513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.575220 (+1004707us) service_pool.cc:224] Handling call
0709 13:09:37.575669 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.576584 (+   915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.586358 (+  9774us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:37.586984 28368 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:09:37.457904 28274 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:37.599637 28491 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:09:37.545873 28163 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.599032 28195 raft_consensus.cc:2764] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:09:37.548854 28302 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.601629 28225 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.602663 28368 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.590970 28382 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:37.617358 28496 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:09:37.318562 28487 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.460394 28436 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.469774 28449 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.627777 28436 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.218855 28443 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.621914 28498 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:37.627817 28487 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.646384 28382 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.649055 28449 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.656005 28368 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.640334 28498 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.659479 28443 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.637197 28417 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.659485 28498 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:37.715030 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.718864 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.720791 28487 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:37.721704 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 191032us
I20260709 13:09:37.722522 28487 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.726838 28487 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:37.637450 28097 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.004s
I20260709 13:09:37.731343 28097 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.731921 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:37.756830 28368 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.758267 28368 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.760277 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:37.819041 23258 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:37.819386 28417 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:37.820078 28417 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:37.826315 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66413.3us
I20260709 13:09:37.833274 28498 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:37.834072 28498 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:37.835671 28498 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:37.841739 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 124899us
I20260709 13:09:37.845333 28330 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:37.846403 28330 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.847575 28097 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:37.814002 28368 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.854151 28506 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:37.862332 28464 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:37.864372 28464 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:37.872661 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:37.873770 22573 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:37.874850 28288 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:37.875571 28288 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:37.876050 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.876578 28417 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.878166 22578 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:37.878513 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3012) took 1547 ms. Trace:
I20260709 13:09:37.879000 22647 rpcz_store.cc:276] 0709 13:09:36.331399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.803381 (+471982us) service_pool.cc:224] Handling call
0709 13:09:37.878026 (+1074645us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54002f8854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.878305 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736191872}
I20260709 13:09:37.880100 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:37.881065 22577 raft_consensus.cc:606] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:37.890458 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3008) took 1564 ms. Trace:
I20260709 13:09:37.890590 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.880775 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.864813 28464 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:37.894716 28349 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:09:37.891108 22645 rpcz_store.cc:276] 0709 13:09:36.326075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.559642 (+233567us) service_pool.cc:224] Handling call
0709 13:09:37.874244 (+1314602us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400298bd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.890226 (+ 15982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759704960}
I20260709 13:09:37.907560 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3021) took 1337 ms. Trace:
I20260709 13:09:37.909330 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:37.891482 28288 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:37.913900 22653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3009) took 1583 ms (client timeout 1801 ms). Trace:
W20260709 13:09:37.914522 22653 rpcz_store.cc:269] 0709 13:09:36.330431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.500289 (+169858us) service_pool.cc:224] Handling call
0709 13:09:37.913421 (+1413132us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400395154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.913637 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801458048}
I20260709 13:09:37.915895 28436 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.916715 28436 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.917156 28490 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:37.917919 28490 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:37.919415 28436 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:37.923105 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3659) took 2720 ms (client timeout 2029 ms). Trace:
W20260709 13:09:37.923849 22580 rpcz_store.cc:269] 0709 13:09:35.202233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.204973 (+  2740us) service_pool.cc:224] Handling call
0709 13:09:37.922485 (+2717512us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54003cc8d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.922804 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890343168}
I20260709 13:09:37.925889 28324 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:37.926313 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2642) took 1049 ms. Trace:
I20260709 13:09:37.926816 28324 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.926971 22651 rpcz_store.cc:276] 0709 13:09:36.876470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.048403 (+171933us) service_pool.cc:224] Handling call
0709 13:09:37.925701 (+877298us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001c84d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.926060 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322441088}
I20260709 13:09:37.930040 28324 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.931102 28490 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.926821 28464 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.932726 28464 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:37.933450 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.935158 28031 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:37.935276 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:37.936200 28494 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.657s	user 0.002s	sys 0.000s
I20260709 13:09:37.936422 22645 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:37.899981 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:37.938587 22653 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:37.941336 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:37.948335 22580 raft_consensus.cc:606] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:37.943459 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2641) took 1067 ms. Trace:
I20260709 13:09:37.949702 22580 raft_consensus.cc:614] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:37.950327 22653 rpcz_store.cc:276] 0709 13:09:36.876286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.915924 (+1039638us) service_pool.cc:224] Handling call
0709 13:09:37.916510 (+   586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.943137 (+ 26627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.943366 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:37.944909 22647 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:37.954711 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97840.2us
I20260709 13:09:37.957307 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:37.960340 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3017) took 2472 ms. Trace:
I20260709 13:09:37.908147 22648 rpcz_store.cc:276] 0709 13:09:36.570003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.544389 (+974386us) service_pool.cc:224] Handling call
0709 13:09:37.583794 (+ 39405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.584286 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.584334 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.585000 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.863326 (+278326us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:37.863985 (+   659us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.864257 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.864424 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.907054 (+ 42630us) raft_consensus.cc:1685] finished
0709 13:09:37.907080 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.907344 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":891,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":2373,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":40681,"thread_start_us":214088,"threads_started":1,"wal-append.queue_time_us":261881}
I20260709 13:09:37.955359 28195 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:37.965620 22502 rpcz_store.cc:276] 0709 13:09:35.488006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.489172 (+  1166us) service_pool.cc:224] Handling call
0709 13:09:37.264000 (+1774828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.264759 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.959837 (+695078us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54001a9850. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:37.960105 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4001374976}
I20260709 13:09:37.975050 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:37.969565 28330 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:37.983752 22648 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:09:37.968626 27836 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.987010 22645 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:37.986815 27836 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:37.994554 27836 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:37.998060 22543 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:37.998731 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.08135e+06us
I20260709 13:09:38.000037 28498 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:38.000604 28498 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.001071 28498 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.001986 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:38.003726 28316 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.014s
I20260709 13:09:38.013000 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:38.022368 22653 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 21. Current term is 22. Ops: [19.14-21.15]
W20260709 13:09:38.004612 22619 connection.cc:256] RPC call timeout handler was delayed by -1.0606307479999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:09:38.016705 22648 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:38.064129 22502 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:38.047749 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 112902us
I20260709 13:09:38.063413 22647 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:38.009050 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:38.010063 22646 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:38.065131 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1136) took 1006 ms. Trace:
I20260709 13:09:38.066370 22648 rpcz_store.cc:276] 0709 13:09:37.058587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.014516 (+955929us) service_pool.cc:224] Handling call
0709 13:09:38.015114 (+   598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.064902 (+ 49788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.065083 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.024437 22468 leader_election.cc:400] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:38.008379 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:38.067835 22468 leader_election.cc:403] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:38.004667 28512 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:38.069638 22496 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.013283 27870 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:38.073014 28360 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.073333 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.024447 28348 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:38.073907 28510 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:38.072181 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2644) took 1193 ms. Trace:
I20260709 13:09:38.050959 28031 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:09:38.020272 28211 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:38.078788 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:38.079006 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.079424 22573 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:38.085053 22501 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.085870 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3664) took 1221 ms. Trace:
I20260709 13:09:38.086310 22499 rpcz_store.cc:276] 0709 13:09:36.864584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.864820 (+   236us) service_pool.cc:224] Handling call
0709 13:09:38.085463 (+1220643us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540033ead4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:38.085665 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470635904}
I20260709 13:09:38.087669 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.088281 22499 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:09:38.074707 27870 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:38.080071 22651 rpcz_store.cc:276] 0709 13:09:36.876993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.928310 (+1051317us) service_pool.cc:224] Handling call
0709 13:09:37.936195 (+  7885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.936691 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:37.939420 (+  2729us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.070269 (+130849us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:38.070309 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:38.070339 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.070388 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.070464 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87936,"prepare.queue_time_us":804,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":54,"raft.queue_time_us":89826,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":6140,"spinlock_wait_cycles":145242368,"thread_start_us":31155,"threads_started":1,"wal-append.queue_time_us":46615}
I20260709 13:09:38.096562 22502 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:38.090255 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:38.074848 28512 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:38.076359 28348 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:38.108624 28513 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:09:38.111240 28279 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:38.111790 28279 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:38.112365 28279 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.111804 28330 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:38.112812 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3022) took 1542 ms. Trace:
I20260709 13:09:38.113901 28330 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:38.113226 22650 rpcz_store.cc:276] 0709 13:09:36.570255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.549263 (+979008us) service_pool.cc:224] Handling call
0709 13:09:37.551261 (+  1998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.552516 (+  1255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.552550 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.553171 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.931823 (+378652us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:37.932972 (+  1149us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.048564 (+115592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.065312 (+ 16748us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.107533 (+ 42221us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:38.112101 (+  4568us) raft_consensus.cc:1685] finished
0709 13:09:38.112364 (+   263us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.112605 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110464,"prepare.queue_time_us":376,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":115577,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":41680,"spinlock_wait_cycles":41600768,"thread_start_us":298786,"threads_started":1,"wal-append.queue_time_us":308526}
I20260709 13:09:38.115285 27686 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:38.115803 27686 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:38.117182 27686 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.118036 22650 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:38.118469 27686 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.119946 22650 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:38.117664 28480 raft_consensus.cc:993] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:09:38.121356 28480 raft_consensus.cc:1081] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:09:38.118606 22505 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:38.126971 28517 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:09:38.128968 28511 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 13:09:38.130823 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.135819 28348 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.138003 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.155629 22500 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:38.155933 22573 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.156673 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2630) took 1846 ms. Trace:
I20260709 13:09:38.157127 22649 rpcz_store.cc:276] 0709 13:09:36.310626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.310773 (+   147us) service_pool.cc:224] Handling call
0709 13:09:36.311086 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.387115 (+ 76029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.156136 (+1769021us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b540017d9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:38.156476 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171833216}
W20260709 13:09:38.160058 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.138499 28493 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.855s	user 0.000s	sys 0.002s
I20260709 13:09:38.139655 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:38.160730 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.163255 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3695) took 1131 ms. Trace:
W20260709 13:09:38.164427 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.165026 28031 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:38.165876 28031 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.164443 28250 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.166222 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.166929 28250 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.169086 28335 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:38.170621 28515 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:09:38.163743 22571 rpcz_store.cc:276] 0709 13:09:37.031963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.035154 (+  3191us) service_pool.cc:224] Handling call
0709 13:09:37.035466 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.035841 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.035869 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.036313 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.148437 (+112124us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:37.148480 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.148548 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.137404 (+988856us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:38.162742 (+ 25338us) raft_consensus.cc:1685] finished
0709 13:09:38.162764 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.163051 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2399,"raft.queue_time_us":96,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":23382,"spinlock_wait_cycles":3213696,"thread_start_us":111834,"threads_started":1,"wal-append.queue_time_us":215021}
I20260709 13:09:38.176234 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.142535 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.142729 28504 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:38.177450 28504 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:38.178280 28348 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:38.178476 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.178762 28504 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:38.180191 28504 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.181384 28445 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.182303 28445 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.182956 22578 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:38.185446 28152 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:38.185880 28250 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.186506 28152 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:38.146173 28507 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
W20260709 13:09:38.187454 28514 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.197s	user 0.000s	sys 0.003s
I20260709 13:09:38.189540 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3024) took 1611 ms. Trace:
W20260709 13:09:38.137796 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 966280us
I20260709 13:09:38.190723 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.191663 22503 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:38.101938 28512 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.145056 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:38.149499 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.150381 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.149302 28446 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.151660 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.152429 28490 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:38.190026 22654 rpcz_store.cc:276] 0709 13:09:36.577589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.596364 (+1018775us) service_pool.cc:224] Handling call
0709 13:09:37.596709 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.598084 (+  1375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.598196 (+   112us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.599470 (+  1274us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.888040 (+288570us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:37.897120 (+  9080us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.928977 (+ 31857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.929095 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.145184 (+216089us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:38.189022 (+ 43838us) raft_consensus.cc:1685] finished
0709 13:09:38.189162 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.189370 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":778,"prepare.queue_time_us":4359,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":30499,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":4721,"spinlock_wait_cycles":59860352,"thread_start_us":217671,"threads_started":1,"wal-append.queue_time_us":267503}
W20260709 13:09:38.137910 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 977166us
I20260709 13:09:38.204046 28490 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.206090 28205 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:38.207082 28097 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:38.208298 28490 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:38.208694 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.209265 28097 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:38.209378 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 64435.6us
I20260709 13:09:38.209936 28097 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:38.124462 22646 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:09:38.140996 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 139258us
W20260709 13:09:38.187085 28497 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.627s	user 0.003s	sys 0.000s
I20260709 13:09:38.181483 22571 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.151226 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.212090 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1138) took 1130 ms. Trace:
I20260709 13:09:38.199774 22653 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:38.201012 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.201562 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.201997 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.202677 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.214946 22496 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:38.212530 22647 rpcz_store.cc:276] 0709 13:09:37.068048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.075057 (+1007009us) service_pool.cc:224] Handling call
0709 13:09:38.094740 (+ 19683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.198295 (+103555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.198328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:38.198372 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:38.198399 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.198460 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.198583 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.212576 22499 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:38.218762 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2646) took 1041 ms. Trace:
I20260709 13:09:38.220366 28250 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:38.180238 28031 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.220878 28250 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.221347 28250 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:38.225824 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.226980 28313 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.227667 28313 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.228544 28477 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:38.229337 28477 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.230324 28313 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:38.231555 28416 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:38.231916 27999 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:38.233197 28476 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:38.233565 28476 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:38.233785 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.234562 22578 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.234980 22579 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:38.235211 28152 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.234666 28476 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.235731 28152 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.219159 22646 rpcz_store.cc:276] 0709 13:09:37.177721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.100016 (+922295us) service_pool.cc:224] Handling call
0709 13:09:38.123794 (+ 23778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.218449 (+ 94655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.218696 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.237865 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1141) took 1125 ms. Trace:
I20260709 13:09:38.238387 22653 rpcz_store.cc:276] 0709 13:09:37.112560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.089453 (+976893us) service_pool.cc:224] Handling call
0709 13:09:38.110107 (+ 20654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.219041 (+108934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.237771 (+ 18730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.239233 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1139) took 1134 ms. Trace:
I20260709 13:09:38.242053 22648 rpcz_store.cc:276] 0709 13:09:37.104637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.083098 (+978461us) service_pool.cc:224] Handling call
0709 13:09:38.200419 (+117321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.238873 (+ 38454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.238911 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:38.238957 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:38.238989 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.239049 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.239179 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.242878 22501 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:38.212383 28445 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.236637 28476 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.246565 22654 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:38.246719 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 977) took 1139 ms. Trace:
I20260709 13:09:38.247960 28097 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.247191 22572 rpcz_store.cc:276] 0709 13:09:37.107558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.107681 (+   123us) service_pool.cc:224] Handling call
0709 13:09:37.124822 (+ 17141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.125196 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.125226 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.153353 (+ 28127us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.269948 (+116595us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:37.269991 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.270061 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.186071 (+916010us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:38.246176 (+ 60105us) raft_consensus.cc:1685] finished
0709 13:09:38.246198 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.246539 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3908,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10809,"spinlock_wait_cycles":26712832,"thread_start_us":53105,"threads_started":1,"wal-append.queue_time_us":197909}
I20260709 13:09:38.250638 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.249644 28097 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.247884 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.236268 28152 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.258631 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:38.259824 28057 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:38.263500 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.231609 28477 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:38.275801 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 251733us
I20260709 13:09:38.244580 28313 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.213938 28211 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.304247 22575 raft_consensus.cc:2368] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:09:38.305799 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.306713 22572 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:38.307847 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.296192 22651 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:38.320919 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2649) took 1096 ms. Trace:
I20260709 13:09:38.321530 22651 rpcz_store.cc:276] 0709 13:09:37.224454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.105483 (+881029us) service_pool.cc:224] Handling call
0709 13:09:38.254863 (+149380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.310468 (+ 55605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.320813 (+ 10345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.323350 22571 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:38.324826 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:38.346930 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 178620us
I20260709 13:09:38.271169 28498 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.350046 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.351162 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.347882 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.358433 22647 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:38.295027 28313 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.373509 22648 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:38.317536 28477 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:09:38.363885 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.380048 22571 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:38.377097 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:38.383394 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 145755us
I20260709 13:09:38.384536 22572 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:38.388016 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 129529us
I20260709 13:09:38.388957 22577 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:38.390307 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:38.397514 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.400681 22575 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:09:38.398360 22654 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:38.402446 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:38.404829 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.374490 28057 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:38.404621 28445 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:38.404654 28335 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:38.417186 22651 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:38.350548 27870 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.419003 28312 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:38.442551 28312 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:38.443593 28312 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.417153 28335 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:38.445070 28335 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.445308 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.445268 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.411681 28279 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.433270 28152 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.433545 28436 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:38.452195 28436 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:38.452739 28436 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:38.453147 22400 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.453855 28436 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.454375 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.455232 23259 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:38.434798 28225 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:38.435550 28264 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.465404 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64526us
I20260709 13:09:38.437232 22646 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:38.438747 22577 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:38.464289 28225 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.467114 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.467800 22577 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:38.440788 22650 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:38.469075 28225 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.471109 28225 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.472651 28264 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.473281 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:38.473904 22647 raft_consensus.cc:2376] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9. Re-sending same reply.
I20260709 13:09:38.475046 28264 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.475728 28264 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:38.460019 22401 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 191) took 39763 ms (client timeout 15000 ms). Trace:
I20260709 13:09:38.436411 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.441939 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:38.444046 28401 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:38.429924 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.404343 28417 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.447691 22573 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:38.445241 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:38.450766 28279 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.452085 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.455559 28436 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.434202 28031 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.418198 28445 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.430006 28211 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.457906 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.458114 22575 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:38.476819 28264 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:38.459074 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.459740 28312 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.444087 28057 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.460440 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.465538 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:38.463162 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.477499 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.491954 27686 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.478832 27870 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:38.503690 27686 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.487948 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.505965 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:38.506625 27686 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.487572 28031 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.506808 23264 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:38.486620 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.485164 22501 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:38.486212 22648 raft_consensus.cc:2376] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11. Re-sending same reply.
I20260709 13:09:38.508103 23263 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.487597 28445 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:38.508173 28163 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.510079 28163 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:38.510555 28163 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.483960 28401 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:38.483155 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71433.7us
W20260709 13:09:38.513168 28518 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:38.515234 28498 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.515341 23257 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:38.483508 28519 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:38.516510 28519 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:38.517460 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.518360 23262 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:38.517834 28519 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.518760 22578 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:38.519398 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.519696 22579 raft_consensus.cc:1217] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.11->[11.12-16.14]   Dedup: 11.12->[14.13-16.14]
I20260709 13:09:38.509502 28446 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.520358 22579 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [11.12-16.14]
I20260709 13:09:38.504621 22469 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:38.521903 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.482651 22653 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:09:38.470147 22654 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:38.522956 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.523169 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.484896 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.491482 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.487206 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.484512 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.523191 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:38.491487 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.493423 28057 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.486729 22571 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:38.501605 22651 raft_consensus.cc:2368] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16.
I20260709 13:09:38.524977 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.502804 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.483886 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:38.478845 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.516889 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.439610 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:38.523439 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.480697 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.486123 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.496501 22577 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:38.533226 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.534070 22579 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:38.535209 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:38.512981 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44137.7us
I20260709 13:09:38.538574 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.540886 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:38.541746 22649 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:38.542990 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.544937 22578 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:38.496613 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.549206 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:38.549721 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 147773us
I20260709 13:09:38.549921 22580 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:38.485353 28417 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:09:38.551679 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.546707 28211 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.553056 28417 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.553414 28211 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.553745 28279 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:38.555295 28279 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:38.555640 28279 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:38.556190 27686 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:38.556564 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.556715 27686 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:38.537870 28490 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.547151 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:38.557183 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.441244 22574 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:38.543432 23255 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:38.557608 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.558449 22579 raft_consensus.cc:2376] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16. Re-sending same reply.
W20260709 13:09:38.561546 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 72210.3us
I20260709 13:09:38.508733 28031 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.557299 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:38.557240 23264 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:38.565100 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.566102 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.569260 22651 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:38.565155 23257 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.478114 28313 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:38.499027 28264 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:38.568732 22575 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:38.555634 28211 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.520545 28446 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.579349 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.557341 27686 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.557973 28490 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:38.589347 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.594383 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.593029 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:38.595444 23259 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.597117 22580 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:38.598850 28446 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:38.601938 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.602260 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.603413 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.603920 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:38.605337 28031 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:38.605792 28031 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.606177 28031 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.606631 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:38.597164 28449 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:38.605613 28264 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.608909 28449 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:38.609650 28264 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.610152 28449 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.612699 22573 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:38.615790 28057 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.619858 22650 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:38.620661 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:38.620929 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.621464 22649 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.622627 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.623375 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.623916 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.624037 22645 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:38.625012 28482 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:38.625247 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:38.625617 28359 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:38.628153 28482 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:38.629704 28482 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.564025 28152 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 13:09:38.632899 28152 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:38.633270 28152 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:38.633913 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.634249 22649 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:38.634822 28211 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:38.635372 28211 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:38.636278 28211 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.638799 28250 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.641010 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.645762 22651 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:38.648797 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:38.650624 22647 raft_consensus.cc:2368] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18.
I20260709 13:09:38.604167 23255 raft_consensus.cc:2410] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:09:38.658110 28250 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.658298 23263 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:09:38.658708 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.659601 22500 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:38.660005 23263 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:38.660779 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.661511 23263 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:38.663314 28031 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.664319 23258 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:38.665153 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.634222 28152 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.665983 22503 raft_consensus.cc:2410] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:38.666590 28152 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:38.668829 22543 leader_election.cc:400] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16.
I20260709 13:09:38.669225 22543 leader_election.cc:403] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:09:38.669396 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:38.670754 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:38.671887 27906 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:38.673323 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 259528us
I20260709 13:09:38.673905 28498 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16.
I20260709 13:09:38.674420 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.676635 28359 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:38.677609 28359 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:38.677984 28359 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:38.678246 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:38.678999 28359 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.680526 22497 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:38.556818 28279 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.681293 22576 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:38.682355 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.682581 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:38.683169 28360 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:38.684679 22503 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:38.684782 28360 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.685276 28360 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:38.687723 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:38.688910 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.674455 27906 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:38.690447 22503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59530
I20260709 13:09:38.691147 22503 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.691529 22503 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.693903 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:38.694921 28031 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.689805 23258 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:09:38.696404 23258 pending_rounds.cc:85] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 7
I20260709 13:09:38.696748 23258 pending_rounds.cc:107] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:09:38.697122 23258 raft_consensus.cc:2889] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:38.697394 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:38.680760 28359 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.698318 28416 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:38.699282 28322 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.699879 28322 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:38.700340 28322 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.616567 28163 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.649946 28490 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.702376 28279 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.702867 28163 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:38.565634 28288 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:09:38.628669 28512 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.708366 22501 raft_consensus.cc:2410] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 13:09:38.480360 22401 rpcz_store.cc:269] 0709 13:08:58.696726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.697198 (+   472us) service_pool.cc:224] Handling call
0709 13:09:38.459758 (+39762560us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:33.698739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:33.704919 (+  6180us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:33.705000 (+    81us) write_op.cc:435] Acquired schema lock
0709 13:09:33.705030 (+    30us) tablet.cc:662] Decoding operations
0709 13:09:33.706246 (+  1216us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:33.706371 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:33.706411 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:33.707456 (+  1045us) tablet.cc:701] Row locks acquired
0709 13:09:33.707511 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:09:33.707747 (+   236us) write_op.cc:270] Start()
0709 13:09:33.707942 (+   195us) write_op.cc:276] Timestamp: P: 1783602573707662 usec, L: 0
0709 13:09:33.707967 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:33.856590 (+148623us) log.cc:844] Serialized 3242 byte log entry
0709 13:09:35.205100 (+1348510us) op_driver.cc:464] REPLICATION: finished
0709 13:09:36.085699 (+880599us) write_op.cc:301] APPLY: starting
0709 13:09:36.085819 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:36.134193 (+ 48374us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:36.134304 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:36.210462 (+ 76158us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:36.259598 (+ 49136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:09:36.264758 (+  5160us) write_op.cc:312] APPLY: finished
0709 13:09:36.322855 (+ 58097us) log.cc:844] Serialized 81 byte log entry
0709 13:09:36.497128 (+174273us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.518764 (+ 21636us) write_op.cc:454] Released schema lock
0709 13:09:36.519551 (+   787us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:36.620417 (+100866us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.621859 (+  1442us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3581662,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":834841,"apply.run_cpu_time_us":81066,"apply.run_wall_time_us":525346,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":561984,"prepare.run_cpu_time_us":77148,"prepare.run_wall_time_us":652300,"raft.queue_time_us":463755,"raft.run_cpu_time_us":22870,"raft.run_wall_time_us":815621,"replication_time_us":1360722,"thread_start_us":1737193,"threads_started":5,"wal-append.queue_time_us":778771,"wal-append.run_cpu_time_us":69135,"wal-append.run_wall_time_us":2387416}]]}
I20260709 13:09:38.583534 28504 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.593673 28349 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:38.698376 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.729593 23262 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:38.716575 22654 raft_consensus.cc:2410] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:09:38.708331 22400 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 13 to 14, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 14 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.580727 28417 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:38.726269 23259 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:09:38.736353 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53902.5us
I20260709 13:09:38.737471 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:38.607076 28401 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:38.741542 23263 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:38.744817 23263 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:38.743445 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.752111 22498 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:38.749010 23258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:09:38.731946 28349 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.729107 28313 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:38.754384 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.765581 23259 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:38.728581 27906 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:38.730916 28057 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:38.760397 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 180437us
I20260709 13:09:38.779281 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:38.780294 23255 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:38.783663 22501 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:38.803328 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 126723us
I20260709 13:09:38.731560 28288 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:09:38.764923 28349 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.807236 22400 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 8 to 9, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 9 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:38.816399 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:38.817070 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.801383 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:38.821053 22498 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.735489 28504 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.767797 28436 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:38.781255 28348 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:38.833914 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 230057us
I20260709 13:09:38.838338 22502 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:09:38.829988 28097 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.006s
I20260709 13:09:38.767095 27686 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.880892 23260 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:38.882803 23258 raft_consensus.cc:606] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:38.883338 23258 raft_consensus.cc:614] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:38.883623 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:38.778694 28417 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:38.889734 22580 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:38.878530 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.893216 22571 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:38.891583 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:38.893989 22575 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:38.894984 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:38.829576 28348 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:38.903343 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 232653us
I20260709 13:09:38.897724 28512 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:38.908718 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 101043us
I20260709 13:09:38.916319 22577 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:38.967314 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 80551.2us
W20260709 13:09:38.968668 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 299313us
I20260709 13:09:38.837103 28445 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:38.908532 28348 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.877492 28163 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:09:38.993432 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:38.999948 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.002404 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:38.966468 27887 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.008199 22502 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
W20260709 13:09:39.012090 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.023609 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 326283us
I20260709 13:09:39.052838 22571 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:39.058503 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:39.059504 28250 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:39.060024 28250 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:39.060987 28250 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.031910 28416 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:39.032065 28288 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.079998 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:39.082329 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.085688 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.088969 28175 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:09:39.089263 22400 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.091218 22400 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 10, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 10 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:39.092926 28522 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.415s	user 0.000s	sys 0.004s
W20260709 13:09:39.072523 28225 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.006s
I20260709 13:09:39.078943 22503 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.046751 28512 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:39.065160 28498 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:39.101457 22578 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:09:39.102324 22504 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:39.119464 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 139654us
I20260709 13:09:39.116470 22578 pending_rounds.cc:85] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 13
I20260709 13:09:39.114859 28225 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:39.123004 22578 pending_rounds.cc:107] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:09:39.123638 22578 raft_consensus.cc:2889] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.124483 28535 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:09:39.124735 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 929) took 1888 ms. Trace:
I20260709 13:09:39.124822 22498 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:39.126967 22503 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:39.003623 27906 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.145282 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.144974 23263 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.146245 23263 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:39.146689 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:39.139608 23257 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 13:09:39.045341 28360 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.147625 23257 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:39.150533 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:39.151645 22502 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:39.170989 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.185382 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.048285 27887 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.209934 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:39.117555 28436 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:39.216879 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 400501us
I20260709 13:09:39.125662 23256 rpcz_store.cc:276] 0709 13:09:37.236284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.236443 (+   159us) service_pool.cc:224] Handling call
0709 13:09:37.236789 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.161355 (+924566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.161411 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.162019 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.381553 (+219534us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:38.381589 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.399890 (+ 18301us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.091999 (+692109us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:39.124283 (+ 32284us) raft_consensus.cc:1685] finished
0709 13:09:39.124317 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.124541 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":923920,"raft.queue_time_us":925893,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"spinlock_wait_cycles":74564352,"thread_start_us":219029,"threads_started":1,"wal-append.queue_time_us":419326}
I20260709 13:09:39.143253 28504 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:39.222643 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.149804 28476 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.225432 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:39.240644 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.203253 28031 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.224583 28322 consensus_meta.cc:287] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.520s	user 0.013s	sys 0.000s
I20260709 13:09:39.245980 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:39.220440 27686 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.206007 28533 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:39.278208 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:39.282879 22503 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:39.244081 28225 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:39.306622 22502 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:39.293529 28543 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:09:39.298806 28436 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:39.300577 28537 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:09:39.301420 28529 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:09:39.301638 28539 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:39.302580 28545 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:39.304687 28335 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.859s	user 0.013s	sys 0.001s
I20260709 13:09:39.284798 28445 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:39.313614 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.284263 28211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.011s	sys 0.014s
I20260709 13:09:39.305294 23263 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:09:39.244288 28536 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:09:39.308351 28417 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:39.281014 28031 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.253311 28322 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:39.355718 28211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.012s	sys 0.016s
I20260709 13:09:39.360255 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:39.366690 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 120819us
I20260709 13:09:39.351380 27686 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.377425 22498 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:39.376399 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:39.377596 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 236582us
I20260709 13:09:39.358601 28360 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:39.336344 28533 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:09:39.414307 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 447016us
I20260709 13:09:39.424664 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:39.378700 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:39.354033 28335 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.334641 28538 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:09:39.430047 28550 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.430855 28550 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:39.433692 28550 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
W20260709 13:09:39.368614 28482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.007s	sys 0.016s
I20260709 13:09:39.438753 22502 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
W20260709 13:09:39.439523 28359 consensus_meta.cc:287] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.006s
I20260709 13:09:39.439882 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:39.440172 28530 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.332s	user 0.008s	sys 0.012s
I20260709 13:09:39.440979 22503 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:39.442325 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.443383 22503 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:39.444320 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.446453 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.373699 28556 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:39.460117 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 454746us
W20260709 13:09:39.447724 28482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.008s	sys 0.016s
I20260709 13:09:39.473970 28383 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.474588 28383 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.459514 28360 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:39.475517 28360 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.475914 28360 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:39.467864 28550 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:09:39.488040 28547 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:39.490024 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 121482us
I20260709 13:09:39.491288 28535 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:39.492714 28483 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:39.493305 28483 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:39.503273 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.503515 28313 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:39.504191 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:39.505026 28401 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:39.505978 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:39.506621 22580 raft_consensus.cc:606] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:39.506964 28401 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:39.507012 22580 raft_consensus.cc:614] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:39.513141 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813ede727198414390a20d5845e75e07"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:39.513847 22580 raft_consensus.cc:606] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:39.514249 22580 raft_consensus.cc:614] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:39.500722 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.488734 28547 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:39.519723 28547 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.504597 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.522799 28322 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.521251 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:39.523763 22580 raft_consensus.cc:606] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:39.537233 22580 raft_consensus.cc:614] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:39.542214 28360 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:39.545945 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.549093 28360 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:39.554621 28163 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:39.555147 28225 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:39.555447 28163 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.556566 28531 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:39.556978 28531 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:39.560931 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:39.525879 28549 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:39.470834 28264 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:39.527262 28550 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:39.531476 28211 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:39.533911 28031 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.454923 22497 raft_consensus.cc:2410] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:09:39.572918 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.573887 22575 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.002s
I20260709 13:09:39.613935 22575 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:39.376044 28545 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.600306 22503 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 10: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:39.574818 28279 consensus_meta.cc:287] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.865s	user 0.013s	sys 0.001s
I20260709 13:09:39.610801 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:39.558894 28539 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.561488 28512 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:39.602293 28550 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:39.558211 28163 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:39.602975 27686 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.557847 28531 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.662700 28531 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:39.664316 27686 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.667565 27686 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.668546 28560 raft_consensus.cc:2764] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:39.577607 27870 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:09:39.607885 28383 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:39.643329 28421 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.635394 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:39.635376 28417 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.655786 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:39.654536 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:39.659334 28416 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.580s	user 0.003s	sys 0.007s
I20260709 13:09:39.660379 28550 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:39.661783 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 283169us
I20260709 13:09:39.680909 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:39.626204 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:39.674082 23257 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:39.683748 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 122971us
I20260709 13:09:39.685894 22544 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:39.629314 28031 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:09:39.695444 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.669924 27887 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:39.680191 28416 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:39.648134 28539 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.699018 28031 consensus_queue.cc:1243] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:39.688215 28279 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:39.703011 28163 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:39.723958 28512 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:39.707213 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:39.735893 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.683411 28417 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.740756 22497 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
W20260709 13:09:39.738843 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.000s	sys 0.014s
I20260709 13:09:39.725414 28556 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:39.750135 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 69332.7us
W20260709 13:09:39.743196 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.000s	sys 0.014s
I20260709 13:09:39.741660 22575 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:39.756148 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:39.747682 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.005s	sys 0.009s
W20260709 13:09:39.763024 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.005s	sys 0.009s
W20260709 13:09:39.752817 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 911394us
I20260709 13:09:39.769919 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:09:39.781212 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.786334 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:39.764503 28542 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.316s	user 0.003s	sys 0.000s
W20260709 13:09:39.763406 28490 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.062s	user 0.011s	sys 0.003s
I20260709 13:09:39.787242 22497 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
W20260709 13:09:39.804296 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.751932 28335 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:39.789660 28519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.182s	user 0.008s	sys 0.016s
I20260709 13:09:39.808387 23257 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:09:39.812059 22575 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:39.780469 28175 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.742082 28279 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:39.820937 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 254938us
I20260709 13:09:39.788520 28550 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:39.817741 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.798791 27870 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:39.768968 28556 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:39.821880 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:39.823668 22497 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
W20260709 13:09:39.809914 28519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.009s	sys 0.016s
I20260709 13:09:39.835732 23264 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:39.836318 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 332100us
I20260709 13:09:39.797582 28512 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:39.850559 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 99535.6us
I20260709 13:09:39.809976 28490 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.852983 22499 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 11: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:39.853596 28490 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.858021 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:39.860576 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:39.861716 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:39.862787 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 80459.8us
I20260709 13:09:39.859491 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:39.864287 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:39.867748 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:39.868495 23256 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:39.869823 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1196) took 1070 ms. Trace:
I20260709 13:09:39.870445 28279 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.870195 22501 rpcz_store.cc:276] 0709 13:09:38.799854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.803082 (+  3228us) service_pool.cc:224] Handling call
0709 13:09:38.833432 (+ 30350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.219713 (+386281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.219740 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.233166 (+ 13426us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.559012 (+325846us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:39.559070 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.559164 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.869607 (+310443us) raft_consensus.cc:1685] finished
0709 13:09:39.869625 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.869748 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":388778,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":482948,"threads_started":2,"wal-append.queue_time_us":512310}
I20260709 13:09:39.872195 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:39.874068 28348 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.000s
I20260709 13:09:39.877312 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3049) took 1193 ms. Trace:
I20260709 13:09:39.877719 22500 rpcz_store.cc:276] 0709 13:09:38.683865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.685765 (+  1900us) service_pool.cc:224] Handling call
0709 13:09:38.686127 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.021817 (+335690us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:39.021846 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.078440 (+ 56594us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.763828 (+685388us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:39.763888 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.763983 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.877098 (+113115us) raft_consensus.cc:1685] finished
0709 13:09:39.877119 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.877252 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51744,"raft.queue_time_us":76558,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10643,"thread_start_us":936517,"threads_started":2,"wal-append.queue_time_us":752978}
I20260709 13:09:39.879470 28541 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:39.879936 22500 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:39.880085 28541 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:39.881372 28541 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.882920 28541 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:39.885275 28573 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:39.886605 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 283482us
I20260709 13:09:39.823729 28175 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.851613 28335 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.889369 28547 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.850369 27870 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:39.891450 28416 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.903764 28416 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.904040 27870 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.906265 28416 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.853618 28421 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:39.906638 22504 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:39.907063 28421 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.858618 28264 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.892134 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:39.909183 28264 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.910096 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:39.910712 23256 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:39.911136 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:39.892792 28563 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:09:39.914180 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:39.886638 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3045) took 1230 ms. Trace:
I20260709 13:09:39.896109 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:39.896512 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:39.859217 28545 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.916621 23260 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.867745 28383 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:09:39.917500 28057 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:39.917908 28057 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:39.868145 27906 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:39.919063 27906 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:39.918800 28057 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.920097 28057 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:39.920001 27906 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.897461 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:39.921679 22497 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:39.922000 22544 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:39.922287 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1197) took 1087 ms. Trace:
I20260709 13:09:39.922627 22497 rpcz_store.cc:276] 0709 13:09:38.835174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.921231 (+1086057us) service_pool.cc:224] Handling call
0709 13:09:39.921525 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.922069 (+   544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.922234 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.923120 28543 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:39.923506 28543 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.924038 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 62562.6us
I20260709 13:09:39.923985 28483 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:39.894738 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:39.925282 28483 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.925964 22503 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:39.926059 28551 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:39.926586 28551 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:39.926709 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:39.926993 28551 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:39.927309 22503 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:39.927997 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:39.891321 28512 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.900938 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1192) took 1308 ms. Trace:
W20260709 13:09:39.929205 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68632.9us
I20260709 13:09:39.889654 28175 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.890065 28558 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:09:39.948258 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:39.911316 28264 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:39.949200 28264 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:39.949612 28264 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:39.949998 28264 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:39.872720 22501 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:39.903025 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 1190) took 1344 ms. Trace:
I20260709 13:09:39.924281 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 772) took 1409 ms. Trace:
I20260709 13:09:39.952458 28504 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:39.914822 23263 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:39.880658 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3682) took 1060 ms. Trace:
I20260709 13:09:39.952979 28504 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:39.953199 22500 rpcz_store.cc:276] 0709 13:09:38.820129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.879277 (+1059148us) service_pool.cc:224] Handling call
0709 13:09:39.879616 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.880381 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.880595 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.952687 23264 rpcz_store.cc:276] 0709 13:09:38.514612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.641476 (+126864us) service_pool.cc:224] Handling call
0709 13:09:38.641877 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.836171 (+1194294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.924083 (+ 87912us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54008e6054. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:39.924230 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745073024}
I20260709 13:09:39.954277 28498 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:39.954564 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:39.915427 22505 rpcz_store.cc:276] 0709 13:09:38.656766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.656939 (+   173us) service_pool.cc:224] Handling call
0709 13:09:38.667211 (+ 10272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.667527 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:38.901231 (+233704us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.567535 (+666304us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.597929 (+ 30394us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.598126 (+   197us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:39.598383 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.885995 (+287612us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b18004912c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:09:39.886232 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.886302 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.886422 (+   120us) raft_consensus.cc:1685] finished
0709 13:09:39.886437 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.886580 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32020,"prepare.queue_time_us":458907,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":5392,"raft.queue_time_us":422891,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":38809,"spinlock_wait_cycles":7729536,"thread_start_us":779897,"threads_started":3,"wal-append.queue_time_us":365706}
I20260709 13:09:39.952098 22499 rpcz_store.cc:276] 0709 13:09:38.558459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.558622 (+   163us) service_pool.cc:224] Handling call
0709 13:09:39.902830 (+1344208us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001a9d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:39.902969 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2892842240}
I20260709 13:09:39.929507 22496 rpcz_store.cc:276] 0709 13:09:38.592335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.592588 (+   253us) service_pool.cc:224] Handling call
0709 13:09:38.613310 (+ 20722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.712333 (+ 99023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.712378 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.736075 (+ 23697us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.056918 (+320843us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:39.056970 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.057035 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.544527 (+487492us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:39.900577 (+356050us) raft_consensus.cc:1685] finished
0709 13:09:39.900603 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.900853 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60157,"raft.queue_time_us":102211,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7659,"spinlock_wait_cycles":47410432,"thread_start_us":223539,"threads_started":1,"wal-append.queue_time_us":459077}
I20260709 13:09:39.931661 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3677) took 1111 ms. Trace:
W20260709 13:09:39.931901 28152 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.265s	user 0.015s	sys 0.000s
I20260709 13:09:39.932284 28279 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:39.933107 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:39.979432 23256 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:39.900286 28417 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:39.874575 28348 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.979189 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:39.929661 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:39.984304 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 54785.5us
I20260709 13:09:39.986157 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:39.923841 28543 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:39.933964 28349 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.094s	user 0.013s	sys 0.000s
I20260709 13:09:39.928602 22503 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:39.940950 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:39.991722 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50901.4us
I20260709 13:09:39.992430 22543 leader_election.cc:400] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18.
I20260709 13:09:39.923849 22497 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:39.942678 28566 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:39.943476 28563 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:39.943883 28490 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:39.944236 28449 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:39.944443 28578 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:39.944653 28225 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:39.945007 28538 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.899741 28556 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:39.928704 28545 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:39.897451 28539 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:39.954674 28498 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:40.012157 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.012838 22575 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:39.929976 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:39.957113 22469 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:39.968569 23260 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:39.956249 22504 rpcz_store.cc:276] 0709 13:09:38.818704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.522898 (+704194us) service_pool.cc:224] Handling call
0709 13:09:39.906455 (+383557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.907126 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.908758 (+  1632us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54001a9d50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:39.930050 (+ 21292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881040768}
W20260709 13:09:39.980392 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 116211us
I20260709 13:09:40.010605 22499 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:39.981561 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:39.982190 28519 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:39.983453 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88757.9us
I20260709 13:09:39.993050 22497 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:39.992838 22543 leader_election.cc:403] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:09:39.992803 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:39.996953 22578 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:40.000178 22501 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:09:39.993458 28550 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:40.006745 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.983461 28279 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:40.029850 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 72812.9us
I20260709 13:09:40.031773 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:40.032009 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:40.003603 22502 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:39.997496 28163 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.991495 28152 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:40.040828 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:40.041491 23263 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:40.028230 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 98315.1us
I20260709 13:09:40.022447 22500 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 21. Ops: []
I20260709 13:09:39.997052 28512 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:39.996321 28578 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.039288 22575 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:40.031381 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:40.045539 22469 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:40.048110 22503 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:40.007802 28545 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.050354 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:40.050678 22504 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:39.953920 28504 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.053506 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.054059 22649 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:40.055887 22654 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:40.051344 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:40.051625 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.058012 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:40.010746 28573 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:40.035494 28490 consensus_queue.cc:1243] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:40.065410 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.066229 22575 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:40.067895 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.069068 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.070056 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.070271 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:40.071165 22654 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:39.994104 28349 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.039170 28163 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:40.040534 28279 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.062896 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.025815 28550 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.059041 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.070238 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.103611 22574 raft_consensus.cc:2376] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19. Re-sending same reply.
I20260709 13:09:40.104754 22645 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:40.072059 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.057622 22469 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:40.073197 22652 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:40.106563 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.107199 22652 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:40.073905 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:40.108345 22499 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:40.064831 28449 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:40.109279 28449 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.109758 28449 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:40.110111 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 52579.3us
I20260709 13:09:40.111445 28566 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.112031 28566 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:40.112995 28566 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:40.052985 22505 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:40.077407 22579 raft_consensus.cc:2410] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:40.118299 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.118505 22505 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:40.077975 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:40.119235 22571 raft_consensus.cc:2368] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:40.042260 27686 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18.
I20260709 13:09:40.119835 22505 raft_consensus.cc:1217] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 13.9->[14.10-21.13]   Dedup: 17.11->[19.12-21.13]
W20260709 13:09:40.061141 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.079082 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:40.055025 28578 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:40.121147 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.047467 28559 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.079929 22578 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:40.041371 28539 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:40.079761 22654 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:40.039661 28519 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:40.072059 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:40.137455 22468 connection.cc:256] RPC call timeout handler was delayed by -1.4231052669999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
I20260709 13:09:40.078786 23255 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:40.137820 22577 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 8.
I20260709 13:09:40.138093 22649 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:40.089246 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:40.007182 28538 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.092235 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:40.088819 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:40.092469 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.059966 28360 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:40.055171 28512 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.059072 28545 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:40.095762 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:40.098299 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66646us
I20260709 13:09:40.210738 22496 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:40.100968 23262 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:40.063586 28436 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.092568 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.101708 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.104930 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.122586 22501 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:40.121181 28550 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.058133 28421 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:40.071354 28535 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:40.120386 22505 pending_rounds.cc:85] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 11
I20260709 13:09:40.249114 22505 pending_rounds.cc:107] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:09:40.249558 22505 raft_consensus.cc:2889] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.138800 22648 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:40.045786 28288 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:40.198143 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 76171.9us
I20260709 13:09:40.094889 28163 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.199378 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.139670 28539 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.252836 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3680) took 1410 ms. Trace:
I20260709 13:09:40.120261 27686 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:40.207773 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.078610 28574 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:09:40.123759 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.207330 28512 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:40.279142 22571 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:40.213042 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:40.214643 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:40.213574 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.120172 23263 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:09:40.253304 22502 rpcz_store.cc:276] 0709 13:09:38.819587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.439582 (+619995us) service_pool.cc:224] Handling call
0709 13:09:40.230094 (+790512us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54000825d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:40.230233 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294700928}
I20260709 13:09:40.196961 28490 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.207093 28360 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.256966 22647 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:40.208666 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:40.280326 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 67403.5us
I20260709 13:09:40.277882 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.257671 22574 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:40.256335 28539 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:40.294478 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.225169 28436 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:40.322952 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 249354us
I20260709 13:09:40.229233 28546 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:40.324200 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:40.327134 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.327322 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:40.328576 23227 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:40.327821 22645 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:40.330816 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:40.344933 22574 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:40.134640 28573 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.317725 28359 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:40.283046 28587 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.324404 28360 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:40.330021 28383 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:40.199044 28559 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:40.369414 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:40.417965 22645 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:40.375450 28587 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.419199 28588 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.342520 28546 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:40.282179 28535 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.226227 28498 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.252435 28335 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.328994 28436 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.332755 28057 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
W20260709 13:09:40.645028 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 320929us
W20260709 13:09:40.560575 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.500589 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 286780us
W20260709 13:09:40.420972 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.648326 22468 connection.cc:256] RPC call timeout handler was delayed by -1.3808052670000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:09:40.618942 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 290416us
I20260709 13:09:40.635567 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.325403 28490 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:40.621351 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.550359 22648 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
W20260709 13:09:40.649758 22468 connection.cc:256] RPC call timeout handler was delayed by -1.2856609039999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:09:40.660169 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0489609040000687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 13:09:40.663085 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:40.257440 28536 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:40.711136 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.421288 27870 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:09:40.427426 28581 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.174s	user 0.005s	sys 0.005s
I20260709 13:09:40.425056 28449 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.408748 28288 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:40.410339 28383 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:40.419953 28349 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:40.416055 28519 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:40.602762 28152 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:40.852239 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.415573 28574 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:40.423259 28538 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:40.985333 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.923719 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:40.753366 22573 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:09:40.857985 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:40.930912 22645 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
W20260709 13:09:40.776695 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.023s	sys 0.051s
W20260709 13:09:40.992935 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.029s	sys 0.083s
I20260709 13:09:40.650314 28348 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:40.993369 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.994442 22645 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:40.995285 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.635480 28559 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:40.996559 22645 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:40.828362 28547 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.998111 28547 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:40.720172 28579 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:09:40.425652 28031 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:40.826431 28598 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:09:40.721711 28335 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:40.420637 28587 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:40.961818 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:40.952023 22501 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:40.966524 28490 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:40.966289 28586 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.006s
I20260709 13:09:40.721928 28498 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:40.948666 28566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.002s	sys 0.006s
W20260709 13:09:40.827297 28594 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:40.825008 28562 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.870321 28592 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:40.804575 28568 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:40.968307 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:40.969543 28551 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.042s	user 0.017s	sys 0.000s
I20260709 13:09:40.870419 28596 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.718063 27686 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.988741 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.763989 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46346.8us
I20260709 13:09:41.009385 22648 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:41.013042 22646 raft_consensus.cc:2368] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:41.017755 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:40.815996 28057 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.976406 28383 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:41.021191 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.783082 28421 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.001488 28031 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:40.987810 28535 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.034178 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:41.016392 28586 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.004s	sys 0.006s
I20260709 13:09:40.952764 27870 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:40.782312 28476 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.255s
W20260709 13:09:41.085914 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.032836 28573 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:41.110373 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 142138us
I20260709 13:09:41.111073 28566 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:41.106535 22496 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:41.047160 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.113289 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 95633.3us
W20260709 13:09:41.116024 22654 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.785s	user 0.004s	sys 0.003s
I20260709 13:09:41.112542 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 941) took 1346 ms. Trace:
I20260709 13:09:41.012647 28288 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.127053 22654 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:09:41.025797 28587 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.126924 22647 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:40.954294 28536 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.152427 28335 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.000805 28547 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:41.121781 28594 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:09:41.120486 28541 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.237s	user 0.010s	sys 0.005s
I20260709 13:09:41.079463 28349 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.153703 28536 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.154767 28288 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.154883 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:41.078938 28602 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.157532 28606 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:09:41.161242 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1202) took 1549 ms. Trace:
W20260709 13:09:41.148530 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 133986us
W20260709 13:09:41.185243 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61344us
I20260709 13:09:41.202262 23263 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:09:41.203080 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:41.200690 22500 rpcz_store.cc:276] 0709 13:09:39.612300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.982931 (+370631us) service_pool.cc:224] Handling call
0709 13:09:40.022281 (+ 39350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.045753 (+ 23472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.160912 (+1115159us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b54001a8450. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:41.161136 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89793280}
I20260709 13:09:41.204972 22496 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:41.187595 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:41.162082 28483 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.236s	user 0.014s	sys 0.008s
I20260709 13:09:41.212227 28536 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.041057 28551 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:41.184734 28279 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.989s	user 0.008s	sys 0.004s
I20260709 13:09:41.079419 27686 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:41.197106 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 157037us
I20260709 13:09:41.229276 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:41.078027 28436 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.126039 23261 rpcz_store.cc:276] 0709 13:09:39.606075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.615997 (+  9922us) service_pool.cc:224] Handling call
0709 13:09:39.633231 (+ 17234us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:39.633645 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.633687 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:39.934568 (+300881us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b2c000129d8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:09:39.935198 (+   630us) log.cc:844] Serialized 52 byte log entry
0709 13:09:39.999233 (+ 64035us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:40.037064 (+ 37831us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.042678 (+  5614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.042749 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.087670 (+ 44921us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b18003281e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec2b224328 00007fec2b21b901 00007fec2b21b8a7 00007fec2b313288 00007fec2b312f37 00007fec2b32755c 00007fec2b327508
0709 13:09:40.483363 (+395693us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b18003281e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:40.952072 (+468709us) raft_consensus.cc:1685] finished
0709 13:09:40.952097 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.952266 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8666,"prepare.queue_time_us":21118,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6627,"raft.queue_time_us":9762,"raft.run_cpu_time_us":2476,"raft.run_wall_time_us":42881,"spinlock_wait_cycles":29830144,"thread_start_us":101069,"threads_started":2,"wal-append.queue_time_us":145082}
W20260709 13:09:41.184280 28550 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.872s	user 0.003s	sys 0.007s
I20260709 13:09:41.079933 28057 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.218394 22572 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:41.148932 28614 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:41.226014 22498 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
W20260709 13:09:41.240638 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 85885us
I20260709 13:09:41.129267 28574 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:09:41.168650 22647 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:41.185388 28560 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.213127 28536 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.126430 28152 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.286801 22468 leader_election.cc:400] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:09:41.287314 22468 leader_election.cc:403] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:09:41.232672 28541 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.237363 28573 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:09:41.249409 28163 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.967s	user 0.012s	sys 0.000s
I20260709 13:09:41.247727 28547 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:41.198879 28335 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:09:41.196631 28587 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.331848 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3738) took 1327 ms. Trace:
I20260709 13:09:41.233388 28591 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.371s
W20260709 13:09:41.332742 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 86350.6us
I20260709 13:09:41.332376 22580 rpcz_store.cc:276] 0709 13:09:40.004025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.011099 (+  7074us) service_pool.cc:224] Handling call
0709 13:09:40.011428 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.011801 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:40.060543 (+ 48742us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.279583 (+219040us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.280041 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.280183 (+   142us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:40.280214 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.280303 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.330597 (+1050294us) raft_consensus.cc:1685] finished
0709 13:09:41.330628 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.331760 (+  1132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31513,"prepare.queue_time_us":33900,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":10236,"raft.queue_time_us":79068,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":29152,"thread_start_us":127353,"threads_started":1,"wal-append.queue_time_us":351405}
I20260709 13:09:41.298486 28163 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.336966 22651 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 10.
I20260709 13:09:41.338272 28163 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:41.340776 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 93768.1us
I20260709 13:09:41.343215 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:41.344079 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:41.346010 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:41.349126 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:41.351953 28539 consensus_meta.cc:287] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.009s	user 0.011s	sys 0.004s
I20260709 13:09:41.352458 28539 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.353546 28628 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:41.384279 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 134371us
I20260709 13:09:41.292737 28586 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:41.356549 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3045) took 1078 ms. Trace:
I20260709 13:09:41.358681 28643 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:41.362380 23263 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:41.363526 28163 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.353612 28573 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:41.363567 28640 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.335796 28483 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:09:41.043756 28596 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.042650 28562 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.335510 22497 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.236199 28279 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.414780 28595 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:41.393589 28586 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.421705 28279 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:41.329751 28609 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 13:09:41.423302 22577 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:41.243700 28288 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 13:09:41.423921 28562 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:41.425065 28264 consensus_meta.cc:287] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.470s	user 0.011s	sys 0.001s
I20260709 13:09:41.425490 28264 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.425853 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1156) took 1377 ms. Trace:
I20260709 13:09:41.425599 28573 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.426282 22653 rpcz_store.cc:276] 0709 13:09:40.048569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.048705 (+   136us) service_pool.cc:224] Handling call
0709 13:09:40.065803 (+ 17098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.596884 (+531081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.596931 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.597576 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.815127 (+217551us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:40.815186 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.815272 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.425625 (+610353us) raft_consensus.cc:1685] finished
0709 13:09:41.425647 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.425792 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55089,"raft.queue_time_us":275368,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":34480,"thread_start_us":617258,"threads_started":2,"wal-append.queue_time_us":272898}
I20260709 13:09:41.289590 28560 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.251428 28250 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:09:41.429281 28560 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.429838 27686 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.429972 22497 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:41.428622 22653 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:41.431042 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3054) took 1082 ms. Trace:
W20260709 13:09:41.431452 28360 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.014s	user 0.009s	sys 0.000s
I20260709 13:09:41.431385 22653 rpcz_store.cc:276] 0709 13:09:40.349622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.428125 (+1078503us) service_pool.cc:224] Handling call
0709 13:09:41.428447 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.430808 (+  2361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.430984 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:41.431974 28360 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.330139 28449 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.249351 28421 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.134s
I20260709 13:09:41.434122 28625 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.434705 28625 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.225129 28602 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.386770 22652 rpcz_store.cc:276] 0709 13:09:40.278135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.024163 (+746028us) service_pool.cc:224] Handling call
0709 13:09:41.037024 (+ 12861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.037554 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.037589 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.042295 (+  4706us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.205957 (+163662us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:41.206007 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.206090 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.356184 (+150094us) raft_consensus.cc:1685] finished
0709 13:09:41.356214 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.356381 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":306,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":42781,"thread_start_us":55258,"threads_started":1,"wal-append.queue_time_us":230699}
I20260709 13:09:41.251094 28604 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 13:09:41.437872 28604 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:41.353539 28627 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:41.438405 28602 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.438639 28627 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:41.439265 28627 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:41.439507 28616 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 13:09:41.440685 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43846.5us
I20260709 13:09:41.438380 28604 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:41.441404 28057 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.442026 28563 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:41.442147 28322 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:41.442862 28622 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:09:41.442934 28563 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:41.443459 28563 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:41.443542 27870 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.302081 28541 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:41.413786 28624 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:09:41.413422 28603 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.164s
I20260709 13:09:41.414103 28607 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 13:09:41.243330 28550 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.442160 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:41.249648 28614 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.452438 22579 raft_consensus.cc:2368] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
W20260709 13:09:41.414827 28610 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:09:41.425096 28634 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:09:41.442338 28604 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.569339 28541 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.570050 28604 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.474298 28360 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.572379 28360 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.456521 28563 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.459991 28550 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:41.460978 28543 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.452s	user 0.007s	sys 0.005s
I20260709 13:09:41.573263 28360 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.400565 28643 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.573665 28543 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.575743 28643 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.404754 28163 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.407601 28628 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.463558 22574 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:09:41.468552 28627 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.488633 22578 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:41.418794 28574 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:41.466068 28611 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:41.414114 28619 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.573577 28563 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:41.461272 28512 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.130s	user 0.008s	sys 0.003s
I20260709 13:09:41.469388 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 786) took 1438 ms. Trace:
I20260709 13:09:41.567775 28421 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:41.510597 28545 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.254s	user 0.012s	sys 0.000s
W20260709 13:09:41.516829 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 74736.7us
W20260709 13:09:41.475628 28578 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.262s	user 0.000s	sys 0.010s
I20260709 13:09:41.499027 28551 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.478487 28536 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.633077 28421 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:41.634354 28637 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:09:41.636119 28421 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.636683 28614 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.637108 28536 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:41.638661 28627 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.417730 28640 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:41.639783 28599 consensus_queue.cc:1175] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fa2f181263f446a6962b649f9348c15f" responder_term: 11 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: [8.9-10.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:41.641381 28640 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.611335 28574 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.644487 27870 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:41.645080 27870 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.646039 28574 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.647498 27870 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.648483 28625 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.547574 28539 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.488076 28596 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.615345 23256 rpcz_store.cc:276] 0709 13:09:40.031245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.031561 (+   316us) service_pool.cc:224] Handling call
0709 13:09:40.053333 (+ 21772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.067166 (+ 13833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.067202 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.102530 (+ 35328us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.578201 (+475671us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:40.649214 (+ 71013us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.661683 (+ 12469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.661758 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.469147 (+807389us) raft_consensus.cc:1685] finished
0709 13:09:41.469184 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.469331 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49219,"prepare.queue_time_us":54941,"prepare.run_cpu_time_us":11956,"prepare.run_wall_time_us":69578,"raft.queue_time_us":13894,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":65154,"thread_start_us":331268,"threads_started":1,"wal-append.queue_time_us":593732}
I20260709 13:09:41.576119 28543 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.448174 28568 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.167s
I20260709 13:09:41.629233 28545 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.629431 28578 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.622464 28512 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.650079 28628 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.477487 28587 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.638691 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:41.652833 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3701) took 1607 ms. Trace:
I20260709 13:09:41.655879 22497 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 13:09:41.627290 28498 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
W20260709 13:09:41.658399 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 179975us
I20260709 13:09:41.681310 22497 pending_rounds.cc:85] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 8
I20260709 13:09:41.681725 22497 pending_rounds.cc:107] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:41.682093 22497 raft_consensus.cc:2889] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:41.627206 28619 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:41.665884 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.666275 22504 raft_consensus.cc:2368] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:41.664103 22505 rpcz_store.cc:276] 0709 13:09:40.045108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.119286 (+ 74178us) service_pool.cc:224] Handling call
0709 13:09:40.119631 (+   345us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:09:40.312599 (+192968us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:40.617224 (+304625us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.043965 (+426741us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.081470 (+ 37505us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:41.104928 (+ 23458us) log.cc:844] Serialized 52 byte log entry
0709 13:09:41.105117 (+   189us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:41.120171 (+ 15054us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.129280 (+  9109us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.129501 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.129598 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.458378 (+328780us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b18002ee520. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:41.652526 (+194148us) raft_consensus.cc:1685] finished
0709 13:09:41.652563 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.652757 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16437,"prepare.queue_time_us":636216,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":134,"raft.queue_time_us":47904,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":33479,"spinlock_wait_cycles":108201856,"thread_start_us":594466,"threads_started":2,"wal-append.queue_time_us":468369}
I20260709 13:09:41.683163 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3052) took 1361 ms. Trace:
W20260709 13:09:41.680971 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 178798us
I20260709 13:09:41.679344 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:41.687337 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3686) took 2720 ms. Trace:
I20260709 13:09:41.679880 28539 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.692795 22497 rpcz_store.cc:276] 0709 13:09:38.967048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.923421 (+956373us) service_pool.cc:224] Handling call
0709 13:09:39.923706 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.308721 (+1385015us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4c0027ef80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec245c7a20 00007fec245d8a29 00007fec2459e644 00007fec245c5f2d 00007fec245c5b93 00007fec262f618b 00007fec262f6cb5 00007fec262f1f30 00007fec262f37de 00007fec262fdb49 00007fec262fe416
0709 13:09:41.687065 (+378344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.687281 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57651072}
I20260709 13:09:41.684366 22654 rpcz_store.cc:276] 0709 13:09:40.322284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.149617 (+827333us) service_pool.cc:224] Handling call
0709 13:09:41.150031 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.151054 (+  1023us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:41.214618 (+ 63564us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.682743 (+468125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:41.682805 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:41.682858 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.682945 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.683095 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57,"prepare.queue_time_us":69785,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4057,"raft.queue_time_us":60858,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":21339,"thread_start_us":430197,"threads_started":2,"wal-append.queue_time_us":125134}
I20260709 13:09:41.691610 28163 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:41.709816 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.700834 22575 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:41.711947 22580 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.683789 28648 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:41.680743 28628 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:41.687911 28543 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.714785 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 76164.6us
I20260709 13:09:41.712327 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.688297 28599 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.702368 28498 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.720041 28512 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.725723 28650 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.731626 28545 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.691946 28097 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:41.765033 28097 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.765506 28097 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:41.766000 28360 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.766710 28619 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:41.767055 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.688932 28614 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:41.768672 28619 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.768899 28650 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.769199 28614 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.770377 28360 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:41.770916 28360 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.771377 28650 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.771492 28614 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.738412 22654 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:41.739573 28401 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:41.772715 28401 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:41.773353 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:41.773602 28360 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.689890 28596 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:41.774134 22654 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:41.774199 28596 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.775118 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.775884 22654 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:41.761323 28498 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.776513 28596 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:41.734272 28383 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
I20260709 13:09:41.758590 28543 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.759797 28599 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.769203 28619 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.738131 28648 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.691675 28421 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:09:41.738946 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:41.684959 28641 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:41.760394 28628 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:41.785280 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47191.7us
I20260709 13:09:41.797816 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.798527 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:41.798919 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:41.803594 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:41.777946 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:41.801685 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:41.786190 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.791800 23263 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:41.812168 22652 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:41.802423 22580 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:41.813146 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:41.800155 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:41.776829 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.814385 23262 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.815618 22654 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:41.783946 28648 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.818229 28614 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:41.785204 28641 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.818214 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.819818 23257 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:41.813807 28642 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:41.824806 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:41.821374 23259 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:41.821599 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.779524 28543 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.785605 28619 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.829990 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:41.831964 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.832955 22652 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:41.836512 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.802027 28545 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:41.837298 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.799822 28359 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:41.790159 28612 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.778298 28498 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.781270 28578 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.839118 22654 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:41.826933 28614 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:41.787788 28628 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.780553 28599 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.840759 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:41.840803 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.802096 28546 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:41.827382 28421 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:41.846783 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.834532 28539 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:41.849007 28421 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.834753 28642 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.851599 28642 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.852375 28614 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.853564 22652 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:41.846158 28563 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:41.841051 28359 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:41.857044 28628 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:41.836958 28543 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:41.849560 28421 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:41.846428 28612 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.778052 28383 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.860615 23255 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:41.862540 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:41.865934 23262 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:41.863175 28612 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:41.871840 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.869042 22573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2582) took 1746 ms (client timeout 1517 ms). Trace:
I20260709 13:09:41.866699 28543 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:41.877056 22573 rpcz_store.cc:269] 0709 13:09:40.122852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.123049 (+   197us) service_pool.cc:224] Handling call
0709 13:09:41.868769 (+1745720us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54003ac5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:41.868947 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150651776}
I20260709 13:09:41.878114 22497 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:41.878494 28264 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.878432 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:41.875113 28619 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:09:41.879631 22505 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:09:41.873308 22645 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:41.880237 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:41.873683 28563 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.880774 28641 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:41.881213 28563 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:41.883322 28563 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:41.885958 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56081us
I20260709 13:09:41.866891 28383 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:41.887945 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:41.866544 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:41.889197 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.889603 22502 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:41.889859 22654 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:41.875032 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 994) took 1504 ms. Trace:
I20260709 13:09:41.875811 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2673) took 1797 ms. Trace:
I20260709 13:09:41.876242 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:41.890828 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.874444 28628 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:41.892257 28646 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:41.872284 22647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3047) took 1593 ms (client timeout 2123 ms). Trace:
I20260709 13:09:41.893014 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:41.893147 22647 rpcz_store.cc:269] 0709 13:09:40.278798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.347802 (+ 69004us) service_pool.cc:224] Handling call
0709 13:09:41.872100 (+1524298us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400169254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:41.872230 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951547136}
I20260709 13:09:41.893853 22497 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:41.890954 22649 rpcz_store.cc:276] 0709 13:09:40.078619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.078774 (+   155us) service_pool.cc:224] Handling call
0709 13:09:40.120719 (+ 41945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.138573 (+ 17854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.875583 (+1737010us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5400169c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:41.875755 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39395200}
I20260709 13:09:41.878399 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:41.894447 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.892172 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:41.880894 22573 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.895826 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:41.891538 28264 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:41.897872 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.898066 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:41.890825 22574 rpcz_store.cc:276] 0709 13:09:40.370814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.371022 (+   208us) service_pool.cc:224] Handling call
0709 13:09:40.371413 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.580841 (+1209428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.874701 (+293860us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003b3b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:41.874950 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2511096064}
I20260709 13:09:41.892720 28646 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:41.877316 28543 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.903699 28612 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:41.893746 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.903246 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:41.895622 22505 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 9.
I20260709 13:09:41.903769 28543 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:41.899026 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.910705 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:41.918380 22654 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
I20260709 13:09:41.875241 28097 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.917455 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:41.920390 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:41.921308 22647 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.921188 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:41.891007 28619 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:41.919982 28539 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:41.904191 28646 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:41.904232 28563 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:41.946105 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:41.946362 23256 raft_consensus.cc:2368] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17.
I20260709 13:09:41.902248 28264 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:41.950373 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.947206 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.946911 22573 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 9.
I20260709 13:09:41.904261 28612 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:09:41.946336 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48345.1us
I20260709 13:09:41.957602 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:41.958598 22497 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:41.956074 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:41.956672 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:41.964529 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:41.968068 22647 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:41.970652 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:41.904826 28578 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:41.972386 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:41.973078 22500 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:41.933092 28619 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.973977 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:41.915666 28383 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:09:41.934809 28628 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:41.983289 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:41.975544 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:41.984697 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.985803 22647 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:41.957381 28264 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:41.961409 28562 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:41.969023 28612 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:42.007905 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.011662 22649 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:42.013648 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:41.973901 28641 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:42.020424 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62135.9us
I20260709 13:09:42.016481 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:42.017953 22573 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:42.017755 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.982285 28614 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:42.019021 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.022364 28557 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:41.982515 28619 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:42.018245 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:41.982129 28628 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.023509 22654 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:42.026232 22505 raft_consensus.cc:2368] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11.
I20260709 13:09:42.036991 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:42.038414 22573 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:42.039371 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:42.043913 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.044757 22647 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:42.028106 28614 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.034607 28641 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:42.027709 28562 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:42.036274 28628 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.056172 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:42.056432 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.074954 22654 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:42.057168 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.058867 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:42.072216 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:42.072715 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.077121 22649 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.054845 28563 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:42.086537 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:42.041898 28557 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:42.080066 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.057987 28614 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.081712 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:42.089349 23264 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:09:42.089843 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.092890 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.093542 22573 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:42.094720 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:42.058466 28360 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.119237 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.115000 23259 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:42.130522 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:42.121642 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:42.124188 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.125850 22649 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:42.133460 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.126185 22505 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:42.134568 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.135788 22649 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:42.092350 28539 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:42.149987 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 103972us
I20260709 13:09:42.151393 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:42.154341 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.123590 28563 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:42.138298 28625 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:42.163887 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:42.122944 28557 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.164304 22649 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:42.137702 28097 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:42.165475 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.138048 28360 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:42.203703 22505 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:42.160367 28536 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:42.135800 28359 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:42.176501 28611 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:42.167833 28641 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.177033 28545 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:42.178086 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:42.211881 22468 leader_election.cc:400] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:42.212209 22468 leader_election.cc:403] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.142975 28498 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:09:42.142675 28533 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:09:42.162503 28539 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:42.166445 28625 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:42.229691 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.212679 28612 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.197948 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3057) took 1487 ms. Trace:
I20260709 13:09:42.168633 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3058) took 1397 ms. Trace:
I20260709 13:09:42.251874 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.218509 28611 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:42.191164 22500 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:09:42.288472 22649 rpcz_store.cc:276] 0709 13:09:40.710767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.149070 (+1438303us) service_pool.cc:224] Handling call
0709 13:09:42.163980 (+ 14910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.197686 (+ 33706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.197890 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126208}
I20260709 13:09:42.294463 28539 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:42.205840 28421 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.298440 28421 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:42.300837 28628 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:42.171027 28562 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:42.305492 22651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2678) took 2198 ms (client timeout 2856 ms). Trace:
W20260709 13:09:42.305891 22651 rpcz_store.cc:269] 0709 13:09:40.106948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.228751 (+121803us) service_pool.cc:224] Handling call
0709 13:09:42.305327 (+2076576us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400235d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.305437 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340178816}
I20260709 13:09:42.307899 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2671) took 2247 ms. Trace:
I20260709 13:09:42.219352 28545 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16.
I20260709 13:09:42.308310 22646 rpcz_store.cc:276] 0709 13:09:40.060509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.060663 (+   154us) service_pool.cc:224] Handling call
0709 13:09:42.307660 (+2246997us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54002da0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.307812 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873831296}
I20260709 13:09:42.309255 28564 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:42.252208 28625 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.303455 28612 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:42.264071 28563 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:42.288851 22505 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
W20260709 13:09:42.304466 28585 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.961s	user 0.006s	sys 0.013s
I20260709 13:09:42.222615 28512 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:42.321658 28360 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:42.322290 28436 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.325341 28619 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:42.329460 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2580) took 2237 ms (client timeout 1832 ms). Trace:
I20260709 13:09:42.329924 28359 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:42.330847 28498 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.331593 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1159) took 2197 ms. Trace:
I20260709 13:09:42.359550 22645 rpcz_store.cc:276] 0709 13:09:40.133766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.997735 (+863969us) service_pool.cc:224] Handling call
0709 13:09:41.873153 (+875418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.880634 (+  7481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.331378 (+450744us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b5400169250. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.331530 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012481280}
I20260709 13:09:42.336064 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.362150 22500 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:42.339421 22649 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:09:42.341548 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.332921 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:42.356786 22575 rpcz_store.cc:269] 0709 13:09:40.091715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.091914 (+   199us) service_pool.cc:224] Handling call
0709 13:09:42.329289 (+2237375us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54003b2c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.329387 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3421121920}
I20260709 13:09:42.345273 23261 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:42.331619 28421 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.304955 22654 rpcz_store.cc:276] 0709 13:09:40.771187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.143453 (+1372266us) service_pool.cc:224] Handling call
0709 13:09:42.164444 (+ 20991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.168291 (+  3847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.168328 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.168375 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:42.168412 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.168472 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.168578 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591040}
I20260709 13:09:42.367020 22645 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:42.348343 28512 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:42.372309 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:42.373247 22505 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.375695 22573 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:42.403420 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3743) took 1060 ms. Trace:
I20260709 13:09:42.404920 22649 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:09:42.407652 22654 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:42.405227 22580 rpcz_store.cc:276] 0709 13:09:41.343169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.309848 (+966679us) service_pool.cc:224] Handling call
0709 13:09:42.310158 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.310365 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:42.310642 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.402914 (+ 92272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.402984 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:42.403059 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.403164 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.403346 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":994,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":732,"thread_start_us":90963,"threads_started":1}
I20260709 13:09:42.425074 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.369760 28360 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:42.428984 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3745) took 1085 ms. Trace:
I20260709 13:09:42.435686 22580 rpcz_store.cc:276] 0709 13:09:41.343771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.427956 (+1084185us) service_pool.cc:224] Handling call
0709 13:09:42.428445 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.428620 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.428645 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.428684 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:42.428728 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.428784 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.428927 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.437474 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3747) took 1086 ms. Trace:
I20260709 13:09:42.437886 22580 rpcz_store.cc:276] 0709 13:09:41.351449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.436684 (+1085235us) service_pool.cc:224] Handling call
0709 13:09:42.436989 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.437164 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.437189 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.437229 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:42.437269 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.437318 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.437423 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:42.438706 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 207660us
I20260709 13:09:42.439440 22580 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:42.439637 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:42.440066 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3748) took 1088 ms. Trace:
I20260709 13:09:42.441310 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:42.427646 28543 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 13:09:42.424602 28562 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.443959 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:42.440428 22580 rpcz_store.cc:276] 0709 13:09:41.351782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.438833 (+1087051us) service_pool.cc:224] Handling call
0709 13:09:42.439114 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.439828 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.440018 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.450850 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3751) took 1098 ms. Trace:
I20260709 13:09:42.451653 22580 rpcz_store.cc:276] 0709 13:09:41.352665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.449526 (+1096861us) service_pool.cc:224] Handling call
0709 13:09:42.449794 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.449991 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.450015 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.450054 (+    39us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:42.450091 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.450146 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.450770 (+   624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.450616 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:42.454995 28611 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:42.455458 28611 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:42.455847 28611 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:42.456434 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:42.459373 28545 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:42.460188 28545 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:42.460695 28545 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:42.461752 28545 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:42.465440 22496 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:42.437527 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.435062 28264 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.401091 28498 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.423709 28359 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:09:42.471957 28436 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:42.400887 28421 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.431879 28360 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:42.466794 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.832s (SENT) [suppressed 19 similar messages]
I20260709 13:09:42.442565 28536 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.494194 22651 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:09:42.433287 28614 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.481781 28360 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.505604 22580 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:09:42.471388 28543 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.515038 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.517100 22503 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:09:42.487329 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3744) took 1143 ms. Trace:
I20260709 13:09:42.519218 22575 rpcz_store.cc:276] 0709 13:09:41.343491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.371249 (+1027758us) service_pool.cc:224] Handling call
0709 13:09:42.371604 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.371863 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:42.407374 (+ 35511us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.482737 (+ 75363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.482923 (+   186us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:42.482989 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.486552 (+  3563us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.487043 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36331,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2476,"raft.queue_time_us":302,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":12220,"thread_start_us":73032,"threads_started":1}
I20260709 13:09:42.478566 28562 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.532011 22574 raft_consensus.cc:2368] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
I20260709 13:09:42.481618 28512 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:42.554138 28675 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:42.555058 22575 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:42.555984 28620 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.449s	user 0.000s	sys 0.007s
I20260709 13:09:42.526703 28614 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.568199 28562 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.510913 28625 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.571758 28625 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:42.573815 28543 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.574887 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1161) took 1227 ms. Trace:
I20260709 13:09:42.575438 28264 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.575315 22647 rpcz_store.cc:276] 0709 13:09:41.347709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.192598 (+844889us) service_pool.cc:224] Handling call
0709 13:09:42.208101 (+ 15503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.208356 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.208374 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.208708 (+   334us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.408387 (+199679us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:42.408517 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.408679 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.574645 (+165966us) raft_consensus.cc:1685] finished
0709 13:09:42.574667 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.574827 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5574,"thread_start_us":121878,"threads_started":1,"wal-append.queue_time_us":254011}
I20260709 13:09:42.579326 28498 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.528496 28642 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:42.588320 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 121546us
W20260709 13:09:42.572680 28670 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:42.596712 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:42.589046 22468 leader_election.cc:336] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.911s (SENT)
I20260709 13:09:42.582089 28628 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:42.586880 28619 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:42.581943 28642 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:42.607945 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.610015 22503 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:42.603225 28421 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:42.602077 28512 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.650147 22505 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:42.652491 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:42.654013 22503 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:42.653258 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:42.654045 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 65026.3us
I20260709 13:09:42.655664 23262 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:42.660422 22468 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.938s (SENT)
I20260709 13:09:42.699044 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3051) took 2387 ms. Trace:
I20260709 13:09:42.699507 22648 rpcz_store.cc:276] 0709 13:09:40.311454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.039521 (+728067us) service_pool.cc:224] Handling call
0709 13:09:41.106135 (+ 66614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.162006 (+ 55871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.162043 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:41.162088 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:41.162124 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.698816 (+1536692us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b5400326254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:42.698858 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.698985 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127998720}
I20260709 13:09:42.701556 28642 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.702647 28642 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:42.711934 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56574.2us
I20260709 13:09:42.718979 22468 leader_election.cc:400] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:42.719353 22468 leader_election.cc:403] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.720633 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.721186 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.721887 22496 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:42.666464 28641 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:42.723133 28545 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:42.737727 22647 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:09:42.739601 22646 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: [18.13-19.14]
I20260709 13:09:42.714273 28360 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.727599 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:42.720273 28558 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 13:09:42.752223 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.729467 28264 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.729630 28597 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.753688 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.755023 22654 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:42.747659 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.745639 28644 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:42.755863 22503 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:42.757125 22649 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:42.756349 28644 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:42.761034 28644 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.762574 28644 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.764410 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1167) took 1043 ms. Trace:
I20260709 13:09:42.764809 22651 rpcz_store.cc:276] 0709 13:09:41.721372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.306638 (+585266us) service_pool.cc:224] Handling call
0709 13:09:42.307028 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.501460 (+194432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.764132 (+262672us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400325d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:42.764346 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429758720}
I20260709 13:09:42.766309 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.766992 22496 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:42.767688 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.768209 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.769310 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.761199 28401 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.773690 28401 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.774680 28031 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.776530 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 1001) took 1076 ms. Trace:
I20260709 13:09:42.777019 22574 rpcz_store.cc:276] 0709 13:09:41.700423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.905304 (+204881us) service_pool.cc:224] Handling call
0709 13:09:42.776290 (+870986us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54003ee9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.776467 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420785024}
W20260709 13:09:42.789767 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.790587 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.792258 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:42.792546 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:42.793195 28646 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:42.795585 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:42.796240 23261 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:09:42.797371 22504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3699) took 2752 ms (client timeout 2755 ms). Trace:
W20260709 13:09:42.797773 22504 rpcz_store.cc:269] 0709 13:09:40.044571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.064315 (+ 19744us) service_pool.cc:224] Handling call
0709 13:09:42.797130 (+2732815us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54001a9354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.797279 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3374283008}
I20260709 13:09:42.799502 28558 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:42.799923 28558 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:42.800674 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:42.800753 28558 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:42.802103 28558 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:42.802538 23262 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:42.803594 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:42.804435 23259 raft_consensus.cc:2410] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:09:42.805109 28597 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.807168 28597 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.808948 28264 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.809911 23261 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:42.811276 28264 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:42.812985 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.829757 22544 leader_election.cc:400] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17.
I20260709 13:09:42.830257 22544 leader_election.cc:403] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.831281 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:42.832258 22646 raft_consensus.cc:2368] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:42.835474 28628 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:42.836133 28498 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:42.837214 28543 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:42.837589 28543 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:42.838387 28543 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.839603 28543 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:42.842815 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.843477 22575 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:42.844480 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:42.874547 28661 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.803s	user 0.000s	sys 0.002s
I20260709 13:09:42.845958 28628 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17.
I20260709 13:09:42.869705 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3746) took 1525 ms. Trace:
I20260709 13:09:42.939134 22578 rpcz_store.cc:276] 0709 13:09:41.344027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.345771 (+  1744us) service_pool.cc:224] Handling call
0709 13:09:42.869459 (+1523688us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003f5054. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.869629 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325922048}
I20260709 13:09:42.939560 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:42.940586 28152 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:42.940758 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.941185 28152 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:42.942365 28152 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.942668 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.943500 22578 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:42.888799 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:42.939145 28573 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.946504 28573 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:42.894649 22575 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:42.867084 28504 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:42.855652 22498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3688) took 3856 ms (client timeout 2548 ms). Trace:
W20260709 13:09:42.950855 22498 rpcz_store.cc:269] 0709 13:09:39.003498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.500366 (+496868us) service_pool.cc:224] Handling call
0709 13:09:42.855359 (+3354993us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54003fbe54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.855564 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3927238528}
I20260709 13:09:42.952299 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:42.851287 28664 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.566s	user 0.002s	sys 0.000s
I20260709 13:09:42.954154 28573 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:42.944625 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:42.955130 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.856952 22499 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:42.955773 22497 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:42.846757 28618 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.736s	user 0.004s	sys 0.004s
I20260709 13:09:42.957062 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.958074 22497 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:42.958446 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2679) took 2851 ms. Trace:
I20260709 13:09:42.959628 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.958935 22650 rpcz_store.cc:276] 0709 13:09:40.107216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.249121 (+141905us) service_pool.cc:224] Handling call
0709 13:09:40.249799 (+   678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.755571 (+505772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.755607 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.769811 (+ 14204us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.965332 (+195521us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:40.965368 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.965505 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.846140 (+1880635us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:42.958094 (+111954us) raft_consensus.cc:1685] finished
0709 13:09:42.958120 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.958353 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65348,"raft.queue_time_us":167101,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":16096128,"thread_start_us":554631,"threads_started":2,"wal-append.queue_time_us":313436}
W20260709 13:09:42.885133 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.961588 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.963318 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.964020 22497 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:42.965636 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:42.965821 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.862875 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3740) took 1520 ms. Trace:
I20260709 13:09:42.976958 22571 rpcz_store.cc:276] 0709 13:09:41.342269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.342414 (+   145us) service_pool.cc:224] Handling call
0709 13:09:41.872655 (+530241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.872839 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.875144 (+  2305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:41.875198 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:41.875251 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.875308 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.862657 (+987349us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54003ac5d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.862803 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218516352}
I20260709 13:09:42.978685 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.979996 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.895610 28564 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.981389 28564 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.984150 28564 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.755122 28611 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.870993 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.985333 22498 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:09:42.985777 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:42.986910 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:42.988091 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.988880 22504 raft_consensus.cc:2410] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:09:42.989878 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:42.900806 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.017007 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.888836 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:43.018805 23259 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.905743 28597 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.020851 28597 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.021351 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.021950 23263 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:09:43.023137 28597 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.023705 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:42.905592 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:42.888142 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:42.906793 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:42.907522 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.030483 22652 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.031040 22647 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:42.887458 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3749) took 1535 ms. Trace:
I20260709 13:09:43.033030 22573 rpcz_store.cc:276] 0709 13:09:41.352090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.154048 (+801958us) service_pool.cc:224] Handling call
0709 13:09:42.887263 (+733215us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003bc254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.887402 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506571008}
I20260709 13:09:43.034181 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.035283 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.035954 22573 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:42.908332 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:43.041162 22504 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 10.
I20260709 13:09:43.042610 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.043453 22504 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:43.043809 22652 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:42.889434 23262 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:43.044368 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:42.913725 22572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2577) took 2844 ms (client timeout 1938 ms). Trace:
W20260709 13:09:43.045399 22572 rpcz_store.cc:269] 0709 13:09:40.069431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.069551 (+   120us) service_pool.cc:224] Handling call
0709 13:09:42.913480 (+2843929us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003bcc54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.913633 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308589824}
I20260709 13:09:43.046499 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.047536 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.048532 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.847853 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:43.049419 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 201718us
I20260709 13:09:43.049722 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:43.051290 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.052711 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.052994 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:43.053695 22572 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:43.054118 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.054462 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.055145 22572 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:42.917639 28663 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.857s	user 0.002s	sys 0.000s
I20260709 13:09:43.055559 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:42.921182 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:09:42.922188 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 991) took 2708 ms (client timeout 2245 ms). Trace:
W20260709 13:09:42.923471 28662 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.789s	user 0.001s	sys 0.000s
W20260709 13:09:43.056836 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 135762us
I20260709 13:09:43.057020 28628 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:09:42.924117 22579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2581) took 2832 ms (client timeout 3250 ms). Trace:
I20260709 13:09:43.057652 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:43.058049 28498 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:43.057863 22579 rpcz_store.cc:269] 0709 13:09:40.091973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.118076 (+ 26103us) service_pool.cc:224] Handling call
0709 13:09:42.923903 (+2805827us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400256f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.924052 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049897856}
I20260709 13:09:43.058750 28498 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.059145 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:42.929883 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:43.057813 28628 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:43.059726 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:09:42.924587 28665 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.640s	user 0.002s	sys 0.000s
I20260709 13:09:43.060475 28628 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.060552 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.060492 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.061888 22579 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:43.062350 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:43.056686 22577 rpcz_store.cc:269] 0709 13:09:40.214085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.214328 (+   243us) service_pool.cc:224] Handling call
0709 13:09:42.921971 (+2707643us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003c96d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.922105 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2628489984}
I20260709 13:09:43.063267 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:43.063438 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.063862 22577 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.060930 28211 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:43.064659 28211 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:42.932250 28360 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.937129 28603 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.966478 28666 raft_consensus.cc:2764] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:09:42.955754 22578 raft_consensus.cc:2376] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15. Re-sending same reply.
I20260709 13:09:42.882563 28586 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.911024 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.968694 28490 consensus_queue.cc:1059] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:42.984478 22576 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:42.967345 28539 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:42.990489 28611 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:42.993363 22571 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:09:42.994277 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:42.997686 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109015us
I20260709 13:09:42.998301 28568 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:42.957118 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3063) took 3009 ms. Trace:
I20260709 13:09:43.000885 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:42.972455 22575 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:42.897118 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:43.007026 22650 raft_consensus.cc:1217] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Deduplicated request from leader. Original: 14.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:09:43.008210 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:43.011418 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.036731 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:43.093567 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.876495 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 998) took 1177 ms. Trace:
I20260709 13:09:43.096621 28596 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.059216 28498 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.097386 22575 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:43.097251 28596 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.099215 22575 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:43.096680 22580 rpcz_store.cc:276] 0709 13:09:41.699518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.495663 (+796145us) service_pool.cc:224] Handling call
0709 13:09:42.496061 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.510261 (+ 14200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.876202 (+365941us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b5400279cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:42.876435 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21352832}
I20260709 13:09:43.102170 22580 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:09:43.104543 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.064141 22502 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:43.065066 28211 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:43.105682 22576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2576) took 3036 ms (client timeout 1911 ms). Trace:
I20260709 13:09:43.106146 22571 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:09:43.106528 22576 rpcz_store.cc:269] 0709 13:09:40.069080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.069230 (+   150us) service_pool.cc:224] Handling call
0709 13:09:43.105499 (+3036269us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54003cbed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:43.105615 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6370701696}
I20260709 13:09:43.108059 22497 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 18: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:43.108489 28568 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:43.112928 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.113658 23260 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:43.113817 28568 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.114871 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.115585 23260 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:43.075884 23263 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:43.116288 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:43.109746 28490 consensus_queue.cc:1243] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer fa2f181263f446a6962b649f9348c15f log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:43.110385 28586 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.117594 28586 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.119434 28668 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:43.119727 28586 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.109510 22650 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:43.120056 28668 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:43.063267 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:43.120522 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:43.121119 22501 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.121119 23260 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.121532 22498 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:42.735368 28641 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:42.876555 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:43.111594 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.124325 23258 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:43.125361 28641 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:43.125451 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.126468 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.126965 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.127610 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.128544 23263 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 17: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:43.128602 22496 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:43.107827 22499 rpcz_store.cc:276] 0709 13:09:39.955930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.109031 (+153101us) service_pool.cc:224] Handling call
0709 13:09:42.856486 (+2747455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.956084 (+ 99598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.956892 (+   808us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54003fbe50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:42.957049 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6317710720}
I20260709 13:09:43.065714 28603 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.065645 28590 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:43.130534 28590 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:43.131618 22646 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:43.131681 28603 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:43.113605 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.067840 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:43.132778 23261 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:43.062714 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.133023 28636 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:43.111982 28596 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:43.133446 28636 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.102170 22578 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:43.133878 28636 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.005820 28564 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.137058 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69291.8us
I20260709 13:09:43.137401 28668 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.139569 28668 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.140692 22469 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:43.109483 22497 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:43.141757 28539 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:43.142179 28539 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.142505 28539 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:43.136085 28564 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.076025 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:43.145630 23257 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:43.084105 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.145892 28611 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:43.146986 28611 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:43.147333 28611 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:43.147729 28564 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.148129 28611 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.150882 28596 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:43.151697 28611 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:43.140895 23258 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:43.111248 22502 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:43.155627 22502 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:09:43.105705 28498 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.158468 22501 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:43.160516 28498 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:43.161080 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:43.163333 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 216691us
I20260709 13:09:43.163954 28211 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.164453 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:43.165360 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.165620 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.167258 22650 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:09:43.161202 22573 raft_consensus.cc:2368] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:43.169178 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:43.087738 22572 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:09:43.161980 22575 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:09:43.170037 22645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.084s	sys 0.254s
W20260709 13:09:43.171591 22645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.084s	sys 0.254s
I20260709 13:09:43.172610 28519 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:43.173491 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3085) took 1214 ms. Trace:
I20260709 13:09:43.177430 22498 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:09:43.131455 28590 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.138177 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:43.168905 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:43.177518 22645 rpcz_store.cc:276] 0709 13:09:41.959627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.368224 (+408597us) service_pool.cc:224] Handling call
0709 13:09:42.368792 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.369062 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:42.611561 (+242499us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.173164 (+561603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.173221 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:43.173267 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.173327 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.173435 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160348,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":4996,"raft.queue_time_us":932,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":768125,"threads_started":2,"wal-append.queue_time_us":558641}
I20260709 13:09:43.186084 28519 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:43.175203 28563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.025s	sys 0.051s
W20260709 13:09:43.192838 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 392884us
W20260709 13:09:43.191861 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53795.5us
I20260709 13:09:43.194213 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:43.187389 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:43.186587 28519 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:43.203123 23260 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:43.197525 23229 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:43.205639 22400 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 323) took 38781 ms (client timeout 15000 ms). Trace:
I20260709 13:09:42.725296 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.252081 22577 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:43.169036 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.254199 22650 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.259503 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:43.036588 23259 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:09:43.241214 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.068s	sys 0.135s
W20260709 13:09:43.290756 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.070s	sys 0.136s
I20260709 13:09:43.268220 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:43.291035 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:43.292253 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:43.191274 28563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.026s	sys 0.051s
I20260709 13:09:43.273032 28589 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:09:43.275568 28642 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:09:43.278445 22398 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 12, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 12 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.144734 28636 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.205034 28641 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.273168 28546 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:43.395504 28586 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:43.273401 28541 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:09:43.275892 28031 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:09:43.250329 28562 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.276448 28335 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:09:43.296242 22647 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:09:43.305809 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.456154 22652 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:09:43.315054 22469 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:43.045019 22504 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:43.458513 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:43.327526 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.297721 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:43.459820 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 162170us
I20260709 13:09:43.206729 28498 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:43.390954 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:43.392159 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.207497 28057 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:43.394451 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:43.396096 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 103921us
I20260709 13:09:43.206921 28211 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.207352 28360 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:43.399119 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.400593 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.400380 28504 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.403784 28490 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:43.406317 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:43.406921 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.408176 22649 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:09:43.206166 22400 rpcz_store.cc:269] 0709 13:09:04.424350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.424544 (+   194us) service_pool.cc:224] Handling call
0709 13:09:43.205545 (+38781001us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:40.016362 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:40.017160 (+   798us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:40.017212 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:09:40.017232 (+    20us) tablet.cc:662] Decoding operations
0709 13:09:40.018206 (+   974us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:40.018368 (+   162us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:40.018396 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:09:40.019055 (+   659us) tablet.cc:701] Row locks acquired
0709 13:09:40.019108 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:09:40.019295 (+   187us) write_op.cc:270] Start()
0709 13:09:40.019452 (+   157us) write_op.cc:276] Timestamp: P: 1783602580019225 usec, L: 0
0709 13:09:40.019490 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:09:40.081121 (+ 61631us) log.cc:844] Serialized 2100 byte log entry
0709 13:09:41.360191 (+1279070us) op_driver.cc:464] REPLICATION: finished
0709 13:09:41.409259 (+ 49068us) write_op.cc:301] APPLY: starting
0709 13:09:41.409403 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:41.642051 (+232648us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:41.642214 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:41.681965 (+ 39751us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:41.741504 (+ 59539us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:09:41.741571 (+    67us) write_op.cc:312] APPLY: finished
0709 13:09:41.741915 (+   344us) log.cc:844] Serialized 57 byte log entry
0709 13:09:41.742120 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:41.742221 (+   101us) write_op.cc:454] Released schema lock
0709 13:09:41.742293 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:41.742703 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:41.742737 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13391,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":48644,"apply.run_cpu_time_us":12114,"apply.run_wall_time_us":333489,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25047,"num_ops":5,"prepare.queue_time_us":165823,"prepare.run_cpu_time_us":10727,"prepare.run_wall_time_us":173204,"raft.queue_time_us":247392,"raft.run_cpu_time_us":17866,"raft.run_wall_time_us":58171,"replication_time_us":1340488,"thread_start_us":503491,"threads_started":4,"wal-append.queue_time_us":476635,"wal-append.run_cpu_time_us":23937,"wal-append.run_wall_time_us":2143348}]]}
I20260709 13:09:43.483052 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.483124 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.483666 22505 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:43.484167 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:43.414203 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.483175 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:43.414855 22496 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:43.485379 28597 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:43.415747 22501 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:43.420308 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:43.487092 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66912us
I20260709 13:09:43.204569 28519 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:43.409546 28552 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:09:43.423666 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.293650 28644 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:09:43.404954 28666 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:43.423174 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:43.397895 28634 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:43.208701 28476 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:43.453178 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.462415 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 147478us
I20260709 13:09:43.451769 28586 consensus_queue.cc:1243] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:43.465965 22653 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.468453 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:43.468704 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:43.465298 22651 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:43.470023 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.467825 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:43.474910 22619 leader_election.cc:400] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11.
I20260709 13:09:43.508484 22504 raft_consensus.cc:2368] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:43.476769 22646 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:43.479430 22398 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 12 to 14, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 14 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.475835 28596 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.456972 28562 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.481542 28504 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.464071 28573 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:43.524046 28573 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:43.524576 28573 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.497730 23258 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:43.498257 22652 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:09:43.502902 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:43.536458 22654 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:43.536624 22649 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:43.467904 28611 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:43.501605 28211 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:09:43.538055 28611 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:43.467691 28057 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:43.508617 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47398us
I20260709 13:09:43.539265 28057 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:43.539230 28611 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.540045 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:43.542310 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:43.511830 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:43.513054 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.515196 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.513087 22651 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:43.516821 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:43.516474 22398 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:43.517413 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.544215 22496 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.517653 22504 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:43.543493 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:43.519557 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.520470 22499 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:43.520382 28596 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.521374 28490 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:43.497677 22650 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:43.506222 28644 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:43.501302 28498 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:43.501631 28666 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:43.534504 23255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.012s	sys 0.024s
I20260709 13:09:43.545434 22505 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 11: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:43.552482 23255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.012s	sys 0.024s
I20260709 13:09:43.552803 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:43.544618 22501 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:43.473789 28539 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.544760 22504 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:43.548316 22645 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:09:43.550086 22648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.008s	sys 0.016s
W20260709 13:09:43.569314 22648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.008s	sys 0.017s
W20260709 13:09:43.545675 23264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.020s
W20260709 13:09:43.570441 23264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.016s	sys 0.020s
W20260709 13:09:43.567071 23227 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.014s
W20260709 13:09:43.543470 28558 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.007s
W20260709 13:09:43.571293 23227 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.010s	sys 0.014s
W20260709 13:09:43.576288 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 755455us
W20260709 13:09:43.580592 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.547098 28031 raft_consensus.cc:2764] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:09:43.550303 28668 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:43.566638 28639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.014s	sys 0.014s
I20260709 13:09:43.547624 28490 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:43.627389 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.550001 28644 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:43.567143 28666 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:43.599424 28152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.008s	sys 0.019s
W20260709 13:09:43.618814 28545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.004s	sys 0.016s
W20260709 13:09:43.596642 28619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.020s	sys 0.009s
I20260709 13:09:43.680951 22496 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
W20260709 13:09:43.665732 28676 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:09:43.666452 28545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.005s	sys 0.016s
W20260709 13:09:43.666056 28152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.008s	sys 0.019s
W20260709 13:09:43.643317 28639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.015s	sys 0.014s
I20260709 13:09:43.696074 28596 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.649837 28490 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:43.787585 22504 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.695937 28644 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.629499 28335 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:43.789502 28644 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:43.789644 28335 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:43.790300 28543 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.790863 28543 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.790911 28335 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:43.703938 22503 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:43.798293 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.799216 23258 raft_consensus.cc:2410] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 13:09:43.677949 28619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.021s	sys 0.009s
I20260709 13:09:43.733546 22653 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:43.692981 22646 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:43.737703 22398 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:43.741281 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 229529us
I20260709 13:09:43.680673 28031 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.758234 28539 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.759109 28057 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.759708 28636 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:43.731243 28586 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:43.816550 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:43.761461 28562 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.762825 28568 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.730646 28634 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:43.788698 22504 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:43.751578 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3724) took 1399 ms. Trace:
I20260709 13:09:43.811221 22468 leader_election.cc:400] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14.
I20260709 13:09:43.817351 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:43.771768 28504 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:43.834240 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:43.831344 22500 rpcz_store.cc:276] 0709 13:09:42.351795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.431477 (+ 79682us) service_pool.cc:224] Handling call
0709 13:09:42.448395 (+ 16918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.448728 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.448755 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.449386 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.291158 (+841772us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:43.395281 (+104123us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.401955 (+  6674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.402032 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.622002 (+219970us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18003b54e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:43.751095 (+129093us) raft_consensus.cc:1685] finished
0709 13:09:43.751256 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.751491 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6370,"prepare.queue_time_us":105960,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":9500,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":2407,"spinlock_wait_cycles":5363584,"thread_start_us":808795,"threads_started":1,"wal-append.queue_time_us":1167777}
W20260709 13:09:43.830447 28590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.010s	sys 0.030s
I20260709 13:09:43.814175 28152 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:43.847730 23257 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:43.848595 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:43.844199 28539 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:09:43.855122 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 300728us
W20260709 13:09:43.848248 28590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.011s	sys 0.031s
I20260709 13:09:43.832103 28597 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:43.842197 28543 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:43.853717 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 368085us
I20260709 13:09:43.844260 28586 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:43.849905 22545 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.023s
W20260709 13:09:43.876514 22545 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.007s	sys 0.024s
W20260709 13:09:43.865515 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 442382us
I20260709 13:09:43.844039 28552 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:09:43.854801 28558 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:43.891109 28603 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:43.892077 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:43.893699 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.880151 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 553307us
I20260709 13:09:43.907527 22577 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:43.909667 22571 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:43.911101 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:43.869902 28642 consensus_queue.cc:1243] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:09:43.841001 28568 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.853323 28563 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:43.876049 28539 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:43.855912 28152 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.898589 28611 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.917850 28543 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.969944 22398 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 11, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.971967 28490 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.973767 28057 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:43.975714 28646 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:43.976120 28646 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:43.977056 28706 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:09:43.978052 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.931118 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 274625us
I20260709 13:09:43.973815 28543 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.986800 28543 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:43.989465 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3089) took 1076 ms. Trace:
I20260709 13:09:43.989988 23227 leader_election.cc:400] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
I20260709 13:09:43.990419 23227 leader_election.cc:403] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:43.990315 28539 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:43.989923 22497 rpcz_store.cc:276] 0709 13:09:42.912571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.142027 (+229456us) service_pool.cc:224] Handling call
0709 13:09:43.142431 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.143664 (+  1233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.143704 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.144305 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.574000 (+429695us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:43.574063 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.574144 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.989255 (+415111us) raft_consensus.cc:1685] finished
0709 13:09:43.989277 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.989406 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":604,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":429269,"threads_started":1,"wal-append.queue_time_us":843046}
I20260709 13:09:43.993351 28476 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
I20260709 13:09:43.917280 28558 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:43.844743 28547 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:09:43.939288 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.942560 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.944255 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:43.946707 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:43.952433 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:43.951735 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.008023 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.003753 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 110178us
W20260709 13:09:43.958055 22545 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Timed out: RequestConsensusVote RPC to 127.20.227.129:38445 timed out after 1.561s (SENT)
I20260709 13:09:43.967224 28611 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:44.011083 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:44.011960 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54026.6us
I20260709 13:09:44.012537 28611 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:43.967842 28692 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:43.968170 28642 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:44.014149 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.014813 28642 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:44.015161 28628 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:43.912994 28634 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.015703 28642 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.934507 22571 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:43.999935 22572 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:43.999879 22502 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:43.946250 28641 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:09:44.022964 28642 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.004189 23257 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:44.020900 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2680) took 1291 ms. Trace:
I20260709 13:09:44.023401 28641 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:44.024096 28641 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:44.024037 22648 rpcz_store.cc:276] 0709 13:09:42.729638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.729758 (+   120us) service_pool.cc:224] Handling call
0709 13:09:42.730095 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.734730 (+  4635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.734763 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.755310 (+ 20547us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.569985 (+814675us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:43.570050 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.570137 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.020577 (+450440us) raft_consensus.cc:1685] finished
0709 13:09:44.020608 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.020801 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11566,"thread_start_us":675753,"threads_started":1,"wal-append.queue_time_us":953752}
I20260709 13:09:44.025327 28641 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.026558 28641 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:44.002911 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110890us
I20260709 13:09:44.029800 28642 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:44.029928 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:44.007398 22503 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:44.039032 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:43.996418 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.041199 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:44.042788 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:44.043345 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:44.044147 22575 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:44.044442 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:44.046038 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49698.4us
I20260709 13:09:44.039898 22580 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:44.047005 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:44.048007 28714 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:43.972625 22398 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.050040 22398 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 13, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 13 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:43.984665 28519 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.053972 22573 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:09:44.054263 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44343.1us
I20260709 13:09:44.055094 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.055994 28541 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:44.056600 28720 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:44.057080 28541 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:44.057358 28720 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:44.057463 28541 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:44.057714 22619 leader_election.cc:400] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:44.057914 28720 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.058349 28720 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.058498 28541 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:44.059751 28541 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:44.055306 28696 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:44.051776 22398 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 8 to 12, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 12 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:44.188269 22504 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:09:44.194471 22504 pending_rounds.cc:85] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 13
I20260709 13:09:44.195953 22504 pending_rounds.cc:107] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:09:44.037413 28552 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:44.197713 22504 raft_consensus.cc:2889] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.061129 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:44.192415 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.968413 28597 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:44.189118 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 961) took 1171 ms. Trace:
I20260709 13:09:44.189898 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 960) took 1172 ms. Trace:
W20260709 13:09:44.194681 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 154354us
I20260709 13:09:44.201417 23264 rpcz_store.cc:276] 0709 13:09:43.018122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.019460 (+  1338us) service_pool.cc:224] Handling call
0709 13:09:43.019753 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.019978 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:43.570987 (+551009us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.188713 (+617726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.188791 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:44.188854 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.188940 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.189059 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":772939,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":114912,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":1053015,"threads_started":3}
I20260709 13:09:44.059806 28716 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.136s
I20260709 13:09:44.005097 28563 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.194s
I20260709 13:09:44.055747 28639 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.191082 28590 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.193046 28611 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:44.207652 28666 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.002s
I20260709 13:09:44.194988 28476 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:43.931803 28586 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.232137 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:44.194191 28545 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:44.201409 23255 rpcz_store.cc:276] 0709 13:09:43.017824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.017970 (+   146us) service_pool.cc:224] Handling call
0709 13:09:43.018292 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.018664 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:43.552904 (+534240us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.189567 (+636663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.189616 (+    49us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:44.189665 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.189728 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.189846 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":649296,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":101692,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":55,"thread_start_us":1069643,"threads_started":3}
I20260709 13:09:44.203928 28552 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:44.256126 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 258340us
I20260709 13:09:44.232681 28717 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:44.279574 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 400754us
W20260709 13:09:44.289105 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57035.3us
I20260709 13:09:44.292059 22545 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.294626 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:44.194589 28713 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
W20260709 13:09:44.353593 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 292504us
I20260709 13:09:44.357276 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:44.199369 28646 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.267086 28031 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:44.290333 28639 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:44.341393 28596 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:44.257561 28666 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:44.361161 28717 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:44.259507 28731 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:09:44.367218 28543 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:44.243860 28558 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:44.250022 28590 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.275727 28611 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:44.399670 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 102944us
I20260709 13:09:44.280241 28545 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:44.549837 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:44.556152 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 279691us
I20260709 13:09:44.556448 22505 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:44.563349 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.385756 28547 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:44.384241 28596 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:44.567159 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.584014 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.079s
I20260709 13:09:44.626754 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:44.564386 22543 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:44.381527 28031 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:44.643337 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.018s	sys 0.081s
I20260709 13:09:44.643703 22503 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:44.624903 28596 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:44.643796 28512 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:44.644788 28512 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.645292 28512 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:44.646246 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 289083us
I20260709 13:09:44.647068 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:44.653152 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 88904.8us
I20260709 13:09:44.655352 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:44.385124 28639 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.586387 28490 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:44.664853 22500 pending_rounds.cc:85] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 7
I20260709 13:09:44.584262 28547 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:44.637362 28401 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:44.671432 22500 pending_rounds.cc:107] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:09:44.699189 22500 raft_consensus.cc:2889] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.640440 28543 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:44.657111 28573 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.096s	user 0.012s	sys 0.005s
I20260709 13:09:44.638125 28568 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:44.709339 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 417393us
I20260709 13:09:44.664999 28152 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:44.717088 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.716140 28710 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.169s
I20260709 13:09:44.731674 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.555346 28552 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:44.397310 28717 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.755853 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.709182 28740 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.775245 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:44.773895 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:44.777953 22645 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:44.709470 28723 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:44.777010 22650 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:44.782047 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:44.782621 22645 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:44.704524 28744 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.797214 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:44.810668 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:44.792156 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:44.733376 28335 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:44.737149 28543 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:44.815280 22649 raft_consensus.cc:2410] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:09:44.815376 22497 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 22: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:44.733731 28730 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:44.814141 22503 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:44.823625 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:44.775043 28735 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
W20260709 13:09:44.774721 28719 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.342s	user 0.001s	sys 0.001s
I20260709 13:09:44.818506 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.819953 22651 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:09:44.823009 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:44.709513 28732 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.709486 28742 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.186s
I20260709 13:09:44.837009 23257 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:44.397652 22398 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 11, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.845211 22497 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:09:44.859632 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 212624us
I20260709 13:09:44.860415 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.865427 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:44.763454 28747 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:44.845803 22503 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:44.834959 28641 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.808s	user 0.012s	sys 0.000s
I20260709 13:09:44.851912 22647 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:09:44.858690 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:44.879439 22645 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:44.882493 28745 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:44.883643 28745 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.709288 28401 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.792409 28740 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.882839 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:44.911804 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.720096 28573 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:44.926160 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 170417us
I20260709 13:09:44.943581 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:44.959604 22648 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:44.806052 28547 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:44.962349 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.915457 28732 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.917302 28568 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:44.882274 28564 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:44.817724 28723 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.854805 28730 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:44.945981 28729 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:09:45.004240 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.031263 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 835065us
I20260709 13:09:45.047680 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:45.050796 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:45.052421 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:45.063062 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:45.063937 22577 raft_consensus.cc:606] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:45.064638 22577 raft_consensus.cc:614] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:44.983987 28568 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.063022 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:45.027009 28721 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:09:44.996685 22650 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:45.073276 28727 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:45.024704 28552 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:45.073745 28724 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:09:44.982762 28756 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:45.073846 28758 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:45.065666 28641 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:09:45.020112 28748 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:45.074774 28760 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:44.992542 28611 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.075300 28744 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:45.077303 28757 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:45.020517 28765 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:45.079285 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:45.137971 22577 raft_consensus.cc:606] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:45.138453 22577 raft_consensus.cc:614] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:45.082119 28738 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:09:45.041656 28737 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:09:45.042218 28714 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.994s	user 0.007s	sys 0.004s
W20260709 13:09:45.023351 28689 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.154s	user 0.002s	sys 0.013s
I20260709 13:09:44.923903 28755 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:44.994150 28547 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:45.033584 28739 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:09:44.995144 28745 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:45.042656 28619 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:45.059794 28642 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:45.038141 28740 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:45.019991 28031 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:45.020988 28476 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:44.907331 28747 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.063700 28590 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:45.130281 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 186776us
I20260709 13:09:45.085227 28754 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.089361 28568 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:45.085815 28545 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.112776 28712 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:44.997162 28564 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.124686 28760 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:45.143072 28539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.002s	sys 0.014s
I20260709 13:09:45.137336 28757 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:45.125463 28733 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:09:45.194345 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 329030us
I20260709 13:09:45.316957 22580 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:45.298573 28541 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.190s	user 0.009s	sys 0.004s
I20260709 13:09:45.113206 28596 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.153079 28753 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:45.151607 28746 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:45.187803 28720 consensus_meta.cc:287] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.129s	user 0.009s	sys 0.005s
W20260709 13:09:45.213037 22620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.019s	sys 0.076s
I20260709 13:09:45.217053 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:45.185845 28713 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.014s	sys 0.034s
W20260709 13:09:45.199666 28644 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.410s	user 0.009s	sys 0.005s
W20260709 13:09:45.215830 28749 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:09:45.213845 28476 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:45.275794 28723 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.224225 28754 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.042524 22398 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 14, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 14 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:09:45.284770 28700 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.319s	user 0.005s	sys 0.010s
I20260709 13:09:45.285740 23255 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:45.280215 28730 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:45.130164 28756 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.273347 28747 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.186431 28714 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:45.281292 28519 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:45.214294 28755 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:45.145313 28748 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:45.302582 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 408657us
W20260709 13:09:45.303086 28668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.012s	sys 0.022s
I20260709 13:09:45.305341 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:45.375072 28723 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.308061 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:45.201862 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 419878us
W20260709 13:09:45.349054 28713 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.014s	sys 0.035s
I20260709 13:09:45.327052 23257 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:09:45.314273 28760 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:45.332811 22620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.019s	sys 0.076s
W20260709 13:09:45.417110 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 326645us
I20260709 13:09:45.353986 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 3102) took 1410 ms. Trace:
I20260709 13:09:45.417943 22505 rpcz_store.cc:276] 0709 13:09:43.943779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.943960 (+   181us) service_pool.cc:224] Handling call
0709 13:09:45.353690 (+1409730us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540042aed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:45.353898 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262734208}
I20260709 13:09:45.355495 28733 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.418989 28519 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:45.419402 28733 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.419775 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:45.420642 28519 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:45.421000 28727 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:45.421944 28733 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.422245 28519 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:45.422734 28519 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:45.359496 28644 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:45.423127 28519 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:45.423478 28644 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.425909 28644 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:45.359853 28736 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.973s	user 0.001s	sys 0.000s
I20260709 13:09:45.360265 28744 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:45.317771 28757 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.319059 28573 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:45.316350 28765 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:09:45.430941 28563 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.431536 28563 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.432024 28519 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.434039 28563 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.434194 28519 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.437054 28563 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.437840 28563 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.440702 28563 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:45.367132 28512 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.721s	user 0.015s	sys 0.009s
I20260709 13:09:45.328337 28401 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.361194 28782 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:45.350165 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 133237us
I20260709 13:09:45.306596 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:45.333701 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 207456us
I20260709 13:09:45.319087 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:45.376331 28543 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:45.422299 28727 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.442042 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:45.331471 22469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.008s	sys 0.011s
W20260709 13:09:45.484898 22469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.008s	sys 0.011s
I20260709 13:09:45.479490 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:45.479935 22573 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:45.483678 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:45.487610 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.450038 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:45.454563 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:45.329809 28753 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.399407 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:45.387009 28668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.013s	sys 0.023s
I20260709 13:09:45.508615 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:45.509364 22504 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:45.458144 28747 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.510380 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.514953 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:45.517655 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:45.519435 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:45.522516 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 203505us
I20260709 13:09:45.516654 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:45.525167 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:45.525794 22573 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:09:45.522063 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62250.6us
I20260709 13:09:45.527704 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:45.524283 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:45.536196 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:45.537897 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 138612us
I20260709 13:09:45.539543 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:45.542038 23262 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:45.547075 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:45.547797 22497 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.548902 22575 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:45.548482 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:45.348779 28720 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:45.555099 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.510905 28753 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.559880 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:45.560745 22645 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:45.496119 28641 consensus_queue.cc:1243] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:45.556515 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:45.562711 22617 leader_election.cc:400] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:45.563093 22617 leader_election.cc:403] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:45.510443 28791 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:45.464776 28541 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:09:45.508414 28519 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.563758 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:45.708288 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 172247us
I20260709 13:09:45.557168 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:45.562615 22498 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:45.334244 28746 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.559551 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:45.708001 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 150455us
I20260709 13:09:45.566330 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:45.396067 28772 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.157s
I20260709 13:09:45.527158 28619 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:45.518764 28713 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.548669 28773 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:09:45.697753 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:45.569382 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:45.485486 28512 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.459236 28723 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.644093 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:45.549191 28733 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.734803 22645 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
W20260709 13:09:45.709116 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 170123us
I20260709 13:09:45.709913 22577 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:45.707429 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:45.477965 28785 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:09:45.639225 22497 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
I20260709 13:09:45.547868 28712 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:45.558454 28744 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:45.564041 28590 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:45.720983 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:45.713023 28564 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:45.700052 28780 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:09:45.726953 28619 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:45.725275 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 208719us
I20260709 13:09:45.639113 28731 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.567917 28641 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.567840 28789 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:45.698513 28558 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:45.720783 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:45.787746 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 67067us
I20260709 13:09:45.717814 28715 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:45.525274 28747 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.562489 28782 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.194s
I20260709 13:09:45.796342 22577 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:45.720376 28519 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.772688 28785 consensus_queue.cc:1243] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:45.710168 28740 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:45.696611 28543 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.730206 28668 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:09:45.748047 28768 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.567890 28757 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.755528 28783 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:09:45.773511 28760 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.862676 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3099) took 1090 ms. Trace:
W20260709 13:09:45.847431 28787 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:09:45.776026 28596 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.739701 28786 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:45.870796 28786 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.778599 28619 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.871338 28786 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:45.774999 28793 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:45.805688 28539 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:09:45.872633 28793 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.874063 28634 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:45.874519 28634 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:45.874646 28720 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:45.874892 28784 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:09:45.875739 28793 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.876072 28666 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.797449 28558 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.878947 28558 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:45.847395 28771 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
W20260709 13:09:45.879508 28547 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.000s
I20260709 13:09:45.745199 28767 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:09:45.736536 28713 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.748191 28733 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.849911 23263 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:45.556777 22398 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.852979 22501 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:45.863150 22646 rpcz_store.cc:276] 0709 13:09:44.771873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.772271 (+   398us) service_pool.cc:224] Handling call
0709 13:09:44.817677 (+ 45406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.833410 (+ 15733us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:44.833441 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.857417 (+ 23976us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.299068 (+441651us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:45.299113 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.299191 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.862484 (+563293us) raft_consensus.cc:1685] finished
0709 13:09:45.862504 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.862619 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202597,"spinlock_wait_cycles":88775424,"thread_start_us":382948,"threads_started":1,"wal-append.queue_time_us":464824}
I20260709 13:09:45.861809 28746 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:45.870891 28769 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.466s	user 0.002s	sys 0.000s
I20260709 13:09:45.641760 28791 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.848392 28807 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:45.884963 22504 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:45.779709 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:45.795735 28641 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.801414 28563 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:09:45.876421 28793 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:45.798280 28564 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:45.938041 28760 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:45.854523 28754 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:45.849138 28756 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:45.874989 28634 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:45.966367 28723 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.968667 28713 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:45.968763 28476 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:09:45.969610 28476 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.970870 28597 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:45.971122 28733 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:45.971446 28597 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:45.982180 22398 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 12, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 12 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.858283 28768 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.987349 28768 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:45.975050 28568 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.688s	user 0.002s	sys 0.009s
I20260709 13:09:45.868597 28712 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.994201 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1232) took 2261 ms. Trace:
I20260709 13:09:45.994688 22502 rpcz_store.cc:276] 0709 13:09:43.733225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.733716 (+   491us) service_pool.cc:224] Handling call
0709 13:09:43.734141 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.022503 (+288362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.993936 (+1971433us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540030bbd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:45.994116 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610653568}
I20260709 13:09:45.792389 28731 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:45.988268 28568 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.036904 28031 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:46.037600 28031 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:46.038969 28568 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:46.038748 28031 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:45.996989 28597 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:46.041150 23258 raft_consensus.cc:2368] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
W20260709 13:09:46.042670 28797 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:09:46.043001 28646 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:46.037106 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.018378 22499 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.003s
W20260709 13:09:46.019491 28758 consensus_meta.cc:287] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.874s	user 0.007s	sys 0.005s
I20260709 13:09:46.066730 28758 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:46.021436 28791 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.022003 28519 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.023200 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3738) took 1394 ms. Trace:
I20260709 13:09:45.963171 28748 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.068009 22500 rpcz_store.cc:276] 0709 13:09:44.628362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.628841 (+   479us) service_pool.cc:224] Handling call
0709 13:09:44.664598 (+ 35757us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:44.713577 (+ 48979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.713623 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:44.714371 (+   748us) log.cc:844] Serialized 52 byte log entry
0709 13:09:45.200722 (+486351us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:45.200782 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.200899 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.022890 (+821991us) raft_consensus.cc:1685] finished
0709 13:09:46.022917 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.023118 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1166,"raft.queue_time_us":170286,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":402109,"threads_started":1,"wal-append.queue_time_us":565281}
I20260709 13:09:46.041410 28597 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:46.079533 28777 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.700s	user 0.003s	sys 0.000s
I20260709 13:09:46.028375 28729 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:46.081086 28729 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:46.081347 28757 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:46.082176 28729 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:46.083072 28552 consensus_meta.cc:287] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.968s	user 0.010s	sys 0.002s
I20260709 13:09:46.029737 28641 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.032384 28512 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.051993 22499 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
W20260709 13:09:46.065611 28694 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.832s	user 0.000s	sys 0.003s
I20260709 13:09:46.026110 22398 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 8 to 10, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 10 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.040483 28031 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.953079 28807 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:46.101754 28734 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.189s	user 0.002s	sys 0.000s
W20260709 13:09:46.111090 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.119756 28563 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:46.120224 28563 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:46.121052 28563 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.121610 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3098) took 1350 ms. Trace:
I20260709 13:09:46.122288 28563 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:46.122190 22648 rpcz_store.cc:276] 0709 13:09:44.771556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.771705 (+   149us) service_pool.cc:224] Handling call
0709 13:09:44.772064 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.960248 (+188184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.121227 (+1160979us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400394754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:46.121520 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430699776}
I20260709 13:09:46.127580 28152 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:46.128052 28152 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:46.128831 28152 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.129177 28792 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.131858 28783 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.131776 28792 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:46.133154 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 353552us
I20260709 13:09:46.133549 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:46.135365 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.136031 22502 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:46.137223 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.138316 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.139008 22497 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:46.140797 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.141100 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.141409 22497 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:46.141776 22502 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.141891 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.142103 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.142565 22498 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:46.142717 22500 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
W20260709 13:09:46.142875 22654 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.015s	sys 0.030s
I20260709 13:09:46.002573 28476 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.104970 28731 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:46.144582 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:46.145135 22654 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.015s	sys 0.030s
I20260709 13:09:46.147965 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:46.148010 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.149379 23259 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:09:46.149775 23259 pending_rounds.cc:85] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 13
I20260709 13:09:46.150034 23259 pending_rounds.cc:107] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:09:46.130250 28564 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:46.117726 28807 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.150362 23259 raft_consensus.cc:2889] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.148825 22499 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:46.151933 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:46.140398 28730 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:46.151640 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3102) took 1379 ms. Trace:
I20260709 13:09:46.139429 28748 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.138056 28628 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:46.168480 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.169309 22497 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.157757 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:46.174291 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:46.159329 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:46.177081 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:46.164789 22498 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:46.166934 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.150923 28646 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:46.138170 28641 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:09:46.196692 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.155560 28152 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.201241 22504 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:09:46.206763 22504 pending_rounds.cc:85] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 9
I20260709 13:09:46.207118 22504 pending_rounds.cc:107] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:09:46.207391 22504 raft_consensus.cc:2889] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.204421 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:46.205718 28806 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:46.144117 28634 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.231598 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:46.193396 28628 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.241710 28812 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:46.242354 28812 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:46.242858 28812 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:46.241470 28504 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.197203 28512 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:46.145756 28783 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.240026 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:46.173437 28562 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:46.247812 28628 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.248490 28504 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.201206 28646 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.201583 28730 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:46.156543 28768 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:46.203876 28519 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:46.203734 28586 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.205084 28476 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:46.252684 28512 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:46.282639 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79389.8us
I20260709 13:09:46.171929 28748 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.245566 28715 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:46.299381 22497 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:46.109072 22398 catalog_manager.cc:5697] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 9, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 9 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.269134 28811 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:46.289793 28760 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:46.305563 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:46.207024 28619 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.290932 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:46.273907 28731 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:46.290186 28628 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:46.300395 28519 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.347921 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.307214 28512 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:46.350229 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59400.3us
W20260709 13:09:46.308389 28753 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.004s
I20260709 13:09:46.306972 28476 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.290776 28646 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.331990 28760 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:46.344311 28782 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:46.344738 28814 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:46.281338 28552 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:46.365022 23230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.018s	sys 0.013s
W20260709 13:09:46.373348 23230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.019s	sys 0.014s
W20260709 13:09:46.351946 22505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.030s	sys 0.048s
W20260709 13:09:46.375960 22505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.031s	sys 0.049s
I20260709 13:09:46.376500 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.336169 22502 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:46.302429 28786 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.353490 28603 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:46.349710 28519 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:46.361665 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.026s	sys 0.057s
I20260709 13:09:46.379118 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:46.380383 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.391191 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.384296 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.353466 28476 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:46.391362 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.027s	sys 0.057s
W20260709 13:09:46.397650 23255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.009s	sys 0.025s
I20260709 13:09:46.357586 28760 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:46.448423 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86510.2us
I20260709 13:09:46.448838 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:46.449795 23255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.010s	sys 0.026s
I20260709 13:09:46.450127 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.412896 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.451063 23262 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:46.357438 28782 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:46.443238 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.404781 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.459308 23258 raft_consensus.cc:2410] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:09:46.432523 22469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.010s	sys 0.038s
W20260709 13:09:46.459954 22469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.011s	sys 0.039s
I20260709 13:09:46.411506 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.298395 28562 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:46.352341 28806 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:09:46.391932 22498 raft_consensus.cc:2376] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15. Re-sending same reply.
W20260709 13:09:46.361438 28778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.021s	sys 0.063s
I20260709 13:09:46.473542 22571 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:46.362792 28731 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:46.415078 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.414554 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.462155 22575 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:09:46.452951 22649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.008s	sys 0.044s
I20260709 13:09:46.465351 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.466849 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.472218 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.473982 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.479812 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:46.356495 28753 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.479676 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.390909 28603 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:46.308089 28586 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.404254 28568 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.448480 28791 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:09:46.484038 22649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.008s	sys 0.044s
I20260709 13:09:46.484622 22497 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.487735 22579 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:46.487995 22503 raft_consensus.cc:2410] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:09:46.448480 28765 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:46.467456 28564 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.485894 22469 leader_election.cc:400] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
I20260709 13:09:46.486673 22576 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:46.494169 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.501811 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:46.511700 22648 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:46.512158 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.512732 22502 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.512830 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:46.514101 22469 leader_election.cc:403] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:46.516047 22574 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:46.516707 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.485733 28558 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.497632 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3112) took 1716 ms. Trace:
W20260709 13:09:46.508886 28543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.021s
I20260709 13:09:46.466487 28782 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.473968 28490 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:09:46.508277 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58700.6us
I20260709 13:09:46.547400 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.495160 28603 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:46.481511 28778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.021s	sys 0.063s
I20260709 13:09:46.577492 28476 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.551414 22646 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:46.381487 28552 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.582322 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.583163 22646 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:46.584136 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:46.586136 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.554912 22647 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
W20260709 13:09:46.488785 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.010s	sys 0.061s
I20260709 13:09:46.586688 28747 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:46.586941 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.010s	sys 0.061s
I20260709 13:09:46.587270 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:46.557003 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 82239.8us
I20260709 13:09:46.588359 22469 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:46.588582 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.549865 22649 rpcz_store.cc:276] 0709 13:09:44.781231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.854564 (+ 73333us) service_pool.cc:224] Handling call
0709 13:09:44.893699 (+ 39135us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:44.912928 (+ 19229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.912974 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:44.913676 (+   702us) log.cc:844] Serialized 52 byte log entry
0709 13:09:45.296822 (+383146us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:45.561348 (+264526us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.497187 (+935839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.497305 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.497374 (+    69us) raft_consensus.cc:1685] finished
0709 13:09:46.497393 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.497567 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176451,"prepare.queue_time_us":473436,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":69,"raft.queue_time_us":346832,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":11649,"thread_start_us":1376929,"threads_started":3,"wal-append.queue_time_us":448197}
I20260709 13:09:46.589718 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:46.590462 28778 raft_consensus.cc:2764] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:46.590698 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1028) took 1082 ms. Trace:
I20260709 13:09:46.591125 22580 rpcz_store.cc:276] 0709 13:09:45.508312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.509295 (+   983us) service_pool.cc:224] Handling call
0709 13:09:45.509611 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.515847 (+  6236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.515910 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.551310 (+ 35400us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.157418 (+606108us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:46.157454 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.157519 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.590493 (+432974us) raft_consensus.cc:1685] finished
0709 13:09:46.590513 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.590643 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5843,"raft.queue_time_us":25348,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":20402,"thread_start_us":449909,"threads_started":1,"wal-append.queue_time_us":937824}
W20260709 13:09:46.513238 28790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.028s	sys 0.030s
I20260709 13:09:46.592990 22398 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:09:46.593816 28790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.028s	sys 0.030s
I20260709 13:09:46.544206 28504 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.567914 28822 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
I20260709 13:09:46.594947 28822 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:46.569796 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.594815 22398 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 10, term changed from 11 to 12, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131), NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 12 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.563004 28490 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:46.587332 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 845935us
I20260709 13:09:46.583050 28552 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.560808 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:46.598941 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:46.599436 22468 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.606s (SENT)
I20260709 13:09:46.599596 22574 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:46.599918 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:46.601373 22572 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:46.601439 28747 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:46.595078 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:46.602993 22575 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.603416 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.605396 28748 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.606215 22499 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:09:46.606467 28783 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.374142 28730 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.610848 28639 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:46.611467 28783 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:46.611913 28783 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.612246 28783 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:46.612414 28476 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.600613 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:46.577574 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 931) took 1270 ms. Trace:
I20260709 13:09:46.621153 23261 rpcz_store.cc:276] 0709 13:09:45.307543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.307706 (+   163us) service_pool.cc:224] Handling call
0709 13:09:46.577373 (+1269667us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400680954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:46.577491 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441744128}
I20260709 13:09:46.577561 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 811) took 1483 ms. Trace:
I20260709 13:09:46.620147 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:46.625146 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.625613 22575 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:46.627532 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:46.628199 22575 raft_consensus.cc:2376] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16. Re-sending same reply.
I20260709 13:09:46.629151 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.630221 22580 raft_consensus.cc:2368] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
I20260709 13:09:46.619328 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 967) took 1130 ms. Trace:
I20260709 13:09:46.632387 22574 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:46.633570 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.633127 23255 rpcz_store.cc:276] 0709 13:09:45.489258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.489423 (+   165us) service_pool.cc:224] Handling call
0709 13:09:45.489775 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.490006 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:45.704454 (+214448us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.463188 (+758734us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.490094 (+ 26906us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.618551 (+128457us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18003c56e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec2a1cf58f 00007fec2320e571 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd
0709 13:09:46.618851 (+   300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.618913 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:46.618966 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.619035 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.619264 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129557,"prepare.queue_time_us":336474,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":8306,"raft.queue_time_us":140812,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":17218,"spinlock_wait_cycles":49625216,"thread_start_us":924031,"threads_started":2}
I20260709 13:09:46.623934 23257 rpcz_store.cc:276] 0709 13:09:45.094434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.094614 (+   180us) service_pool.cc:224] Handling call
0709 13:09:45.095019 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.412677 (+317658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.577272 (+1164595us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400719b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:46.577491 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532686080}
I20260709 13:09:46.641314 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.644316 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.647143 22572 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:46.707293 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.708297 22572 raft_consensus.cc:2368] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
W20260709 13:09:46.557811 28543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.010s	sys 0.021s
I20260709 13:09:46.648180 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:46.653980 28031 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.001s
I20260709 13:09:46.734849 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.736377 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.506781 28568 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.657168 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:46.617916 28821 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:46.661921 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.772410 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:46.772954 22645 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:46.662428 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:46.553563 28634 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:46.668004 22497 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:46.670845 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.779716 23264 raft_consensus.cc:2368] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:46.671316 28603 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.619138 28421 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:46.619204 28586 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:46.673751 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:46.674832 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.675879 23258 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:46.676101 23261 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:46.646613 28791 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:46.677340 28828 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.798552 23256 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:46.682240 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.516431 28564 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.511534 28765 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.677954 28806 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.114s
I20260709 13:09:46.698303 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:46.703699 22502 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:46.709566 22580 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
W20260709 13:09:46.808970 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 110796us
I20260709 13:09:46.809568 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.809794 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:46.731869 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.733182 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.647199 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:46.656002 28597 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.576s	user 0.003s	sys 0.007s
W20260709 13:09:46.757006 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.756996 22646 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:46.763273 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:46.764310 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.813676 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:46.814421 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51281.4us
I20260709 13:09:46.814930 22574 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:46.812737 22653 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:46.815657 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:46.812801 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.816967 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:46.773563 22645 pending_rounds.cc:85] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 9
I20260709 13:09:46.818717 22645 pending_rounds.cc:107] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:46.819108 22645 raft_consensus.cc:2889] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.773429 22648 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:46.560292 28558 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:46.782227 28619 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:46.779937 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:46.679684 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.785516 28628 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.826102 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.827237 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:46.855455 23261 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:46.794890 28421 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:46.861382 23256 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:46.862584 22577 raft_consensus.cc:606] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:46.863076 22577 raft_consensus.cc:614] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.616811 28562 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:46.853628 22497 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:46.793708 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.858845 28783 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.860101 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:46.617054 28731 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:46.863602 22572 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:46.917970 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.850333 28733 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:46.850786 28746 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:46.923794 22580 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:46.923941 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:46.941794 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 124912us
I20260709 13:09:46.944129 22468 leader_election.cc:400] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
I20260709 13:09:46.945806 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:46.775869 28504 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:46.926043 22502 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:46.810910 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:46.929746 22576 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:46.860245 28597 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:46.684100 28712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.021s	sys 0.075s
I20260709 13:09:46.862591 28824 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:46.935380 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 74597.7us
I20260709 13:09:46.932161 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.029513 22647 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:46.985181 28767 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:09:46.985193 28712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.021s	sys 0.075s
I20260709 13:09:46.683383 22398 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.009330 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.010926 28748 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:09:47.012239 28597 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.861477 28563 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:09:47.013013 22498 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:46.985325 28421 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.108392 28421 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.108757 28563 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:47.108994 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3745) took 1579 ms. Trace:
I20260709 13:09:47.109216 28563 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:47.109488 22501 rpcz_store.cc:276] 0709 13:09:45.530059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.566694 (+ 36635us) service_pool.cc:224] Handling call
0709 13:09:45.712386 (+145692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.943438 (+231052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.108734 (+1165296us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540039a8d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:47.108936 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231047040}
I20260709 13:09:47.110126 28563 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:47.111191 28807 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.941s	user 0.011s	sys 0.000s
I20260709 13:09:47.111395 28563 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.111661 28807 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.114028 28807 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:47.015004 28564 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.015878 28791 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.115021 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:46.867859 28828 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.119290 28597 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.120273 28828 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.020430 28603 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:47.025774 23256 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:47.027012 28827 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 13:09:47.027683 22576 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:09:46.866720 28628 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:46.922439 28264 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.132663 22503 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.016s	sys 0.041s
W20260709 13:09:47.084275 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.096514 22649 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:47.097779 22505 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.034s	sys 0.037s
W20260709 13:09:47.100142 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 289289us
I20260709 13:09:47.099968 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:46.933320 28786 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.105459 22502 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.120498 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:46.937754 28746 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:47.116719 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.147753 22651 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:09:47.126952 23262 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:47.104704 22648 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:09:46.159307 22654 rpcz_store.cc:276] 0709 13:09:44.772903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.773071 (+   168us) service_pool.cc:224] Handling call
0709 13:09:44.818350 (+ 45279us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:45.054243 (+235893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.054292 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:45.070042 (+ 15750us) log.cc:844] Serialized 52 byte log entry
0709 13:09:45.532713 (+462671us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:46.147866 (+615153us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.151366 (+  3500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.151435 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.151470 (+    35us) raft_consensus.cc:1685] finished
0709 13:09:46.151480 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.151592 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3674,"prepare.queue_time_us":240899,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":52,"raft.queue_time_us":252338,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":4356,"spinlock_wait_cycles":1657088,"thread_start_us":1151311,"threads_started":3,"wal-append.queue_time_us":728517}
I20260709 13:09:47.096971 22646 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:47.153587 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.136292 22647 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:47.135713 22505 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.034s	sys 0.037s
I20260709 13:09:47.164011 22648 raft_consensus.cc:2410] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:09:47.136543 22503 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.041s
I20260709 13:09:47.136253 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:47.102698 28823 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.182s	user 0.004s	sys 0.000s
W20260709 13:09:47.145242 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 199570us
W20260709 13:09:47.134939 22578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.005s
I20260709 13:09:47.157815 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.179772 22654 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:47.099370 28801 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:47.161206 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.163174 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.181360 22651 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
W20260709 13:09:47.181624 22578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.006s	sys 0.005s
I20260709 13:09:47.182548 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.170637 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:47.186077 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.186901 22654 raft_consensus.cc:2376] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12. Re-sending same reply.
I20260709 13:09:47.164310 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.194815 22647 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:47.145255 28713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.044s	sys 0.062s
I20260709 13:09:47.202651 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.156769 28746 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:47.140267 28768 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:47.133476 28564 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:09:47.142339 28824 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:47.208613 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.210340 28628 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:47.211802 28713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.044s	sys 0.063s
W20260709 13:09:47.212324 28152 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.980s	user 0.007s	sys 0.003s
I20260709 13:09:47.213469 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3754) took 1047 ms. Trace:
I20260709 13:09:47.214216 22500 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:09:47.260052 22500 pending_rounds.cc:85] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 8
I20260709 13:09:47.260339 22500 pending_rounds.cc:107] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:09:47.260587 22500 raft_consensus.cc:2889] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:47.151211 28504 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:47.146279 28264 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.264776 28264 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.266490 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:47.267400 23262 raft_consensus.cc:2410] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:09:47.259853 28768 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.273615 28768 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.220850 28743 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.221432 28831 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 13:09:47.221515 28597 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.222182 28816 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:47.222821 28770 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.223142 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:47.202853 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:47.226243 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55718.1us
I20260709 13:09:47.289184 22654 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:47.289453 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66404.9us
I20260709 13:09:47.289580 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:47.161348 28748 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:47.243479 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.291260 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.256143 28807 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:09:47.169876 28730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.002s	sys 0.037s
W20260709 13:09:47.193693 28812 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.942s	user 0.015s	sys 0.001s
I20260709 13:09:47.182726 28057 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:47.183182 28714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.006s	sys 0.035s
I20260709 13:09:47.187851 28801 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:47.259740 22499 rpcz_store.cc:276] 0709 13:09:46.166019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.166647 (+   628us) service_pool.cc:224] Handling call
0709 13:09:47.213254 (+1046607us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b540033e0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:47.213406 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976661376}
I20260709 13:09:47.262650 28504 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:47.251268 22649 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
W20260709 13:09:47.258093 28519 consensus_meta.cc:287] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.810s	user 0.011s	sys 0.000s
I20260709 13:09:47.290347 28770 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:47.294457 28264 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:47.299119 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:47.297290 28730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.002s	sys 0.038s
I20260709 13:09:47.314774 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.251609 22647 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:47.287547 28558 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:47.312749 22654 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:47.306488 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:47.276777 28732 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:47.294353 28828 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.325139 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:47.325955 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:47.309047 28421 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:47.307757 28568 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.329437 28504 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:47.307287 28152 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:09:47.330855 28504 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.331133 28770 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:47.333015 28603 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:47.333770 22648 raft_consensus.cc:2410] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:09:47.333693 28586 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:47.252323 22398 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 13, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 13 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.304973 28812 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.335709 22398 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 14 to 15, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 15 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.338232 28812 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.337968 22398 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:47.338706 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.339571 22645 raft_consensus.cc:2410] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:47.339525 22398 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.340512 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:47.307981 28714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.006s	sys 0.036s
I20260709 13:09:47.321837 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.307880 28801 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.331177 28152 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:47.341090 23259 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:47.342311 22499 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:47.382537 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.309749 28807 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:47.387974 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 62949.2us
I20260709 13:09:47.344964 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:47.348358 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.346769 22645 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:47.353915 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:47.316483 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:47.297402 28715 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.014s	sys 0.031s
W20260709 13:09:47.390727 28715 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.014s	sys 0.032s
I20260709 13:09:47.390586 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.391671 22654 raft_consensus.cc:2376] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15. Re-sending same reply.
I20260709 13:09:47.349427 28828 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.393646 23262 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 13:09:47.393764 28782 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.000s
I20260709 13:09:47.393910 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3106) took 2618 ms. Trace:
I20260709 13:09:47.394270 28782 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.395414 28824 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.391273 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.397151 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.397797 22649 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:47.398509 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:47.398530 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.399627 22499 raft_consensus.cc:2410] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:09:47.401124 22502 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:47.297699 28597 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.401170 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.292627 28743 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:47.392695 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.420507 22646 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:47.405510 22574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.017s	sys 0.050s
I20260709 13:09:47.398623 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:47.421484 22574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.051s
I20260709 13:09:47.421693 22649 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:47.394464 22652 rpcz_store.cc:276] 0709 13:09:44.775262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.775815 (+   553us) service_pool.cc:224] Handling call
0709 13:09:44.776368 (+   553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:44.992512 (+216144us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:45.572074 (+579562us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.161002 (+588928us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:46.605678 (+444676us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b2c0013e058. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:09:47.273776 (+668098us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b2c0013e058. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:09:47.274498 (+   722us) log.cc:844] Serialized 598 byte log entry
0709 13:09:47.274671 (+   173us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:47.274707 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.274785 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.393675 (+118890us) raft_consensus.cc:1685] finished
0709 13:09:47.393696 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.393850 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94320,"prepare.queue_time_us":751603,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":262397,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":26947,"spinlock_wait_cycles":99487744,"thread_start_us":1075626,"threads_started":3,"wal-append.queue_time_us":768311}
I20260709 13:09:47.396492 28782 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.422673 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:47.424301 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70508.7us
I20260709 13:09:47.396591 28828 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.424525 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:47.423115 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.433631 23262 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:47.434767 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:47.435885 22652 raft_consensus.cc:2410] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
W20260709 13:09:47.382624 28760 consensus_meta.cc:287] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.000s
I20260709 13:09:47.430529 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:47.352222 28586 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.382352 28152 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:47.349742 28421 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:47.461926 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:47.463235 22645 raft_consensus.cc:2410] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:09:47.403374 28783 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.418463 28603 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.473557 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.443384 28714 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:47.422606 22496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.014s	sys 0.026s
I20260709 13:09:47.316474 28519 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.295363 28816 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.404064 28730 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:47.494247 22646 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:47.495735 22646 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:09:47.496093 22646 pending_rounds.cc:85] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 7
I20260709 13:09:47.496361 22646 pending_rounds.cc:107] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:09:47.496654 22646 raft_consensus.cc:2889] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:47.433135 28646 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.074s	user 0.011s	sys 0.001s
I20260709 13:09:47.453459 22651 raft_consensus.cc:2376] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20. Re-sending same reply.
I20260709 13:09:47.417434 28401 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:47.451839 28825 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:47.438452 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:47.487335 22496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.015s	sys 0.026s
W20260709 13:09:47.438567 23261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.006s	sys 0.048s
I20260709 13:09:47.489724 22645 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:47.351989 28732 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.463932 28723 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:47.473697 28512 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.118s	user 0.007s	sys 0.005s
I20260709 13:09:47.497539 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1242) took 2014 ms. Trace:
I20260709 13:09:47.497378 28807 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.502190 28729 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.449342 28760 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:47.525238 23257 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:47.530303 23261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.006s	sys 0.048s
I20260709 13:09:47.453356 28586 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.529240 22505 rpcz_store.cc:276] 0709 13:09:45.482773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.483728 (+   955us) service_pool.cc:224] Handling call
0709 13:09:45.512908 (+ 29180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.532971 (+ 20063us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:45.563488 (+ 30517us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.089476 (+525988us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b18003c35e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:47.163851 (+1074375us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.164048 (+   197us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.184081 (+ 20033us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.184263 (+   182us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.184310 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.184395 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.497286 (+312891us) raft_consensus.cc:1685] finished
0709 13:09:47.497315 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.497476 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44010,"prepare.queue_time_us":237672,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":50131,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":81641,"spinlock_wait_cycles":16890752,"thread_start_us":1413796,"threads_started":2,"wal-append.queue_time_us":1082891}
I20260709 13:09:47.528937 28730 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:47.527513 28723 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.546504 22654 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:47.529578 28668 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.549239 23262 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:09:47.475369 28603 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.559347 22647 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:47.561000 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:47.561838 28819 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:47.562886 28770 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:47.524348 28646 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.530046 28401 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.549520 28723 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:47.537011 28512 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:47.570641 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:47.523360 28152 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.505400 28421 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.640365 22575 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:47.642627 23255 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:47.575284 28770 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:47.630118 28558 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:47.644817 28825 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:47.641857 28152 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:47.659669 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.013s	sys 0.039s
W20260709 13:09:47.660108 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.013s	sys 0.039s
W20260709 13:09:47.660655 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.649868 28596 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.032s	sys 0.029s
I20260709 13:09:47.643864 28783 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:47.630307 28264 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:09:47.663074 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:47.662976 23263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.008s	sys 0.053s
W20260709 13:09:47.697793 23263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.008s	sys 0.053s
W20260709 13:09:47.671583 22503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.014s
I20260709 13:09:47.674621 22499 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:09:47.699044 22503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.009s	sys 0.014s
W20260709 13:09:47.675777 22498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.025s
W20260709 13:09:47.676888 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.677862 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:47.699927 22498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.005s	sys 0.025s
I20260709 13:09:47.659483 28748 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:47.559069 22398 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:47.686038 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:47.663970 28558 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:47.688302 28782 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:47.667564 28743 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:47.701296 22504 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:47.704555 22574 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:47.704839 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:47.705248 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:47.685642 28836 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:09:47.685444 28504 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.723776 22468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.029s	sys 0.087s
W20260709 13:09:47.724298 22468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.029s	sys 0.087s
W20260709 13:09:47.725143 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.968s (SENT) [suppressed 27 similar messages]
I20260709 13:09:47.724910 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:47.725939 22499 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:47.680372 28519 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.709633 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:47.732131 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:47.711092 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:47.712682 22497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.022s	sys 0.045s
I20260709 13:09:47.712904 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:47.733234 22497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.023s	sys 0.045s
I20260709 13:09:47.734431 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:47.724213 22574 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.738438 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:47.747411 22579 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:47.696518 28596 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.033s	sys 0.029s
I20260709 13:09:47.749715 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:47.750033 22574 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.750634 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:47.746135 22572 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:47.648581 28730 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.752446 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:47.717569 28619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.011s
I20260709 13:09:47.713279 28816 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.729559 28641 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:47.729460 28760 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:47.761035 22501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.026s	sys 0.052s
I20260709 13:09:47.717902 28841 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:47.785331 22501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.027s	sys 0.052s
I20260709 13:09:47.785804 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:47.765719 28834 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:09:47.793262 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3768) took 1378 ms. Trace:
I20260709 13:09:47.793659 22578 rpcz_store.cc:276] 0709 13:09:46.414451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.414566 (+   115us) service_pool.cc:224] Handling call
0709 13:09:46.480344 (+ 65778us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:46.480977 (+   633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.481016 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:46.492667 (+ 11651us) log.cc:844] Serialized 52 byte log entry
0709 13:09:47.182248 (+689581us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:47.182307 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.182417 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.793063 (+610646us) raft_consensus.cc:1685] finished
0709 13:09:47.793084 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.793207 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6565,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8983,"thread_start_us":619365,"threads_started":1,"wal-append.queue_time_us":947788}
I20260709 13:09:47.794584 28558 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:47.795420 28563 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.003s
I20260709 13:09:47.718426 28783 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.797103 28512 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.799913 22505 raft_consensus.cc:2410] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:09:47.800729 28783 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.773687 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:47.802752 28768 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:47.709304 28748 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.803378 28768 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:47.804361 28768 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:47.805102 28748 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.729123 28770 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:47.774879 28619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.013s	sys 0.011s
I20260709 13:09:47.751677 28772 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:47.760349 28840 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:47.822381 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:47.823129 22578 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:47.733781 28504 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:47.809201 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 980) took 1070 ms. Trace:
I20260709 13:09:47.830626 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:47.806408 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:47.800987 28646 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.761147 28586 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.766835 28811 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:47.787720 28713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.019s	sys 0.021s
I20260709 13:09:47.833184 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:47.832041 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:47.807682 28603 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:47.719174 28782 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:47.835762 28401 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.830857 23261 rpcz_store.cc:276] 0709 13:09:46.738777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.856261 (+117484us) service_pool.cc:224] Handling call
0709 13:09:46.856714 (+   453us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:46.857187 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.857227 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:46.858014 (+   787us) log.cc:844] Serialized 52 byte log entry
0709 13:09:47.540355 (+682341us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:47.540423 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.540518 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.808896 (+268378us) raft_consensus.cc:1685] finished
0709 13:09:47.808928 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.809126 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2778,"raft.queue_time_us":6387,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":57427,"thread_start_us":681967,"threads_started":1,"wal-append.queue_time_us":850891}
I20260709 13:09:47.846076 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:47.847255 22577 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:47.821573 28714 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:47.848186 28851 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:47.850244 22578 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:09:47.879354 22578 pending_rounds.cc:85] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 15
I20260709 13:09:47.879693 22578 pending_rounds.cc:107] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:09:47.879987 22578 raft_consensus.cc:2889] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:47.852509 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:47.844826 28713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.019s	sys 0.021s
I20260709 13:09:47.874702 23261 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.836360 28841 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:47.878213 28772 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:47.885974 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:47.879349 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 316901us
I20260709 13:09:47.911533 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:47.877104 28840 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:47.912473 22578 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:47.885562 28851 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:47.872304 28811 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:09:47.927104 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 201937us
W20260709 13:09:47.928683 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 83950.2us
I20260709 13:09:47.980536 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:47.920083 28512 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:47.920614 28840 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.983959 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:47.919801 28841 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:47.904384 28801 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:47.991039 28855 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:09:47.991233 28850 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:09:47.992092 28849 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:09:47.992427 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 976) took 1314 ms. Trace:
I20260709 13:09:47.992820 23258 rpcz_store.cc:276] 0709 13:09:46.677829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.797250 (+119421us) service_pool.cc:224] Handling call
0709 13:09:46.799187 (+  1937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.800321 (+  1134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.800359 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.274743 (+474384us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b18003c57a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a
0709 13:09:47.275118 (+   375us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.728895 (+453777us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.728945 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.729014 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.992136 (+263122us) raft_consensus.cc:1685] finished
0709 13:09:47.992157 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.992369 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":692,"raft.queue_time_us":910,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12623,"spinlock_wait_cycles":8155904,"thread_start_us":434500,"threads_started":1,"wal-append.queue_time_us":535448}
W20260709 13:09:47.995205 28852 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:09:47.996433 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3122) took 1233 ms. Trace:
I20260709 13:09:47.996799 22497 rpcz_store.cc:276] 0709 13:09:46.762540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.106956 (+344416us) service_pool.cc:224] Handling call
0709 13:09:47.136547 (+ 29591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.136782 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:47.136806 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.163159 (+ 26353us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.746938 (+583779us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:47.746980 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.747047 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.996221 (+249174us) raft_consensus.cc:1685] finished
0709 13:09:47.996242 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.996374 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":534608,"threads_started":1,"wal-append.queue_time_us":685342}
I20260709 13:09:47.985025 28713 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:48.001642 28713 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:48.001937 28782 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.002188 28713 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:48.003257 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:48.005069 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77215.1us
I20260709 13:09:48.006539 28586 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:48.006951 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2708) took 1505 ms. Trace:
I20260709 13:09:48.007091 28841 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.007440 22653 rpcz_store.cc:276] 0709 13:09:46.501955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.553925 (+ 51970us) service_pool.cc:224] Handling call
0709 13:09:48.006730 (+1452805us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400237154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.006898 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374923648}
I20260709 13:09:48.009217 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3123) took 1246 ms. Trace:
I20260709 13:09:48.009421 28851 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.009675 22501 rpcz_store.cc:276] 0709 13:09:46.762827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.110569 (+347742us) service_pool.cc:224] Handling call
0709 13:09:47.110928 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.111264 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.111287 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.111746 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.785878 (+674132us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:47.785919 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.785990 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.008997 (+223007us) raft_consensus.cc:1685] finished
0709 13:09:48.009017 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.009157 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1331,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"thread_start_us":673754,"threads_started":1,"wal-append.queue_time_us":795993}
I20260709 13:09:48.011211 28851 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:48.014015 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 933) took 1614 ms. Trace:
I20260709 13:09:48.017556 22651 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:09:48.019105 22651 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: [19.14-22.16]
W20260709 13:09:48.019767 28746 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.007s
I20260709 13:09:48.020273 22651 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:48.021541 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1181) took 2463 ms. Trace:
I20260709 13:09:48.022006 22650 rpcz_store.cc:276] 0709 13:09:45.558599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.559558 (+   959us) service_pool.cc:224] Handling call
0709 13:09:45.559822 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.585337 (+1025515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.585368 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.585408 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:46.585440 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.021259 (+1435819us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002daad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.021321 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.021470 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2357965184}
I20260709 13:09:48.024187 22650 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:48.020222 28746 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.014533 23263 rpcz_store.cc:276] 0709 13:09:46.400058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.400250 (+   192us) service_pool.cc:224] Handling call
0709 13:09:46.406045 (+  5795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.800496 (+394451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.800522 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.805720 (+  5198us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.698212 (+892492us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:47.698251 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.013481 (+315230us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400834d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.013550 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.013614 (+    64us) raft_consensus.cc:1685] finished
0709 13:09:48.013634 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.013939 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1056,"raft.queue_time_us":130,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":13691,"spinlock_wait_cycles":907117184,"thread_start_us":831654,"threads_started":1,"wal-append.queue_time_us":999729}
I20260709 13:09:48.027614 22653 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:09:48.031677 22645 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:48.033957 22650 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:47.983783 28512 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:47.926326 28715 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:09:47.989629 28840 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:47.985723 28760 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:09:48.061692 23262 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:48.049206 28512 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:48.135159 28801 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.135329 28746 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.133754 28765 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:48.142424 28832 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.133s	user 0.002s	sys 0.000s
I20260709 13:09:48.142261 28792 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:48.176697 28840 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.179788 28840 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:47.841681 22398 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 9 to 11, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:48.218874 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 236290us
I20260709 13:09:48.229228 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.230715 22501 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:48.233511 22502 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:48.243670 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237401us
I20260709 13:09:48.247035 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3116) took 1216 ms. Trace:
I20260709 13:09:48.285944 28563 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.247841 22646 rpcz_store.cc:276] 0709 13:09:47.030431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.498296 (+467865us) service_pool.cc:224] Handling call
0709 13:09:47.498650 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.499229 (+   579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.499258 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.499852 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.869116 (+369264us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:48.030758 (+161642us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.032875 (+  2117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.032965 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.135467 (+102502us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18004461a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:48.246187 (+110720us) raft_consensus.cc:1685] finished
0709 13:09:48.246384 (+   197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.246746 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34787,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":1794,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":1562,"spinlock_wait_cycles":9659776,"thread_start_us":504557,"threads_started":2,"wal-append.queue_time_us":539549}
I20260709 13:09:48.287130 28563 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:48.291280 28723 consensus_meta.cc:287] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.005s
I20260709 13:09:48.291371 28746 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.292101 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 814) took 1635 ms. Trace:
W20260709 13:09:48.293618 28848 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.380s	user 0.003s	sys 0.009s
W20260709 13:09:48.285948 28755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.364s	user 0.005s	sys 0.005s
W20260709 13:09:48.298843 28755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.432s	user 0.005s	sys 0.005s
I20260709 13:09:48.299197 28539 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:48.299695 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3120) took 1537 ms. Trace:
I20260709 13:09:48.126883 28504 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.297123 23255 rpcz_store.cc:276] 0709 13:09:46.656786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.657631 (+   845us) service_pool.cc:224] Handling call
0709 13:09:46.658027 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.643230 (+985203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.291448 (+648218us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b540035d754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.291830 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254098176}
I20260709 13:09:48.292569 28746 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.329607 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 932) took 2773 ms. Trace:
I20260709 13:09:48.292454 28723 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.338723 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2726) took 1178 ms. Trace:
I20260709 13:09:48.338984 28723 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.339174 22654 rpcz_store.cc:276] 0709 13:09:47.160228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.392440 (+232212us) service_pool.cc:224] Handling call
0709 13:09:48.338265 (+945825us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.338531 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288512256}
I20260709 13:09:48.300173 22498 rpcz_store.cc:276] 0709 13:09:46.761957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.101866 (+339909us) service_pool.cc:224] Handling call
0709 13:09:47.107816 (+  5950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.113537 (+  5721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.113582 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.114172 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.700396 (+586224us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:47.700442 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.700521 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.292225 (+591704us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:48.296770 (+  4545us) raft_consensus.cc:1685] finished
0709 13:09:48.296796 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.299437 (+  2641us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5280,"raft.queue_time_us":6701,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":8544128,"thread_start_us":585795,"threads_started":1,"wal-append.queue_time_us":728545}
I20260709 13:09:48.340723 23264 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:48.343182 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:48.345583 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:48.346704 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2727) took 1156 ms. Trace:
I20260709 13:09:48.347146 22653 rpcz_store.cc:276] 0709 13:09:47.190664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.008453 (+817789us) service_pool.cc:224] Handling call
0709 13:09:48.027267 (+ 18814us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.033174 (+  5907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.346306 (+313132us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54003f0050. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.346529 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42354560}
I20260709 13:09:48.349992 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3118) took 1318 ms. Trace:
I20260709 13:09:48.350464 28558 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:48.351111 28558 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.351598 28558 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:48.319111 28563 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.358403 28539 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.359138 28539 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.330282 23260 rpcz_store.cc:276] 0709 13:09:45.555990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.558287 (+  2297us) service_pool.cc:224] Handling call
0709 13:09:45.564830 (+  6543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.755786 (+190956us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:46.140484 (+384698us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.657802 (+517318us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.658327 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.658542 (+   215us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:46.658584 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.658662 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.141992 (+1483330us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:48.308694 (+166702us) raft_consensus.cc:1685] finished
0709 13:09:48.316745 (+  8051us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.329355 (+ 12610us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142073,"prepare.queue_time_us":89060,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":32508,"raft.queue_time_us":373457,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":16729,"spinlock_wait_cycles":52075392,"thread_start_us":848810,"threads_started":3,"wal-append.queue_time_us":671036}
I20260709 13:09:48.359508 28539 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.350517 22645 rpcz_store.cc:276] 0709 13:09:47.031026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.004342 (+973316us) service_pool.cc:224] Handling call
0709 13:09:48.026997 (+ 22655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.033651 (+  6654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.349536 (+315885us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5400237150. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.349777 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51257088}
I20260709 13:09:48.371116 28563 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:48.360641 28490 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.371419 28753 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.378556 28490 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:48.382110 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:48.382437 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:48.383672 23264 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:09:48.390355 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.391217 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:48.392212 23255 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:48.393543 22579 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:48.376783 28746 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.428267 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3767) took 1084 ms. Trace:
I20260709 13:09:48.450368 22501 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:48.451746 28552 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:48.452325 28552 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:48.453965 28552 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.455709 28552 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:48.457391 22648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2719) took 1653 ms (client timeout 2142 ms). Trace:
I20260709 13:09:48.457516 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3756) took 1893 ms. Trace:
W20260709 13:09:48.457958 22648 rpcz_store.cc:269] 0709 13:09:46.803538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.225684 (+422146us) service_pool.cc:224] Handling call
0709 13:09:48.442573 (+1216889us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54001c89d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.457113 (+ 14540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96471296}
I20260709 13:09:48.458052 22503 rpcz_store.cc:276] 0709 13:09:46.564253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.565286 (+  1033us) service_pool.cc:224] Handling call
0709 13:09:46.574478 (+  9192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.590576 (+ 16098us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:47.164714 (+574138us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.699553 (+534839us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.699604 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:47.699653 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.439833 (+740180us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b1800078340. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:09:48.456981 (+ 17148us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b54001db0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.457049 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.457317 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17634,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":107,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8271,"spinlock_wait_cycles":39706752,"thread_start_us":1108290,"threads_started":2,"wal-append.queue_time_us":651943}
I20260709 13:09:48.465370 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3106) took 2116 ms. Trace:
I20260709 13:09:48.465885 22500 rpcz_store.cc:276] 0709 13:09:46.348424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.348617 (+   193us) service_pool.cc:224] Handling call
0709 13:09:47.213843 (+865226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.261094 (+ 47251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.435944 (+1174850us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b540033e0d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.465158 (+ 29214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968491776}
I20260709 13:09:48.468369 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1236) took 3689 ms. Trace:
I20260709 13:09:48.428758 22502 rpcz_store.cc:276] 0709 13:09:47.343328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.424021 (+ 80693us) service_pool.cc:224] Handling call
0709 13:09:47.429151 (+  5130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.234113 (+804962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.427883 (+193770us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54001a8e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.428158 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848474368}
W20260709 13:09:48.474843 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 108253us
I20260709 13:09:48.479907 28563 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.473538 22496 rpcz_store.cc:276] 0709 13:09:44.778735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.778957 (+   222us) service_pool.cc:224] Handling call
0709 13:09:44.779261 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:44.961265 (+182004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.961295 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:46.508069 (+1546774us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b2c000014c8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:09:46.508609 (+   540us) log.cc:844] Serialized 52 byte log entry
0709 13:09:47.527698 (+1019089us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:47.527745 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.467699 (+939954us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540033f9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.467800 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.467891 (+    91us) raft_consensus.cc:1685] finished
0709 13:09:48.467911 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.468182 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122958,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":35940,"spinlock_wait_cycles":458574848,"thread_start_us":900566,"threads_started":1,"wal-append.queue_time_us":1138803}
I20260709 13:09:48.486636 28586 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.491078 28586 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.488667 28746 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:09:48.495260 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.495615 28746 consensus_queue.cc:1243] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:48.507784 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.505538 28715 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:48.509240 22574 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:48.509876 28715 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.512311 28755 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.513150 28755 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.514151 28586 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:48.516263 28875 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.374s	user 0.014s	sys 0.026s
I20260709 13:09:48.550704 28715 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.551529 28597 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.554075 22501 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:48.539506 22652 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:48.527462 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:48.527730 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:48.539907 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:48.528800 22574 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:48.530390 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:48.534696 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:48.554322 22543 connection.cc:256] RPC call timeout handler was delayed by -1.5707263099999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:09:48.524206 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:48.532423 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.539135 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:48.533460 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:48.584200 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 78184.3us
I20260709 13:09:48.584735 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:48.529356 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.544109 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:48.545970 28818 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:48.584762 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:48.528294 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:48.538761 28713 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.536s	user 0.019s	sys 0.003s
I20260709 13:09:48.543193 28760 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.586916 22618 leader_election.cc:400] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:48.592813 22651 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:48.595479 22618 leader_election.cc:403] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:48.585227 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:48.543351 28586 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.527995 28563 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.547331 28819 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:48.593428 22578 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:48.516297 28755 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.598768 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:48.599419 22543 connection.cc:256] RPC call timeout handler was delayed by -1.4861263099999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
I20260709 13:09:48.588883 28818 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:48.522789 28732 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:48.597873 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 43773.1us
I20260709 13:09:48.603338 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:48.608404 23257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 813) took 1951 ms (client timeout 2403 ms). Trace:
W20260709 13:09:48.608994 23257 rpcz_store.cc:269] 0709 13:09:46.656442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.662121 (+  5679us) service_pool.cc:224] Handling call
0709 13:09:48.607927 (+1945806us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54007e1dd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.608191 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718284032}
I20260709 13:09:48.611670 22578 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:48.613754 22578 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:48.614279 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.615370 22501 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:48.617376 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 816) took 1947 ms. Trace:
I20260709 13:09:48.617966 23259 rpcz_store.cc:276] 0709 13:09:46.669682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.678136 (+  8454us) service_pool.cc:224] Handling call
0709 13:09:46.774941 (+ 96805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.382993 (+608052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.582529 (+1199536us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54006d3b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.617138 (+ 34609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301557120}
I20260709 13:09:48.621014 22578 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:48.621706 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.603829 28819 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:48.622470 22650 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:48.622794 22579 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:48.621879 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.628774 22577 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.629683 22649 raft_consensus.cc:2410] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:48.530023 28512 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.626740 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:48.631346 22576 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
W20260709 13:09:48.632591 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47547.4us
I20260709 13:09:48.635246 22580 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:48.600553 28713 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.622877 28264 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15.
I20260709 13:09:48.614424 28782 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.661049 28783 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.661805 28783 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:48.663074 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2624) took 2005 ms (client timeout 2167 ms). Trace:
W20260709 13:09:48.663503 22575 rpcz_store.cc:269] 0709 13:09:46.657825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.736072 (+ 78247us) service_pool.cc:224] Handling call
0709 13:09:48.662675 (+1926603us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540027abd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:48.662894 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076364672}
I20260709 13:09:48.664191 28783 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.664592 28563 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:48.665052 28563 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:48.665508 28563 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:48.665884 22571 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:09:48.645407 28539 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.669221 22573 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:48.671149 22544 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:48.673118 28755 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.673259 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.675145 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.675305 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:48.676349 28837 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.132s	user 0.009s	sys 0.004s
I20260709 13:09:48.677482 28819 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.678217 28877 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:48.678738 28819 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:48.682395 28767 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.683176 28767 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:48.685408 22543 connection.cc:256] RPC call timeout handler was delayed by -1.0924661359999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 13:09:48.686555 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:48.687551 28768 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.687660 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:48.688642 22496 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
I20260709 13:09:48.688361 28768 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.689152 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.689321 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.691032 28753 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:48.691596 28753 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.692040 28753 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:48.703999 22503 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:48.707536 22579 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:48.708302 22572 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:48.712478 22652 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:48.714186 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3765) took 2302 ms. Trace:
I20260709 13:09:48.714658 22573 rpcz_store.cc:276] 0709 13:09:46.411768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.412003 (+   235us) service_pool.cc:224] Handling call
0709 13:09:46.474639 (+ 62636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.669695 (+2195056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.692737 (+ 23042us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b5400256a54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:48.714091 (+ 21354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4991320448}
I20260709 13:09:48.717283 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.718437 22578 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:48.720721 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 82148.8us
I20260709 13:09:48.724190 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.643739 28586 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.707686 28760 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.729831 22653 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:48.731788 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.732242 28760 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.732734 22502 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.735249 28782 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.737782 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:48.741489 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.741901 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:48.719278 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:48.723785 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 74242.1us
I20260709 13:09:48.744328 22647 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:48.748574 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54419.4us
I20260709 13:09:48.750025 22501 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:48.757068 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:48.743191 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:48.747690 28767 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.765847 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.753227 28730 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.761356 22574 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:09:48.782956 28562 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:09:48.756916 28539 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:48.781787 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.846153 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:48.849975 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 67965.1us
W20260709 13:09:48.851588 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 92199.1us
I20260709 13:09:48.852523 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:48.857106 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.857108 22573 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:48.861893 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:48.864208 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:48.870890 28782 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:48.879973 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:48.885011 22651 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:09:48.889403 22647 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:48.893301 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:48.905344 23259 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:48.917044 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:48.918576 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:48.918159 22574 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:48.920336 28730 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:48.934041 28730 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:48.935169 22573 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:48.937924 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:48.938719 22501 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:48.940832 28882 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:09:48.941574 28558 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.006s
I20260709 13:09:48.942093 28558 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.946440 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.945793 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:48.946700 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 101848us
W20260709 13:09:48.965739 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 121218us
I20260709 13:09:48.967180 22577 raft_consensus.cc:2410] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:09:48.979565 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:48.944718 28558 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:48.976141 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64691.2us
I20260709 13:09:48.984090 22500 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:48.984393 28586 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:48.985157 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.985122 28586 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.986079 22505 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:48.985834 28586 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:09:48.985848 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.992460 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.989092 28597 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:48.989606 28539 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:48.996481 28539 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.996989 28539 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:49.003453 28731 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.984192 28824 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:49.020701 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:49.004292 28731 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:48.973904 28512 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:49.038717 22502 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:49.041445 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:49.042950 22501 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:49.020320 28713 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:48.984661 28805 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.159s
I20260709 13:09:48.895382 28818 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.024066 28768 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.048074 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:49.051535 23260 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:49.054621 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:49.068549 22574 raft_consensus.cc:2410] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:49.053010 28877 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:49.095345 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 202272us
I20260709 13:09:49.029161 28824 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:49.101341 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.104244 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.068082 28828 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:49.108153 22499 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:49.107878 28740 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:09:49.112152 23259 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:49.082758 28768 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:49.091554 28877 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:49.106783 28818 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:49.146136 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.152697 22498 raft_consensus.cc:2410] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:09:49.153752 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:49.127998 28732 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.137415 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:49.147246 28713 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:49.160348 28552 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.008s
I20260709 13:09:49.160221 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:49.126214 28490 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.160827 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:49.161427 28747 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.161262 28877 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.165462 28746 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.165970 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.166193 28824 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.166968 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.167351 22573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc46eb991824d25bde40d1001e04798"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:09:49.167475 28754 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:09:49.166559 28504 raft_consensus.cc:2955] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Committing config change with OpId 14.12: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:49.161263 28897 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:09:49.169656 22571 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:09:49.173209 28883 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.402s	user 0.000s	sys 0.004s
I20260709 13:09:49.174239 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:49.175978 22500 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:09:49.178668 28889 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 13:09:49.180027 22501 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
W20260709 13:09:49.184576 28884 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.328s	user 0.003s	sys 0.000s
I20260709 13:09:49.186864 22505 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:09:49.189358 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 346474us
I20260709 13:09:49.191357 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.147465 28558 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:09:49.190706 28730 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:49.092993 28597 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:09:49.245759 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 50664.8us
I20260709 13:09:49.270955 22502 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:09:49.369287 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.330691 22573 raft_consensus.cc:606] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:09:49.337325 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 177245us
W20260709 13:09:49.272622 28819 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.006s
I20260709 13:09:49.354010 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.373103 22504 raft_consensus.cc:2410] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:49.354542 22498 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:49.371351 22573 raft_consensus.cc:614] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:49.254034 28713 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:49.338116 28586 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:49.348097 28264 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.382794 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:49.352723 28767 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:49.268258 28783 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.102s
I20260709 13:09:49.393254 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.348379 28760 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:49.349363 28746 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:49.354771 28740 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:49.397562 22503 raft_consensus.cc:2410] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:09:49.396366 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.396494 22500 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:09:49.400612 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.331818 28747 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:49.402458 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 294489us
I20260709 13:09:49.335858 28732 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.355700 28490 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:49.397046 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:49.400143 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 308754us
I20260709 13:09:49.405529 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.408288 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:49.400645 28753 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.708s	user 0.014s	sys 0.000s
I20260709 13:09:49.417867 22505 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:49.405280 28877 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:49.421061 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 53242.4us
I20260709 13:09:49.425328 22505 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:49.424603 23262 raft_consensus.cc:2955] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:49.427433 22505 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:09:49.404708 28767 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:49.435313 28539 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:49.435736 28898 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:09:49.438930 22503 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:49.444125 22499 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:09:49.444578 22500 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:49.409634 28586 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:09:49.433969 28755 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:49.451917 28563 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.004s
I20260709 13:09:49.456755 28747 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:49.457329 28732 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:49.415177 28760 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.458124 28805 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:09:49.465728 28901 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:09:49.467617 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:49.467897 28760 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:49.468324 23260 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:49.443900 28731 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:49.404798 28264 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.439944 28552 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:49.420056 28753 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.469658 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:49.469897 22469 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:49.422470 28713 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:49.514705 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 127975us
I20260709 13:09:49.516981 22505 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:49.457636 22500 raft_consensus.cc:2955] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:49.534490 28264 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:49.541697 28732 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.542366 28732 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:49.544967 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 336532us
I20260709 13:09:49.545550 28818 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.546311 28818 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:49.557541 28539 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.558311 28767 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.561208 22574 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:49.562309 28753 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:49.563750 28490 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.570216 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:49.571818 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.573033 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.573530 28746 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.576078 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.577864 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.578850 22498 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:49.443941 28740 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.582782 28818 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:49.589187 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:49.590076 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 118215us
I20260709 13:09:49.592269 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:49.471493 28828 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:49.596089 28828 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.603938 28562 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.604595 28562 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:49.521306 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:49.544601 28732 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:49.470186 28563 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:49.516103 28747 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:49.623241 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3127) took 1096 ms. Trace:
I20260709 13:09:49.622952 22571 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:49.641117 22497 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:49.630587 28747 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.631388 22645 rpcz_store.cc:276] 0709 13:09:48.522070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.525238 (+  3168us) service_pool.cc:224] Handling call
0709 13:09:48.525723 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.526313 (+   590us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:48.526776 (+   463us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.628880 (+102104us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.705214 (+ 76334us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.705371 (+   157us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:48.705407 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.705481 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.181492 (+476011us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:49.605981 (+424489us) raft_consensus.cc:1685] finished
0709 13:09:49.618512 (+ 12531us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.618671 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3977,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":2120,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":5376,"spinlock_wait_cycles":141612928,"thread_start_us":101145,"threads_started":1,"wal-append.queue_time_us":198079}
W20260709 13:09:49.644188 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129813us
I20260709 13:09:49.658541 22503 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:49.647006 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:49.699268 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46758us
I20260709 13:09:49.711442 28908 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:49.717458 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:49.720711 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 546609us
I20260709 13:09:49.725656 28903 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:49.730118 28563 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.651682 28740 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:49.705876 28747 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.741736 28909 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 13:09:49.712884 28908 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:49.699738 28805 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:09:49.758498 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:49.748710 28768 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:49.763669 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.764549 22505 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:49.765339 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 328321us
W20260709 13:09:49.766055 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.766847 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.763716 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:49.767724 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.768090 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.754588 28563 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.772732 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:49.790601 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 169712us
I20260709 13:09:49.758391 28753 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:09:49.767382 28562 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.816169 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:49.767990 28768 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:49.808125 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:49.823653 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:49.811484 28908 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:49.794546 28563 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:49.826529 28896 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:49.772974 28760 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:09:49.831499 28768 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:49.833292 28818 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:49.854084 22497 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:49.840128 28805 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.873167 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:49.847764 28897 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:49.889920 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:49.891137 23256 raft_consensus.cc:2410] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:49.862491 28818 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.853437 28921 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:49.864384 28896 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:49.896440 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:49.900482 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:49.903167 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:49.906486 22499 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:49.904168 22504 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:49.884372 28903 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:49.897065 28909 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.886682 28562 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:49.899144 28818 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:49.897562 28921 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:49.923642 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.924764 22545 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:49.927040 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 82490.8us
I20260709 13:09:49.930697 28926 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:49.879896 28805 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.926916 28921 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:49.932487 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 116454us
W20260709 13:09:49.933302 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115157us
I20260709 13:09:49.935798 28805 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.936218 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:49.895476 28924 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
W20260709 13:09:49.939415 28907 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:09:49.937520 28897 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:49.927212 28753 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:49.953359 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 209938us
I20260709 13:09:49.957653 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:49.946220 28782 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:49.957306 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:49.956880 28916 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:09:49.961462 28919 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:09:49.954433 28897 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.962476 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:49.963565 28586 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:49.966943 28912 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:09:49.927925 28909 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.970356 22543 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:49.971040 28563 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:49.972777 28851 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:49.958597 28900 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:49.974931 28914 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.234s	user 0.004s	sys 0.000s
I20260709 13:09:49.974037 28755 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:49.977547 28920 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:49.978096 28920 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.978497 28920 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:49.982045 28915 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:09:49.972996 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:49.985131 28563 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:49.990329 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.955799 28911 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:09:49.974009 28900 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:49.962610 28897 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.957065 28264 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:09:50.025893 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45611.1us
I20260709 13:09:49.990882 28753 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.029469 28930 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:49.993950 28767 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:09:50.033004 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3132) took 1115 ms. Trace:
I20260709 13:09:50.013404 28755 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:50.035090 22496 rpcz_store.cc:276] 0709 13:09:48.917713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.917875 (+   162us) service_pool.cc:224] Handling call
0709 13:09:48.980747 (+ 62872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.050872 (+ 70125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.050924 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.096713 (+ 45789us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.398716 (+302003us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:49.398768 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.398834 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.032705 (+633871us) raft_consensus.cc:1685] finished
0709 13:09:50.032735 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.032935 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5469,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":35390,"thread_start_us":262754,"threads_started":1,"wal-append.queue_time_us":520778}
W20260709 13:09:50.047966 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 81426.1us
I20260709 13:09:50.027920 28933 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:09:50.009430 28896 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.034751 28930 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.062163 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 107670us
W20260709 13:09:50.061205 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 108309us
I20260709 13:09:50.065142 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:50.068259 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 96119.2us
I20260709 13:09:50.062017 28917 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.077977 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 115620us
I20260709 13:09:50.023872 28903 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.067831 28930 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:50.069418 28767 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:50.073029 28563 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:50.064009 28916 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:09:50.077651 28586 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:09:50.067809 28932 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 13:09:50.109539 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44524.7us
I20260709 13:09:50.138370 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.113397 28945 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.062533 28947 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:09:50.113801 28946 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:50.100024 28767 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:50.114673 28938 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.100449 28909 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:50.122372 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52143.2us
I20260709 13:09:50.129043 28951 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:50.130106 28952 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.096522 28917 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.133262 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.127326 28760 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:09:50.133733 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.115383 28818 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:50.135280 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:50.104842 28563 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.114696 28921 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.105587 28755 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.162006 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:50.162420 28877 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.004s
I20260709 13:09:50.162961 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:50.166252 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:50.141996 28946 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:50.173779 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48519.6us
W20260709 13:09:50.169955 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 136736us
I20260709 13:09:50.148125 28900 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.184578 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:50.194545 28943 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:50.194949 28818 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:50.195263 28917 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.195683 28943 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:50.195636 28818 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:50.196326 28943 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:50.196847 22605 heartbeater.cc:646] Failed to heartbeat to 127.20.227.190:45599 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.227.190:45599 timed out after 15.000s (SENT)
W20260709 13:09:50.197220 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69855.5us
W20260709 13:09:50.197589 28948 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:09:50.198153 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.199523 22503 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:50.202232 28563 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.179545 28490 raft_consensus.cc:2764] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:09:50.191303 28916 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:50.202936 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69281.5us
I20260709 13:09:50.192327 28938 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:50.203881 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:50.184593 28586 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:50.205055 28586 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.204118 28938 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.205403 28264 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:50.205921 28264 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:50.205415 28586 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.185288 28912 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.206952 28264 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.207801 28912 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.205735 28938 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:50.209049 28767 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.210170 28912 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.210904 28877 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.160537 28951 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.212515 28942 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.192198 28929 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:50.177268 28747 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.169360 28952 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.215757 28929 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:50.180032 28909 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.210820 28767 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.199457 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.147691 28945 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:50.232607 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46324.1us
I20260709 13:09:50.233182 28952 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.233399 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:50.234256 28945 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:50.231957 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.232118 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45108.4us
I20260709 13:09:50.240808 28851 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:50.239485 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:50.218248 28929 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.248183 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:50.248955 22498 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:50.249826 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:50.250407 22498 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:50.251866 28713 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.257278 28909 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.258910 28909 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:50.260174 28932 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:50.260308 28927 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:09:50.260609 28932 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:50.261515 28932 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.263656 28828 consensus_queue.cc:1059] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:50.197646 28921 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.265096 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.267091 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.245530 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:50.236824 28916 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:09:50.277845 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44546.1us
I20260709 13:09:50.243219 28936 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:50.280122 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.281278 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:50.243296 28951 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.283176 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:50.286154 22497 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:50.288939 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.280637 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.290588 22647 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:50.290963 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45421us
I20260709 13:09:50.292444 22646 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:09:50.292680 22649 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:50.277527 28504 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:50.294580 28963 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:09:50.295253 28935 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:09:50.296092 22650 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:50.266601 28740 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:50.290266 22654 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:50.289691 22645 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:09:50.308476 28732 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.299844 28920 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.281994 28731 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:50.311336 28731 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:50.312427 28731 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.312932 28920 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.313758 28731 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.317582 22496 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:50.318171 28586 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.318796 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:50.320312 28586 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:50.297515 28946 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.321931 28946 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:50.322999 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 950) took 1173 ms. Trace:
I20260709 13:09:50.323419 23259 rpcz_store.cc:276] 0709 13:09:49.149666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.149910 (+   244us) service_pool.cc:224] Handling call
0709 13:09:49.159895 (+  9985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.160179 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:49.405694 (+245515us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.322507 (+916813us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b180028bdc0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287
0709 13:09:50.322608 (+   101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.322664 (+    56us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:50.322730 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.322813 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.322924 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":290078,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1588,"raft.queue_time_us":124656,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11098,"spinlock_wait_cycles":2519424,"thread_start_us":693669,"threads_started":3,"wal-append.queue_time_us":428753}
I20260709 13:09:50.284958 28747 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.325249 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:50.289765 28943 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.326807 28943 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:50.327335 28897 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.326735 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:50.330091 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 63077.5us
I20260709 13:09:50.330940 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.306550 28851 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:50.335160 22498 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:09:50.338234 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 138895us
I20260709 13:09:50.332767 28740 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.332024 28942 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:50.329589 28936 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:50.332182 28730 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.334234 28747 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.337827 28563 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:50.371152 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:50.371833 22654 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.349388 28932 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.349774 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:50.377897 28972 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:50.378484 28972 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:50.378852 28972 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.381808 28558 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.382251 28936 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.382660 28558 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.384832 28563 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.385071 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.388242 28964 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.354434 28877 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:50.355044 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:50.355453 28924 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:50.357812 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.358515 22647 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
W20260709 13:09:50.391089 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 126059us
I20260709 13:09:50.393673 28924 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:50.398252 28924 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.399577 28924 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:50.400090 28558 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:50.392349 28768 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.515s	user 0.014s	sys 0.000s
I20260709 13:09:50.402010 28768 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.403546 28933 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:50.403972 28933 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:50.404382 28768 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.404848 28933 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.405802 28740 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:50.406353 28933 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:50.364848 28942 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.395506 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:50.410558 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96659.7us
I20260709 13:09:50.414233 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.416205 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:50.428139 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3140) took 1254 ms. Trace:
I20260709 13:09:50.428772 22500 rpcz_store.cc:276] 0709 13:09:49.173686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.452565 (+278879us) service_pool.cc:224] Handling call
0709 13:09:49.457239 (+  4674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.457492 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:49.724676 (+267184us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.408439 (+683763us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800333340. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec263150bf 00007fec26315038
0709 13:09:50.426873 (+ 18434us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.427139 (+   266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.427186 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:50.427249 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.427880 (+   631us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.428060 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":189457,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1630,"raft.queue_time_us":215,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":10482,"spinlock_wait_cycles":4444544,"thread_start_us":186484,"threads_started":2,"wal-append.queue_time_us":204245}
I20260709 13:09:50.389258 28964 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:50.435236 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:50.408742 28597 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:09:50.442443 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 84695.8us
I20260709 13:09:50.395094 28921 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.449752 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:50.434789 28504 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:50.454089 22501 raft_consensus.cc:2410] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:09:50.433409 28942 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.479874 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:50.494810 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:50.499987 22654 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:09:50.501147 22653 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:50.508486 22505 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:50.510555 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.446079 28597 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:50.507447 28949 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:50.515556 23260 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:50.369907 28916 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.523000 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.524498 22574 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:50.511531 22646 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:09:50.525265 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:50.521559 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:50.445765 28964 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:50.519449 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:50.526684 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.526809 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:50.474113 28951 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:50.532069 22577 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:09:50.525944 22571 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:50.477958 28504 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:50.473676 28929 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:50.533205 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:50.546679 23259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:09:50.453235 28921 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:50.551287 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.565528 22575 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:50.567124 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.568166 22572 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:50.568427 22654 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:50.565696 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:50.570143 22497 raft_consensus.cc:2376] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15. Re-sending same reply.
I20260709 13:09:50.572333 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:50.550841 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.519256 28952 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:50.574143 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 164371us
I20260709 13:09:50.453588 28926 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.088s
I20260709 13:09:50.532137 28920 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:50.586481 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.520340 28949 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.554026 23259 raft_consensus.cc:606] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.542623 28504 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.583083 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:50.607687 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:50.584164 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:50.588481 28964 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.589834 28965 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:50.597112 28952 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.600406 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:50.601883 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:50.616014 22502 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:50.533262 28912 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:50.549151 28897 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.621556 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:50.619319 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 139396us
I20260709 13:09:50.542925 28562 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:09:50.597119 28931 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:50.541802 28768 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:09:50.609206 28949 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.542623 28951 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:50.641639 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60312.2us
I20260709 13:09:50.607461 28946 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:50.658599 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 107861us
I20260709 13:09:50.617717 28932 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:50.641121 28931 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.644433 28877 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.636929 28805 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:09:50.690474 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.690757 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:50.692114 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.694803 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:50.640796 28851 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:50.695751 22646 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:50.645645 28732 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:50.698283 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47082.8us
I20260709 13:09:50.700743 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.661497 28767 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:50.640389 28912 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.689651 28931 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.701607 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:50.635052 28828 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:09:50.703013 22648 raft_consensus.cc:2955] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:50.700855 28732 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.725636 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.651643 28974 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.274s
I20260709 13:09:50.731765 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:50.741308 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 163044us
I20260709 13:09:50.648325 28938 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.620538 28597 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.662163 28976 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:09:50.642906 28965 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.693209 28932 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.695868 28946 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.730744 28975 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:50.703236 28877 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.722612 28929 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:50.711915 28818 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:50.762187 28981 log.cc:927] Time spent T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:50.745020 28732 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:50.761116 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:50.741703 28760 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:50.780328 23263 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:09:50.783443 28977 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:09:50.762741 28912 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.805464 28952 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.807020 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:50.810240 28992 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:50.813398 28877 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.815876 28942 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.780249 28975 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.818573 28975 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:50.819870 28972 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.822136 28972 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:50.869103 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 376608us
W20260709 13:09:50.829478 28930 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.726s	user 0.004s	sys 0.008s
I20260709 13:09:50.873334 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:50.882673 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:50.797585 28740 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:50.893298 28929 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.826761 28597 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:50.902705 28951 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:50.906744 22496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.030s
W20260709 13:09:50.906672 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 126464us
I20260709 13:09:50.911286 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:50.870404 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 294112us
I20260709 13:09:50.912438 28896 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:50.915196 28918 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.088s	user 0.002s	sys 0.000s
I20260709 13:09:50.926775 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:50.927557 22578 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:50.871997 28946 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:50.939158 22578 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:50.936906 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:50.915326 28732 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:50.915465 28931 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:50.922163 22496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.010s	sys 0.030s
I20260709 13:09:50.950800 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:50.954917 28933 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 13:09:50.956324 28986 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:09:50.958411 29000 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:50.959829 29000 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:50.960289 29000 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:50.948583 28951 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:50.946599 28974 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:09:50.967742 28951 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.984851 28951 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:50.946447 28828 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:50.973747 28938 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.975165 28932 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:50.976424 28942 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:50.995044 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:50.984210 28264 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:51.009032 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:50.994635 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83482.2us
I20260709 13:09:50.993973 28828 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:50.996342 28563 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:50.995885 28851 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:50.997154 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54285us
I20260709 13:09:50.911038 28930 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.027659 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.013636 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:50.979401 28949 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:50.994181 28964 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.956374 28933 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:51.012462 28828 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.027419 28851 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:51.030323 28932 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:51.048130 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.050585 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:51.031088 28912 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:51.050060 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.034214 28933 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:51.042352 28782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.005s	sys 0.010s
W20260709 13:09:51.047605 28943 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.720s	user 0.013s	sys 0.011s
I20260709 13:09:51.043830 28755 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:51.059530 22572 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:51.043026 28897 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.056659 28932 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:51.063643 28732 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:51.029811 28563 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.053812 28912 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.065371 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.066808 28930 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.049309 28851 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:51.072726 28931 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.081470 28932 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.054533 28961 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:09:51.058614 28782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.006s	sys 0.010s
I20260709 13:09:51.089592 22498 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:09:51.090438 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.036543 28964 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.091621 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.108083 22577 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:51.092042 28897 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.113022 28897 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.113417 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.113963 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.114254 22500 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:51.114701 22497 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 16: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:51.115132 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.115482 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.116101 22497 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:51.116952 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.118109 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.118615 22500 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:51.119566 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:51.095621 28563 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.097636 28912 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.098366 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:51.089241 28504 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.099154 28933 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.133816 28933 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:51.100332 28740 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:51.102008 28903 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:51.052711 28877 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:09:51.110324 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.120427 22503 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:51.125042 22577 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:51.132072 28964 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.132354 28504 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.141487 22573 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:51.142369 22578 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:51.106716 28782 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:51.140798 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:51.174750 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55287.3us
W20260709 13:09:51.198057 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.050280 29000 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.209883 22500 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:09:51.143661 28961 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:51.181192 29018 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:09:51.170069 28563 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.214119 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:51.182044 29022 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:51.196444 28972 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:51.226838 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.215396 28908 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.229981 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.225661 28975 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.231915 28990 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:51.219034 28964 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.232528 28990 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.233289 28964 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.234809 28990 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:51.141215 29007 consensus_queue.cc:1175] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ca917eaada84bf38a5daae9f8ffa066" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 13 index: 10 } }
I20260709 13:09:51.236492 28961 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.238320 29000 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:51.229946 28972 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.243192 28972 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.245002 28740 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:51.245801 28740 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.246281 28740 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.249694 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.250346 22503 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 9.
I20260709 13:09:51.251057 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.251201 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.223644 29022 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:51.253026 28782 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.222294 28931 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:51.233289 28975 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.259342 22497 raft_consensus.cc:2410] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:09:51.170403 28747 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:09:51.235664 28964 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.248775 28851 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.290391 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.291023 23262 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:51.291699 28851 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.277187 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.280514 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.293339 22500 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.295949 23257 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:51.297192 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.288746 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.281366 28740 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.289098 28951 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.294864 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.289448 22497 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:51.308827 23264 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:51.289971 28935 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:51.319010 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.327950 22503 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:51.326850 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.331228 22500 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:51.334056 22500 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:51.308050 28931 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:51.265559 29022 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:51.317495 28851 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:51.338343 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.341568 22497 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:51.265110 28908 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.320597 28935 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:51.345345 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:51.347370 23264 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:51.355803 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.359030 22497 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:51.360337 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:51.362403 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 221662us
I20260709 13:09:51.362941 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.340299 28851 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:51.363579 23255 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:51.373529 22500 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:51.368033 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:51.378868 22497 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:51.365257 28747 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.413586 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.484754 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.487445 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.487905 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.488194 22578 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.488559 22574 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:51.491779 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.492439 22500 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:51.400029 28897 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:51.496837 22575 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:51.415642 28755 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:51.413136 28951 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:51.501595 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 134932us
I20260709 13:09:51.503376 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.504078 22579 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:51.508055 22578 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:51.514472 22500 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:51.414084 28747 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.498847 28897 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.520727 28819 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:51.503938 28755 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:51.517637 23259 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:51.528759 22579 raft_consensus.cc:1217] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 10.11->[11.12-18.15]   Dedup: 11.12->[14.13-18.15]
I20260709 13:09:51.529424 22579 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [11.12-18.15]
I20260709 13:09:51.424144 28931 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.530319 22500 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:51.481962 28935 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.537818 22577 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:51.521363 28819 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:51.538789 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.539397 22580 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:51.539650 28819 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.540719 28819 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.541210 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.542374 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.542532 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.543434 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.543675 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.543977 22574 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:51.532697 28935 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.545222 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.520852 29033 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:09:51.546726 29033 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:51.547084 29033 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:51.547827 29033 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.544245 22579 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:51.550894 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.551484 22577 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:51.558244 28747 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.559751 23264 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:51.569591 22580 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:09:51.570812 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.572080 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.577312 28908 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.520273 28897 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:51.578436 22469 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:51.582840 28747 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:51.583461 28747 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:51.584400 28563 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:51.591279 22579 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
W20260709 13:09:51.603708 22468 connection.cc:256] RPC call timeout handler was delayed by -1.5627054769998949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:09:51.580437 22577 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
W20260709 13:09:51.607496 22468 connection.cc:256] RPC call timeout handler was delayed by -1.4448054769999317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 13:09:51.606388 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:51.588574 29006 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.617s	user 0.000s	sys 0.003s
W20260709 13:09:51.598024 29032 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:51.621253 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:51.638307 29003 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.657s	user 0.000s	sys 0.010s
I20260709 13:09:51.598363 29033 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:51.669598 28900 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:51.670034 28900 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:51.670840 28900 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.671828 28900 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.648384 28753 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:51.649703 28828 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:09:51.686759 28828 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.689199 23264 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:51.691047 28949 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:51.657109 29002 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.674s	user 0.001s	sys 0.002s
I20260709 13:09:51.659278 28851 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.699059 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3799) took 1397 ms. Trace:
I20260709 13:09:51.699625 22574 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:51.661831 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:51.662885 28984 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.863s	user 0.002s	sys 0.000s
I20260709 13:09:51.665232 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.678949 22500 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:51.682008 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:51.682717 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:51.584585 28747 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:51.684564 29037 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:09:51.686098 29034 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.711423 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.661764 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.699479 22496 rpcz_store.cc:276] 0709 13:09:50.301709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.319726 (+ 18017us) service_pool.cc:224] Handling call
0709 13:09:50.320058 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.341671 (+ 21613us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:50.341719 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.358709 (+ 16990us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.949357 (+590648us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.949409 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.949483 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.656234 (+706751us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:51.698788 (+ 42554us) raft_consensus.cc:1685] finished
0709 13:09:51.698809 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.698995 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2685,"raft.queue_time_us":4044,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2464,"spinlock_wait_cycles":26815232,"thread_start_us":559954,"threads_started":1,"wal-append.queue_time_us":593049}
I20260709 13:09:51.702268 22500 pending_rounds.cc:85] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 8
I20260709 13:09:51.703338 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:51.703903 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:51.707520 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:51.712728 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 104512us
I20260709 13:09:51.707772 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:51.707525 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:51.714411 23262 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.715106 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.717305 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:51.717909 23256 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:51.715745 23255 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 10.
I20260709 13:09:51.717929 22575 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 14: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:51.707412 28851 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:51.720570 28935 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:51.720999 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:51.712983 22500 pending_rounds.cc:107] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:51.723866 22500 raft_consensus.cc:2889] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.738476 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:51.749639 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.750314 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.751283 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.751291 29027 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:51.730818 28935 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:51.755116 28935 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:51.766110 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.735937 28828 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:51.760388 28921 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:51.770702 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 836) took 1226 ms. Trace:
I20260709 13:09:51.772325 23262 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:51.771181 23263 rpcz_store.cc:276] 0709 13:09:50.543908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.574637 (+ 30729us) service_pool.cc:224] Handling call
0709 13:09:51.770510 (+1195873us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54006d9cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:51.770645 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395037952}
I20260709 13:09:51.774315 23256 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:51.773851 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:51.731127 28755 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.741642 28897 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.740535 29022 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.791289 28563 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:51.810683 22576 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:51.794275 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:51.812211 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:51.810698 28932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.010s	sys 0.003s
W20260709 13:09:51.832068 29038 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:09:51.833832 28897 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.834950 23229 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:51.837069 28931 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:51.836933 29000 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:51.837599 28931 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:51.838408 29000 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:51.838497 28931 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.830325 28740 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:51.842159 28989 raft_consensus.cc:993] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:09:51.842684 28989 raft_consensus.cc:1081] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:09:51.843237 22498 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:51.846199 29022 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.846948 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:51.849972 22496 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:51.850309 22496 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:51.851034 22496 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.852025 22496 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:51.853294 22503 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:51.854272 28563 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:51.857981 22501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3784) took 2688 ms (client timeout 2807 ms). Trace:
W20260709 13:09:51.858469 22501 rpcz_store.cc:269] 0709 13:09:49.169739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.395982 (+226243us) service_pool.cc:224] Handling call
0709 13:09:51.857702 (+2461720us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001a9d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:51.857881 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2394277632}
I20260709 13:09:51.859972 22499 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:09:51.831147 28932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.003s
I20260709 13:09:51.872234 23263 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:51.879225 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56094us
I20260709 13:09:51.862977 28926 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:09:51.883421 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:51.888072 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:51.890903 29045 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:51.891474 29045 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:51.891865 29045 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:51.882357 28961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.001s	sys 0.014s
I20260709 13:09:51.883071 22496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:48204
I20260709 13:09:51.881608 28755 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:51.895624 22496 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.896804 22496 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:51.897807 29028 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:51.898294 29028 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.898644 29028 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:51.901482 28730 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:51.902024 28730 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:51.911465 29027 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:51.892637 28740 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:51.912493 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1290) took 1016 ms. Trace:
I20260709 13:09:51.912544 28740 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:51.912930 22499 rpcz_store.cc:276] 0709 13:09:50.896421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.912493 (+ 16072us) service_pool.cc:224] Handling call
0709 13:09:51.859525 (+947032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.860460 (+   935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.912307 (+ 51847us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54001a9d50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:51.912442 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177107328}
I20260709 13:09:51.913790 28740 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:51.914940 28926 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:51.925199 22469 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:51.926271 28851 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:51.926728 28851 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:51.940326 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:51.927145 28851 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:51.897212 28961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.001s	sys 0.014s
I20260709 13:09:51.922686 28965 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:51.953893 22496 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.962170 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:51.958606 29027 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:51.973431 28997 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.012s	user 0.003s	sys 0.008s
I20260709 13:09:51.975274 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1284) took 1431 ms. Trace:
I20260709 13:09:51.975642 22502 rpcz_store.cc:276] 0709 13:09:50.543655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.642598 (+ 98943us) service_pool.cc:224] Handling call
0709 13:09:50.683441 (+ 40843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.683747 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.683786 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.696640 (+ 12854us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.855043 (+158403us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:50.855104 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.855200 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.972904 (+1117704us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:51.974973 (+  2069us) raft_consensus.cc:1685] finished
0709 13:09:51.974993 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.975215 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60516736,"thread_start_us":107806,"threads_started":1,"wal-append.queue_time_us":240822}
I20260709 13:09:51.981820 28563 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.993399 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1212) took 1541 ms. Trace:
I20260709 13:09:51.989959 28828 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.015210 22496 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:52.017279 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1210) took 1565 ms. Trace:
I20260709 13:09:52.020999 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:52.021734 23259 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:52.022073 23259 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:52.022958 23259 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:52.024032 23259 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:52.024972 28995 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:52.025484 28995 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.025825 28995 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:51.808426 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.028505 28946 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.029166 28946 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:52.030170 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3149) took 1376 ms. Trace:
I20260709 13:09:52.030596 22651 rpcz_store.cc:276] 0709 13:09:50.653645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.659139 (+  5494us) service_pool.cc:224] Handling call
0709 13:09:50.689250 (+ 30111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.703587 (+ 14337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.703628 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.708422 (+  4794us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.923142 (+214720us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:50.946295 (+ 23153us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.637605 (+691310us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:52.029734 (+392129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.029817 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.029857 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:52.029964 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.030106 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1084312,"prepare.queue_time_us":26635,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":1274,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6416,"spinlock_wait_cycles":64828160,"thread_start_us":141905,"threads_started":1,"wal-append.queue_time_us":231307}
I20260709 13:09:52.031952 28946 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:52.034137 28730 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:51.993918 22652 rpcz_store.cc:276] 0709 13:09:50.452458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.452606 (+   148us) service_pool.cc:224] Handling call
0709 13:09:50.485448 (+ 32842us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:09:50.514644 (+ 29196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.514692 (+    48us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:09:50.542271 (+ 27579us) log.cc:844] Serialized 104 byte log entry
0709 13:09:50.685018 (+142747us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:50.704816 (+ 19798us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.713267 (+  8451us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.724223 (+ 10956us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.992915 (+1268692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.993037 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.993099 (+    62us) raft_consensus.cc:1685] finished
0709 13:09:51.993120 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.993322 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1283155,"prepare.queue_time_us":88972,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":9722,"raft.queue_time_us":2590819,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":28451,"spinlock_wait_cycles":5935872,"thread_start_us":72222,"threads_started":1,"wal-append.queue_time_us":323990}
I20260709 13:09:52.013849 28924 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:52.036569 28730 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:51.994191 28920 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:52.067014 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3151) took 1386 ms. Trace:
W20260709 13:09:52.067425 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 1.34181e+06us
I20260709 13:09:52.017916 22645 rpcz_store.cc:276] 0709 13:09:50.451876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.452679 (+   803us) service_pool.cc:224] Handling call
0709 13:09:50.502213 (+ 49534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:50.516574 (+ 14361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.516619 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:50.534950 (+ 18331us) log.cc:844] Serialized 52 byte log entry
0709 13:09:50.697300 (+162350us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:50.711475 (+ 14175us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.948104 (+236629us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b4800190158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:09:51.989541 (+1041437us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b180033d480. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:09:52.016806 (+ 27265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.016943 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.017005 (+    62us) raft_consensus.cc:1685] finished
0709 13:09:52.017019 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.017198 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26335,"prepare.queue_time_us":13917,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":2817,"raft.queue_time_us":1312803,"raft.run_cpu_time_us":3076,"raft.run_wall_time_us":431441,"spinlock_wait_cycles":129490432,"thread_start_us":141532,"threads_started":2,"wal-append.queue_time_us":216878,"wal-append.run_cpu_time_us":3234,"wal-append.run_wall_time_us":1171245}
I20260709 13:09:52.068189 22654 rpcz_store.cc:276] 0709 13:09:50.680205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.722169 (+ 41964us) service_pool.cc:224] Handling call
0709 13:09:50.749654 (+ 27485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.749980 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:50.750473 (+   493us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.066585 (+1316112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.066637 (+    52us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:52.066708 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.066792 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.066942 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1222441,"prepare.queue_time_us":2718,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1241453,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":93302,"threads_started":2,"wal-append.queue_time_us":66598,"wal-append.run_cpu_time_us":1212,"wal-append.run_wall_time_us":1010749}
W20260709 13:09:52.073202 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 111072us
I20260709 13:09:52.052839 29027 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:52.078507 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 655531us
I20260709 13:09:52.051751 28828 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:52.074739 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:52.091841 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:52.097174 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.098203 28558 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:52.099014 29056 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:52.105695 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:52.108285 29044 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:09:52.109724 28828 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:52.109932 28963 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:52.110428 28963 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:52.113049 28512 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:09:52.117388 28512 consensus_queue.cc:1243] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:52.113895 29056 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:52.119294 29056 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.120756 28768 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.121397 28768 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:52.123555 28768 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:52.124004 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:52.124625 23260 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.124543 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:52.120772 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.112756 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:52.116348 23259 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24.
I20260709 13:09:52.135589 22469 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:52.144837 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:52.145495 22573 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:52.145836 22499 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:52.147625 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:52.122826 29028 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.156351 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:52.106338 28558 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:52.167706 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.208540 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.281575 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:52.308715 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:52.309664 22572 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:52.112716 28947 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:52.149396 29034 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:52.113068 28943 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
W20260709 13:09:52.324818 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 1.593e+06us
I20260709 13:09:52.316358 22579 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:09:52.322783 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 217238us
W20260709 13:09:52.709028 23260 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.013s
I20260709 13:09:52.709444 23260 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
W20260709 13:09:52.709540 22619 connection.cc:256] RPC call timeout handler was delayed by -1.1888672670000915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2807s for a response
W20260709 13:09:52.307150 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 151436us
I20260709 13:09:52.154314 28989 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:52.710284 28989 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.710717 28989 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:52.711397 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:52.323527 22544 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:52.323572 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.315820 22578 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:09:52.362763 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.713083 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:52.713809 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 427719us
W20260709 13:09:52.657783 22505 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.034s	sys 0.043s
W20260709 13:09:52.714483 22505 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.034s	sys 0.046s
I20260709 13:09:52.323165 28961 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.154s
I20260709 13:09:52.517342 28558 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.722339 28989 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:52.111326 28963 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:52.733598 28989 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:52.314121 29027 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.467183 28828 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:52.709728 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:52.764890 22499 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
W20260709 13:09:52.713390 28995 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.687s	user 0.015s	sys 0.006s
I20260709 13:09:52.155759 29013 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:52.733680 28563 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.773136 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:52.705611 29045 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.813s	user 0.005s	sys 0.020s
I20260709 13:09:52.702769 22572 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:52.767907 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1071) took 1253 ms. Trace:
W20260709 13:09:52.737993 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 633873us
I20260709 13:09:52.755162 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2644) took 1216 ms. Trace:
I20260709 13:09:52.785174 22576 rpcz_store.cc:276] 0709 13:09:51.539051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.544985 (+  5934us) service_pool.cc:224] Handling call
0709 13:09:52.754312 (+1209327us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003ac5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:52.754877 (+   565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607282048}
I20260709 13:09:52.746905 28755 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.811057 28747 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.811730 28747 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:52.812522 29008 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.829s	user 0.013s	sys 0.033s
I20260709 13:09:52.814049 29062 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.793354 29045 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.814565 29062 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.815514 28818 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:52.776980 28995 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.816076 28818 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:52.775906 29051 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.751s	user 0.011s	sys 0.013s
I20260709 13:09:52.768738 28946 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:52.776911 28947 consensus_queue.cc:1243] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:52.777179 28586 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.836787 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:52.786885 29024 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.767587 28819 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.826438 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53433.8us
I20260709 13:09:52.777894 22571 rpcz_store.cc:276] 0709 13:09:51.500004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.500124 (+   120us) service_pool.cc:224] Handling call
0709 13:09:51.500442 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.509512 (+  9070us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:51.517402 (+  7890us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.926977 (+409575us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b18004cc0c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:09:52.100036 (+173059us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b18004cc0c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec2a1cf58f 00007fec2320e571 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd
0709 13:09:52.126316 (+ 26280us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.126873 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.127053 (+   180us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:52.127088 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.127161 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.753132 (+625971us) raft_consensus.cc:1685] finished
0709 13:09:52.753166 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.753392 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110020,"prepare.queue_time_us":9453,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1441,"raft.queue_time_us":107598,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":4323,"spinlock_wait_cycles":61882880,"thread_start_us":92345,"threads_started":1,"wal-append.queue_time_us":566533}
W20260709 13:09:52.827282 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116918us
I20260709 13:09:52.767666 29013 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:52.876277 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.894435 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:52.894882 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.881572 23227 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.647s (SENT) [suppressed 7 similar messages]
I20260709 13:09:52.892513 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:52.780537 29034 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:52.924711 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 88067.3us
W20260709 13:09:52.934351 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.956651 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64211.5us
I20260709 13:09:52.816804 29062 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:52.978726 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85372.4us
I20260709 13:09:52.956470 28952 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:52.793210 28563 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:52.890020 29057 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.937474 29061 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.030190 28947 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:53.048750 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:53.049526 22498 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.061249 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:53.063781 22502 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:53.081383 29028 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:52.925956 29013 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:52.923230 28586 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.163651 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1313) took 1075 ms. Trace:
I20260709 13:09:53.164179 22496 rpcz_store.cc:276] 0709 13:09:52.088724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.088876 (+   152us) service_pool.cc:224] Handling call
0709 13:09:52.104663 (+ 15787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.104967 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.105002 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.106822 (+  1820us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.698931 (+592109us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:52.698992 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.699077 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.163326 (+464249us) raft_consensus.cc:1685] finished
0709 13:09:53.163362 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.163574 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":351749,"threads_started":1,"wal-append.queue_time_us":912979}
I20260709 13:09:53.165485 28586 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:52.922780 28819 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.020262 29062 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:53.140450 29028 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:53.159970 28959 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.223s
I20260709 13:09:53.160562 28916 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:52.991179 28943 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:52.938258 29024 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.185482 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:53.204279 22543 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.033s	sys 0.043s
I20260709 13:09:53.186640 29062 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:53.205132 22543 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.033s	sys 0.043s
W20260709 13:09:53.210709 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 928892us
I20260709 13:09:53.192544 28916 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:53.196425 28972 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.215386 23260 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:53.195644 22503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 3179) took 1508 ms (client timeout 1758 ms). Trace:
I20260709 13:09:53.047276 29057 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:53.223145 22503 rpcz_store.cc:269] 0709 13:09:51.676145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.676259 (+   114us) service_pool.cc:224] Handling call
0709 13:09:53.184370 (+1508111us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54003faf54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:53.184549 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346135296}
I20260709 13:09:53.221910 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:53.231642 23259 raft_consensus.cc:2368] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:09:53.233278 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:53.226565 22498 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:53.236188 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:53.205380 28995 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:53.239430 22652 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:53.214260 29062 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:53.196370 29028 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.251456 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:53.257141 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.257313 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.234181 28972 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:53.236040 28851 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.279s	user 0.014s	sys 0.007s
I20260709 13:09:53.258409 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.259536 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.261358 22646 raft_consensus.cc:2410] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:09:53.241626 22580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.036s	sys 0.040s
I20260709 13:09:53.243700 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:53.267975 22580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.037s	sys 0.040s
I20260709 13:09:53.262949 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1314) took 1166 ms. Trace:
I20260709 13:09:53.239929 28947 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:53.242614 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1004) took 1666 ms. Trace:
I20260709 13:09:53.301206 23264 rpcz_store.cc:276] 0709 13:09:51.575757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.576379 (+   622us) service_pool.cc:224] Handling call
0709 13:09:51.576657 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.689704 (+113047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.242371 (+1552667us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54006d2ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:53.242547 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258272640}
I20260709 13:09:53.302700 22650 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:53.249614 28755 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:53.265054 28851 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.304538 22500 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:53.305732 28819 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:53.306695 28818 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:53.307235 28851 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:53.277365 22653 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:53.203934 29034 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.277848 28916 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.239182 28943 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.279075 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.279889 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.280591 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.295717 22645 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:53.276176 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.310580 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.277208 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.320245 22647 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:53.266455 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1312) took 1216 ms. Trace:
W20260709 13:09:53.312347 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 430775us
I20260709 13:09:53.322569 22652 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:53.323863 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.324661 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.319348 22650 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:53.324708 22653 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:53.245138 28932 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.014s	sys 0.031s
I20260709 13:09:53.269073 22505 rpcz_store.cc:276] 0709 13:09:52.095870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.096189 (+   319us) service_pool.cc:224] Handling call
0709 13:09:52.113427 (+ 17238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.113649 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:52.714941 (+601292us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.244502 (+529561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:53.245338 (+   836us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:53.253921 (+  8583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.256376 (+  2455us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.261911 (+  5535us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85138,"prepare.queue_time_us":632847,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":7493,"raft.queue_time_us":98099,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":1038543,"threads_started":2}
I20260709 13:09:53.340533 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.341329 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.322044 22497 rpcz_store.cc:276] 0709 13:09:52.050160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.050343 (+   183us) service_pool.cc:224] Handling call
0709 13:09:52.067503 (+ 17160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.067797 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:52.699227 (+631430us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.265972 (+566745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:53.266040 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:53.266142 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.266233 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.266386 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101745,"prepare.queue_time_us":631200,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":114788,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":45,"thread_start_us":880642,"threads_started":2}
I20260709 13:09:53.321736 28943 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.345824 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1005) took 1500 ms. Trace:
I20260709 13:09:53.301242 28947 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.353315 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.353909 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.359059 22647 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:09:53.359547 29057 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:53.361702 22654 raft_consensus.cc:2410] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:09:53.341976 28563 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:53.360179 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.364670 22651 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:53.356060 23263 rpcz_store.cc:276] 0709 13:09:51.844975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.845128 (+   153us) service_pool.cc:224] Handling call
0709 13:09:51.845421 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.875667 (+ 30246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.345483 (+1469816us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54008359d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:53.345735 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61113728}
W20260709 13:09:53.333043 28932 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.014s	sys 0.033s
I20260709 13:09:53.347656 28916 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.376037 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.377108 22645 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:09:53.380576 22572 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:53.383143 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.384557 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.385612 22651 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:53.391618 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.392572 22645 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:53.395804 22653 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24.
I20260709 13:09:53.374747 28943 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:53.402292 28947 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:53.407723 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.408888 22653 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:53.410070 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.412962 22653 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:53.414078 28972 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:53.414310 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.415186 22653 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:53.416209 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.414080 29028 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:53.421553 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:53.423838 29024 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:53.431646 22646 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:09:53.440358 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:53.441946 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.423110 22645 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:09:53.455169 22654 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:53.455920 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.456646 22645 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:53.451773 22653 raft_consensus.cc:2376] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24. Re-sending same reply.
I20260709 13:09:53.453898 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:53.454330 22505 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:09:53.461616 22618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.011s	sys 0.000s
W20260709 13:09:53.462415 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.462919 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.448187 28851 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.478559 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.436637 29013 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.486114 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.487385 22571 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:53.489919 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.491789 22645 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:53.482205 29074 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.499042 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.499394 29074 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.469487 29054 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:09:53.502336 29054 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:53.502914 29054 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:53.505577 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.511837 29062 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.483176 28851 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.520670 23263 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:53.504067 29054 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.530652 22501 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:53.532750 23264 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:53.533965 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.550182 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.536402 22654 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:53.577343 22579 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:09:53.535622 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.578691 22497 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:53.549758 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.580099 22469 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:53.535255 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.582507 22572 raft_consensus.cc:2410] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:09:53.586264 22575 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:53.531190 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:53.588230 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 1.26468e+06us
I20260709 13:09:53.589819 22651 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:53.592082 22647 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:53.593670 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.602967 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.597280 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.582722 22652 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:53.600003 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:53.557317 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.535378 29075 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.605093 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.605662 22579 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:09:53.605541 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.606884 22650 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:53.514243 29045 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:53.609973 22647 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:53.623181 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.612584 22646 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:53.612789 22649 raft_consensus.cc:2410] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:53.574586 28908 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.628453 28908 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.629662 29005 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:53.630113 29005 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:53.631021 28908 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:53.631937 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:53.632788 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:53.633064 28877 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:53.634506 28877 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:53.634879 28877 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.635319 28877 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:53.635052 29083 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:53.637431 29083 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:53.638700 29083 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.641513 22576 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:53.634879 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.642727 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.577824 28943 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:53.643778 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.626843 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:53.625841 22651 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:53.642848 28897 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:53.534063 28903 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:53.622927 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.623001 22654 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:09:53.648108 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.649036 22573 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:53.650357 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.653322 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.623687 22652 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:09:53.655997 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.597760 28740 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:09:53.665264 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.666533 22647 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:53.666980 22647 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:53.665395 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.665735 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.656682 22652 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:53.674566 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 47797.4us
I20260709 13:09:53.678633 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.678551 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.679798 22571 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:53.653475 28897 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:53.681145 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.681356 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.667136 29077 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:53.630975 29005 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.682081 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.682324 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.685779 22651 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:53.686427 22578 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:53.683308 22572 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:53.675639 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:53.613458 29056 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:53.682029 22574 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:53.682694 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:53.683537 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.682339 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.682461 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.693188 22645 raft_consensus.cc:2410] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:09:53.694244 22573 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:09:53.698086 23264 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:09:53.698604 23264 pending_rounds.cc:85] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 15
I20260709 13:09:53.698184 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.698818 23264 pending_rounds.cc:107] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:09:53.699079 23264 raft_consensus.cc:2889] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.683212 29077 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.683486 29005 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:53.703298 22497 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:09:53.628530 28753 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.699038 22646 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:09:53.694274 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.707553 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.697310 22503 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:53.710740 22645 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:53.707580 23264 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:53.705122 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.711908 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:53.647676 29054 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:53.708835 22577 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:53.709234 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.694749 22505 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:53.717021 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:53.724119 23264 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:09:53.710561 22571 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:09:53.725389 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.726094 22571 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:53.726805 28989 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.651113 29074 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:53.727768 22571 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:53.705322 28912 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:53.648468 28903 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:53.725291 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:53.728982 29073 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:53.729962 29073 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:53.729570 28903 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.730146 22577 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:53.730368 29073 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:53.730641 28903 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.729604 23260 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:09:53.726048 22646 raft_consensus.cc:2376] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21. Re-sending same reply.
I20260709 13:09:53.731295 29073 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.732581 29073 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:53.705730 22647 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.749230 22647 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:53.735633 29072 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:53.736925 28908 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.608953 29057 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:09:53.738982 29013 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:53.684438 28959 consensus_queue.cc:1175] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ca917eaada84bf38a5daae9f8ffa066" responder_term: 21 status { last_received { term: 19 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.11-20.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:53.757725 22574 raft_consensus.cc:2410] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:09:53.643478 28943 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.683791 29024 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:53.740335 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.726230 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:53.764643 23263 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:53.732573 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:53.766027 22646 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:53.759871 28908 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.744489 22652 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:53.746055 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:53.753414 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.723403 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:53.627139 29075 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.759192 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.693318 28805 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:53.760699 22571 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:53.761656 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:53.761766 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:53.774382 22577 raft_consensus.cc:2376] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17. Re-sending same reply.
I20260709 13:09:53.770656 22573 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:53.723798 28851 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:53.724136 29056 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:53.752594 28912 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:53.789390 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:53.825006 29024 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:53.681646 28897 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.847395 22647 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
W20260709 13:09:53.848506 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 59277.1us
I20260709 13:09:53.773856 29074 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:53.773532 29028 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:53.852350 22647 pending_rounds.cc:85] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 12
I20260709 13:09:53.850312 28908 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:53.781093 28805 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.856139 29056 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.857826 28912 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.768304 28753 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
W20260709 13:09:53.865002 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.865604 28897 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:53.867246 28943 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:53.772075 28972 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 13:09:53.824986 28896 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:53.869666 22576 raft_consensus.cc:2410] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:09:53.826140 29057 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:09:53.855098 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:53.880703 22646 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:09:53.873540 22647 pending_rounds.cc:107] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:09:53.757916 28961 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
I20260709 13:09:53.877683 28753 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:53.882457 22647 raft_consensus.cc:2889] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.880117 28896 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:53.883509 29057 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:53.884469 29075 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:53.853480 29084 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:53.854205 29074 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:53.890311 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:53.896199 22505 raft_consensus.cc:2410] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:09:53.889783 29024 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:53.873279 29028 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.891247 28753 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:53.898075 28851 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.895143 29084 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.888517 29073 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:53.894549 29057 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:53.915513 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:53.909441 28558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.003s	sys 0.046s
I20260709 13:09:53.957229 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1074) took 1812 ms. Trace:
I20260709 13:09:53.958361 29084 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:53.980226 22575 rpcz_store.cc:276] 0709 13:09:52.144430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.144553 (+   123us) service_pool.cc:224] Handling call
0709 13:09:52.155395 (+ 10842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.586992 (+1431597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.956893 (+369901us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003c82d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:53.957150 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3290106624}
I20260709 13:09:53.958590 28896 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.986861 28896 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.948065 28877 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:53.947292 28753 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:53.917610 28946 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.009s	sys 0.052s
W20260709 13:09:53.964241 29066 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.622s	user 0.008s	sys 0.000s
I20260709 13:09:53.903360 28563 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:53.972808 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.902627 29028 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:53.900095 29045 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:53.901487 29053 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:53.903584 29078 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:53.990015 22618 leader_election.cc:400] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:09:53.974977 29072 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.994830 22501 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 13:09:53.980269 28558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.004s	sys 0.047s
W20260709 13:09:53.993966 28946 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.009s	sys 0.052s
W20260709 13:09:53.995425 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.998775 22618 leader_election.cc:403] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:53.959355 28851 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.005617 22496 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:09:54.005927 28747 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:54.006174 29033 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:54.008912 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.009567 22618 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.009722 22646 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:54.012576 22580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.030s	sys 0.036s
W20260709 13:09:54.012939 22580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.031s	sys 0.036s
I20260709 13:09:54.018903 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1076) took 1873 ms. Trace:
I20260709 13:09:54.019308 22580 rpcz_store.cc:276] 0709 13:09:52.145034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.147507 (+  2473us) service_pool.cc:224] Handling call
0709 13:09:52.278673 (+131166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.278991 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:53.268649 (+989658us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.017588 (+748939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.017665 (+    77us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:54.018662 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.018735 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.018842 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1062631,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"thread_start_us":1689336,"threads_started":2,"wal-append.queue_time_us":744100}
W20260709 13:09:54.021883 22468 connection.cc:256] RPC call timeout handler was delayed by -1.2500089730000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:09:54.024403 22468 connection.cc:256] RPC call timeout handler was delayed by -1.125808973000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:09:54.025539 22468 connection.cc:256] RPC call timeout handler was delayed by -1.125808973000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:09:54.024720 22503 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:53.974422 29073 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:54.027909 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0907089730001189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:09:54.006707 29033 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:09:54.032069 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0160089730001118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:09:54.032596 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.033562 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.001317 29053 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.007807 28753 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.050544 28558 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.050660 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:54.065770 22496 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:09:54.029939 29034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.000s	sys 0.040s
I20260709 13:09:53.979055 29074 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:54.057291 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0034089730000915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 13:09:54.062162 22498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.024s	sys 0.038s
I20260709 13:09:54.007328 29054 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:54.067451 22498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.024s	sys 0.038s
W20260709 13:09:54.071223 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.065189 22499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.007s	sys 0.011s
W20260709 13:09:54.051110 28932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.031s	sys 0.032s
I20260709 13:09:53.998338 28563 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.025341 29081 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:54.051373 29075 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:09:54.079788 22502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.017s	sys 0.005s
W20260709 13:09:54.082031 22502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.017s	sys 0.005s
I20260709 13:09:54.001078 29045 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:54.080181 22648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.014s	sys 0.015s
I20260709 13:09:54.006891 29072 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.091523 29074 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.068732 28747 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:54.085377 22646 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
W20260709 13:09:54.072957 29034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.000s	sys 0.040s
W20260709 13:09:54.087327 22648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.014s	sys 0.015s
W20260709 13:09:54.073436 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.008s	sys 0.012s
W20260709 13:09:54.076320 28932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.031s	sys 0.033s
I20260709 13:09:54.007268 29078 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.121212 29034 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.125829 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.087740 29081 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.077881 29054 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.133868 28805 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:54.135147 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.135798 29054 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.133894 29034 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.075322 28558 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.127838 22496 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:54.141703 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.068919 29057 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.148608 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1302) took 2303 ms. Trace:
W20260709 13:09:54.146586 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 381307us
I20260709 13:09:54.149060 22504 rpcz_store.cc:276] 0709 13:09:51.844763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.844903 (+   140us) service_pool.cc:224] Handling call
0709 13:09:51.845236 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.131111 (+285875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.131143 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.131193 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:52.131242 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.148363 (+2017121us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540033e5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:54.148413 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.148555 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656942848}
I20260709 13:09:54.116606 28747 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.149211 28943 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:54.169466 28747 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.149168 29017 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:54.159653 28877 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:54.161113 29033 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:54.174168 29057 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:54.176005 29083 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.023s
I20260709 13:09:54.175920 28978 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:09:54.245350 28978 consensus_queue.cc:1243] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:09:54.247364 29088 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:09:54.248076 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 3183) took 1241 ms. Trace:
I20260709 13:09:54.248487 22500 rpcz_store.cc:276] 0709 13:09:53.006522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.084033 (+ 77511us) service_pool.cc:224] Handling call
0709 13:09:54.247886 (+1163853us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000f9954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:54.248012 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245645184}
W20260709 13:09:54.249898 29094 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:54.271756 28963 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:54.273475 28563 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.274741 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.274946 28851 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.276338 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.276503 29045 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.276973 29073 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:54.289320 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:54.217191 29090 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:09:54.291864 22647 raft_consensus.cc:2376] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18. Re-sending same reply.
W20260709 13:09:54.242067 29083 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.000s	sys 0.024s
I20260709 13:09:54.183342 28903 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.106s
W20260709 13:09:54.286959 22653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.020s	sys 0.031s
W20260709 13:09:54.318677 22653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.021s	sys 0.032s
I20260709 13:09:54.319835 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:54.315349 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:54.317730 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.324311 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.324815 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.324524 22647 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:54.326790 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.289026 29053 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.327550 28943 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.328567 29034 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:54.343178 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.005s	sys 0.037s
W20260709 13:09:54.356693 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.005s	sys 0.037s
I20260709 13:09:54.345571 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.345019 22647 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:54.369992 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.370862 22652 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:09:54.365257 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 386686us
I20260709 13:09:54.374718 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:54.375567 22499 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:54.376655 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.378822 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:54.357172 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 647725us
I20260709 13:09:54.380582 22647 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:54.378341 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.381464 22654 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:54.382135 29034 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.382567 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.383282 22654 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:54.384402 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.385666 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.386919 22654 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:54.380740 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:54.397480 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.398607 22652 raft_consensus.cc:2376] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17. Re-sending same reply.
I20260709 13:09:54.333635 29028 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.403003 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:54.403035 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.406850 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.341903 29072 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:54.382498 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.412593 22647 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:54.407950 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:54.409585 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.414443 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.391026 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.417656 23260 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:09:54.418720 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.419723 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:54.405500 29091 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:09:54.420971 22647 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
W20260709 13:09:54.421548 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 388087us
I20260709 13:09:54.421957 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.424345 22647 pending_rounds.cc:85] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 10
I20260709 13:09:54.426173 28877 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.405680 28912 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:54.427043 28912 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.427412 28912 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.426471 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:54.427536 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.429812 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.432060 28903 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:54.436734 28903 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:54.437469 29093 log.cc:927] Time spent T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:54.437944 22651 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:54.425947 22647 pending_rounds.cc:107] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:54.439456 22651 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:54.441252 22645 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:54.442209 22651 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:54.409215 29034 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:54.421236 29099 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:54.444039 29099 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:54.444063 22651 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:09:54.360050 28943 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.440088 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.446082 28961 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:54.444844 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2765) took 1168 ms. Trace:
I20260709 13:09:54.446633 28961 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:54.446853 22650 rpcz_store.cc:276] 0709 13:09:53.276733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.340090 (+ 63357us) service_pool.cc:224] Handling call
0709 13:09:54.444673 (+1104583us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400393d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:54.444789 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589632896}
I20260709 13:09:54.446717 28943 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:54.448374 28943 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.448124 28961 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.444301 22645 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:09:54.449443 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.420449 23260 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:09:54.440560 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:54.449870 22651 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:54.450598 22647 raft_consensus.cc:2889] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.450871 22654 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.405794 28558 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:54.452309 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.449641 22645 pending_rounds.cc:85] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 14
I20260709 13:09:54.459626 22645 pending_rounds.cc:107] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:09:54.459507 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.460088 22645 raft_consensus.cc:2889] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:54.461650 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 296495us
I20260709 13:09:54.462836 23227 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:54.470950 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.471581 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.427618 29028 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.448825 28943 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.473456 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:54.423247 29027 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:54.478434 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:54.480228 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.501329 22498 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:09:54.501689 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.502318 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.502817 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.453173 28805 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:54.508589 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.511296 22647 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:54.474349 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:54.505702 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 87052.6us
W20260709 13:09:54.494637 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.507393 22543 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:54.514770 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.514688 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51933.4us
I20260709 13:09:54.514652 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:54.513871 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50123.6us
I20260709 13:09:54.519129 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.520653 22654 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:54.522166 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.523921 22654 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:09:54.524659 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:54.525251 22496 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.473269 28896 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.534425 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.535161 22654 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:54.536422 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.539865 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.540659 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.476169 29024 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:54.549198 22654 raft_consensus.cc:2376] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19. Re-sending same reply.
I20260709 13:09:54.515375 29017 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:54.509851 28877 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.550268 29028 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:54.558493 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.558871 29082 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:54.559959 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.560181 29074 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.560660 29074 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.561831 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:09:54.562502 29100 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:09:54.562892 28805 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:54.563323 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.563952 28805 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.564463 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.565640 22645 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:09:54.505261 29027 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:54.569204 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.570526 22647 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:09:54.447134 29099 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.557020 28909 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:54.557686 29024 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:54.557525 28828 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:09:54.595880 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.552428 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:54.556895 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3147) took 3900 ms. Trace:
I20260709 13:09:54.550770 28558 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:54.568442 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:54.523780 28952 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:09:54.583848 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 64718.6us
I20260709 13:09:54.601053 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:54.586042 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.534219 28908 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:54.592666 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3817) took 1141 ms. Trace:
W20260709 13:09:54.555866 29084 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.004s
I20260709 13:09:54.472637 28912 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.573274 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2759) took 1298 ms. Trace:
I20260709 13:09:54.567186 29072 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.609812 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.606575 22653 rpcz_store.cc:276] 0709 13:09:53.275193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.469195 (+194002us) service_pool.cc:224] Handling call
0709 13:09:53.516987 (+ 47792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.576060 (+ 59073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.576105 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.586346 (+ 10241us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.319233 (+732887us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:54.345415 (+ 26182us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.572774 (+227359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.572853 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.572917 (+    64us) raft_consensus.cc:1685] finished
0709 13:09:54.572933 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.573207 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58430,"prepare.queue_time_us":6488,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":58619,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":33823,"thread_start_us":862172,"threads_started":2,"wal-append.queue_time_us":769844}
I20260709 13:09:54.572341 29101 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.593189 28933 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:54.568538 29074 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:54.597225 22648 rpcz_store.cc:276] 0709 13:09:50.653055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.661726 (+  8671us) service_pool.cc:224] Handling call
0709 13:09:50.682240 (+ 20514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.702881 (+ 20641us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:50.909840 (+206959us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.101538 (+1191698us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b18002adb40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:53.426470 (+1324932us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18002adb40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec263150bf 00007fec26315038
0709 13:09:54.118708 (+692238us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.552986 (+434278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.553035 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:54.553096 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.553158 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.553258 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1007249,"prepare.queue_time_us":2010140,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1606,"raft.queue_time_us":992886,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6585,"spinlock_wait_cycles":17589248,"thread_start_us":1246930,"threads_started":4,"wal-append.queue_time_us":158590,"wal-append.run_cpu_time_us":1244,"wal-append.run_wall_time_us":1001996}
I20260709 13:09:54.596342 28926 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:54.613988 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.572180 29027 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:54.595698 29045 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:54.642057 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.629268 28563 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:54.643989 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.624393 22496 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:09:54.646402 28563 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:54.646624 22653 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:54.646631 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1232) took 1006 ms. Trace:
I20260709 13:09:54.647579 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.647378 28563 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.648288 22653 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:54.643088 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:54.586848 29109 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:54.619635 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55242.4us
I20260709 13:09:54.593859 28851 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.640652 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:54.656507 22648 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:54.603612 22502 rpcz_store.cc:276] 0709 13:09:53.451209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.500433 (+ 49224us) service_pool.cc:224] Handling call
0709 13:09:53.500785 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.501049 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:53.501386 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.567447 (+1066061us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.592270 (+ 24823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.592331 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:54.592384 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.592462 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.592604 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24549,"prepare.queue_time_us":199768,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":77822,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1065273,"threads_started":3,"wal-append.queue_time_us":747105}
I20260709 13:09:54.608719 29099 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.596505 29056 raft_consensus.cc:2764] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 LEADER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:09:54.664306 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:54.649359 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97025.2us
I20260709 13:09:54.650342 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.665088 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:54.633080 29108 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:54.617624 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:54.675179 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2751) took 1402 ms. Trace:
I20260709 13:09:54.675706 22654 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:09:54.655684 22571 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:54.661665 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:54.678241 22580 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:09:54.643422 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:54.663036 22651 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:54.666385 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.667220 22576 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.616631 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.664247 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.668996 28943 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:54.680639 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1234) took 1040 ms. Trace:
W20260709 13:09:54.669310 29102 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:09:54.669894 28916 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:54.670043 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:54.670666 29116 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:54.672320 29078 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.629850 28933 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:54.674142 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:54.619308 28952 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.686481 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.655608 28909 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:54.685591 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69074.5us
I20260709 13:09:54.689854 22653 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:54.686285 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:54.675719 22649 rpcz_store.cc:276] 0709 13:09:53.273006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.280358 (+  7352us) service_pool.cc:224] Handling call
0709 13:09:54.674956 (+1394598us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54003c23d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:54.675107 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666669952}
I20260709 13:09:54.638676 29073 consensus_queue.cc:1059] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:09:54.665647 29111 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:54.612351 29084 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.710527 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.706708 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:54.704182 28959 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:54.638489 29101 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.625725 29072 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.638005 28740 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:09:54.733752 28740 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:54.734135 29105 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:09:54.734344 28740 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:54.691167 29116 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:54.735458 28740 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.701330 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:54.737444 29118 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:09:54.737162 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.737763 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:54.647984 22650 rpcz_store.cc:276] 0709 13:09:53.639873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.447990 (+808117us) service_pool.cc:224] Handling call
0709 13:09:54.448266 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.448470 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:54.448822 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.646279 (+197457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.646345 (+    66us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:54.646384 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.646458 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.646576 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":608,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":196860,"threads_started":2}
I20260709 13:09:54.739068 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:54.702745 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3165) took 1050 ms. Trace:
I20260709 13:09:54.682448 22651 rpcz_store.cc:276] 0709 13:09:53.640396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.640279 (+999883us) service_pool.cc:224] Handling call
0709 13:09:54.640712 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.680429 (+ 39717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.680587 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28032}
I20260709 13:09:54.665091 28926 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:54.709540 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:54.710592 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.697461 22648 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:09:54.780085 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.686074 29034 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:54.701166 29132 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.710916 29111 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.704273 29074 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.659423 29045 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:54.733815 29112 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:54.695541 28933 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:54.666134 28897 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.765995 22650 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:54.757169 22649 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:09:54.700030 28932 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:09:54.780654 28740 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:54.764686 22575 raft_consensus.cc:2368] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
I20260709 13:09:54.739725 22505 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:09:54.781641 22648 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:54.809767 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3169) took 1036 ms. Trace:
W20260709 13:09:54.722446 29075 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 13:09:54.762094 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:54.787849 29062 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:54.790145 29028 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:54.708591 28943 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:54.794266 22651 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:09:54.852878 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 146207us
I20260709 13:09:54.702622 29108 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:54.728925 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:54.854864 22496 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:09:54.855370 22651 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:09:54.794562 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 84122.6us
I20260709 13:09:54.796568 22647 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:54.856611 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:54.857306 22647 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:54.727413 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.858245 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:54.733777 29114 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:09:54.858809 29034 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:54.859563 29034 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:54.861217 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.797605 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.729187 29077 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.741593 22653 rpcz_store.cc:276] 0709 13:09:53.652842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.649362 (+996520us) service_pool.cc:224] Handling call
0709 13:09:54.689688 (+ 40326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.702459 (+ 12771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.702689 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:54.742537 29053 consensus_queue.cc:1175] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 15 status { last_received { term: 15 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 15 index: 8 } }
I20260709 13:09:54.800741 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.761515 29017 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:54.735484 29116 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:54.865803 29017 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.868034 29017 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:54.712716 28903 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:09:54.810178 22649 rpcz_store.cc:276] 0709 13:09:53.777561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.703262 (+925701us) service_pool.cc:224] Handling call
0709 13:09:54.732279 (+ 29017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.808548 (+ 76269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.809714 (+  1166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.847738 22650 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:09:54.799528 29078 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:54.869508 22650 pending_rounds.cc:85] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 9
I20260709 13:09:54.703915 29103 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:09:54.869819 22650 pending_rounds.cc:107] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:09:54.870096 22650 raft_consensus.cc:2889] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.850371 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.853689 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:54.858368 23260 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:54.700526 28972 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:54.871757 28972 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:54.872166 28972 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:54.876754 29116 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.799290 29111 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:54.882648 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 144942us
I20260709 13:09:54.882002 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.886689 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:54.888139 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 126154us
I20260709 13:09:54.881482 29074 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:54.852763 29028 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:54.900198 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46575.4us
I20260709 13:09:54.809917 29130 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.855784 29132 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:54.884580 28916 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.853142 29121 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:54.888998 29124 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:54.943524 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:54.876884 29075 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 13. Current term is 14.
I20260709 13:09:54.880256 29034 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:54.948120 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:54.956182 23259 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:54.950331 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:54.904801 29117 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:09:54.897995 28897 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:54.962400 29123 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
W20260709 13:09:54.963642 29119 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:09:54.945425 28926 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.951958 28916 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:54.953099 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54113.3us
I20260709 13:09:54.972522 23255 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:09:54.897531 29074 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:54.905359 28903 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:54.936285 29098 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.905396 28912 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:54.998195 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.851522 28909 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:54.982252 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:54.977065 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 108135us
I20260709 13:09:54.972493 29103 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:09:55.035514 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 53073.7us
I20260709 13:09:55.045830 22469 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:55.017199 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115555us
I20260709 13:09:55.051374 22652 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
W20260709 13:09:55.052938 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 313996us
I20260709 13:09:55.054672 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:55.049481 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:54.978215 29074 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:54.978699 28903 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:55.043557 28563 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:55.077023 22543 leader_election.cc:336] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.575s (SENT)
I20260709 13:09:55.079981 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:55.081314 28753 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:55.077776 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:55.085388 22650 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:54.979200 28972 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.090054 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:55.062641 28912 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:55.060446 29103 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:55.080286 28903 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:55.116173 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:55.118284 29126 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:09:55.119350 29129 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:09:55.120281 29115 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:09:55.120956 29144 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.121112 29101 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.079823 28563 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:55.064145 29112 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:09:55.033459 29098 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.060803 28851 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.107607 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:55.069339 29017 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:09:55.141919 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:55.101588 29075 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:55.090440 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.062863 29024 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:09:55.102409 28753 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.104660 28558 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:55.108430 28916 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.115279 28952 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.093473 28877 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:09:55.184176 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 210236us
I20260709 13:09:55.084628 28896 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:09:55.049409 29108 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.107637 29084 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.197592 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:55.121598 29144 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.143790 28563 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:55.152691 29121 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.217199 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75368.9us
I20260709 13:09:55.145382 29139 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:55.151774 22576 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:55.152981 29137 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:55.153244 29124 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:55.141541 28912 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:55.222355 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 282517us
I20260709 13:09:55.152923 28851 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:55.229929 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:55.187767 29130 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.145180 29112 consensus_queue.cc:1243] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:55.211796 29138 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.214715 29077 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:55.241209 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:55.221848 29075 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:09:55.320513 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 79624.7us
W20260709 13:09:55.259969 29057 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.053s	user 0.014s	sys 0.000s
I20260709 13:09:55.241745 29137 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.370563 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:55.258720 28851 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.387921 22646 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
W20260709 13:09:55.382709 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 199646us
I20260709 13:09:55.344553 28916 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:55.239585 29142 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.262491 29045 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.261404 29034 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:55.482769 29034 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.483433 29034 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:55.395457 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:55.408972 29028 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.344625 29138 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.488849 29138 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.265259 29130 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.261165 29124 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.411542 28912 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.388813 29137 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:55.532238 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.345072 29077 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.534291 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.534710 29077 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.475200 22650 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:55.480681 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:55.379354 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3168) took 1624 ms. Trace:
I20260709 13:09:55.535874 22652 rpcz_store.cc:276] 0709 13:09:53.764080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.407360 (+643280us) service_pool.cc:224] Handling call
0709 13:09:55.379138 (+971778us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54002daad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:55.379284 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373244800}
I20260709 13:09:55.244344 29121 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:55.495184 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 99810.9us
I20260709 13:09:55.543812 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:55.355319 29116 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:55.506821 29135 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
I20260709 13:09:55.490106 29028 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:55.472642 28740 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.625s	user 0.014s	sys 0.007s
I20260709 13:09:55.389721 29132 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.117s
I20260709 13:09:55.467979 28558 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.549877 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.772572 22574 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:09:55.520227 28896 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.556327 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.560149 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:55.505640 28916 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.261109 29103 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.528033 28972 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.701180 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.617801 29081 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.835767 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:55.843632 22468 leader_election.cc:400] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15.
I20260709 13:09:55.660537 28943 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.643725 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3199) took 1184 ms. Trace:
I20260709 13:09:55.683192 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:55.653115 29027 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.997s	user 0.006s	sys 0.007s
I20260709 13:09:55.609338 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1244) took 1080 ms. Trace:
I20260709 13:09:55.716403 29078 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:55.652163 29099 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.973s	user 0.012s	sys 0.000s
W20260709 13:09:55.714916 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.612920 29130 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.656340 29139 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.611162 29124 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:55.606057 29149 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:09:55.753511 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:55.719173 29053 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:09:55.652783 28933 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.801s	user 0.017s	sys 0.005s
I20260709 13:09:55.701959 22577 raft_consensus.cc:1217] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 10.11->[11.12-19.16]   Dedup: 11.12->[14.13-19.16]
I20260709 13:09:55.897179 22577 pending_rounds.cc:85] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 12
I20260709 13:09:55.817708 28896 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.736667 22497 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:55.725477 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:55.897588 22577 pending_rounds.cc:107] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:09:55.899283 22577 raft_consensus.cc:2889] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:55.664142 28563 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.660753 29083 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:55.624396 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3167) took 1927 ms. Trace:
W20260709 13:09:55.663393 29143 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:09:55.655094 29074 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.001s
I20260709 13:09:55.607910 28828 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:55.696173 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.679023 28753 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.617640 29121 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:55.589313 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:55.650233 29152 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:09:55.544957 29136 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
I20260709 13:09:55.592697 29144 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.660365 29024 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.699765 29034 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.468832 29142 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.701246 22578 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:55.610514 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:55.943823 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:55.944398 23262 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:09:55.619735 28897 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.720340 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:55.654635 29153 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:09:55.618845 29084 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:55.960783 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:55.961143 29084 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:55.961889 29142 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.962123 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:55.962463 29121 raft_consensus.cc:2764] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:55.721189 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:55.963222 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.963305 22501 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:55.963449 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:55.964790 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:55.897226 29139 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.967056 29139 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.693368 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:55.641750 22645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2768) took 1171 ms (client timeout 1532 ms). Trace:
W20260709 13:09:55.969234 22645 rpcz_store.cc:269] 0709 13:09:54.470072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.474064 (+  3992us) service_pool.cc:224] Handling call
0709 13:09:55.623862 (+1149798us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b5400237654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:55.641664 (+ 17802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117890816}
I20260709 13:09:55.594538 29098 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.660408 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:55.559911 29057 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:09:55.607997 29111 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.710s	user 0.013s	sys 0.000s
I20260709 13:09:55.972499 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3189) took 2023 ms. Trace:
I20260709 13:09:55.972455 29111 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.913553 29083 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.973071 22648 rpcz_store.cc:276] 0709 13:09:53.949212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.810136 (+860924us) service_pool.cc:224] Handling call
0709 13:09:54.853437 (+ 43301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.886714 (+ 33277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.886750 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.901167 (+ 14417us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.219045 (+317878us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:55.397418 (+178373us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.397727 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.397824 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.972291 (+574467us) raft_consensus.cc:1685] finished
0709 13:09:55.972311 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.972448 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93651,"prepare.queue_time_us":371375,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":79235,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":37479,"thread_start_us":394500,"threads_started":2,"wal-append.queue_time_us":402579}
I20260709 13:09:55.974866 29111 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:55.974951 29083 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:55.559708 29138 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:55.962117 29084 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.975262 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:55.975951 29162 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.607384 22646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3181) took 1719 ms (client timeout 1575 ms). Trace:
I20260709 13:09:55.976375 29084 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:55.976533 22646 rpcz_store.cc:269] 0709 13:09:53.887776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.124355 (+236579us) service_pool.cc:224] Handling call
0709 13:09:55.594300 (+1469945us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002f8854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:55.607251 (+ 12951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898420480}
I20260709 13:09:55.794553 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.977882 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:55.978402 22574 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:55.978470 22646 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 24.
I20260709 13:09:55.979463 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:55.980051 22646 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:09:55.916121 29099 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:09:55.970454 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:55.972012 23260 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:55.902415 29053 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.970492 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:55.983476 29053 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.871420 28943 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.813393 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:55.857750 22503 rpcz_store.cc:276] 0709 13:09:54.459397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.459556 (+   159us) service_pool.cc:224] Handling call
0709 13:09:54.803374 (+343818us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5800003698. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:09:54.803596 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.851416 (+ 47820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.851452 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.851509 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:54.851573 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.631212 (+779639us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b54001b8354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:55.631316 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.643651 (+ 12335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115238016}
I20260709 13:09:55.875463 23259 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:55.829283 28926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.020s	sys 0.044s
I20260709 13:09:55.881134 23264 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:55.882149 22647 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:55.883046 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.866488 22651 rpcz_store.cc:276] 0709 13:09:54.529344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.856107 (+326763us) service_pool.cc:224] Handling call
0709 13:09:54.891104 (+ 34997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.901197 (+ 10093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.901228 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.937100 (+ 35872us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.246442 (+309342us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:55.395106 (+148664us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.395324 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.395396 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.609088 (+213692us) raft_consensus.cc:1685] finished
0709 13:09:55.609110 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.609265 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47066,"prepare.queue_time_us":374187,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":36684,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":58215,"thread_start_us":262045,"threads_started":2,"wal-append.queue_time_us":557960}
I20260709 13:09:55.842406 29120 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:55.998644 22575 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:55.998904 29120 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.999418 29120 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:55.930022 28753 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:55.992695 28926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.020s	sys 0.045s
I20260709 13:09:56.002094 28753 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.002799 29158 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:56.002972 29169 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:56.003378 29158 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:55.893664 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:56.004804 28563 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.003568 29169 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.000636 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:56.007905 28903 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.864s	user 0.012s	sys 0.000s
I20260709 13:09:56.008821 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.010119 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.011154 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:55.943598 29024 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.898741 22499 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:55.907125 28933 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:55.623452 28963 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.351s	user 0.010s	sys 0.012s
I20260709 13:09:55.865700 29077 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:56.013533 29077 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:56.013659 29024 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.014451 28933 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.015391 28896 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.015798 22572 raft_consensus.cc:2393] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:55.971943 28989 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.017097 29142 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:56.017601 28989 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:56.019120 28851 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.009s
I20260709 13:09:55.644567 29137 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.920339 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:55.798382 28558 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.932260 22497 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:55.935497 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.892840 29131 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:55.945008 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:55.898276 29151 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:55.950919 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:55.917374 29074 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:55.958717 29034 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.959143 28897 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:55.959936 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 239651us
I20260709 13:09:55.976135 23261 raft_consensus.cc:2368] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:55.623219 29072 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.871666 29027 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:55.780258 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 220173us
I20260709 13:09:55.796502 28740 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:09:55.913141 28828 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:56.052017 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 238753us
I20260709 13:09:55.986302 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:55.988741 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:55.993571 22573 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:55.989362 22501 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:56.055969 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.058969 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:56.065341 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:56.011241 28943 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:56.076812 22499 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:56.011894 22503 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:56.014485 29077 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:55.904213 22654 rpcz_store.cc:276] 0709 13:09:53.697477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.690227 (+992750us) service_pool.cc:224] Handling call
0709 13:09:54.690508 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.716001 (+ 25493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.716048 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.716104 (+    56us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:54.716160 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.604893 (+888733us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b54002da5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:55.624210 (+ 19317us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.624335 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58002176}
I20260709 13:09:55.865573 28946 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:56.097581 22501 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:56.020675 22579 raft_consensus.cc:2410] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:09:56.100140 29156 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:56.101186 29156 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:56.101244 29027 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.101648 29156 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:56.102079 22502 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:56.102629 29156 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.104127 29156 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.020186 22496 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:56.017120 23255 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:56.021785 22648 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:56.023401 23260 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:56.008347 28903 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.045198 22619 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:56.122929 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77902.7us
I20260709 13:09:56.050724 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.074084 22646 raft_consensus.cc:2410] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:56.088382 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.089488 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.090713 29169 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.092940 29024 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:56.093103 29161 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:56.093775 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:56.093811 22649 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:56.132747 22503 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:56.132845 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:56.017594 29142 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:56.004482 29158 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.141656 29142 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.142498 29158 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:55.897219 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.131984 28926 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:56.145298 28926 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.145687 28926 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:56.146239 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:56.104421 28897 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.106508 22497 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:56.149983 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.150592 22497 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:09:56.150629 28903 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:55.976506 29162 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.151674 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.152177 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.107939 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.110226 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.019552 28851 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.154803 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:56.126214 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75635.3us
I20260709 13:09:56.156706 23258 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:56.160364 22503 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:56.129791 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.069615 29128 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.105216 28755 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.123996 28943 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:56.136459 28989 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:56.152696 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.140686 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:56.129576 23263 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:09:56.161743 22646 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:09:56.122335 28963 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.046006 29151 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:56.166915 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 56826.2us
I20260709 13:09:56.167086 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.175689 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:56.043426 29131 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.173892 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.169590 23229 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:56.173317 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:56.178378 22572 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:56.134701 29138 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:56.184630 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.157160 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:56.184744 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.181625 22646 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:56.186671 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.186960 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:56.187520 22646 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:56.188486 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.189075 22646 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:09:56.163447 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.190994 22503 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
W20260709 13:09:56.193558 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.199952 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.188724 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:56.208993 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:56.211524 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54457.2us
I20260709 13:09:56.128234 29057 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:09:56.165560 28943 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.171873 28755 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:56.223074 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.177098 29024 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:56.177522 28912 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:56.221256 22576 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:56.213279 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.224197 22503 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:56.208421 29080 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:09:56.170861 29160 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:09:56.222781 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.184526 28740 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:56.179948 29144 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:56.218374 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.267961 23263 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:09:56.183957 29138 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.231803 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:09:56.214493 28961 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:56.182562 29083 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:09:56.237674 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:56.179884 28963 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.222757 29155 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:56.214311 29127 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:09:56.175140 29128 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.242161 28740 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:56.242807 28908 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:56.243260 29157 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:56.240247 29150 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:56.244844 29081 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:56.246833 28851 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.253094 29024 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.254952 28558 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.256713 29131 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:56.258018 29137 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:56.259683 29151 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.174778 28975 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:09:56.218147 28989 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:56.324151 28989 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:56.231163 29169 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:56.325188 29169 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.327534 29169 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.262876 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.223613 28943 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:56.270948 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:56.214608 28753 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:56.337098 28753 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:56.337549 28753 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:56.274904 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:56.341462 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66647.2us
W20260709 13:09:56.265041 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 419630us
I20260709 13:09:56.173053 29120 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.346580 29120 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:56.277630 28926 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.240267 29180 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:56.273442 29138 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.280407 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:56.360519 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 80217.3us
I20260709 13:09:56.238497 28896 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:56.291328 22653 pending_rounds.cc:85] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 11
I20260709 13:09:56.376617 22653 pending_rounds.cc:107] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:09:56.377110 22653 raft_consensus.cc:2889] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:56.275825 28961 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.275987 29084 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:56.301028 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.279223 28972 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:56.216331 28828 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.283991 28903 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.274580 29144 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.323575 28975 consensus_queue.cc:1243] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:09:56.291901 28908 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:56.362884 22503 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:56.364640 28740 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.384049 29160 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:56.375095 28963 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:56.375799 29172 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 13:09:56.269966 29103 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:56.386039 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.386157 23263 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:56.386723 23255 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 13:09:56.353312 29148 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:56.376547 28896 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.385165 28961 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:56.385514 29180 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.373122 29116 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:56.384354 29084 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.387845 29185 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.420998 22649 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:09:56.421677 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.427327 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:56.427386 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:56.430708 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:56.396279 28903 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.406126 29160 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.424451 28896 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:56.453828 28903 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.430280 29180 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:56.440682 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.441026 28908 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.437146 22580 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:56.440469 29185 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.436233 29084 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:56.403409 28989 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.457651 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:56.511754 22579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3813) took 2889 ms (client timeout 2148 ms). Trace:
I20260709 13:09:56.507514 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46826 (request call id 1017) took 1700 ms. Trace:
W20260709 13:09:56.435530 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52143.2us
I20260709 13:09:56.509779 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3205) took 1848 ms. Trace:
I20260709 13:09:56.556815 22502 rpcz_store.cc:276] 0709 13:09:54.661115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.661291 (+   176us) service_pool.cc:224] Handling call
0709 13:09:54.661538 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.102488 (+1440950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.509461 (+406973us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001a7f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:56.509704 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3312500096}
I20260709 13:09:56.441612 29160 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:56.560664 22469 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:56.535226 22579 rpcz_store.cc:269] 0709 13:09:53.622507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.622695 (+   188us) service_pool.cc:224] Handling call
0709 13:09:56.511500 (+2888805us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b5400256a54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:56.511645 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5455570816}
I20260709 13:09:56.556275 23261 rpcz_store.cc:276] 0709 13:09:54.806942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.807079 (+   137us) service_pool.cc:224] Handling call
0709 13:09:56.507279 (+1700200us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54007a30d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:56.507447 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2540651776}
W20260709 13:09:56.460196 29184 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:09:56.458755 29183 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:09:56.459566 29178 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:09:56.514717 29192 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:56.520604 29161 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.524286 28926 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.519537 28755 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:56.492556 28912 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:56.463382 29144 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.510535 22402 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:56.494290 29081 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:56.576198 29077 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:56.607816 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.605111 29169 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.584600 29128 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.582762 28912 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:56.581264 29195 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:09:56.624958 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1330) took 1160 ms. Trace:
I20260709 13:09:56.634797 22505 rpcz_store.cc:276] 0709 13:09:55.464490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.464603 (+   113us) service_pool.cc:224] Handling call
0709 13:09:55.505655 (+ 41052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.887123 (+381468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.887173 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.900433 (+ 13260us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.186310 (+285877us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:56.186376 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.186464 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.624718 (+438254us) raft_consensus.cc:1685] finished
0709 13:09:56.624740 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.624892 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29266,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":606837,"threads_started":2,"wal-append.queue_time_us":416828}
I20260709 13:09:56.626832 28912 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.640163 28912 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:56.581463 29161 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.644887 28961 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.647254 29161 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.624212 29169 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.651786 29169 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.663476 29180 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.665397 23263 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:56.669690 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3200) took 1012 ms. Trace:
I20260709 13:09:56.670188 22652 rpcz_store.cc:276] 0709 13:09:55.657402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.663493 (+  6091us) service_pool.cc:224] Handling call
0709 13:09:55.663803 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.799061 (+135258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.799106 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.847208 (+ 48102us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.222085 (+374877us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:56.222131 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.222203 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.669459 (+447256us) raft_consensus.cc:1685] finished
0709 13:09:56.669479 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.669624 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":468,"raft.queue_time_us":48881,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":452575,"threads_started":2,"wal-append.queue_time_us":437676}
I20260709 13:09:56.652328 28961 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.617512 28943 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.633972 28908 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.612996 28753 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.672600 22652 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:09:56.683087 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:56.670554 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.674314 23260 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:56.674347 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.672806 22402 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 11, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 11 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.680135 22469 leader_election.cc:400] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:09:56.684993 22469 leader_election.cc:403] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:56.615418 22398 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 311) took 37199 ms (client timeout 15000 ms). Trace:
I20260709 13:09:56.614779 29077 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:56.686633 23262 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:56.688416 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:56.691138 22502 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:56.691680 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.669891 29081 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:56.697515 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.703318 22502 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:09:56.704574 22580 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:56.706744 22402 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:56.710566 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2671) took 1151 ms. Trace:
I20260709 13:09:56.764272 22576 rpcz_store.cc:276] 0709 13:09:55.560756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.586328 (+ 25572us) service_pool.cc:224] Handling call
0709 13:09:56.710385 (+1124057us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54001e55d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:56.710492 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676239744}
I20260709 13:09:56.698618 29195 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:56.689742 22398 rpcz_store.cc:269] 0709 13:09:19.309574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.312121 (+  2547us) service_pool.cc:224] Handling call
0709 13:09:56.508665 (+37196544us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:48.892248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:48.904995 (+ 12747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:48.905062 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:09:48.905095 (+    33us) tablet.cc:662] Decoding operations
0709 13:09:48.907416 (+  2321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:48.907519 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:48.907561 (+    42us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:09:48.909627 (+  2066us) tablet.cc:701] Row locks acquired
0709 13:09:48.909678 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:09:48.909880 (+   202us) write_op.cc:270] Start()
0709 13:09:48.910036 (+   156us) write_op.cc:276] Timestamp: P: 1783602588909803 usec, L: 0
0709 13:09:48.910074 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:09:48.941474 (+ 31400us) log.cc:844] Serialized 9168 byte log entry
0709 13:09:49.922085 (+980611us) op_driver.cc:464] REPLICATION: finished
0709 13:09:50.129302 (+207217us) write_op.cc:301] APPLY: starting
0709 13:09:50.129437 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:50.352323 (+222886us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:50.352454 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:51.102272 (+749818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:51.117122 (+ 14850us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:09:51.117181 (+    59us) write_op.cc:312] APPLY: finished
0709 13:09:51.117783 (+   602us) log.cc:844] Serialized 204 byte log entry
0709 13:09:51.183112 (+ 65329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.183327 (+   215us) write_op.cc:454] Released schema lock
0709 13:09:51.183413 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:51.183964 (+   551us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.183995 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19398,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":191342,"apply.run_cpu_time_us":46592,"apply.run_wall_time_us":1054651,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100359,"num_ops":23,"prepare.queue_time_us":235097,"prepare.run_cpu_time_us":14305,"prepare.run_wall_time_us":199017,"raft.queue_time_us":413587,"raft.run_cpu_time_us":13861,"raft.run_wall_time_us":188202,"replication_time_us":990941,"thread_start_us":649360,"threads_started":5,"wal-append.queue_time_us":467965,"wal-append.run_cpu_time_us":31961,"wal-append.run_wall_time_us":2415323}]]}
I20260709 13:09:56.721081 29074 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.721563 29098 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:56.724151 29131 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:56.726687 29162 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.728080 29171 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.730077 28943 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:56.731443 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 623593us
I20260709 13:09:56.799984 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.732087 29121 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:56.732421 22645 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:09:56.732791 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 565783us
I20260709 13:09:56.768159 29132 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:56.818074 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3205) took 1049 ms. Trace:
I20260709 13:09:56.818486 22645 rpcz_store.cc:276] 0709 13:09:55.768957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.983987 (+215030us) service_pool.cc:224] Handling call
0709 13:09:56.731864 (+747877us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:09:56.732086 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.817747 (+ 85661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.818013 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4387200}
I20260709 13:09:56.737083 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:56.737990 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:56.738819 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.695063 29169 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
W20260709 13:09:56.821810 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.821867 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83949.2us
I20260709 13:09:56.822443 22645 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:09:56.648727 29138 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.744271 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.824719 22652 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:56.663458 28896 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:56.766717 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75110.2us
I20260709 13:09:56.769490 23229 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.741209 29161 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.745393 28908 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.788642 29131 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:56.745687 29083 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:56.767683 29195 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:56.765228 29137 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.797915 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:56.770453 28558 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:56.858727 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.742530 29084 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.810735 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.859762 22652 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:56.860532 22651 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:56.860704 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 50340.9us
I20260709 13:09:56.787070 29128 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.846292 22648 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:09:56.851570 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82205.1us
I20260709 13:09:56.852624 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:56.813005 22402 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 8, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 8 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.835330 29116 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:56.831811 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.873641 22652 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:56.843340 28943 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:56.763835 29077 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.780948 28961 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:09:56.818506 29171 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.886518 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.887831 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:56.847267 29082 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:56.856995 29195 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:56.861733 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.888437 22645 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:56.879874 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48206.5us
I20260709 13:09:56.896212 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.864912 29120 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:56.863782 28989 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.889501 22402 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 13, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 13 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.889068 22652 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:09:56.889588 29057 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:56.841114 29045 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:09:56.845625 29161 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.909663 22402 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 12 to 14, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 14 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.904536 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.871789 29169 raft_consensus.cc:476] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:56.848763 28908 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:56.907862 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46213.1us
I20260709 13:09:56.884193 29204 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:56.833828 29132 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.860343 29083 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:56.857699 29182 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:09:56.892946 29082 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:56.919771 22402 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 11, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 11 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:56.921015 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.934460 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:56.936710 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:56.909734 29137 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.913872 28916 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:56.906591 29180 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.942319 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:56.943617 29208 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:09:56.886478 28933 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 13:09:56.949258 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75904.2us
I20260709 13:09:56.945770 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:56.919486 29045 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:56.982762 29045 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:56.872547 29128 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.918424 28753 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:56.909998 28943 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:09:56.976794 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1251) took 1206 ms. Trace:
I20260709 13:09:56.934940 29139 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:56.929315 29169 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.948174 28916 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:56.966394 29213 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:09:56.902251 29099 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:09:56.948952 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:56.900151 29160 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:56.900974 29131 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:57.004489 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55646.6us
I20260709 13:09:56.984122 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:56.985242 22646 rpcz_store.cc:276] 0709 13:09:55.770068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.189900 (+419832us) service_pool.cc:224] Handling call
0709 13:09:56.190237 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.733357 (+543120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.733393 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.733897 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.886051 (+152154us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:56.886096 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.886179 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.976526 (+ 90347us) raft_consensus.cc:1685] finished
0709 13:09:56.976555 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.976721 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":542623,"raft.queue_time_us":574804,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2491,"thread_start_us":151728,"threads_started":1,"wal-append.queue_time_us":197538}
I20260709 13:09:56.986928 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:57.005820 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:56.973728 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:56.979113 29161 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.007901 22502 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:56.991231 22402 catalog_manager.cc:5697] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:57.010460 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:56.987917 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109320us
W20260709 13:09:56.993844 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.982867 29084 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:57.047762 29198 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.437s	user 0.005s	sys 0.004s
I20260709 13:09:57.065344 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:56.980002 29057 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:57.009505 29218 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:57.020354 29210 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:09:57.123241 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.021194 29116 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:09:57.022122 29128 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.022483 29204 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:57.135418 29204 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:57.135970 29204 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:57.137208 29160 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:57.121383 29211 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.082s	user 0.000s	sys 0.004s
I20260709 13:09:57.140147 29195 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.023859 29132 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.024379 29180 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:57.025439 29083 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.026573 28908 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:56.997488 28916 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:56.996951 29169 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.034237 28896 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.034893 29138 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:57.035336 29171 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:57.018229 28943 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:57.116977 22402 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 11, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 11 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:57.120177 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.163859 22646 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.164426 29169 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.164470 22402 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 6 to 11, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 11 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:57.167023 29109 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:57.121668 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1255) took 1324 ms. Trace:
I20260709 13:09:57.167585 29109 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.123302 22576 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:09:57.121830 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:57.020426 28933 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:57.169334 23264 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 25: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:57.140955 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1089) took 1446 ms. Trace:
I20260709 13:09:57.169766 29109 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.170019 22577 rpcz_store.cc:276] 0709 13:09:55.694707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.694811 (+   104us) service_pool.cc:224] Handling call
0709 13:09:55.701693 (+  6882us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 13:09:56.074648 (+372955us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:56.717867 (+643219us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b18003a9120. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec2630e5e5 00007fec2630e568
0709 13:09:56.718184 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.854244 (+136060us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:09:56.855321 (+  1077us) log.cc:844] Serialized 104 byte log entry
0709 13:09:56.855552 (+   231us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:56.861499 (+  5947us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.862195 (+   696us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.876267 (+ 14072us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.893397 (+ 17130us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.897627 (+  4230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.897725 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.035015 (+137290us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b18003a9120. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:57.140649 (+105634us) raft_consensus.cc:1685] finished
0709 13:09:57.140673 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.140847 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156299,"prepare.queue_time_us":762286,"prepare.run_cpu_time_us":229,"prepare.run_wall_time_us":9293,"raft.queue_time_us":185609,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":16438,"spinlock_wait_cycles":56288256,"thread_start_us":135662,"threads_started":1,"wal-append.queue_time_us":267659}
I20260709 13:09:57.143603 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1337) took 1389 ms. Trace:
I20260709 13:09:57.172780 22499 rpcz_store.cc:276] 0709 13:09:55.740691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.012577 (+271886us) service_pool.cc:224] Handling call
0709 13:09:56.016922 (+  4345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.077277 (+ 60355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.029262 (+951985us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540030bbd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:57.130097 (+100835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136924928}
I20260709 13:09:57.161095 22505 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:57.166345 22402 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 15 to 16, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 16 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.128996 23258 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 13: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:57.177184 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1260) took 1127 ms. Trace:
I20260709 13:09:57.167795 22653 rpcz_store.cc:276] 0709 13:09:55.797486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.276636 (+479150us) service_pool.cc:224] Handling call
0709 13:09:56.291070 (+ 14434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:56.765594 (+474524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.765626 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:56.766157 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 13:09:56.866938 (+100781us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:56.867862 (+   924us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.879708 (+ 11846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.879823 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.121401 (+241578us) raft_consensus.cc:1685] finished
0709 13:09:57.121428 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.121596 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390596,"prepare.queue_time_us":254,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":410005,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":15311,"thread_start_us":72225,"threads_started":1,"wal-append.queue_time_us":126399}
I20260709 13:09:57.178217 22650 rpcz_store.cc:276] 0709 13:09:56.050055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.521585 (+471530us) service_pool.cc:224] Handling call
0709 13:09:56.521950 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.890900 (+368950us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:56.890944 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.899706 (+  8762us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.996697 (+ 96991us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:56.996727 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.997639 (+   912us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.176948 (+179309us) raft_consensus.cc:1685] finished
0709 13:09:57.176969 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.177113 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252438,"raft.queue_time_us":300704,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4236,"thread_start_us":168476,"threads_started":2,"wal-append.queue_time_us":211509}
I20260709 13:09:57.179419 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 983) took 1307 ms. Trace:
W20260709 13:09:57.183254 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.185745 28946 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:57.186257 28946 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:57.179895 23256 rpcz_store.cc:276] 0709 13:09:55.872475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.874779 (+  2304us) service_pool.cc:224] Handling call
0709 13:09:55.901895 (+ 27116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.217795 (+315900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.217824 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.226401 (+  8577us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.398280 (+171879us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:56.398337 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.178993 (+780656us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54008dead4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:57.179046 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.179095 (+    49us) raft_consensus.cc:1685] finished
0709 13:09:57.179110 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.179358 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725892480,"thread_start_us":167562,"threads_started":1,"wal-append.queue_time_us":217803}
I20260709 13:09:57.144304 29116 consensus_queue.cc:1243] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:09:57.141695 29081 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.189635 29160 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:57.190728 29083 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:57.191113 29083 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:57.191506 29081 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.192050 29083 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.192646 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1249) took 1423 ms. Trace:
I20260709 13:09:57.195760 22499 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:57.195984 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3216) took 1088 ms. Trace:
I20260709 13:09:57.198148 22646 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:09:57.200901 22496 rpcz_store.cc:276] 0709 13:09:56.107776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.108682 (+   906us) service_pool.cc:224] Handling call
0709 13:09:56.109102 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.109352 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:56.393264 (+283912us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.180305 (+787041us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.195633 (+ 15328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.195699 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:57.195749 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.195811 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.195921 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":756106,"prepare.queue_time_us":1781751,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":17655,"thread_start_us":305829,"threads_started":2,"wal-append.queue_time_us":218928}
I20260709 13:09:57.212577 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.215292 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.216149 22498 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:09:57.217275 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.219918 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:57.220793 22498 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.225358 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.197872 22647 rpcz_store.cc:276] 0709 13:09:55.769591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.077272 (+307681us) service_pool.cc:224] Handling call
0709 13:09:56.077624 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:56.109406 (+ 31782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.109466 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:56.126926 (+ 17460us) log.cc:844] Serialized 52 byte log entry
0709 13:09:56.329462 (+202536us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:56.331078 (+  1616us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.805077 (+473999us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.805302 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.805402 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.191122 (+385720us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b24001df378. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324cfb0 00007fec25ec3488 00007fec25ec3be8 00007fec25e9b398 00007fec25e9676a 00007fec25e95bb6
0709 13:09:57.192363 (+  1241us) raft_consensus.cc:1685] finished
0709 13:09:57.192398 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.192536 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1045297,"prepare.queue_time_us":1089,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":98,"raft.queue_time_us":522077,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":41367,"spinlock_wait_cycles":24539776,"thread_start_us":221584,"threads_started":2,"wal-append.queue_time_us":282536}
I20260709 13:09:57.230515 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.232018 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:57.233747 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.235769 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.236644 22496 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:57.237939 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:57.238772 22496 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.242308 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.252583 22502 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:09:57.253579 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:57.243117 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.247965 22402 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 8 to 11, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 11 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:09:57.065711 29045 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.255591 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.257097 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.257913 22501 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:09:57.254588 22499 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:09:57.261299 22579 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:57.250010 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.233167 29083 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:57.275303 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.276036 22578 raft_consensus.cc:2368] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:57.276741 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.277413 22572 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 11: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:57.278421 22572 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:57.279529 22498 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:09:57.262900 22402 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 17 to 18, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 18 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:57.273315 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.273747 22571 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:57.280402 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3219) took 1139 ms. Trace:
I20260709 13:09:57.282788 22500 rpcz_store.cc:276] 0709 13:09:56.141202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.328784 (+187582us) service_pool.cc:224] Handling call
0709 13:09:56.329137 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.329353 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:57.177479 (+848126us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.280056 (+102577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.280114 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:57.280164 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.280232 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.280350 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":847773,"prepare.queue_time_us":848218,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":81,"thread_start_us":102163,"threads_started":1}
I20260709 13:09:57.283571 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.285455 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.286036 22577 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:57.289633 22402 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:09:57.293080 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.291764 22402 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 12, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 12 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:57.261270 29195 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.257815 29084 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:57.294092 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:09:57.296042 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:57.304162 22571 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:09:57.304306 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:57.306573 22468 leader_election.cc:400] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12.
I20260709 13:09:57.307893 29081 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:57.308979 29077 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:57.310180 29077 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:57.310518 29077 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:57.284893 29131 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.311317 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:57.321051 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:57.316051 22502 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:57.325258 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.336452 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.337468 22571 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:57.338824 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.330677 22496 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:57.308137 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:57.317698 29084 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.341526 29053 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:57.343034 29084 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.343258 29053 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:57.311362 29077 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.345691 29077 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:57.317420 29132 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:09:57.320103 29057 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:57.359128 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.326164 28908 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:57.353941 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:57.353330 29084 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:57.319293 29116 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:09:57.373867 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:57.379997 29098 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:57.380452 29098 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.380893 29098 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:57.381853 28946 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.383428 28946 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.372229 28908 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.362917 22577 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:09:57.372983 29155 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:57.389876 28896 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:57.394163 29204 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.418215 29229 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:57.395603 28916 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.419373 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.374953 28912 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:57.420653 28912 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.421116 28912 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:57.421325 28916 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:09:57.398944 29227 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:57.408331 29155 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:57.423269 29155 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.424319 29155 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:57.399703 29181 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.036s	user 0.000s	sys 0.002s
I20260709 13:09:57.409266 28896 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:57.425272 28896 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:09:57.410032 22468 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.696s (SENT)
I20260709 13:09:57.426103 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3212) took 1696 ms. Trace:
I20260709 13:09:57.373726 29228 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:09:57.427405 29228 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:57.426602 22504 rpcz_store.cc:276] 0709 13:09:55.729531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.729660 (+   129us) service_pool.cc:224] Handling call
0709 13:09:55.730093 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.730352 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.730380 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.764495 (+ 34115us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.161104 (+396609us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:56.161153 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.161223 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.398847 (+1237624us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:09:57.425768 (+ 26921us) raft_consensus.cc:1685] finished
0709 13:09:57.425796 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.426039 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5178752,"thread_start_us":289907,"threads_started":1,"wal-append.queue_time_us":546019}
I20260709 13:09:57.427788 29228 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:57.428797 29228 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.430234 29228 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:57.409713 28908 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.372041 29057 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.412910 29137 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:57.435037 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.426121 28896 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.435483 29057 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.435601 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.436342 28896 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:57.438625 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.419468 29229 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:57.454319 29229 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:57.455354 29229 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.445973 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 993) took 1514 ms. Trace:
I20260709 13:09:57.457386 23262 rpcz_store.cc:276] 0709 13:09:55.931383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.996475 (+ 65092us) service_pool.cc:224] Handling call
0709 13:09:56.507408 (+510933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.694077 (+186669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.180953 (+486876us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54007a30d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:57.445775 (+264822us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54007a30d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:57.445905 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468862976}
I20260709 13:09:57.426417 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:57.458914 29182 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.459095 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49106.9us
I20260709 13:09:57.459470 29182 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.461035 29053 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:57.462081 29182 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.463773 29204 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.464972 29229 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:57.469484 29195 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:57.446339 28912 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.449724 28908 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:57.471788 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:57.472285 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.472479 22651 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:09:57.472766 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.453784 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1250) took 1684 ms. Trace:
I20260709 13:09:57.473655 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.474051 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.473579 22650 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.475837 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.476388 22650 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:57.477046 28908 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:57.477236 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.477787 22653 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:57.482133 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.484483 22650 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:57.485814 22575 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:57.465226 29162 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:57.466933 29053 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:57.488535 29162 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:57.474890 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.489874 22645 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.490669 29142 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.493672 22505 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:57.447719 29082 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.495195 29082 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:57.443367 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.498829 28908 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:57.500401 29024 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:57.476504 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.500573 28558 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:09:57.501166 22646 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.501668 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:57.500896 29024 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:57.504001 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.514842 23258 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:57.387390 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:57.476433 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.515617 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.516151 22648 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
W20260709 13:09:57.517153 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129896us
I20260709 13:09:57.521759 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.522938 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.523900 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.524518 22578 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:57.525362 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.525992 22578 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:09:57.526701 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.527186 22578 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:57.499094 29185 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.504530 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:57.473421 22654 rpcz_store.cc:276] 0709 13:09:55.769833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.080376 (+310543us) service_pool.cc:224] Handling call
0709 13:09:56.127708 (+ 47332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.730102 (+602394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.730133 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.730628 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.766705 (+ 36077us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:56.766750 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.766819 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.120901 (+354082us) raft_consensus.cc:1685] finished
0709 13:09:57.120923 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.453504 (+332581us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b5400283050. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:57.453716 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601956,"raft.queue_time_us":602070,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":107980160,"thread_start_us":34208,"threads_started":1,"wal-append.queue_time_us":36990}
I20260709 13:09:57.521015 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:57.534272 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.506991 23264 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:57.508320 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.353133 29222 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:09:57.538873 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:57.548189 22574 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 18. Ops: []
I20260709 13:09:57.550616 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.551811 22577 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:57.512138 22653 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:09:57.513607 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:57.518731 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:57.537637 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.537788 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:57.554030 23264 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.556777 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:57.557561 23261 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:09:57.554140 22578 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:57.558096 22646 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:09:57.559386 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.563316 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:57.565377 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:57.500612 29045 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.517390 28912 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.578186 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.537451 28943 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.586964 22648 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.579841 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.538838 29128 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.546043 29199 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:57.489466 29162 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.603089 23262 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:57.571554 29111 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:57.556697 28975 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:57.588352 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:57.613852 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.621882 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.599059 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.600497 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:57.625059 22648 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.626402 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:57.607285 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.589391 22646 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:57.641927 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.597819 29199 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.651443 22646 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:57.653066 22646 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25. Ops: []
I20260709 13:09:57.654446 22646 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:57.627759 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.657503 22648 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:57.663556 29053 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:09:57.665562 29053 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:57.669267 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.593709 28943 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.662923 23264 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
W20260709 13:09:57.672441 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 332793us
I20260709 13:09:57.635984 29162 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:57.697214 22573 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:57.602010 29128 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.608906 28558 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:09:57.609123 29182 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:09:57.701437 22504 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:57.649871 29083 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:57.650596 29144 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:57.659435 29199 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:57.667613 28975 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:09:57.709273 29235 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:09:57.710844 28943 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:57.723317 22654 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
W20260709 13:09:57.724221 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.788476 28828 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:57.737778 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.789906 23263 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:57.793764 29045 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:57.794533 29231 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:57.795360 29045 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:57.795792 29045 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:09:57.743582 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.745230 29083 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.799974 29128 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:57.800338 29083 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:57.748302 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:57.666658 29053 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.749825 22652 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:09:57.814568 22646 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:57.804564 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.753669 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:57.819423 23264 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:57.756114 22571 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:09:57.598767 29024 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.762638 22645 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:57.765275 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.826829 22653 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:57.828174 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:57.829404 23263 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 22: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:57.773656 28975 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.801151 22500 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:09:57.825008 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.817145 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:09:57.835253 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.835436 22646 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.811280 29144 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:57.840451 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.841471 22645 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:09:57.840972 29144 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.842384 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.843212 22645 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.844069 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.844501 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:57.845161 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.845888 29130 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:57.846426 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.846419 29130 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.847569 29130 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:57.847633 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.848506 22653 raft_consensus.cc:2393] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.721805 29185 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:09:57.858750 29109 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:57.865851 29109 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:57.869129 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:57.882104 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.882266 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.892206 22646 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:57.893348 22653 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:57.734089 29098 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:57.897588 23257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.014s	sys 0.005s
W20260709 13:09:57.902752 23257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.014s	sys 0.006s
I20260709 13:09:57.901336 22648 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:09:57.914016 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:57.890122 29217 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:57.917657 23264 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:57.922240 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.939960 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.891726 29024 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.880947 29185 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.958864 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:57.891053 29221 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:09:57.904242 28946 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:57.907763 29057 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:57.908232 29103 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.976670 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:57.952757 29162 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.980211 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44773.9us
W20260709 13:09:57.979818 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 93929.4us
I20260709 13:09:57.958438 29137 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.890635 29045 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.021238 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:58.021577 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.556s (SENT) [suppressed 37 similar messages]
I20260709 13:09:58.001410 29155 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.023764 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:58.026899 29222 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:09:58.042608 29202 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.043852 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:58.044925 28897 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:58.045377 28897 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.045830 28897 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:58.047413 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1034) took 1374 ms. Trace:
I20260709 13:09:58.047879 23257 rpcz_store.cc:276] 0709 13:09:56.672536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.691134 (+ 18598us) service_pool.cc:224] Handling call
0709 13:09:56.691425 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.704088 (+ 12663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.704116 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.707870 (+  3754us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.395776 (+687906us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b1800369e20. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:09:57.903281 (+507505us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:57.903329 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.903406 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.047086 (+143680us) raft_consensus.cc:1685] finished
0709 13:09:58.047126 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.047349 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12271,"raft.queue_time_us":13819,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":66,"spinlock_wait_cycles":70685568,"thread_start_us":507254,"threads_started":1,"wal-append.queue_time_us":1337200}
I20260709 13:09:58.047215 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:58.053313 22580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.026s
I20260709 13:09:57.995723 29057 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:57.979943 28946 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:58.056275 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 537578us
W20260709 13:09:58.030903 29228 consensus_meta.cc:287] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.004s
W20260709 13:09:58.055604 22580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.010s	sys 0.026s
I20260709 13:09:58.067143 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.011462 29162 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.028205 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:58.081079 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:57.956094 29217 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.019274 29137 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:58.083035 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.043196 29202 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.104619 23259 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:58.112449 29081 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:58.112923 23261 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
W20260709 13:09:58.113225 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 62542.1us
I20260709 13:09:58.152102 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:58.113408 28897 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.114601 28912 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:58.028831 29109 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:58.117159 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 85950.5us
I20260709 13:09:58.119714 29098 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.065192 29245 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:58.121134 28896 consensus_meta.cc:287] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.667s	user 0.005s	sys 0.007s
I20260709 13:09:58.126505 29185 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.126904 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:58.127700 29083 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:58.129714 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:58.129972 29057 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:58.131155 22653 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:58.134368 22646 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:09:58.176266 22646 pending_rounds.cc:85] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 11
I20260709 13:09:58.176595 22646 pending_rounds.cc:107] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:09:58.176913 22646 raft_consensus.cc:2889] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.138651 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.139665 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.040717 29045 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.142788 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.143684 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.144474 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.137741 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:58.181102 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:58.085006 29077 consensus_meta.cc:287] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.003s
I20260709 13:09:58.157737 28897 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.037659 29155 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.194324 22502 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:58.195904 29155 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.198560 28989 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:58.198642 28897 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:58.202584 28946 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:58.204676 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.205511 22654 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:58.155012 29142 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.002s
I20260709 13:09:58.172060 22575 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:09:58.308379 22575 pending_rounds.cc:85] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 12
I20260709 13:09:58.151217 29111 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.173240 22501 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:09:58.308599 22652 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:58.309773 22504 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:58.174697 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.310683 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.311424 22503 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:58.179738 22498 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 11.
I20260709 13:09:58.186391 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:58.312163 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.313331 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.313936 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.308669 22575 pending_rounds.cc:107] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:09:58.314723 22575 raft_consensus.cc:2889] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.312629 22648 raft_consensus.cc:2376] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13. Re-sending same reply.
I20260709 13:09:58.316018 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:58.317075 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.317833 22648 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:09:58.187984 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.183444 29083 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:58.327729 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.330410 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.331321 22652 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:58.331614 22648 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:09:58.220412 28558 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:58.222551 29139 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.226636 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.344904 22653 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:09:58.220510 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.227864 28897 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:58.239997 29180 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.242218 29237 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:58.167210 29245 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:58.251212 29137 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:58.148324 29128 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:09:58.270799 29082 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.001s
I20260709 13:09:58.289834 29202 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.168376 29053 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:58.307265 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.307839 29222 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.370990 29222 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.373559 29222 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.374220 22649 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:09:58.319062 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.325942 28943 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.308669 29195 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:58.376415 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.313571 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:58.378211 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64736.3us
I20260709 13:09:58.327693 22504 raft_consensus.cc:2410] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:09:58.216255 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.218346 22468 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:58.380301 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 162035us
I20260709 13:09:58.337702 22501 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
W20260709 13:09:58.339645 22650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.025s	sys 0.047s
I20260709 13:09:58.280483 29217 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:58.346078 22654 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:58.206687 29185 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:58.361389 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:09:58.367775 22469 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:09:58.368108 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.387135 22653 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
W20260709 13:09:58.382148 22650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.027s	sys 0.047s
W20260709 13:09:58.396972 22402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.037s	sys 0.041s
W20260709 13:09:58.412148 22402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.037s	sys 0.043s
W20260709 13:09:58.410777 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.310989 29109 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:09:58.416823 29109 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:58.417464 29109 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:58.417932 29109 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:58.364329 29180 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.392647 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.423358 22501 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
I20260709 13:09:58.424891 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:58.426038 29131 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:58.426507 29131 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.426898 29131 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:58.364828 29245 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:58.445200 29180 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.354229 29237 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:09:58.328972 29111 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.464046 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:58.465147 22654 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:09:58.453452 22651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.011s	sys 0.057s
I20260709 13:09:58.457211 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:58.469905 22576 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:09:58.457942 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:09:58.472684 22651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.011s	sys 0.057s
W20260709 13:09:58.462857 23258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.011s	sys 0.077s
W20260709 13:09:58.461066 23262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.017s	sys 0.024s
W20260709 13:09:58.473423 23258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.012s	sys 0.077s
I20260709 13:09:58.355492 29139 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.348578 28558 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.392256 29185 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.391953 29077 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.409962 29082 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:58.473470 23262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.017s	sys 0.024s
I20260709 13:09:58.481210 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:58.483124 22571 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:09:58.451308 29202 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:58.487687 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3232) took 1013 ms. Trace:
I20260709 13:09:58.488199 22649 rpcz_store.cc:276] 0709 13:09:57.474439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.481891 (+  7452us) service_pool.cc:224] Handling call
0709 13:09:58.487527 (+1005636us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540017d9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:09:58.487634 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050014464}
W20260709 13:09:58.474788 28903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.027s	sys 0.012s
I20260709 13:09:58.489678 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:58.462244 29160 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.025s	sys 0.024s
I20260709 13:09:58.500524 28558 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:58.382756 28943 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.502516 29139 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:58.482733 29082 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:58.482196 29185 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:58.497139 22649 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:09:58.504156 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.556615 22653 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
W20260709 13:09:58.505640 29103 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:09:58.507221 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3223) took 1035 ms. Trace:
I20260709 13:09:58.511936 29162 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.590988 22647 rpcz_store.cc:276] 0709 13:09:57.471713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.474831 (+  3118us) service_pool.cc:224] Handling call
0709 13:09:57.475122 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.475513 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:57.475540 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.475943 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.496814 (+ 20871us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800386e00. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:09:57.961566 (+464752us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:57.961604 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.961685 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.506946 (+545261us) raft_consensus.cc:1685] finished
0709 13:09:58.506965 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.507162 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":653,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"spinlock_wait_cycles":24436992,"thread_start_us":474654,"threads_started":1,"wal-append.queue_time_us":1029287}
W20260709 13:09:58.515519 29130 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.667s	user 0.003s	sys 0.007s
I20260709 13:09:58.466535 29083 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.521118 29237 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.495265 29202 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.524214 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.527231 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:58.618053 23258 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:58.535569 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:58.477609 28975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.036s
I20260709 13:09:58.548499 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:58.561507 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:58.641510 22576 raft_consensus.cc:2410] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:09:58.568727 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:09:58.496873 28903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.028s	sys 0.012s
W20260709 13:09:58.549289 29199 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.001s
W20260709 13:09:58.550045 29160 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.025s	sys 0.026s
I20260709 13:09:58.613051 22646 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
I20260709 13:09:58.615828 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.616139 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:58.688956 22649 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
W20260709 13:09:58.553872 29144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.022s	sys 0.027s
I20260709 13:09:58.538339 29222 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.530776 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:58.591739 29082 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.671449 29162 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:58.605760 29103 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:58.666312 28975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.007s	sys 0.037s
I20260709 13:09:58.615736 28909 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.619831 29202 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:58.691394 29084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.006s	sys 0.024s
I20260709 13:09:58.612285 29130 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:58.716792 29144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.023s	sys 0.027s
I20260709 13:09:58.700910 29139 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:58.735064 29084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.006s	sys 0.024s
I20260709 13:09:58.698217 29199 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.739645 29112 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.738325 28909 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.728454 29222 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:58.729810 29162 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:58.769155 29240 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:09:58.748353 29229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.007s	sys 0.018s
I20260709 13:09:58.759052 29112 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:58.779099 29229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.008s	sys 0.019s
W20260709 13:09:58.837507 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.838876 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.843029 22497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.007s	sys 0.007s
W20260709 13:09:58.843647 22497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.008s
I20260709 13:09:58.845111 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1117) took 1416 ms. Trace:
W20260709 13:09:58.846083 22543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.005s	sys 0.008s
W20260709 13:09:58.846633 22543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.005s	sys 0.008s
I20260709 13:09:58.845743 22580 rpcz_store.cc:276] 0709 13:09:57.428128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.428913 (+   785us) service_pool.cc:224] Handling call
0709 13:09:57.429300 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.429689 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.429718 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.430182 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.069924 (+639742us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:58.069986 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.070073 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.844189 (+774116us) raft_consensus.cc:1685] finished
0709 13:09:58.844273 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.844719 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2358,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":52,"thread_start_us":639360,"threads_started":1,"wal-append.queue_time_us":1160976}
W20260709 13:09:58.682547 22572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.022s	sys 0.014s
W20260709 13:09:58.849160 22544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.003s	sys 0.011s
W20260709 13:09:58.849677 22544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.003s	sys 0.011s
W20260709 13:09:58.849799 22573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.003s	sys 0.035s
W20260709 13:09:58.850272 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 687251us
W20260709 13:09:58.850634 22573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.003s	sys 0.035s
W20260709 13:09:58.853201 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.003s	sys 0.012s
W20260709 13:09:58.853734 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.003s	sys 0.012s
I20260709 13:09:58.854439 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:58.855968 22501 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:58.683808 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 115205us
W20260709 13:09:58.843029 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.014s	sys 0.048s
W20260709 13:09:58.861650 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.014s	sys 0.048s
I20260709 13:09:58.862428 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:09:58.845396 22505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.007s	sys 0.008s
W20260709 13:09:58.864027 22505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.007s	sys 0.008s
W20260709 13:09:58.683446 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.867602 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:58.728317 22645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.035s	sys 0.040s
W20260709 13:09:58.870199 22645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.036s	sys 0.041s
I20260709 13:09:58.870810 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1271) took 1397 ms. Trace:
I20260709 13:09:58.872678 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1272) took 1389 ms. Trace:
I20260709 13:09:58.871392 22651 rpcz_store.cc:276] 0709 13:09:57.473270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.474150 (+   880us) service_pool.cc:224] Handling call
0709 13:09:57.474449 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.474794 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.474819 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.475271 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.479477 (+1004206us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:58.479559 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.479667 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.870099 (+390432us) raft_consensus.cc:1685] finished
0709 13:09:58.870162 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.870510 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1154,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1003469,"threads_started":1,"wal-append.queue_time_us":1264293}
W20260709 13:09:58.849404 22572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.022s	sys 0.014s
I20260709 13:09:58.873131 22650 rpcz_store.cc:276] 0709 13:09:57.483025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.485242 (+  2217us) service_pool.cc:224] Handling call
0709 13:09:57.485564 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.507185 (+ 21621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.507230 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.507676 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.390434 (+882758us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:58.390488 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.390563 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.872217 (+481654us) raft_consensus.cc:1685] finished
0709 13:09:58.872248 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.872500 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21308,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":22785,"thread_start_us":882413,"threads_started":1,"wal-append.queue_time_us":1208557}
I20260709 13:09:58.876209 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:58.876504 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.877542 22575 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:58.843254 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 461619us
I20260709 13:09:58.882441 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1042) took 1094 ms. Trace:
I20260709 13:09:58.882956 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:58.883649 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:58.883033 23262 rpcz_store.cc:276] 0709 13:09:57.788284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.796973 (+  8689us) service_pool.cc:224] Handling call
0709 13:09:57.797371 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.797750 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.797784 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.798294 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.484340 (+686046us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:58.484383 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.484444 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.881728 (+397284us) raft_consensus.cc:1685] finished
0709 13:09:58.881772 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.882117 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":312,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":685725,"threads_started":1,"wal-append.queue_time_us":946193}
I20260709 13:09:58.868741 22577 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:58.900156 28558 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:58.902135 28558 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:58.902951 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:09:58.900840 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 48292.3us
I20260709 13:09:58.904277 28558 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:58.971501 29112 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.975098 28755 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:09:58.981161 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 119260us
I20260709 13:09:58.982649 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:58.986747 29199 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:58.991786 29111 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:58.993352 29137 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:58.994680 28912 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.032s	sys 0.016s
W20260709 13:09:58.995464 28912 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.032s	sys 0.016s
I20260709 13:09:58.995954 28912 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:58.782791 29130 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:59.012111 29162 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:59.017241 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 137707us
I20260709 13:09:59.025390 29139 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:59.025872 28909 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.036237 29199 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.037464 29199 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.041088 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:59.029902 29139 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.054234 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.055325 23262 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:58.992604 29222 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.078872 22501 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
W20260709 13:09:59.037487 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55191.2us
W20260709 13:09:59.034255 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 881955us
W20260709 13:09:59.078984 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45533.2us
I20260709 13:09:59.046895 29139 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:58.994705 29137 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:59.138005 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44633.8us
I20260709 13:09:59.150650 22579 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 23. Ops: []
I20260709 13:09:59.132102 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:59.131640 22499 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.013s	sys 0.019s
I20260709 13:09:59.122713 22544 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:59.123418 29139 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:59.171136 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.170948 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:59.177780 29259 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:59.178279 29259 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:59.178691 29259 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:59.170754 29072 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:59.179600 29072 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.179955 29072 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:59.184128 29077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.024s	sys 0.034s
I20260709 13:09:59.184299 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3246) took 1063 ms. Trace:
W20260709 13:09:59.184718 29077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.024s	sys 0.034s
I20260709 13:09:59.184891 22505 rpcz_store.cc:276] 0709 13:09:58.121112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.121323 (+   211us) service_pool.cc:224] Handling call
0709 13:09:58.121819 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.122323 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.122370 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.123046 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.864988 (+741942us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:58.865115 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.865278 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.183935 (+318657us) raft_consensus.cc:1685] finished
0709 13:09:59.183959 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.184200 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1449,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":741105,"threads_started":1,"wal-append.queue_time_us":1058036}
I20260709 13:09:59.186656 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:59.167143 22648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.023s	sys 0.012s
W20260709 13:09:59.190690 22499 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.014s	sys 0.020s
I20260709 13:09:59.188725 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1125) took 1181 ms. Trace:
W20260709 13:09:59.205001 22648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.024s	sys 0.013s
I20260709 13:09:59.217140 29139 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.220338 29139 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:59.221733 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:09:59.170763 29195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.014s	sys 0.047s
I20260709 13:09:59.222676 22651 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:09:59.222340 29072 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:59.222945 29195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.014s	sys 0.048s
I20260709 13:09:59.233062 22580 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:09:59.238185 29185 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.630s	user 0.013s	sys 0.000s
I20260709 13:09:59.238893 29185 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.243077 29072 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.165681 29130 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:59.245159 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:59.254664 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:09:59.261761 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1364) took 1231 ms. Trace:
I20260709 13:09:59.265842 29199 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.269661 28912 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:59.271683 29131 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.844s	user 0.013s	sys 0.009s
I20260709 13:09:59.273159 29057 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.160305 29112 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:59.277279 29139 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:59.283322 29144 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:59.312570 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 151361us
I20260709 13:09:59.165673 29137 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:59.276521 29109 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.858s	user 0.019s	sys 0.003s
I20260709 13:09:59.312187 29139 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:59.317278 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.347994 29144 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:59.386821 29139 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.286978 22500 rpcz_store.cc:276] 0709 13:09:58.030570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.030740 (+   170us) service_pool.cc:224] Handling call
0709 13:09:58.056103 (+ 25363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.056578 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.056626 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.072651 (+ 16025us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.862547 (+789896us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:59.201179 (+338632us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.261139 (+ 59960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.261304 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.261385 (+    81us) raft_consensus.cc:1685] finished
0709 13:09:59.261408 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.261671 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59514,"prepare.queue_time_us":333473,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":593,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9667,"thread_start_us":1126837,"threads_started":2,"wal-append.queue_time_us":1101257}
W20260709 13:09:59.393541 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 490824us
I20260709 13:09:59.410172 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2818) took 1248 ms. Trace:
I20260709 13:09:59.410805 22648 rpcz_store.cc:276] 0709 13:09:58.161937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.338437 (+176500us) service_pool.cc:224] Handling call
0709 13:09:58.338817 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.339227 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.339261 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.353435 (+ 14174us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.513035 (+159600us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4800190158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:09:59.206156 (+693121us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:59.206251 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.206374 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.389106 (+182732us) raft_consensus.cc:1685] finished
0709 13:09:59.389130 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.410087 (+ 20957us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7579,"raft.run_cpu_time_us":1367,"raft.run_wall_time_us":163665,"spinlock_wait_cycles":14956928,"thread_start_us":717164,"threads_started":1,"wal-append.queue_time_us":878121}
I20260709 13:09:59.413897 29259 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:59.414989 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.415309 22650 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
W20260709 13:09:59.416937 29160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.022s	sys 0.089s
W20260709 13:09:59.417450 29160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.022s	sys 0.089s
W20260709 13:09:59.418243 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 163755us
W20260709 13:09:59.418596 22468 connection.cc:256] RPC call timeout handler was delayed by -1.2674681350000583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 13:09:59.423513 22468 connection.cc:256] RPC call timeout handler was delayed by -1.192985649000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:09:59.352272 29199 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:59.428814 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.434502 29137 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:09:59.432920 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1794856490000711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 13:09:59.342885 29130 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:09:59.436542 22468 connection.cc:256] RPC call timeout handler was delayed by -1.1605856490000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 13:09:59.440435 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2817) took 1148 ms. Trace:
I20260709 13:09:59.440979 22652 rpcz_store.cc:276] 0709 13:09:58.152556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.333488 (+180932us) service_pool.cc:224] Handling call
0709 13:09:58.333934 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.334458 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.334543 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.335125 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.875499 (+540374us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:59.089278 (+213779us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.159026 (+ 69748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.166357 (+  7331us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.285455 (+119098us) raft_consensus.cc:1685] finished
0709 13:09:59.285483 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.301016 (+ 15533us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":489479,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":55,"raft.queue_time_us":39099,"raft.run_cpu_time_us":459,"raft.run_wall_time_us":10301,"thread_start_us":696271,"threads_started":2,"wal-append.queue_time_us":905391}
I20260709 13:09:59.443364 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1366) took 1402 ms. Trace:
I20260709 13:09:59.443902 22497 rpcz_store.cc:276] 0709 13:09:58.040686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.040919 (+   233us) service_pool.cc:224] Handling call
0709 13:09:58.041366 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.041821 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.041850 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.224846 (+182996us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4800080358. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:09:58.249519 (+ 24673us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18002fe600. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a
0709 13:09:58.259076 (+  9557us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b2c000014c8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:09:58.260076 (+  1000us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.844695 (+584619us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:58.844880 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.845055 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.389807 (+544752us) raft_consensus.cc:1685] finished
0709 13:09:59.389837 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.443281 (+ 53444us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8420,"raft.run_cpu_time_us":2435,"raft.run_wall_time_us":168542,"spinlock_wait_cycles":71124992,"thread_start_us":583674,"threads_started":1,"wal-append.queue_time_us":930304}
I20260709 13:09:59.451385 29111 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.452425 29111 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.455461 29111 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:59.365455 29112 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.461978 29144 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.463315 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3848) took 1942 ms. Trace:
I20260709 13:09:59.463922 22579 rpcz_store.cc:276] 0709 13:09:57.520446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.533069 (+ 12623us) service_pool.cc:224] Handling call
0709 13:09:57.533332 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.190193 (+1656861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.462841 (+272648us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003ac5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:09:59.463209 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3046069120}
W20260709 13:09:59.469081 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 440165us
I20260709 13:09:59.472653 29263 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.473544 29263 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.476445 29263 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.392637 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1124) took 1395 ms. Trace:
I20260709 13:09:59.351467 29180 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.419315 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:59.460459 29112 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:59.416548 29259 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.324348 29131 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.355116 29072 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.429189 29199 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:59.332196 29109 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.404073 29185 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.435287 29137 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:59.528707 22580 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:59.477202 29262 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.542655 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 415159us
I20260709 13:09:59.526089 29199 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:59.545295 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 357008us
W20260709 13:09:59.552734 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.554209 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.547771 29269 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:59.571040 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 513034us
I20260709 13:09:59.575210 29262 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.576704 28909 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:59.578123 29262 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.578896 29259 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.579605 29259 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:59.552971 29137 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.537894 29180 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.584400 29185 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.583454 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:09:59.589905 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 170720us
I20260709 13:09:59.590950 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:59.556270 29072 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.593079 29137 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.593695 29262 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.594542 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.594511 29262 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.595491 23258 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:09:59.595570 29272 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.595722 29137 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:59.596304 29272 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.597237 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:59.597975 22652 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:09:59.598699 29180 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.599102 29262 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.593501 29072 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.599114 29272 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.605266 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:59.605576 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.606837 29084 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.606925 29072 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:59.607772 29084 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.607048 23261 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:59.608588 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.607846 22545 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:59.610790 29084 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.611533 29084 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.612178 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:59.604939 29131 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.613281 23262 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:09:59.613431 28908 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:59.613195 29275 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:59.614425 29237 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:59.607824 29072 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.596400 29137 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.622394 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 181821us
I20260709 13:09:59.627513 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:59.613229 29053 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.018s	sys 0.059s
I20260709 13:09:59.623407 29269 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:09:59.635293 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:09:59.632597 29053 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.019s	sys 0.059s
I20260709 13:09:59.651983 29289 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.651877 22468 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.610s (SENT)
I20260709 13:09:59.653043 29289 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:59.653559 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0838681349999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 13:09:59.653668 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:09:59.654445 29083 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:59.655596 29289 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.655740 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:09:59.656191 29082 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.852s	user 0.014s	sys 0.006s
I20260709 13:09:59.503288 22573 rpcz_store.cc:276] 0709 13:09:57.997720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.998043 (+   323us) service_pool.cc:224] Handling call
0709 13:09:57.998461 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.998761 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:58.851694 (+852933us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.274101 (+422407us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.298838 (+ 24737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.304603 (+  5765us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:59.326541 (+ 21938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.343762 (+ 17221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.392574 (+ 48812us) inbound_call.cc:177] Queueing success response
0709 13:09:59.440208 (+ 47634us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b4800002dd8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
Metrics: {"mutex_wait_us":23699,"prepare.queue_time_us":413056,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":39878,"raft.run_cpu_time_us":3551,"raft.run_wall_time_us":306580,"spinlock_wait_cycles":49783168,"thread_start_us":1094103,"threads_started":2,"wal-append.queue_time_us":632992}
I20260709 13:09:59.656454 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.656700 22502 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:59.657758 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:59.651857 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 61028.9us
I20260709 13:09:59.657323 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.667876 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.668903 23262 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:09:59.197508 22572 rpcz_store.cc:276] 0709 13:09:58.007413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.007582 (+   169us) service_pool.cc:224] Handling call
0709 13:09:58.007981 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.008246 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:58.874137 (+865891us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.127516 (+253379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.151269 (+ 23753us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:59.171046 (+ 19777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.188497 (+ 17451us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.188663 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":318154,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":21911,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":68913,"thread_start_us":1075296,"threads_started":2}
I20260709 13:09:59.657603 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.614787 29275 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.658355 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.636480 29185 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.680105 22500 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:09:59.648988 29264 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:59.658457 29286 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.697343 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1372) took 1448 ms. Trace:
W20260709 13:09:59.702452 29277 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:59.694690 28908 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:59.703224 28908 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.709316 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.710242 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:59.710803 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.711510 22576 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:59.712842 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.714108 22571 raft_consensus.cc:2393] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:09:59.714884 29245 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.283s	user 0.006s	sys 0.017s
I20260709 13:09:59.715632 29245 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.710296 22579 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:09:59.717058 29262 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:59.717825 29262 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:59.718916 29262 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:09:59.723049 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:59.673908 29160 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:59.723866 22505 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 23: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:59.724086 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.725040 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:59.725509 29287 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:09:59.672710 29289 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:59.727149 29289 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.724125 29160 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:59.730192 28908 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.733016 29293 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:59.733798 29293 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:09:59.733551 29160 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.734863 29160 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:59.735335 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.734979 29293 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.657976 29272 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:59.719271 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:59.749405 22501 raft_consensus.cc:2410] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:09:59.692744 29202 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.861s	user 0.011s	sys 0.003s
I20260709 13:09:59.747363 22498 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:59.752485 22580 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:59.736191 29180 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:59.756060 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:59.656688 29082 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.757187 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.763501 22575 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 23: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:09:59.764750 22502 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:09:59.766155 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.764941 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.745658 29259 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:09:59.771140 22579 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
I20260709 13:09:59.774281 29072 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.774736 29275 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:09:59.775501 29045 consensus_meta.cc:287] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.561s	user 0.014s	sys 0.006s
I20260709 13:09:59.775668 29182 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.776298 29292 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.776484 29182 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.776993 29292 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.777487 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:59.778131 29286 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.778937 29182 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.779078 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:59.780177 22504 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:09:59.780529 29286 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.781137 29084 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:59.780964 29272 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:09:59.783385 29285 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:09:59.783759 22646 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.762800 29180 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.785277 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:09:59.828850 22571 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:59.824455 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.785521 29185 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.786398 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.838413 29272 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.838785 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.839409 22578 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:09:59.694828 29137 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.793301 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:59.794832 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 178366us
I20260709 13:09:59.757819 29195 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:09:59.805498 22577 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:59.806047 28912 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:09:59.819985 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:59.775553 29283 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:59.850210 23259 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:09:59.824816 29269 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.825917 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:59.862146 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 104801us
I20260709 13:09:59.828409 29045 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:09:59.833645 29281 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:09:59.834082 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.834450 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:09:59.836820 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:09:59.834131 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53664.1us
I20260709 13:09:59.772014 29109 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.841846 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:09:59.848748 22505 raft_consensus.cc:2410] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:59.767516 29202 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.852703 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:09:59.850559 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:59.852311 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:09:59.888823 22652 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:09:59.840180 29180 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:59.862131 23261 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:09:59.830190 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:09:59.891359 22575 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.843649 29057 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:09:59.856389 29284 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:09:59.867508 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:09:59.877337 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.879141 22579 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:09:59.853662 29084 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:09:59.898028 22496 raft_consensus.cc:2410] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 26 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 13:09:59.897861 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:59.902143 22651 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
I20260709 13:09:59.902355 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:09:59.860422 29286 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:09:59.881345 28912 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.925912 28943 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:59.897668 29289 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:09:59.937268 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.925748 23259 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:09:59.893101 29045 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.940446 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:09:59.901428 29185 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:09:59.944367 22497 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:59.942510 23261 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 25.
I20260709 13:09:59.883881 29195 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:09:59.960727 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:09:59.902761 29284 consensus_queue.cc:1243] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:59.959661 22469 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:09:59.969441 22648 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:09:59.899806 29084 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:09:59.925935 29293 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:59.991443 29303 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:09:59.993110 29246 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:09:59.993631 29082 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:09:59.995862 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:09:59.998804 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 653951us
I20260709 13:10:00.006263 29202 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.994271 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:09:59.993836 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53563.9us
W20260709 13:10:00.030392 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 70828.3us
I20260709 13:09:59.993172 29045 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:09:59.998178 29293 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.035856 22469 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.016544 29245 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.042944 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:09:59.943049 29057 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.038879 29303 consensus_queue.cc:1243] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:00.051757 29284 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:00.053699 29302 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:10:00.037148 29185 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:00.059717 29185 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:00.061122 29185 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.063781 28943 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:00.064672 28943 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.044090 29293 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:00.071558 29295 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:00.072216 29295 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:00.032543 29137 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:00.083101 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 51666.1us
W20260709 13:10:00.084470 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 90342.6us
I20260709 13:10:00.086330 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.086745 28912 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.087491 29130 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.089246 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.090201 29045 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:00.091082 29045 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:00.091996 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.093734 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.096567 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:00.096652 29109 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.098196 29305 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:00.098483 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:00.100157 29315 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:00.100607 29315 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.100986 29315 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.101806 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.102912 29245 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:00.103863 29245 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:00.104065 29305 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.106546 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.045101 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.115267 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:00.119766 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 74745.1us
I20260709 13:10:00.120481 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.127483 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.131096 22498 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:00.109279 29303 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:00.134262 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.136459 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:00.131524 22498 pending_rounds.cc:85] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 9
I20260709 13:10:00.139961 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.124886 28912 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:00.121130 29045 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.140568 22505 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:00.150496 29045 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:00.151057 29045 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.152786 28908 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:00.154279 29237 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.003s
I20260709 13:10:00.133486 29303 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.155489 29303 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:00.157021 29313 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:00.157577 29313 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.157946 29313 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:00.174425 29318 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.175110 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 1291) took 1147 ms. Trace:
I20260709 13:10:00.175717 22650 rpcz_store.cc:276] 0709 13:09:59.109957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.140586 (+ 30629us) service_pool.cc:224] Handling call
0709 13:10:00.174846 (+1034260us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400168d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:00.174999 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524181760}
I20260709 13:10:00.137609 22498 pending_rounds.cc:107] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:00.177155 22498 raft_consensus.cc:2889] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:00.179927 22496 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:00.180122 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.177076 23258 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:10:00.145867 28912 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.180826 22651 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:00.183094 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:00.182842 28912 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:00.187456 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.192013 22575 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:10:00.174793 29045 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.196462 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:00.198253 29045 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.147405 29130 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:00.205722 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.207330 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.207716 29057 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.208204 29228 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:00.207821 28943 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.209293 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.212819 22468 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:00.214551 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 167235us
I20260709 13:10:00.215261 29303 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.215811 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.218515 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.199221 29082 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.220677 29082 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:00.221098 29082 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.221755 29286 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:00.222476 29286 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:00.223768 29286 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.199369 29289 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:00.229563 29289 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.230800 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:00.232183 29289 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.210973 29228 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.234069 29228 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:00.236399 29306 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.222s	user 0.004s	sys 0.000s
I20260709 13:10:00.237104 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.180239 29272 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:00.238400 29272 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:00.239548 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.239481 29272 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.240222 29303 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.240532 29272 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.241196 29103 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:00.208127 29322 log.cc:927] Time spent T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:00.192399 29237 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.245075 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2699) took 1184 ms. Trace:
I20260709 13:10:00.260578 22577 rpcz_store.cc:276] 0709 13:09:59.081664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.084514 (+  2850us) service_pool.cc:224] Handling call
0709 13:09:59.164509 (+ 79995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.849373 (+684864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.220541 (+371168us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54003bd154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:00.220780 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1473688320}
I20260709 13:10:00.260684 29237 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.245289 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.262710 22505 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 22: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:00.263708 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.264312 22505 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.241832 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.247774 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:00.193143 29264 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.249960 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:00.191298 29292 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.250778 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.266312 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.266778 29264 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:00.267135 29264 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:00.267449 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.267650 28975 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:00.268241 28975 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.269836 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.270152 29072 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:00.270658 29072 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:00.271016 29072 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:00.271517 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.246994 29103 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.273862 29103 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:00.273998 29221 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:00.274528 29221 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.274876 29221 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:59.700999 22499 rpcz_store.cc:276] 0709 13:09:58.244619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.244785 (+   166us) service_pool.cc:224] Handling call
0709 13:09:58.245146 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.245357 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:59.225394 (+980037us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.629472 (+404078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.635180 (+  5708us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:59.644360 (+  9180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.666592 (+ 22232us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.693041 (+ 26449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3926,"prepare.queue_time_us":918805,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":1380,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":1228,"spinlock_wait_cycles":643968,"thread_start_us":1343738,"threads_started":2,"wal-append.queue_time_us":474763}
I20260709 13:10:00.276247 22499 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.192662 29295 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.267481 29264 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.285112 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.286935 23261 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:00.290982 29160 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:00.291570 29160 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:00.292003 29160 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.252316 22652 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
W20260709 13:10:00.257803 29307 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:10:00.258936 29311 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:10:00.259532 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.292827 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.297817 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:00.300619 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:00.210491 29130 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:00.301209 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 256184us
I20260709 13:10:00.268651 28975 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:00.297420 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:00.307024 22648 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:10:00.326025 23261 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:10:00.315984 22651 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.311800 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:00.306430 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55745.1us
I20260709 13:10:00.329144 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.264030 29237 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.334117 22501 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:00.339499 22469 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.341949 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.338649 22498 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 10.
W20260709 13:10:00.346495 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53762.6us
I20260709 13:10:00.306118 28943 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:00.326439 29130 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:00.293498 29222 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.294181 29195 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.346616 22500 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.308594 29137 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.348975 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:00.355635 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 156587us
I20260709 13:10:00.327745 29292 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:00.359023 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.361331 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.301571 29083 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:10:00.345844 29305 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:00.337641 29289 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:00.345834 29286 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:00.345961 29111 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.380718 22497 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:10:00.382014 29315 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.306788 29245 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.371789 29109 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:00.373034 29222 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.349591 29259 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:10:00.379974 29084 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:10:00.399945 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 184320us
I20260709 13:10:00.403189 29057 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.405676 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.410811 22651 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
W20260709 13:10:00.417634 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58702.2us
I20260709 13:10:00.383078 29289 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.425196 29289 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:00.428994 29278 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.429685 29278 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:00.431856 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.432189 29278 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.445802 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.446918 29057 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:00.447364 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:00.448417 29057 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.448814 29057 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.449251 29057 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:00.449347 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 104926us
W20260709 13:10:00.449707 22646 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 13:10:00.450068 22646 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:10:00.450349 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:00.404928 29199 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.817s	user 0.014s	sys 0.000s
I20260709 13:10:00.451061 29199 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.453785 22573 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:00.454315 28943 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.454671 29267 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:00.455184 29267 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:00.454953 28943 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.455585 29267 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:00.457162 29199 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.412259 29318 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.458539 29318 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.458889 29318 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.464190 22505 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:10:00.464392 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:00.413538 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71486.2us
I20260709 13:10:00.382620 29305 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.421168 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.470944 22498 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:00.476837 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:00.481029 29314 raft_consensus.cc:2764] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:10:00.481253 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.482122 29057 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.503099 22651 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:00.505226 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:00.501722 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 80614.4us
I20260709 13:10:00.504148 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.504733 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.561570 22648 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:00.515336 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.562455 22499 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.484542 29057 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.501974 29272 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:00.503753 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.565363 22500 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:10:00.457202 28943 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.563361 22650 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
W20260709 13:10:00.566936 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.505347 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.567795 22652 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:00.565817 22500 pending_rounds.cc:85] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 10
I20260709 13:10:00.571220 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.573688 29318 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.497756 28975 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.490726 28912 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.577925 28908 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:00.572688 29267 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.493745 29315 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.476547 29262 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:10:00.475592 29305 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:00.587446 29293 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
W20260709 13:10:00.511902 29325 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:10:00.486147 29319 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:10:00.536679 29330 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:10:00.621001 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 249139us
I20260709 13:10:00.622244 22646 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:00.525573 29180 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.005s
I20260709 13:10:00.624994 22500 pending_rounds.cc:107] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:10:00.674994 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.675282 22500 raft_consensus.cc:2889] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:00.485630 29222 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.511479 29289 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:00.625707 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 251625us
I20260709 13:10:00.678144 22648 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.484018 29295 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:00.672685 23262 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 26: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:10:00.674584 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 103471us
I20260709 13:10:00.675597 22504 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.466771 29082 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.660507 29272 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.528937 29072 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.508654 29228 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.501188 29313 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.568540 29160 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:00.711052 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.677434 29259 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.711148 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:00.686079 29057 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.637006 29264 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.689015 29084 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:00.716372 22499 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:00.713228 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.666601 29293 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.721982 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:00.679745 29180 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.731455 23227 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.734512 28975 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.734810 29267 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.736299 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3260) took 1068 ms. Trace:
W20260709 13:10:00.727746 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 246605us
I20260709 13:10:00.735858 29263 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:00.757314 22646 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:00.759377 22645 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:00.759910 22648 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:00.711295 29083 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:10:00.722708 29137 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.762965 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.760656 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.759110 29263 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:00.729141 29185 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:00.740660 22503 rpcz_store.cc:276] 0709 13:09:59.670570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.722233 (+ 51663us) service_pool.cc:224] Handling call
0709 13:09:59.722555 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.791482 (+ 68927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.791525 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.792323 (+   798us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.122365 (+330042us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:00.122402 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.304383 (+181981us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b540033efd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:00.304433 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.730058 (+425625us) raft_consensus.cc:1685] finished
0709 13:10:00.730078 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.736233 (+  6155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60132,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":14724,"spinlock_wait_cycles":157352320,"thread_start_us":329629,"threads_started":1,"wal-append.queue_time_us":413897}
W20260709 13:10:00.773613 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 62595.8us
I20260709 13:10:00.756038 28975 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:00.779738 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.783814 29072 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.752962 29084 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.786513 29084 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:00.786749 29103 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 13:10:00.786998 29137 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.787257 29103 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.787998 29180 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.777004 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.763695 29182 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.777982 28909 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:00.807869 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 50992.4us
I20260709 13:10:00.797653 29278 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:00.791250 29228 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.810344 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.811105 22646 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:00.807699 29222 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:10:00.815032 29278 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:00.769025 29259 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.820648 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.822070 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.822860 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.823467 22650 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:00.826596 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:00.824620 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.833832 22645 raft_consensus.cc:2410] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:00.835110 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.835486 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.835863 22496 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:00.836465 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.836879 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.837134 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.837761 22646 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:00.837816 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:00.838449 22576 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:00.838847 29334 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:00.839421 29334 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:00.839599 29278 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.840313 29334 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.841122 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:00.836201 29221 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.007s
I20260709 13:10:00.841703 22573 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:00.842063 29221 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.842406 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.842617 22580 pending_rounds.cc:85] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 11
I20260709 13:10:00.838377 29333 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:00.843425 29333 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:00.844305 29221 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.844431 29333 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.845322 29103 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.845935 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.831593 29318 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:00.847358 29180 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:00.847267 29237 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:00.847837 29180 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:00.848104 29237 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:00.848589 29237 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:00.827504 28912 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.852818 29313 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.857507 29331 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:00.857971 29331 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:00.858841 29331 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.835273 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:00.842964 22580 pending_rounds.cc:107] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:10:00.864001 22580 raft_consensus.cc:2889] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:00.837457 22496 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.835114 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:00.844369 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:00.885251 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.894999 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.895821 22645 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:00.896494 22572 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:00.892546 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 70571us
I20260709 13:10:00.901328 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:00.903774 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.916167 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.917323 22503 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 26: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:00.919785 22577 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:10:00.920023 23227 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.933784 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.935354 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:00.929159 22498 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.896390 29185 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:00.901100 29137 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.939486 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.940711 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:00.945565 22646 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:00.941486 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 112365us
I20260709 13:10:00.901521 29331 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.943924 23261 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:00.944438 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.944562 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.945154 22499 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:10:00.948365 22651 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:10:00.950049 22501 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:10:00.950331 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 148084us
I20260709 13:10:00.951037 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:00.951227 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:00.953428 29337 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:10:00.954602 29111 consensus_meta.cc:287] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.002s
I20260709 13:10:00.955138 28975 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:00.955651 28975 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.955991 28975 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:00.957389 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:00.952603 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:00.961905 29293 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.961465 29314 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:00.962299 29272 raft_consensus.cc:2764] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:00.963691 29259 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.964462 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:00.965142 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.965792 22647 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:00.966741 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.967244 22647 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.939951 29264 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.940970 29160 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:00.867252 29180 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.969727 29314 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.969921 29180 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:00.955031 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.919442 29289 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:00.970229 29314 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:00.970835 29314 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.971359 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.961647 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:00.978605 22646 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:00.984738 22645 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 26.
I20260709 13:10:00.961246 29185 raft_consensus.cc:2764] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:10:00.986907 23256 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:10:00.942206 29130 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.001s
I20260709 13:10:00.991236 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.934895 29221 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:00.897650 29182 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.998874 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:00.860352 29263 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:00.999784 22646 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.955040 29111 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:01.013676 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:01.019534 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55173.6us
I20260709 13:10:01.021160 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:00.997391 29289 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:01.030754 23258 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:01.045446 23261 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:01.049157 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 91911.9us
I20260709 13:10:01.050081 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.051484 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.051923 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.053010 22572 raft_consensus.cc:2368] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:01.054085 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.055356 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.060282 29082 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:01.062302 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:01.067471 22652 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:01.069458 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:01.071310 22576 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:10:01.073869 22651 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
W20260709 13:10:01.078188 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.080307 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:01.081096 22503 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:10:01.085423 22646 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:01.089656 22579 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:01.090901 28975 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.092355 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.092931 29182 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:01.093611 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.094251 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.154825 22573 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:01.095731 29286 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.000s
I20260709 13:10:01.096063 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.095927 29314 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.096813 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.100487 22496 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:01.105829 29305 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:00.996692 29130 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.198521 29130 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:01.109704 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.201898 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.202880 22577 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:10:01.203186 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.203426 22500 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:01.110225 22653 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:10:01.204205 22577 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:10:01.204406 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 153026us
I20260709 13:10:01.204547 29267 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:01.205291 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.205524 22653 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:01.206552 29267 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.206776 29313 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:01.206933 22653 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:01.207279 29313 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.207746 29313 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:01.104511 22468 connection.cc:256] RPC call timeout handler was delayed by -1.5023518409999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 13:10:01.143963 29131 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:01.209188 29131 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.209234 29264 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:01.209748 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.122591 29185 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.091s
W20260709 13:10:01.079485 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49150us
I20260709 13:10:01.210659 29185 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:01.211025 29185 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:01.211735 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.211903 29185 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:01.154165 29323 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:10:01.212981 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.214263 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:01.119330 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.215366 29305 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:01.216531 22497 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:10:01.124366 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44145.7us
I20260709 13:10:01.128504 22574 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:01.223729 23259 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:10:01.128556 22645 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:01.137100 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.224838 22571 raft_consensus.cc:2393] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:01.138154 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:01.113576 29259 raft_consensus.cc:2764] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 13:10:01.147179 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.225888 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.150308 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:01.226601 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.226909 22651 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:01.151281 22647 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:01.152336 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:01.152472 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:01.228029 22646 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:10:01.228217 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75833.6us
I20260709 13:10:01.114497 29293 raft_consensus.cc:2764] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:10:01.156040 22578 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:01.187520 29341 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:10:01.189489 22649 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.189379 22579 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:01.236898 22645 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:01.190091 29314 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:01.193251 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:01.194382 28975 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:01.120265 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:01.218545 29262 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:01.219558 22648 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:01.207927 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.232685 22650 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:01.234037 22576 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
W20260709 13:10:01.235359 22504 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.002s
I20260709 13:10:01.235255 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:01.235934 22498 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:01.248059 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:01.240391 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.209708 29131 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:01.241415 22573 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:01.246354 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:01.246949 22504 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:10:01.252362 22645 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:01.244060 29262 consensus_queue.cc:1243] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:01.254000 22496 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:01.255358 22496 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.239250 29333 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:10:01.256268 29333 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 26 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:01.260458 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.245916 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:01.236052 29289 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:01.269474 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:01.276111 23259 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:01.278301 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70481.4us
I20260709 13:10:01.278949 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:01.279219 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.279738 23257 raft_consensus.cc:2368] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21.
I20260709 13:10:01.282413 29137 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:01.283136 28912 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:01.283704 28912 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:01.245381 28909 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:01.285262 28909 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:01.286213 28909 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.286706 29084 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:01.288810 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.290131 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.290926 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.293358 22579 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:01.239624 29275 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:01.241178 29130 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.303157 22497 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:01.302703 22500 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.306454 22646 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:01.274197 29289 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.244498 29082 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.319744 22651 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:01.257159 29185 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:01.321527 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 61173.3us
I20260709 13:10:01.324690 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.322785 22499 pending_rounds.cc:85] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 10
I20260709 13:10:01.331704 22499 pending_rounds.cc:107] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:10:01.332013 22499 raft_consensus.cc:2889] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.291352 29293 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:01.265353 29264 consensus_queue.cc:1059] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:10:01.308985 29331 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:01.267980 29245 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:10:01.325870 29289 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:01.284688 28912 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.321734 29339 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:01.357606 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 67545.4us
I20260709 13:10:01.357982 22645 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:01.363389 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:01.376070 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.320833 29144 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:10:01.335103 29275 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:01.341241 29259 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:01.340559 29262 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:01.340937 29084 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:01.342975 29315 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:01.386891 22579 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
W20260709 13:10:01.388409 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 109266us
I20260709 13:10:01.390162 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.360767 29245 consensus_queue.cc:1243] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:01.363715 29267 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.410766 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:01.416217 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 206984us
I20260709 13:10:01.417806 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.392390 29318 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:01.347306 29333 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.392650 29339 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:01.428082 22502 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:01.429919 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.419553 29331 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.404461 29305 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:01.430223 29245 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:10:01.437291 22468 connection.cc:256] RPC call timeout handler was delayed by -1.4591518409999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:10:01.424444 29318 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.439519 29144 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:01.438735 29259 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:01.428475 29313 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.451740 29318 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:01.494040 29314 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.494724 29314 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.449101 29305 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.524266 29082 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.489451 29180 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:10:01.533869 29295 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:10:01.578804 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.585493 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.492851 29275 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.565888 29180 consensus_queue.cc:1243] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer 6ca917eaada84bf38a5daae9f8ffa066 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:10:01.602880 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 185155us
I20260709 13:10:01.604251 22543 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:01.592085 29346 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:10:01.612644 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:01.622247 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55536.4us
I20260709 13:10:01.596391 29182 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.605346 29286 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:01.603794 29262 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:01.550525 29339 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:01.627148 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 171189us
I20260709 13:10:01.633785 22543 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:01.589979 29082 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.643447 29084 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:01.611179 29137 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:01.637926 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:01.680086 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.660303 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.659606 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.675521 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.658854 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.733800 22573 raft_consensus.cc:2368] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
I20260709 13:10:01.675065 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.736482 22576 raft_consensus.cc:2368] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
I20260709 13:10:01.734046 22579 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:01.678540 29237 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.796s	user 0.014s	sys 0.006s
I20260709 13:10:01.677073 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.765856 22578 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:01.732112 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.734817 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:01.631528 29278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.025s
W20260709 13:10:01.677186 29352 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.239s	user 0.007s	sys 0.000s
I20260709 13:10:01.628513 29314 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:01.667236 29361 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:01.737689 22496 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:10:01.737404 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 99918.4us
I20260709 13:10:01.777024 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:01.777741 22500 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:01.632124 29286 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:01.673122 29259 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:01.768090 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 126311us
I20260709 13:10:01.766639 22577 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:10:01.770596 22618 leader_election.cc:400] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21.
W20260709 13:10:01.771109 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106471us
I20260709 13:10:01.793148 22618 leader_election.cc:403] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.793644 22468 leader_election.cc:400] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
W20260709 13:10:01.773813 29278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.012s	sys 0.025s
I20260709 13:10:01.658030 29245 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:10:01.754114 29084 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:01.631336 29363 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:01.674712 28908 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:01.772809 22498 pending_rounds.cc:85] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 5
I20260709 13:10:01.813836 22498 pending_rounds.cc:107] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:10:01.814261 22498 raft_consensus.cc:2889] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.650367 29305 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:01.661933 29182 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:01.781412 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.650763 29264 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 13:10:01.792276 29259 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.727736 29293 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:10:01.775100 29350 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.374s	user 0.000s	sys 0.002s
W20260709 13:10:01.793696 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 95404us
I20260709 13:10:01.650969 29331 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:10:01.650537 29267 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.126s
I20260709 13:10:01.764392 29180 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:10:01.901197 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127018us
I20260709 13:10:01.796037 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:01.903465 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 107488us
I20260709 13:10:01.648761 29289 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.804574 22579 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:01.650264 29144 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 13:10:01.772219 22502 raft_consensus.cc:1240] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:01.632774 29364 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:01.816402 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:01.818214 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.821451 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:01.823125 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:01.795979 29313 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:01.794691 29314 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:01.653508 29262 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.820135 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1310) took 1016 ms. Trace:
I20260709 13:10:01.850533 22503 pending_rounds.cc:85] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 15
I20260709 13:10:01.938767 22503 pending_rounds.cc:107] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:10:01.939152 22503 raft_consensus.cc:2889] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.793923 29130 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:01.779078 29237 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.868764 22572 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:01.880999 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.855240 29182 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.813724 28908 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:01.834223 29357 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:10:01.903746 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:01.950330 22648 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 23: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:01.951030 29366 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:01.951282 29182 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:01.951443 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:01.952289 22648 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 26: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:10:01.953411 29362 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:10:01.953646 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:01.880538 29360 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:10:01.956271 29351 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.507s	user 0.004s	sys 0.004s
W20260709 13:10:01.957398 29374 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:10:01.959125 29347 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.674s	user 0.006s	sys 0.000s
I20260709 13:10:01.959494 29377 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.907322 29355 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:01.911803 22500 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:01.915854 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:01.876631 29263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.013s	sys 0.013s
W20260709 13:10:01.968338 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52587.7us
I20260709 13:10:01.917214 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:01.921296 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 104930us
I20260709 13:10:01.919150 23257 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:10:01.928203 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:01.971170 22649 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:01.941201 22574 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:01.935480 22579 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:01.942397 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:01.972483 22646 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:01.937577 22654 rpcz_store.cc:276] 0709 13:10:00.803784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.817671 (+ 13887us) service_pool.cc:224] Handling call
0709 13:10:00.863782 (+ 46111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.864073 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:01.080349 (+216276us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.285018 (+204669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.285081 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:01.285134 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.285198 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.676573 (+391375us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:01.819937 (+143364us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54002daad0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:01.820063 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2148,"prepare.queue_time_us":325355,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":24761,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":105026688,"thread_start_us":271202,"threads_started":2,"wal-append.queue_time_us":323335}
I20260709 13:10:01.949467 29083 raft_consensus.cc:3055] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:01.873708 29370 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:10:01.933651 29111 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:01.960096 29377 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.826750 28909 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.098s
I20260709 13:10:01.966346 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:01.970132 22653 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:10:01.943327 29382 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.978174 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:01.889477 29137 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.908326 29315 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:10:01.925078 29295 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:01.976470 29182 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:01.986379 29082 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:01.949586 28908 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.987108 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3283) took 1055 ms. Trace:
I20260709 13:10:01.977178 29083 raft_consensus.cc:740] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:01.990667 23256 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:01.991844 22469 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:01.979669 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:02.030959 22648 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:02.035004 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.962935 29305 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:02.036682 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:02.037173 29305 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:01.972798 29084 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.037619 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:02.038605 22573 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:02.038205 29305 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.039050 29295 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:01.892761 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:10:02.040337 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:01.970888 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:02.041229 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 70418.6us
I20260709 13:10:02.037221 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:02.042061 28908 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.042269 22578 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:01.999599 29370 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:02.037654 22571 raft_consensus.cc:2368] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21.
I20260709 13:10:02.045056 29370 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:02.046011 29370 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.047292 29370 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.048679 29334 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:02.049360 29334 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:02.050519 29334 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:01.999773 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:02.027886 29083 consensus_queue.cc:260] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.052642 29083 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:01.967667 29372 raft_consensus.cc:2764] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:01.973317 29245 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:02.003652 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:02.003866 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:01.913676 29286 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:01.949546 29289 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:02.018157 22647 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:10:01.990341 29237 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:02.023571 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:02.035028 29371 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:10:01.996825 29111 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:01.977495 29314 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:02.056854 29305 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:02.040366 29295 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:02.024605 22501 rpcz_store.cc:276] 0709 13:10:00.931607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.041124 (+109517us) service_pool.cc:224] Handling call
0709 13:10:01.041482 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.041864 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.041893 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.042370 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.242997 (+200627us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:01.243038 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.243135 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.986873 (+743738us) raft_consensus.cc:1685] finished
0709 13:10:01.986894 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.987028 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14798,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":200247,"threads_started":1,"wal-append.queue_time_us":299331}
I20260709 13:10:02.040657 22650 raft_consensus.cc:606] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.001169 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:02.059607 22573 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:02.141965 22574 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:02.070271 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 156416us
W20260709 13:10:02.078053 29185 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.001s
W20260709 13:10:02.026078 29131 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.725s	user 0.005s	sys 0.008s
I20260709 13:10:02.147683 29131 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.149041 29295 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.150561 29131 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:02.024609 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:01.998162 29318 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.085469 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:02.090466 22648 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:02.097581 29392 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:02.097702 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 93903.8us
I20260709 13:10:02.105234 22651 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:10:01.973440 29263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.014s	sys 0.013s
I20260709 13:10:02.106894 22654 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:10:02.110934 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:02.112250 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:02.178407 22646 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 12: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:02.115634 22647 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:10:02.123574 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.123854 29381 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:02.083138 29387 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:02.230125 29387 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:02.230306 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:02.167972 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82588.7us
I20260709 13:10:02.231109 29387 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.232381 29387 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:02.158593 29286 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:02.235263 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:02.235977 22499 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.239596 22504 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:02.240135 22496 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:02.240296 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:02.241433 22646 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 26: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:02.242461 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:02.243173 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:02.171810 22579 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
I20260709 13:10:02.244525 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:02.245595 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:02.245956 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:02.007094 29382 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.082782 29245 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.171641 29131 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:02.189057 22648 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:10:02.191039 22649 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:02.191463 22577 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:02.194936 29377 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:02.205201 29259 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:02.213125 29130 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21.
I20260709 13:10:02.213712 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:02.216436 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:02.307852 22468 leader_election.cc:336] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.556s (SENT)
I20260709 13:10:02.308336 22650 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:02.308408 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:02.217665 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:02.154891 29185 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.220182 29318 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:02.224767 29072 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:02.176506 29392 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.229278 22543 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.247067 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:02.241586 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:02.253716 22578 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:10:02.341387 22504 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:02.342031 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:02.254324 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.342535 22579 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:10:02.254634 22580 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:10:02.256315 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:02.344157 22496 raft_consensus.cc:2410] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:10:02.261746 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 265102us
I20260709 13:10:02.298700 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:02.298974 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:02.299873 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.306672 29293 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.298311 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:02.309623 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:02.354485 22574 raft_consensus.cc:2410] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:02.315423 22654 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [17.15-18.16]
I20260709 13:10:02.319125 22646 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:10:02.326327 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.320318 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82746.3us
W20260709 13:10:02.337998 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 99441.8us
I20260709 13:10:02.387548 22499 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:02.375710 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:02.392129 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:10:02.393321 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 164123us
I20260709 13:10:02.337162 29072 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:02.344772 29083 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.396059 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:02.350750 29392 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.407225 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1035) took 1147 ms. Trace:
I20260709 13:10:02.344069 29355 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
W20260709 13:10:02.408849 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101035us
I20260709 13:10:02.397146 28912 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:10:02.414774 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 154855us
I20260709 13:10:02.394718 29395 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:02.405980 29263 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:02.417152 22617 leader_election.cc:400] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
I20260709 13:10:02.446511 22617 leader_election.cc:403] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:02.407627 23263 rpcz_store.cc:276] 0709 13:10:01.259429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.259570 (+   141us) service_pool.cc:224] Handling call
0709 13:10:01.678238 (+418668us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:10:01.678529 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.679019 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.679060 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.679929 (+   869us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.866674 (+186745us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:01.866720 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.866788 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.393968 (+527180us) raft_consensus.cc:1685] finished
0709 13:10:02.393989 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.407155 (+ 13166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4209,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":10291,"spinlock_wait_cycles":4446592,"thread_start_us":185972,"threads_started":1,"wal-append.queue_time_us":288508}
I20260709 13:10:02.448110 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.450040 22617 leader_election.cc:400] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
I20260709 13:10:02.421224 29383 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:02.422057 28912 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:02.422571 29245 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:02.452432 22468 leader_election.cc:336] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.604s (SENT)
I20260709 13:10:02.423554 29382 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:02.424000 29375 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.400225 29293 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.431978 29182 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:02.406677 29083 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:02.352088 29111 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.416324 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:02.485635 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72325.1us
I20260709 13:10:02.469456 29370 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:10:02.457355 22646 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:10:02.492043 22501 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:10:02.492497 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:02.452981 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.457747 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1031) took 1436 ms. Trace:
I20260709 13:10:02.455482 22545 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:02.464560 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:02.475898 22575 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:10:02.408721 29363 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:02.451488 29263 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:02.453773 29395 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
W20260709 13:10:02.490535 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 132533us
I20260709 13:10:02.494613 22651 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:02.499526 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:02.500476 22651 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
W20260709 13:10:02.502625 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47205.9us
I20260709 13:10:02.502918 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:02.503793 22652 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:02.503997 22579 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:02.493577 23256 rpcz_store.cc:276] 0709 13:10:01.020912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.029039 (+  8127us) service_pool.cc:224] Handling call
0709 13:10:01.086327 (+ 57288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.029625 (+943298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.457523 (+427898us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54005a1754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:02.457691 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058546048}
W20260709 13:10:02.540359 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 89109.5us
I20260709 13:10:02.541427 22649 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:02.541625 22651 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:10:02.547783 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 95381.9us
W20260709 13:10:02.549331 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48973.3us
I20260709 13:10:02.545892 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:02.495707 28909 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:02.553071 22503 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:02.562680 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.572801 22652 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:02.594108 22652 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:10:02.596494 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:02.597455 22502 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:02.459627 29383 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.554986 29373 raft_consensus.cc:476] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:02.579988 28909 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:02.583127 29262 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:02.552320 29378 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:02.579605 29375 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.495937 29364 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:10:02.614899 29131 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:02.615424 29386 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:02.618140 29228 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:02.618582 28909 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.621140 28975 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:02.650470 29262 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.601591 29395 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:02.582581 29318 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:10:02.581893 29355 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:10:02.665830 29363 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:02.657394 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 94805.6us
I20260709 13:10:02.693148 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.647152 29378 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.556166 29263 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:02.739006 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.739765 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 172629us
I20260709 13:10:02.672669 29289 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:02.687059 29262 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:02.743283 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.743435 22652 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:02.559881 28912 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:02.738469 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45402.5us
I20260709 13:10:02.758651 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.664810 29375 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.763335 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:02.751794 29362 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:02.746256 29386 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.740892 29378 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:02.772100 22617 leader_election.cc:400] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21.
I20260709 13:10:02.745162 29275 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:10:02.759915 29350 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:10:02.777531 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.785894 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:02.753185 29414 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.769045 29267 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:02.790385 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 190965us
W20260709 13:10:02.801512 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.765223 29395 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:02.809062 29407 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:10:02.842548 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56762.1us
I20260709 13:10:02.852738 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:02.773663 29415 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:02.764951 29359 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:10:02.774209 29334 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 13:10:02.805511 29386 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:02.844532 29259 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:02.928375 22468 leader_election.cc:336] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 2.241s (SENT)
I20260709 13:10:02.856041 29267 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:02.849996 29414 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.929476 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:02.916936 29395 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.944582 22652 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:02.925170 29405 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:02.948422 29387 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.711s	user 0.014s	sys 0.000s
I20260709 13:10:02.942106 29259 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:02.952719 29383 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.011149 29421 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.016398 29267 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.016929 29421 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:03.017863 29424 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:10:03.017030 29417 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:10:03.020831 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3269) took 1125 ms. Trace:
I20260709 13:10:02.959693 29386 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.859427 29363 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.021471 22645 rpcz_store.cc:276] 0709 13:10:01.895418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.895581 (+   163us) service_pool.cc:224] Handling call
0709 13:10:01.895915 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.288148 (+392233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.288218 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.320773 (+ 32555us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.549260 (+228487us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:02.555274 (+  6014us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.581888 (+ 26614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.581963 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.020618 (+438655us) raft_consensus.cc:1685] finished
0709 13:10:03.020646 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.020773 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68910,"prepare.queue_time_us":11877,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":149777,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":10284,"spinlock_wait_cycles":10873984,"thread_start_us":483934,"threads_started":2,"wal-append.queue_time_us":291722}
W20260709 13:10:03.030629 29398 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:10:03.027444 29386 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:03.031280 29418 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:10:02.950822 29395 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:02.956729 29405 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:03.053507 29422 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.130s	user 0.004s	sys 0.000s
I20260709 13:10:03.063081 28908 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:03.066010 28908 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:03.066927 29405 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:03.066897 28908 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.068070 28908 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:03.070760 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.072788 29131 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:03.072692 29221 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:10:03.076576 29425 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.052s	user 0.004s	sys 0.000s
I20260709 13:10:03.091399 29421 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.078778 29395 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.096477 29433 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.096593 29427 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:10:03.121734 29409 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.196s	user 0.000s	sys 0.002s
I20260709 13:10:03.126895 29293 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:03.127503 29385 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:03.104524 29408 log.cc:927] Time spent T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.444s	user 0.001s	sys 0.000s
W20260709 13:10:03.116065 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.119170 29433 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:03.131825 29423 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:10:03.133100 29433 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.134466 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.134925 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.135428 22497 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:10:03.135864 22503 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:03.136543 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.164578 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:03.166803 22572 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:03.144632 29160 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.165987 22577 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:03.139079 29414 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:03.172586 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 319940us
I20260709 13:10:03.163674 29084 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.184243 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:03.185065 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.128082 29385 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.141673 29375 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.181811 22572 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:03.190805 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:03.216562 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.224782 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.228489 22577 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:03.200690 29395 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:03.217125 29293 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:03.239027 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:10:03.239789 22648 raft_consensus.cc:606] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.240159 22648 raft_consensus.cc:614] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:03.242028 29259 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:03.236219 29137 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.245898 29137 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.246920 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:10:03.247684 22648 raft_consensus.cc:606] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.248060 22648 raft_consensus.cc:614] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:03.186240 29160 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.201754 29355 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:10:03.253345 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.249027 29137 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.201390 29084 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.230716 29435 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.257951 29392 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.840s	user 0.013s	sys 0.000s
I20260709 13:10:03.300137 29392 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.293248 29406 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:03.301838 29406 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.302719 29392 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.257346 29363 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:10:03.304216 29406 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.286131 22572 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:03.285233 23256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ec411c33594ae08408279ef5c44410"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:10:03.305521 23256 raft_consensus.cc:606] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.305588 23262 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:10:03.306013 23256 raft_consensus.cc:614] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:03.306955 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.307664 23257 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:03.308817 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.309594 29363 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:03.310037 29363 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:03.310398 29160 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.310879 29363 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.311786 22497 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:03.312490 29363 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:03.295426 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.315363 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.317160 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:03.318521 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:03.319175 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:10:03.319334 29263 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:03.319792 22648 raft_consensus.cc:606] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.320212 22648 raft_consensus.cc:614] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:03.320901 29263 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:03.322072 29385 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.277452 29364 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.323304 29364 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.325438 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.325878 29364 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.328591 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.329862 29084 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.319844 29160 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:03.330904 29160 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.331298 29160 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.333400 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2727) took 1024 ms. Trace:
I20260709 13:10:03.333794 22579 rpcz_store.cc:276] 0709 13:10:02.309422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.345239 (+ 35817us) service_pool.cc:224] Handling call
0709 13:10:02.345528 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.504768 (+159240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.333154 (+828386us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000e7254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:03.333342 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363884416}
I20260709 13:10:03.334954 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.336036 22579 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:03.337873 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:03.332405 29262 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.002s
I20260709 13:10:03.258934 29378 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:03.346659 29436 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:03.355392 29082 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.362177 29082 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.364471 29082 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.365973 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.366914 22501 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:10:03.376434 29386 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:03.380360 29445 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260709 13:10:03.382205 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:03.383601 22497 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:03.385462 22501 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:03.390383 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3308) took 1152 ms. Trace:
I20260709 13:10:03.420920 22500 rpcz_store.cc:276] 0709 13:10:02.237828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.238010 (+   182us) service_pool.cc:224] Handling call
0709 13:10:02.238295 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.356603 (+118308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.356633 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.356684 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:02.356716 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.389936 (+1033220us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540007b554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:03.390003 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.390193 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271603584}
I20260709 13:10:03.390735 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.391744 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.391949 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.390429 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.423539 23256 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:03.393422 22648 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:10:03.346879 29262 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.398687 29339 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:03.427923 22577 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 22: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:03.428495 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.400704 29378 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.401929 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.336470 29435 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.425475 29130 raft_consensus.cc:993] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:10:03.411821 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:03.347585 29137 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:10:03.415480 22617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.902s (SENT) [suppressed 6 similar messages]
I20260709 13:10:03.431149 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.428622 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:03.433203 22573 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:10:03.433775 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.406939 29083 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.435657 22497 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:03.431917 29377 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.444021 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.445732 22500 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:03.447690 29160 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.450683 29262 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.432382 29339 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.451189 29435 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:03.442128 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 1337) took 1383 ms. Trace:
I20260709 13:10:03.441915 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:03.456708 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.457491 22573 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:03.454708 22653 rpcz_store.cc:276] 0709 13:10:02.058878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.073941 (+ 15063us) service_pool.cc:224] Handling call
0709 13:10:03.411670 (+1337729us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800035198. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:10:03.442027 (+ 30357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3612928}
I20260709 13:10:03.459874 29082 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:03.466378 29082 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.466989 29082 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:03.467177 29420 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.451s	user 0.000s	sys 0.002s
I20260709 13:10:03.440431 29202 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.469360 29202 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.457729 29377 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.471796 29202 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.471585 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.473214 29377 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.474378 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.502463 23263 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:03.469381 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:03.503417 22496 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:03.480285 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.482430 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:03.456211 22501 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:03.486698 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:03.442782 29130 raft_consensus.cc:1081] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:10:03.439512 29137 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.493008 29160 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.515818 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:03.517102 29315 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:03.493162 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:03.520784 22651 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:03.494207 22652 raft_consensus.cc:1275] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:03.493811 29072 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.524219 29072 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:03.497833 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:03.528934 22647 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:03.498808 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:03.533139 23256 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.504412 22497 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:03.505229 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:03.500558 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:03.513218 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:03.513883 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:03.539897 22648 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:03.539922 22653 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
W20260709 13:10:03.557523 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 52411.1us
I20260709 13:10:03.558210 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:03.514667 29137 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.559146 22652 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:03.543020 29377 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:03.566162 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:03.569764 22653 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:03.582201 22647 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:03.510480 29293 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:10:03.553171 29365 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:03.586462 22496 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:03.612643 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.559746 29386 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.569057 29377 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.512526 29435 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:10:03.617074 22496 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:03.617612 22653 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:03.623011 22501 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:03.626633 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:03.636058 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:03.636801 22652 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
W20260709 13:10:03.630213 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 214749us
I20260709 13:10:03.567395 29433 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:03.548576 29084 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:10:03.587940 29383 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.639215 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:03.641412 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.648984 22578 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
W20260709 13:10:03.642525 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53034.7us
I20260709 13:10:03.643925 22651 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:03.645210 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.591194 23256 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:03.607334 29431 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.616681 29365 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.632326 29377 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:03.639631 29448 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:10:03.655627 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.663020 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.629978 29130 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.652933 22544 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:03.643744 29433 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.640316 29315 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.639465 29160 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.694525 29160 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.643292 29339 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:03.650558 22496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59520
I20260709 13:10:03.679286 29431 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.697780 22496 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.698347 22496 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.699307 29431 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:03.689515 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.701025 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 48211.7us
I20260709 13:10:03.701272 29413 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:03.702044 29413 raft_consensus.cc:697] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:03.703177 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 47619.6us
I20260709 13:10:03.703435 29414 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.704025 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.705327 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:03.706179 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:03.707015 28912 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:03.707386 28912 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.707698 28912 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:03.670320 29083 consensus_queue.cc:1048] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:10:03.709198 29315 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.710435 29245 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:03.710995 29245 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:03.711885 29245 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.666826 29144 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:03.713780 29144 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.714200 29144 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:03.685427 29433 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:03.717083 29130 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.718014 28912 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.723037 28912 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.704044 29414 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.731077 29414 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.734357 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1160) took 1684 ms. Trace:
I20260709 13:10:03.664500 29365 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.735011 22576 rpcz_store.cc:276] 0709 13:10:02.050041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.074443 (+ 24402us) service_pool.cc:224] Handling call
0709 13:10:02.074773 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.317468 (+242695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.317533 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.317578 (+    45us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:02.317617 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.734081 (+1416464us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400279cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:03.734131 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.734283 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557694208}
W20260709 13:10:03.736727 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3870) took 1881 ms (client timeout 1902 ms). Trace:
W20260709 13:10:03.737177 22580 rpcz_store.cc:269] 0709 13:10:01.855596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.855764 (+   168us) service_pool.cc:224] Handling call
0709 13:10:03.736492 (+1880728us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54003b2c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:03.736647 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666717952}
I20260709 13:10:03.739825 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.740651 23262 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:10:03.741087 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.741379 22571 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:10:03.709851 29083 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:03.667404 29395 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:03.742326 29262 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:03.742790 29262 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:03.743134 29160 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.743432 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2728) took 1422 ms. Trace:
W20260709 13:10:03.743592 29457 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:03.700798 29431 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.745582 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:03.753145 29417 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:03.744854 22544 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:03.742372 29083 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:03.633445 29386 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.754586 29083 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.755272 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.755697 29386 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.756899 29431 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.758397 29363 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:03.758865 29363 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.759124 29431 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.759236 29363 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.703230 29413 consensus_queue.cc:237] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.743702 29262 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:03.750344 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79478.3us
I20260709 13:10:03.712180 29315 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.762216 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:03.765681 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:03.772068 22571 rpcz_store.cc:276] 0709 13:10:02.321475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.378613 (+ 57138us) service_pool.cc:224] Handling call
0709 13:10:03.741107 (+1362494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.741771 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.743245 (+  1474us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003b2c50. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:03.743380 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3076578560}
I20260709 13:10:03.768720 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.779562 22572 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:03.770092 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:03.666076 28908 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:10:03.795559 29082 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.798909 29289 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:03.799558 29289 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.803057 22578 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:03.804767 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3316) took 1227 ms. Trace:
I20260709 13:10:03.805198 22499 rpcz_store.cc:276] 0709 13:10:02.577364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.577467 (+   103us) service_pool.cc:224] Handling call
0709 13:10:02.577764 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.577971 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:02.594116 (+ 16145us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.594406 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.804224 (+1209818us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b180027fac0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:10:03.804384 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.804438 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:03.804488 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.804570 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.804702 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5897,"prepare.queue_time_us":164579,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":4448,"spinlock_wait_cycles":6959488}
I20260709 13:10:03.777161 22496 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.809437 22498 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:03.790982 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:03.792965 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.687065 29432 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:03.793908 29262 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:03.665243 29383 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.818014 23261 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:03.831358 22496 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:03.839811 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3315) took 1262 ms. Trace:
I20260709 13:10:03.840446 22505 rpcz_store.cc:276] 0709 13:10:02.577092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.577746 (+   654us) service_pool.cc:224] Handling call
0709 13:10:02.592316 (+ 14570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.592541 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:02.671539 (+ 78998us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.839308 (+1167769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.839373 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:03.839449 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.839544 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.839729 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1174991,"prepare.queue_time_us":71330,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":7235,"thread_start_us":55209,"threads_started":1}
I20260709 13:10:03.790913 29160 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:03.810626 29386 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:03.849064 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3320) took 1088 ms. Trace:
W20260709 13:10:03.847114 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 141004us
I20260709 13:10:03.852021 29433 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.854336 29433 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.811425 29130 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:03.870239 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.872143 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:03.874794 29454 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:03.818941 29435 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:03.888736 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.849366 29160 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.893887 22501 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:03.892167 22496 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:03.895421 22496 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:03.901041 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 238106us
I20260709 13:10:03.902330 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:03.896306 22496 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:03.914945 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:03.915865 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.916990 22496 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:03.922515 22501 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 11.
I20260709 13:10:03.875531 29392 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.923635 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.891222 29237 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:03.926767 22501 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:10:03.925117 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:10:03.931675 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.894357 29160 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:03.934546 22617 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:03.938697 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:03.939761 22577 raft_consensus.cc:2393] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:03.945055 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.972520 22501 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:10:03.973074 22496 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:10:03.973546 22496 pending_rounds.cc:85] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 9
I20260709 13:10:03.973795 22496 pending_rounds.cc:107] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:10:03.973999 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:03.974850 22501 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:03.976891 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:03.978297 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:03.979705 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:03.915421 28912 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:10:03.891073 29275 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:10:03.974026 22496 raft_consensus.cc:2889] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:03.941404 29372 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.987036 29082 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.987229 29372 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.987993 29182 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:03.988528 29182 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.990116 29372 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.990769 29182 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:03.990854 29372 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.929791 29237 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.991681 29372 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.991834 29237 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:03.995072 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:04.003348 22578 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:03.997509 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:03.928411 29130 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.884516 29137 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.930063 29386 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:03.929518 29396 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.946825 29263 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.905186 29435 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:03.949432 29293 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:03.892107 29454 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.010787 29386 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.999046 29339 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:04.021813 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 1.09912e+06us
I20260709 13:10:04.001766 29370 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:10:04.027557 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.031116 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.009958 29382 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:04.028705 22654 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:03.933863 29392 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.016333 29263 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.014431 29130 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.023350 29293 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.029012 29339 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.033372 29386 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:04.044226 29072 consensus_meta.cc:287] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.001s
I20260709 13:10:04.037961 29382 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.013989 29414 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.025820 29396 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.056641 29263 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.096153 29475 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.097199 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:04.097092 29475 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.098016 22648 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:04.099251 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:04.099653 29130 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.099627 29475 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.100790 29435 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.100975 29475 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.101804 29475 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.104092 29375 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.077286 29382 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.105638 29383 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.109309 29375 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.087127 29432 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:04.110668 29432 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.068306 29339 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.114553 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:04.115276 22498 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:10:04.100463 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:04.115983 22648 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 11.
I20260709 13:10:04.067289 29293 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:04.066293 29395 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.118650 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:04.152848 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:04.127086 29458 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:10:04.155525 22653 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.159413 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:04.174117 29137 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.187057 29476 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.187738 29476 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.172997 22653 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:04.193401 29372 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.127656 29295 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:04.197983 22580 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:04.198151 29396 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.126262 29365 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.199769 29432 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:04.201085 29365 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.201781 29365 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.202245 29365 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.202750 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3319) took 1590 ms. Trace:
I20260709 13:10:04.203222 22504 rpcz_store.cc:276] 0709 13:10:02.612881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.613042 (+   161us) service_pool.cc:224] Handling call
0709 13:10:02.613495 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.826244 (+1212749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.826292 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.834098 (+  7806us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.021265 (+187167us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:04.021307 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.021375 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.202515 (+181140us) raft_consensus.cc:1685] finished
0709 13:10:04.202537 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.202684 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1257715,"raft.queue_time_us":1225197,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9714,"thread_start_us":139217,"threads_started":1,"wal-append.queue_time_us":340680}
I20260709 13:10:04.136641 29462 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:10:04.118253 29383 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.207541 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:04.209527 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:04.216938 22503 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:04.210402 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:04.218101 22498 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
W20260709 13:10:04.148814 29417 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:04.142784 29435 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:04.226964 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:04.285523 22648 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:04.205344 29462 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:04.289151 22578 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:04.239050 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.232965 29365 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:04.312485 29476 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:04.314848 29454 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:04.319416 29382 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.329797 29414 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:04.292008 29456 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 13:10:04.332190 29392 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:04.342061 29375 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:04.344412 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:04.345440 22651 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
W20260709 13:10:04.348246 29377 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 13:10:04.348876 29377 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.351838 29377 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:04.286077 29363 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.359282 29363 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.221087 29144 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.371646 29144 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.374670 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:04.375563 23261 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:04.378898 22576 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260709 13:10:04.380390 29459 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.492s	user 0.000s	sys 0.002s
I20260709 13:10:04.383541 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:04.384514 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:04.398597 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 76395us
I20260709 13:10:04.399456 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:04.399852 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:04.403402 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:04.389611 29475 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.142477 29395 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:04.383728 29461 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:04.409334 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:04.216374 29111 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:04.411826 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:04.408962 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 357699us
I20260709 13:10:04.419269 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:04.420364 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:04.421906 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:04.292189 29462 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:04.422772 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:04.427687 22578 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:04.424118 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:04.307394 29435 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.430555 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.433437 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:04.436705 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:04.326936 29160 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.438365 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.444126 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:04.444661 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.445299 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.448680 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.453994 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.455226 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:04.412717 29130 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.409871 29137 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:04.408609 29180 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.464120 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:04.412951 29432 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.450496 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:04.434374 29475 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:04.493687 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:04.502857 22504 raft_consensus.cc:3055] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:04.503391 22504 raft_consensus.cc:740] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:04.453346 29377 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:04.227978 29383 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.498117 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3891) took 1203 ms. Trace:
I20260709 13:10:04.499010 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:04.511672 22647 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.511281 22573 rpcz_store.cc:276] 0709 13:10:03.294224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.483555 (+189331us) service_pool.cc:224] Handling call
0709 13:10:03.483897 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.484148 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.484172 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.484640 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.814097 (+329457us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:03.814169 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.814262 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.379640 (+565378us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:04.479166 (+ 99526us) raft_consensus.cc:1685] finished
0709 13:10:04.479198 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.498043 (+ 18845us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7109888,"thread_start_us":264730,"threads_started":1,"wal-append.queue_time_us":350558}
I20260709 13:10:04.452744 29435 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.504256 22504 consensus_queue.cc:260] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.519215 22504 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:10:04.478494 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:04.520931 22498 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.408460 29433 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:10:04.451885 29289 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.466528 29295 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.471095 29364 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:04.470695 29476 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:04.437906 29111 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:04.527377 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.528379 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.547437 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.552207 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.491958 29396 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.557356 22647 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:10:04.557618 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.568888 29476 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:04.569494 29476 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.559291 29369 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.571075 29369 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.572974 29111 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.509857 29263 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.553493 29364 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.585033 29364 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:04.586779 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:04.587740 22499 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.588043 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:04.581301 29471 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:04.528218 29462 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:04.582931 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54635.5us
I20260709 13:10:04.603194 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.583575 29392 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:10:04.606997 22503 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:04.593763 29395 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.607978 23261 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:04.598242 22504 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:10:04.598925 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:04.606005 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:04.611182 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 56253.3us
I20260709 13:10:04.619450 22503 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:04.610596 22504 pending_rounds.cc:85] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 14
I20260709 13:10:04.612452 22618 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.528751 29377 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:04.607259 29375 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:04.622452 29377 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.623934 29369 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:04.614507 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:04.624897 28909 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:04.625365 22505 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.627115 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.493522 29180 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.618330 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:04.632025 22647 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.631029 22504 pending_rounds.cc:107] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:10:04.632993 22504 raft_consensus.cc:2889] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:04.634006 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:04.493165 29137 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.584482 29295 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.564262 29289 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.648140 22503 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:10:04.609436 29421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.001s	sys 0.019s
I20260709 13:10:04.524039 29386 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:04.682046 22498 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:04.668834 22499 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:04.621201 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:04.652609 22648 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:04.550678 29475 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:10:04.711043 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:04.711426 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0611312019999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:10:04.758580 23260 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 19. Ops: []
I20260709 13:10:04.759392 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.760385 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:04.604734 29339 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:04.761196 22504 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:04.771405 22500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.016s	sys 0.026s
W20260709 13:10:04.771795 22500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.016s	sys 0.026s
I20260709 13:10:04.619689 29395 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:04.655432 29462 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:04.654816 29130 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.647074 29315 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.711894 29421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.002s	sys 0.020s
I20260709 13:10:04.765106 22647 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:04.709594 22505 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:10:04.768658 28908 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:04.799335 22504 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:10:04.863142 29433 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:04.823408 29293 consensus_meta.cc:287] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
W20260709 13:10:04.781114 29262 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.951s	user 0.012s	sys 0.003s
I20260709 13:10:04.741266 29392 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.864307 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71140.7us
I20260709 13:10:04.774292 29180 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:04.883975 29137 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.889818 22647 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 20. Current term is 21. Ops: []
W20260709 13:10:04.966859 22501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.006s	sys 0.026s
W20260709 13:10:04.967216 22501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.006s	sys 0.026s
I20260709 13:10:04.967298 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1361) took 1085 ms. Trace:
W20260709 13:10:04.897524 29237 consensus_meta.cc:287] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.881s	user 0.012s	sys 0.000s
I20260709 13:10:04.646046 29396 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.161s
W20260709 13:10:04.899837 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 140517us
I20260709 13:10:04.865969 29480 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:04.774928 29160 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:04.775240 29475 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:04.775456 29373 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:04.772435 29289 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:04.863756 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 242618us
I20260709 13:10:04.791910 29259 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:04.798528 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3329) took 1387 ms. Trace:
I20260709 13:10:04.967698 22647 rpcz_store.cc:276] 0709 13:10:03.881678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.889016 (+1007338us) service_pool.cc:224] Handling call
0709 13:10:04.889508 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.966994 (+ 77486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.967240 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:04.973150 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.010903 22500 rpcz_store.cc:276] 0709 13:10:03.410848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.447515 (+ 36667us) service_pool.cc:224] Handling call
0709 13:10:03.447777 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.447969 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:03.537679 (+ 89710us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.903675 (+365996us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.772078 (+868403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.772139 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:04.772197 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.772288 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.798454 (+ 26166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37952,"prepare.queue_time_us":269249,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":129541,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":29748,"spinlock_wait_cycles":15357824,"thread_start_us":1270842,"threads_started":3,"wal-append.queue_time_us":648324}
W20260709 13:10:04.999600 23257 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.015s	sys 0.042s
I20260709 13:10:05.001045 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.892583 29364 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.007759 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:05.014585 23257 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.015s	sys 0.042s
I20260709 13:10:05.015156 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:04.920797 29435 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.021483 29478 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:05.028709 22471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.016s	sys 0.025s
I20260709 13:10:04.992728 29433 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:04.993556 29386 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:05.029191 22471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.016s	sys 0.025s
I20260709 13:10:05.029557 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:05.032985 22647 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:05.033665 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3312) took 1146 ms. Trace:
I20260709 13:10:04.877960 29315 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.034129 22647 rpcz_store.cc:276] 0709 13:10:03.887693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.025180 (+1137487us) service_pool.cc:224] Handling call
0709 13:10:05.025534 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.033366 (+  7832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.033586 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:05.025269 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.045s
W20260709 13:10:05.034948 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.007s	sys 0.046s
I20260709 13:10:05.035581 22647 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:05.036331 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3313) took 1093 ms. Trace:
I20260709 13:10:05.037055 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:05.039309 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:05.040100 22573 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:04.965744 29293 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:05.043135 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.048887 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.036641 22647 rpcz_store.cc:276] 0709 13:10:03.942656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.034992 (+1092336us) service_pool.cc:224] Handling call
0709 13:10:05.035285 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.036083 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.036274 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:05.027688 29262 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:04.969415 29476 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.004174 29475 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:04.975329 29392 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.069386 22653 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:04.995389 29237 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.021502 29259 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.046474 29480 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:10:05.031633 29375 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:05.073109 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.096903 22579 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:10:05.077220 22651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.017s	sys 0.045s
I20260709 13:10:05.077587 22498 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 13:10:05.079214 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:05.079823 22573 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:05.098160 22498 pending_rounds.cc:85] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 17
I20260709 13:10:05.072798 29383 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.046319 29295 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:05.038806 29395 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:05.098634 22498 pending_rounds.cc:107] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 13:10:05.110235 22498 raft_consensus.cc:2889] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:05.099077 22651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.018s	sys 0.045s
I20260709 13:10:05.105321 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.111692 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:05.112170 22505 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:05.046017 29137 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:05.117040 23256 raft_consensus.cc:2368] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21.
I20260709 13:10:05.117879 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3304) took 1266 ms. Trace:
I20260709 13:10:05.118278 22651 rpcz_store.cc:276] 0709 13:10:03.851882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.398897 (+547015us) service_pool.cc:224] Handling call
0709 13:10:04.422216 (+ 23319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.422430 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:04.457459 (+ 35029us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.116553 (+659094us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.117520 (+   967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.117566 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:05.117621 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.117705 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.117824 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39478,"prepare.queue_time_us":100292,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":9298,"thread_start_us":654054,"threads_started":1}
W20260709 13:10:05.123184 22645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.014s	sys 0.022s
W20260709 13:10:05.123569 22645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.014s	sys 0.022s
I20260709 13:10:05.032132 29481 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:10:05.040524 29363 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:10:05.047315 29414 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:10:05.132355 22654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.020s
I20260709 13:10:05.093276 29262 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:05.150627 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:05.151134 22654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.003s	sys 0.021s
W20260709 13:10:05.161007 22620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.035s	sys 0.113s
W20260709 13:10:05.161408 22620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.036s	sys 0.113s
I20260709 13:10:05.124505 29383 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:10:05.157423 22652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.069s
I20260709 13:10:05.170617 22498 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:05.171249 22652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.013s	sys 0.069s
I20260709 13:10:05.174088 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3314) took 1096 ms. Trace:
I20260709 13:10:05.180750 22651 rpcz_store.cc:276] 0709 13:10:04.078208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.152836 (+1074628us) service_pool.cc:224] Handling call
0709 13:10:05.173576 (+ 20740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.173765 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.173791 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.173839 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:05.173877 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.173928 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.174033 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:05.149852 29295 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:05.160717 29130 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:05.128537 29395 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.131037 29137 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.189330 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3351) took 1012 ms. Trace:
I20260709 13:10:05.202375 22501 rpcz_store.cc:276] 0709 13:10:04.176455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.179118 (+  2663us) service_pool.cc:224] Handling call
0709 13:10:04.179449 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.179859 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:04.180197 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.972308 (+792111us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.976250 (+  3942us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.976445 (+   195us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:04.976495 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.976599 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.189080 (+212481us) raft_consensus.cc:1685] finished
0709 13:10:05.189108 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.189269 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":704,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":39271,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":5785,"thread_start_us":787071,"threads_started":1,"wal-append.queue_time_us":999205}
W20260709 13:10:05.208181 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.026s	sys 0.019s
W20260709 13:10:05.209272 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.026s	sys 0.019s
W20260709 13:10:05.210455 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 589207us
I20260709 13:10:05.182615 29339 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.215368 22498 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:05.219749 22501 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:05.225551 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3315) took 1141 ms. Trace:
I20260709 13:10:05.226184 22651 rpcz_store.cc:276] 0709 13:10:04.084393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.198721 (+1114328us) service_pool.cc:224] Handling call
0709 13:10:05.224817 (+ 26096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.225093 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.225132 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.225183 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:05.225237 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.225311 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.225467 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:05.149930 29433 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.196885 29130 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:03.849701 22502 rpcz_store.cc:276] 0709 13:10:02.760531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.760699 (+   168us) service_pool.cc:224] Handling call
0709 13:10:02.779133 (+ 18434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.779357 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:02.842076 (+ 62719us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.848395 (+1006319us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.848593 (+   198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.848651 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:03.848723 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.848817 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.848990 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1005828,"prepare.queue_time_us":67730,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1375,"raft.queue_time_us":1008323,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":17825536}
I20260709 13:10:05.273790 22501 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.277550 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3310) took 1418 ms. Trace:
I20260709 13:10:05.241442 29364 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.242063 29130 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:05.244514 29339 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:05.293692 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 262706us
I20260709 13:10:05.294541 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:05.283775 22650 rpcz_store.cc:276] 0709 13:10:03.859571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.876667 (+1017096us) service_pool.cc:224] Handling call
0709 13:10:04.968535 (+ 91868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.968774 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:10:04.973140 (+  4366us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.277192 (+304052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.277260 (+    68us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:05.277307 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.277371 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.277493 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20664,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":60,"thread_start_us":303632,"threads_started":1}
I20260709 13:10:05.299005 22651 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:05.283335 29289 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.283155 29435 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.290519 29496 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:05.301268 22545 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:05.308753 22501 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:05.301754 22650 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:05.294059 29293 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.320107 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1352) took 1593 ms. Trace:
I20260709 13:10:05.320600 22653 rpcz_store.cc:276] 0709 13:10:03.726902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.189542 (+462640us) service_pool.cc:224] Handling call
0709 13:10:04.189957 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.071461 (+881504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.319873 (+248412us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400411c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:05.320040 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021976448}
I20260709 13:10:05.322420 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1171) took 1584 ms. Trace:
I20260709 13:10:05.322842 22576 rpcz_store.cc:276] 0709 13:10:03.738416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.746798 (+  8382us) service_pool.cc:224] Handling call
0709 13:10:03.769079 (+ 22281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.379490 (+610411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.741458 (+361968us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54003bc754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:05.322217 (+580759us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b54003bc750. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:05.322362 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451559040}
I20260709 13:10:05.325047 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:05.325425 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:05.295612 29406 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.328074 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:05.245537 29262 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.334723 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.335728 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:05.336519 23263 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.327409 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.295040 29237 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.398957 29392 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:05.400978 29490 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:10:05.402573 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1183) took 1208 ms. Trace:
I20260709 13:10:05.403188 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.403743 29137 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:05.403960 29499 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:05.299485 29476 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.404049 22502 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:05.283980 29295 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.312750 29496 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:05.410934 29111 consensus_meta.cc:287] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.000s
I20260709 13:10:05.411445 29111 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.412618 23255 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:05.413544 29495 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:10:05.417546 29395 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:05.419603 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.402977 22577 rpcz_store.cc:276] 0709 13:10:04.194539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.200989 (+  6450us) service_pool.cc:224] Handling call
0709 13:10:04.206954 (+  5965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.222529 (+ 15575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.222571 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.223059 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.763291 (+540232us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:04.763399 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.763632 (+   233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.402312 (+638680us) raft_consensus.cc:1685] finished
0709 13:10:05.402349 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.402509 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15976,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":56455,"thread_start_us":476279,"threads_started":1,"wal-append.queue_time_us":893517}
I20260709 13:10:05.296969 29339 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.471539 23261 raft_consensus.cc:1275] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:05.300424 29364 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:05.490902 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.488632 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.496714 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.497645 22501 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
W20260709 13:10:05.499893 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.506870 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:05.507658 23261 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:05.292474 29180 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:10:05.515805 22576 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.506304 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:05.418738 29363 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:05.519295 22544 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:05.519462 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:05.525671 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 213112us
I20260709 13:10:05.526906 22545 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:05.472411 29293 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.534029 29377 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:05.534761 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:05.475479 29083 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.490653 29484 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:05.516621 29462 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.000s
I20260709 13:10:05.559708 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:05.560573 23263 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:10:05.514901 29392 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.563738 23261 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
W20260709 13:10:05.562598 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 431956us
I20260709 13:10:05.516060 29364 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:05.473372 29406 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:05.575448 29432 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.082s	user 0.008s	sys 0.005s
I20260709 13:10:05.617663 29432 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:05.623098 29477 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.240s	user 0.000s	sys 0.007s
I20260709 13:10:05.568307 29484 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.627149 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3347) took 1735 ms. Trace:
I20260709 13:10:05.627935 29484 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.628933 29507 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:05.629542 22646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1363) took 1591 ms. Trace:
I20260709 13:10:05.629979 22646 rpcz_store.cc:276] 0709 13:10:04.038210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.074298 (+1036088us) service_pool.cc:224] Handling call
0709 13:10:05.074579 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.238205 (+163626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.238267 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.238328 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:05.238396 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.629285 (+390889us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400283054. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:05.629332 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.629480 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375701376}
I20260709 13:10:05.633416 29339 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:05.633817 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1362) took 1622 ms. Trace:
I20260709 13:10:05.634433 22647 rpcz_store.cc:276] 0709 13:10:04.011074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.050125 (+1039051us) service_pool.cc:224] Handling call
0709 13:10:05.050416 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.222999 (+172583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.223046 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.223107 (+    61us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:05.223162 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.633467 (+410305us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001c7fd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:05.633538 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.633741 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396288384}
W20260709 13:10:05.609238 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.559173 29083 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.627699 22496 rpcz_store.cc:276] 0709 13:10:03.891610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.017425 (+125815us) service_pool.cc:224] Handling call
0709 13:10:04.021553 (+  4128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.021887 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.021913 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.022352 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.120648 (+ 98296us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:04.120794 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.120944 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.622260 (+1501316us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:05.626720 (+  4460us) raft_consensus.cc:1685] finished
0709 13:10:05.626754 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.627067 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16525,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7576,"spinlock_wait_cycles":35859200,"thread_start_us":91976,"threads_started":1,"wal-append.queue_time_us":359850}
I20260709 13:10:05.558260 29293 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:05.616037 29498 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
W20260709 13:10:05.616963 29497 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:10:05.574796 29392 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.638911 22646 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:10:05.678870 22646 pending_rounds.cc:85] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 11
I20260709 13:10:05.679188 22646 pending_rounds.cc:107] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:10:05.679436 22646 raft_consensus.cc:2889] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:05.639313 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 408935us
I20260709 13:10:05.647111 29507 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:05.685950 29476 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:05.686636 29476 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.686470 29507 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.690199 29182 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:05.690847 29182 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.693884 29182 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.694829 29476 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.702425 29083 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.704852 29406 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.707144 29293 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:05.675307 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.614987 29160 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:05.716161 22618 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:05.697876 29506 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:10:05.735606 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 419784us
I20260709 13:10:05.740283 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:05.746533 22646 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:05.750988 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.738802 29130 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.759645 29130 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.736532 29072 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:10:05.744154 29476 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.765277 29516 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:05.765802 29476 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:05.767930 29476 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.612566 29364 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.779385 29382 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.779264 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.781661 29392 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:05.783226 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:05.783862 22650 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:05.772758 28908 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.000s
I20260709 13:10:05.744760 29221 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:10:05.788874 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:05.789654 22496 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:05.808182 22646 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:10:05.814006 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:05.814299 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 267841us
I20260709 13:10:05.788318 28908 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:05.822645 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 303406us
I20260709 13:10:05.823273 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:05.795002 29383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.019s
I20260709 13:10:05.823963 22646 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:05.823421 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:05.811906 22650 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
W20260709 13:10:05.819872 29082 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.441s	user 0.023s	sys 0.009s
I20260709 13:10:05.835896 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:05.838048 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:05.825443 29383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.012s	sys 0.019s
I20260709 13:10:05.840133 22646 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:05.841830 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:05.838027 29082 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.024s	sys 0.009s
I20260709 13:10:05.841941 22646 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:05.839454 29377 raft_consensus.cc:697] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:05.839257 29221 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:05.838054 22650 raft_consensus.cc:1240] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:05.888087 22646 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:05.834324 29433 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:10:05.891490 22577 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:05.892264 22576 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260709 13:10:05.892901 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:05.905361 22579 raft_consensus.cc:2410] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:10:05.884227 29221 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:05.004954 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.909695 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.915729 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:05.920329 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 95521.8us
I20260709 13:10:05.921028 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.924968 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.925868 22577 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:05.921738 29363 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:05.903802 29526 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:05.932936 29377 consensus_queue.cc:237] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.934728 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:05.934425 29526 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:05.921590 29083 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:05.938304 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.922796 29500 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:05.939952 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:05.930075 29525 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:05.926535 29382 consensus_queue.cc:1048] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:10:05.945904 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.955330 22576 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 20. Ops: []
I20260709 13:10:05.955214 22577 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
W20260709 13:10:05.956401 22652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.010s	sys 0.011s
W20260709 13:10:05.962252 22652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.010s	sys 0.011s
I20260709 13:10:05.944494 29525 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.966744 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.945495 29500 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:05.968849 22573 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:05.957190 29083 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:05.976169 29522 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:10:05.981778 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3322) took 1329 ms. Trace:
I20260709 13:10:05.982275 22651 rpcz_store.cc:276] 0709 13:10:04.652147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.300763 (+648616us) service_pool.cc:224] Handling call
0709 13:10:05.335996 (+ 35233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.419293 (+ 83297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.419324 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.419780 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.835828 (+416048us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:05.835863 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.835932 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.981527 (+145595us) raft_consensus.cc:1685] finished
0709 13:10:05.981550 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.981716 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82805,"thread_start_us":283588,"threads_started":1,"wal-append.queue_time_us":447057}
I20260709 13:10:05.985306 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:05.979003 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.987640 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.960142 29534 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:05.990655 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1348) took 2262 ms. Trace:
I20260709 13:10:05.969506 29525 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:05.991285 22652 rpcz_store.cc:276] 0709 13:10:03.725489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.727520 (+  2031us) service_pool.cc:224] Handling call
0709 13:10:03.727888 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.728329 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:10:04.519860 (+791531us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.963188 (+1443328us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.963744 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.963900 (+   156us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:05.963933 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.964008 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.987816 (+ 23808us) raft_consensus.cc:1685] finished
0709 13:10:05.987833 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.987945 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339449,"prepare.queue_time_us":634090,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":133628,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":6405,"thread_start_us":1817288,"threads_started":3,"wal-append.queue_time_us":744619}
I20260709 13:10:05.992626 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:05.993368 29500 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.998847 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:05.994377 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:05.995796 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.000838 22571 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:06.011655 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.022207 29237 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:06.023057 22571 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:10:06.023247 29237 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:06.024749 29237 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.031276 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1359) took 2222 ms. Trace:
I20260709 13:10:06.031910 22654 rpcz_store.cc:276] 0709 13:10:03.809270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.367472 (+558202us) service_pool.cc:224] Handling call
0709 13:10:04.367785 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.563591 (+195806us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:04.610448 (+ 46857us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.472808 (+862360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.472887 (+    79us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:05.472958 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.030971 (+558013us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400412154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:06.031020 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.031204 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50636,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":62,"raft.queue_time_us":88125,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":34945,"spinlock_wait_cycles":449598720,"thread_start_us":861883,"threads_started":2,"wal-append.queue_time_us":671836}
I20260709 13:10:06.038792 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:06.042009 29528 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:05.971987 29180 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:10:06.044490 29259 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:05.966316 29221 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.006349 29534 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:06.066895 29472 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.774s	user 0.004s	sys 0.003s
I20260709 13:10:06.068250 29083 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.069661 29370 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:06.070252 29370 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.071000 29534 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.073195 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3886) took 2850 ms. Trace:
I20260709 13:10:05.974071 29363 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.073570 22574 rpcz_store.cc:276] 0709 13:10:03.223470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.227007 (+  3537us) service_pool.cc:224] Handling call
0709 13:10:03.235049 (+  8042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.253342 (+ 18293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.253375 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.255191 (+  1816us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.765897 (+510706us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b1800403f00. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:10:04.008430 (+242533us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:04.029083 (+ 20653us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.401646 (+372563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.401736 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.271527 (+869791us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b1800403f00. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:06.066272 (+794745us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:06.072951 (+  6679us) raft_consensus.cc:1685] finished
0709 13:10:06.072972 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.073111 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40159,"prepare.queue_time_us":20463,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":57187,"raft.run_cpu_time_us":583,"raft.run_wall_time_us":24883,"spinlock_wait_cycles":40455552,"thread_start_us":592127,"threads_started":2,"wal-append.queue_time_us":831283}
I20260709 13:10:06.072516 29370 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.082141 29263 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.083693 29144 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.083993 29475 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.039988 22571 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
W20260709 13:10:06.091192 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 144036us
I20260709 13:10:06.084559 29144 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:05.987092 29526 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.096192 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.098680 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:06.099274 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:06.095033 29475 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.113988 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:06.098641 29221 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.119469 29484 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:06.122578 29484 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.125500 29484 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.113065 29500 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:10:06.122838 29382 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:06.116526 29431 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:10:06.127772 29382 consensus_queue.cc:1243] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:06.114123 29530 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:10:06.104698 29529 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:06.132385 29536 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:06.136488 29536 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.137069 29180 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:06.137475 29539 consensus_queue.cc:1059] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:06.133873 22654 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:10:06.135635 29500 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.138998 29536 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.141731 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.142547 23259 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:10:06.143507 29111 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.144085 29540 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:06.144516 29540 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:06.145361 29540 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.140688 29500 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:06.146723 29540 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:06.154817 29367 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:10:06.156379 29500 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.157706 29500 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.158581 29315 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.159965 29111 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:06.160382 29111 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:06.173280 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 606454us
I20260709 13:10:06.174911 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:06.161023 29529 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:10:06.175709 29462 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.174666 29111 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:06.191006 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 474905us
I20260709 13:10:06.197463 29517 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.201236 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.201563 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3324) took 1188 ms. Trace:
I20260709 13:10:06.202109 22646 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:10:06.209673 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.210714 22646 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:06.204892 29462 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.202144 22653 rpcz_store.cc:276] 0709 13:10:05.012724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.472064 (+459340us) service_pool.cc:224] Handling call
0709 13:10:05.472449 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.472693 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:05.519867 (+ 47174us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.201079 (+681212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.201158 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:06.201234 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.201339 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.201489 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396189,"prepare.queue_time_us":47005,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":274940,"threads_started":1,"wal-append.queue_time_us":440432}
I20260709 13:10:06.222368 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.229490 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:06.230329 22651 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:06.233995 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.216068 29082 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.260658 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.248461 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.261866 22653 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:06.244714 29111 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.300235 22651 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:06.279349 29536 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:06.293785 29493 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.211s	user 0.000s	sys 0.008s
W20260709 13:10:06.308455 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 485073us
I20260709 13:10:06.282472 29462 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:06.294060 29259 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.307089 29545 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:10:06.315970 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 141146us
I20260709 13:10:06.316915 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:06.273195 29082 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.320278 29293 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:06.320816 29293 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.321344 29293 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:06.323973 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.326681 29496 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:06.329344 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1350) took 2603 ms. Trace:
I20260709 13:10:06.313290 29130 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:06.377032 29130 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.377490 29130 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.379097 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.379765 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.340202 29406 raft_consensus.cc:3055] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:06.341538 29339 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:06.349485 29373 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.353210 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.356074 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.385955 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.386325 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.386766 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:06.357407 29544 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:10:06.359463 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:06.361653 29549 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:06.330001 29435 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:06.369630 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3307) took 2513 ms. Trace:
W20260709 13:10:06.370106 29547 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:10:06.361912 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.397058 29435 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.376406 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.387367 22652 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:06.411445 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.383337 29406 raft_consensus.cc:740] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:06.388005 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.388245 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.322575 29259 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.417634 29259 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:06.391139 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.405828 22578 raft_consensus.cc:2393] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 24: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:06.375900 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.398062 22648 rpcz_store.cc:276] 0709 13:10:03.856716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.759302 (+902586us) service_pool.cc:224] Handling call
0709 13:10:04.866702 (+107400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:04.867189 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.867229 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:04.867968 (+   739us) log.cc:844] Serialized 52 byte log entry
0709 13:10:05.272528 (+404560us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:05.296055 (+ 23527us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.296251 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.296323 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.365728 (+1069405us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b1800409e40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:06.369266 (+  3538us) raft_consensus.cc:1685] finished
0709 13:10:06.369371 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.369540 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110669,"prepare.queue_time_us":23287,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":894474,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":2889,"spinlock_wait_cycles":213019904,"thread_start_us":302370,"threads_started":1,"wal-append.queue_time_us":346828}
I20260709 13:10:06.412101 22652 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:10:06.422811 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.423046 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:06.397895 29498 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:06.387915 29373 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:06.433724 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.435518 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:06.393610 29339 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:06.449728 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.450019 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.464643 22648 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:06.467162 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.466843 29339 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.468303 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.436935 28908 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:06.468946 22646 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:06.469065 28908 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.469461 28908 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:06.469874 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:06.466890 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.473496 23257 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:06.473850 22648 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:06.473881 23257 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:06.474833 23260 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:06.474926 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:06.475368 23260 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:06.425488 22647 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:06.473726 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1080) took 1550 ms. Trace:
I20260709 13:10:06.451190 29082 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.451556 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:06.452021 22652 raft_consensus.cc:2410] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 20 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:10:06.476332 23255 rpcz_store.cc:276] 0709 13:10:04.923109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.923290 (+   181us) service_pool.cc:224] Handling call
0709 13:10:04.923600 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.499141 (+575541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.473505 (+974364us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b540087c654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:06.473669 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124225792}
I20260709 13:10:06.453506 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.453714 29373 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.454309 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.485857 23259 raft_consensus.cc:2368] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:10:06.455054 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.456168 29525 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.449757 29406 consensus_queue.cc:260] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.487303 23263 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:06.459810 29144 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.453507 29536 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.467374 22579 raft_consensus.cc:1240] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 19. Ops: []
I20260709 13:10:06.427284 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:06.476765 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.475732 22648 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:06.475021 23257 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.494194 23257 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.489848 22646 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
W20260709 13:10:06.491074 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 63899.8us
I20260709 13:10:06.495679 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.480644 23260 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.497355 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:06.496614 22647 raft_consensus.cc:2393] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:06.498657 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:06.499765 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.500128 22646 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.502147 23260 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:06.502163 23262 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:10:06.503419 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.506083 29130 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.510582 23261 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:10:06.491992 29082 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:06.519413 29525 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.520419 29237 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:06.532509 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.542414 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1434) took 1467 ms. Trace:
I20260709 13:10:06.542850 22499 rpcz_store.cc:276] 0709 13:10:05.075021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.075141 (+   120us) service_pool.cc:224] Handling call
0709 13:10:05.075435 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.075685 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:10:05.369224 (+293539us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.790858 (+421634us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.018325 (+227467us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003c4fc0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:06.541941 (+523616us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b18003c4fc0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:10:06.542072 (+   131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.542119 (+    47us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:06.542169 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.542246 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.542361 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27747,"prepare.queue_time_us":466090,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":120,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":39756928,"thread_start_us":674739,"threads_started":2,"wal-append.queue_time_us":574675}
I20260709 13:10:06.543926 28908 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.546224 29476 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.546654 29482 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.562095 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:06.562687 22497 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.562443 29482 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.564496 29482 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:06.547122 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.565137 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.566313 29475 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:06.566774 29563 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:10:06.566834 29475 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.548298 29392 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:06.550992 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:06.570590 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.555560 23257 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:06.557132 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:06.575464 29474 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.578889 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.578495 29474 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.581485 29482 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.582149 29482 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.583325 29474 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.583909 29474 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:06.584122 29482 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.579738 29392 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.562009 29476 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:06.586560 29516 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:10:06.586755 29392 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.587391 29474 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:06.587996 29474 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.589730 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.590395 29474 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.591714 29482 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.592139 29482 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:06.593860 29476 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.607298 23260 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:10:06.595072 23261 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:06.599828 29435 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.538507 29293 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.601464 22651 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:06.581032 29475 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.619360 22497 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
W20260709 13:10:06.608847 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 117670us
I20260709 13:10:06.608125 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:10:06.614208 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.618965 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:06.593042 29482 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.622659 22646 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:10:06.629169 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:06.626921 29392 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:06.632915 29475 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.671005 29475 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.674069 29392 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.676371 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:06.658267 22651 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.660190 29373 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:06.664851 29565 log.cc:927] Time spent T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:10:06.669975 29130 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:06.627907 29435 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.828274 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.757625 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:06.789201 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.828059 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:10:06.841655 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.841747 22648 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:10:06.827054 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.841177 23257 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:06.842919 22577 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.845052 22648 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:06.897261 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.329766 22645 rpcz_store.cc:276] 0709 13:10:03.726269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.730336 (+  4067us) service_pool.cc:224] Handling call
0709 13:10:03.730660 (+   324us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:03.731139 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:04.498287 (+767148us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.558332 (+1060045us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:06.129163 (+570831us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b2c0013e058. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:10:06.129873 (+   710us) log.cc:844] Serialized 78 byte log entry
0709 13:10:06.130051 (+   178us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:06.277278 (+147227us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.316102 (+ 38824us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.328936 (+ 12834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.329087 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.329134 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:06.329144 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.329280 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418114,"prepare.queue_time_us":755275,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":145,"raft.queue_time_us":108842,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":5919,"spinlock_wait_cycles":199104896,"thread_start_us":1473870,"threads_started":4,"wal-append.queue_time_us":738736}
I20260709 13:10:06.880999 22650 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:06.846889 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3306) took 2994 ms. Trace:
W20260709 13:10:06.900836 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.884325 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.802479 22654 pending_rounds.cc:85] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 9
I20260709 13:10:06.904889 23263 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:06.905402 22654 pending_rounds.cc:107] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:10:06.905799 22654 raft_consensus.cc:2889] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.703205 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1428) took 1670 ms. Trace:
I20260709 13:10:06.881700 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.838939 22651 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:06.913226 22469 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:06.835948 22646 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:10:06.880849 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 54338us
I20260709 13:10:06.881603 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:10:06.765771 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 209884us
I20260709 13:10:06.849058 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.920028 22579 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:06.651428 29476 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.906636 22500 rpcz_store.cc:276] 0709 13:10:05.032980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.037482 (+  4502us) service_pool.cc:224] Handling call
0709 13:10:05.053383 (+ 15901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.053599 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:05.521497 (+467898us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.702814 (+1181317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.702870 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:06.702929 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.702999 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.703138 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664240,"prepare.queue_time_us":479501,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":665965,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":943005,"threads_started":3,"wal-append.queue_time_us":530617}
I20260709 13:10:06.907689 22649 rpcz_store.cc:276] 0709 13:10:03.852444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.746427 (+893983us) service_pool.cc:224] Handling call
0709 13:10:04.746848 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.747142 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:04.793505 (+ 46363us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.189842 (+396337us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.166468 (+976626us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b18002bf9c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec2a1cf58f 00007fec2320e571 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd
0709 13:10:06.633497 (+467029us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b18002bf9c0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:10:06.846530 (+213033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.846581 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:06.846631 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.846696 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.846833 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":723615,"prepare.queue_time_us":130558,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":94,"raft.queue_time_us":346989,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":116035,"spinlock_wait_cycles":53937920,"thread_start_us":519890,"threads_started":2,"wal-append.queue_time_us":535103,"wal-append.run_cpu_time_us":1712,"wal-append.run_wall_time_us":1001689}
I20260709 13:10:06.924770 22398 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 11 to 17, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 17 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:06.933667 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52147.9us
I20260709 13:10:06.934602 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:06.935803 29144 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:06.937115 29536 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.937207 29083 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:06.936491 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:06.937781 29536 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.939495 29084 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:06.940781 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:06.941908 29370 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:06.942304 29370 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.942655 29370 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.937800 29083 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.946066 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:06.952281 22649 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.677359 29475 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.687911 29392 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.849246 29482 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.946748 29406 raft_consensus.cc:3060] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:06.966351 22649 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:06.879676 29386 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:06.765277 29275 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:06.993412 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.955543 29518 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.801852 29481 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:06.970371 22650 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:06.966424 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:06.972467 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.976075 23263 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:07.018718 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52397.9us
I20260709 13:10:06.945528 29083 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:06.976823 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.978289 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.963712 23257 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:06.984505 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.986318 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:06.977407 28908 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:06.936539 29144 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:06.954560 29558 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:07.031955 29558 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:07.034327 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.034441 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:06.983196 29392 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.989667 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.995268 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.714007 29474 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.997028 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:06.961406 29525 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
I20260709 13:10:06.977552 29315 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:10:06.954820 29476 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:06.920614 29160 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:10:06.998489 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.999432 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:06.980808 29082 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.990936 29536 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:06.977422 29523 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.982672 29475 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.971397 29571 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.888782 29435 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.027534 29481 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:06.996968 29339 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:06.955122 29529 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:10:07.039003 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.009991 29373 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:07.048399 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.048485 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:07.178030 22650 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
I20260709 13:10:06.992621 22577 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:07.055584 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:07.055931 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:07.180200 22652 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:07.026130 29500 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:07.040763 29144 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:07.184068 29569 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.087s	user 0.013s	sys 0.009s
I20260709 13:10:07.130669 29339 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.188380 29339 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:07.189239 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:07.189893 22501 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:07.079833 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:07.011396 29275 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.023845 29518 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.067324 29575 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.072089 29237 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.027437 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:07.042495 29540 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:07.094306 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.205348 29476 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.205514 22496 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:07.205960 29476 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.206621 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:07.207232 22496 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.190004 29373 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.208287 29373 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.080034 29082 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.210670 29082 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:07.086405 29523 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.212913 29523 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:07.216009 29518 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:07.217566 29575 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.219715 22651 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:07.117309 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.221496 22499 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:10:07.221832 22500 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:07.091917 29571 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.222886 22501 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:07.089064 29475 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.053331 29474 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.174597 22572 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:10:07.175865 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:07.239075 22503 raft_consensus.cc:2368] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:10:07.049283 29392 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:06.988559 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.180279 22653 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:07.183919 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.174553 29572 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:07.184751 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:07.033165 29558 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.192719 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.201691 29275 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.203652 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.206431 29476 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.083339 29570 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:07.259083 22576 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:10:07.237542 22652 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:07.243687 22505 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:07.253027 22496 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:10:07.265395 29482 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.261672 29572 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.266052 29482 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.268409 29572 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.270222 29571 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.270536 29083 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.271638 22573 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:07.274183 29083 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:07.276134 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 437804us
I20260709 13:10:07.277041 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:07.277431 29571 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.268625 29482 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.285303 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.287101 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.272567 29293 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.272608 29570 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:07.197765 29370 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.300279 29475 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.292421 29518 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:07.304742 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:07.290889 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.288249 29144 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.289438 29386 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:10:07.300043 29267 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:07.310702 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.289837 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:07.321738 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 408917us
I20260709 13:10:07.324370 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:07.331038 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.332183 22579 raft_consensus.cc:2410] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
W20260709 13:10:07.334575 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 44813.9us
I20260709 13:10:07.335773 22618 leader_election.cc:400] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:10:07.337220 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:07.338364 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:07.320618 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 286249us
I20260709 13:10:07.339181 23263 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 12.
I20260709 13:10:07.337445 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:07.347570 22469 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:07.339964 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:07.341049 22619 leader_election.cc:400] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:10:07.340050 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:07.353427 22574 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:07.355283 22619 leader_election.cc:403] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.356009 23255 raft_consensus.cc:2410] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:07.294404 29571 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.357461 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:07.362268 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:07.363731 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:07.373402 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:07.352773 29293 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:07.328097 29267 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:07.340736 29523 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:07.381979 22653 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:07.382513 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:07.382567 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:07.384891 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:07.393299 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:07.365247 29367 raft_consensus.cc:2764] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:10:07.336122 29481 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.400472 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:07.409269 23257 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:07.353622 29082 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:07.415473 29082 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:07.415937 29082 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.419055 29395 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:07.419867 29130 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:07.420323 29130 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:07.420707 29130 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.411677 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.422015 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.422525 29392 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.422665 22499 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:07.423624 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.365458 29575 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.424201 22499 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:07.370430 29432 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:07.378376 29131 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:07.369776 29518 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:07.364686 29475 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:07.428086 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.442421 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.443270 22499 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:10:07.394721 29137 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:07.412496 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 449421us
I20260709 13:10:07.375243 29513 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:07.375288 29339 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18.
I20260709 13:10:07.429572 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:07.392215 29293 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.449218 23257 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:07.450935 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:07.360244 29275 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:10:07.448385 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48047.8us
I20260709 13:10:07.461843 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:07.456012 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:07.434399 29131 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.483481 22574 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:07.469856 23255 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:07.470224 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.484620 22504 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:07.485831 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.486588 22504 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:07.453646 29378 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:07.488806 29378 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.489059 29083 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:07.491317 29378 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.452119 29475 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.492113 29475 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.492887 22545 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:07.496389 29365 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.497272 29160 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:07.473766 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44293.2us
I20260709 13:10:07.498502 29571 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.498708 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:07.499408 29131 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:07.467288 29518 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:07.502063 29518 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.483978 29267 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.504829 29267 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.506510 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:07.444484 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:07.507879 23258 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:10:07.423621 29476 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.422048 29144 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.481791 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:07.497721 29160 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:07.469009 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:07.479523 29293 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.525115 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:07.508059 22499 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:07.513437 29570 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:07.513859 29511 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:07.515003 29523 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:07.508718 29137 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:07.516299 29367 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:07.471679 29413 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:07.471522 29548 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:07.520905 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.481261 29406 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:07.511152 23259 raft_consensus.cc:2468] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:07.514901 29373 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.522596 29160 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.519837 29474 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.590644 29373 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:07.521733 29365 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:07.605721 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:07.608079 22645 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:07.610359 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:07.614713 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:07.576923 29443 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:07.593719 22504 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:07.618758 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:07.619629 22504 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:07.628913 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.644033 22648 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:07.517920 29082 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.645475 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:07.537245 29523 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:07.509689 29315 consensus_queue.cc:1175] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" responder_term: 19 status { last_received { term: 19 index: 14 } last_committed_idx: 13 last_received_current_leader { term: 19 index: 14 } }
I20260709 13:10:07.598841 22499 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:07.658727 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:07.532848 29137 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:07.564838 29570 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.681905 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.696055 22499 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:10:07.688654 22504 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:07.526259 29378 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:10:07.709439 22545 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:07.542163 28908 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 13:10:07.571445 29144 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:10:07.717723 22499 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.660457 29523 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:07.719753 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:07.731887 22504 raft_consensus.cc:2410] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:10:07.706892 22645 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:07.673861 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:07.678161 29373 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:07.679150 29072 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.739319 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 887) took 1230 ms. Trace:
I20260709 13:10:07.698207 29137 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:07.749406 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75649.3us
I20260709 13:10:07.745718 23259 rpcz_store.cc:276] 0709 13:10:06.487792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.488008 (+   216us) service_pool.cc:224] Handling call
0709 13:10:07.717976 (+1229968us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400680954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:07.718125 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219841792}
I20260709 13:10:07.675153 29474 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:07.677489 29406 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:07.691339 29443 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:07.710646 29370 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:07.763875 29443 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.765270 29581 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:07.765904 29581 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:07.766379 29584 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:07.766803 29581 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.768342 29581 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:07.657141 29365 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:07.765398 29580 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:10:07.744123 22504 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:07.717738 29481 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:07.754841 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:07.799926 22499 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:10:07.838095 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83322us
I20260709 13:10:07.840696 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:07.768460 29406 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.851723 22499 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:07.747622 29579 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:07.803407 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.715365 29570 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.852438 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:07.875015 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:07.862596 22499 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:07.877744 22499 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:07.877120 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:07.841269 29378 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.878970 22499 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.774178 29511 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:07.833348 29575 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.773906 29072 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.850683 29474 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:07.915505 22499 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.906689 29392 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:07.920842 29395 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:07.931638 29392 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.866750 29571 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:07.749060 29373 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.919492 29370 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:10:07.934772 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.909603 29481 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:07.956374 22499 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:10:07.956849 22499 pending_rounds.cc:85] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 8
I20260709 13:10:07.957278 22499 pending_rounds.cc:107] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:10:07.957708 22499 raft_consensus.cc:2889] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.959846 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3339) took 1308 ms. Trace:
I20260709 13:10:07.924592 29084 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:07.960386 22647 rpcz_store.cc:276] 0709 13:10:06.651650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.653068 (+  1418us) service_pool.cc:224] Handling call
0709 13:10:06.653485 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.839707 (+186222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.839740 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.840393 (+   653us) log.cc:844] Serialized 52 byte log entry
0709 13:10:07.197268 (+356875us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:07.197319 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.197386 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:07.959601 (+762215us) raft_consensus.cc:1685] finished
0709 13:10:07.959631 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.959789 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218457,"raft.queue_time_us":185767,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":61853,"thread_start_us":236714,"threads_started":1,"wal-append.queue_time_us":559129}
I20260709 13:10:07.931133 29476 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:07.932070 29392 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:07.920379 29588 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:07.922991 29529 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.929610 29474 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:07.943405 29571 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:07.922789 29144 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:10:07.920053 29378 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.980130 29395 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:07.977777 29474 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:07.929337 29575 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:07.973470 22499 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:08.016673 23229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.008s	sys 0.029s
W20260709 13:10:08.019181 23229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.008s	sys 0.029s
W20260709 13:10:08.019550 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 612086us
I20260709 13:10:07.968555 29476 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:07.926270 29511 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:08.026124 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.025s	sys 0.019s
W20260709 13:10:08.026628 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.025s	sys 0.019s
I20260709 13:10:08.027693 22499 raft_consensus.cc:1275] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:07.998198 29592 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:07.975015 29588 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:08.032725 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.035055 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:07.993142 29571 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:08.037514 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:08.037763 22572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.002s	sys 0.021s
I20260709 13:10:07.991842 29072 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:08.040661 22572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.002s	sys 0.021s
I20260709 13:10:07.989969 29373 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:08.044536 23261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.016s	sys 0.034s
I20260709 13:10:08.019464 29082 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:08.033792 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 540826us
W20260709 13:10:08.046277 23261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.016s	sys 0.034s
W20260709 13:10:08.049664 22543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.013s
W20260709 13:10:08.052163 22543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.008s	sys 0.013s
I20260709 13:10:08.031299 29476 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:08.037439 29558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.022s
W20260709 13:10:08.041920 29083 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.016s	sys 0.014s
I20260709 13:10:07.984831 29293 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:08.061014 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.062150 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.005s	sys 0.024s
W20260709 13:10:08.065079 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.024s
W20260709 13:10:08.050328 29131 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.002s
I20260709 13:10:08.066296 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:08.069355 22647 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:08.061056 29558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.001s	sys 0.022s
I20260709 13:10:08.037317 29588 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:07.978706 29529 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.071653 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:08.067437 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 568808us
I20260709 13:10:08.073827 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:08.075471 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:08.078624 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:08.079422 22645 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:08.064589 29083 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.017s	sys 0.015s
I20260709 13:10:08.080556 22651 raft_consensus.cc:2368] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20.
I20260709 13:10:08.067569 29082 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:08.081137 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:08.092808 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:10:08.087658 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.067289 29572 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:08.096437 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:08.101016 29597 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:08.106225 22544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.017s
I20260709 13:10:08.106884 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:08.116780 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:08.115402 22653 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.008s	sys 0.017s
I20260709 13:10:08.101497 22647 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
W20260709 13:10:08.101579 29130 consensus_meta.cc:287] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.003s
I20260709 13:10:08.103180 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:08.076376 29367 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:08.038930 29481 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.124111 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:08.124831 23257 raft_consensus.cc:2376] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24. Re-sending same reply.
I20260709 13:10:08.117776 22496 raft_consensus.cc:2376] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12. Re-sending same reply.
I20260709 13:10:08.119726 23264 raft_consensus.cc:2410] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:10:08.076537 29131 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:08.121538 22544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.006s	sys 0.019s
I20260709 13:10:08.122999 23229 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:08.122999 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:08.125869 23256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.013s	sys 0.018s
W20260709 13:10:08.134960 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 609856us
W20260709 13:10:08.135598 23256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.018s
W20260709 13:10:08.104725 29475 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.002s
I20260709 13:10:08.138350 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:08.143241 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.145627 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:08.145104 22505 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:08.095084 29365 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.104918 29570 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.146991 22496 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:10:08.124325 29082 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:08.156210 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.170408 22505 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:08.134985 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.019s	sys 0.015s
I20260709 13:10:08.178241 23263 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: []
W20260709 13:10:08.179735 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.019s	sys 0.015s
W20260709 13:10:08.180085 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 701434us
I20260709 13:10:08.180992 29585 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:08.184266 29585 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:08.191980 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:08.192842 22649 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
W20260709 13:10:08.212263 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 291720us
W20260709 13:10:08.215533 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.141666 29586 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.228144 22497 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:08.120024 29572 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:08.225850 29593 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:10:08.125294 29130 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:08.229390 29594 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:10:08.225358 29536 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.146534 29475 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.132113 29367 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.272019 29378 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:08.345796 29595 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:10:08.393784 22499 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:08.267488 29596 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
W20260709 13:10:08.369978 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 492899us
I20260709 13:10:08.411653 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:08.413407 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.414989 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.300057 29575 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.228467 29598 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:08.400610 22498 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:10:08.378823 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 104752us
I20260709 13:10:08.422295 22498 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:08.373888 29072 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.451344 22646 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:10:08.450114 29137 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.000s
I20260709 13:10:08.459610 22498 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.482417 22498 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:08.485947 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:08.491832 22648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.007s	sys 0.017s
W20260709 13:10:08.492909 22648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.008s	sys 0.018s
W20260709 13:10:08.503690 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 405584us
I20260709 13:10:08.506058 29144 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:10:08.508503 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.510362 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 366707us
W20260709 13:10:08.511658 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 96767.9us
I20260709 13:10:08.515727 22618 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:08.517019 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 282332us
I20260709 13:10:08.524950 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:08.526232 29367 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.452803 29511 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.508284 22543 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:08.440023 29575 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:08.395051 29536 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:08.534034 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.544912 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3379) took 1356 ms. Trace:
I20260709 13:10:08.546247 22502 rpcz_store.cc:276] 0709 13:10:07.188691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.256767 (+ 68076us) service_pool.cc:224] Handling call
0709 13:10:07.273353 (+ 16586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.282319 (+  8966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.282355 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.282817 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.671533 (+388716us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:07.671605 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.671713 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.544577 (+872864us) raft_consensus.cc:1685] finished
0709 13:10:08.544604 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.544806 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3815,"raft.queue_time_us":22566,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5736,"thread_start_us":388292,"threads_started":1,"wal-append.queue_time_us":646315}
I20260709 13:10:08.474805 29293 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.483417 29599 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:08.556959 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71093.9us
I20260709 13:10:08.475515 29137 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.450994 29598 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.565439 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:08.459052 29072 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.473942 29607 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:10:08.464296 29571 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.622969 29293 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:08.622869 29599 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:08.624308 29293 raft_consensus.cc:2804] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:08.624698 22498 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:10:08.624922 29293 raft_consensus.cc:697] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:08.626592 29293 consensus_queue.cc:237] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.627974 29599 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.560230 29378 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:08.644964 22572 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:10:08.623513 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61285.1us
I20260709 13:10:08.625097 22498 pending_rounds.cc:85] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 10
I20260709 13:10:08.652240 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:08.613816 29475 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.637720 29082 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:08.538420 29606 consensus_queue.cc:1059] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:10:08.548811 29575 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.557132 29548 consensus_queue.cc:1048] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:10:08.671708 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:08.649382 22498 pending_rounds.cc:107] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 20.11
W20260709 13:10:08.638656 29160 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.057s	user 0.012s	sys 0.000s
I20260709 13:10:08.577163 29529 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.672334 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:08.677623 22498 raft_consensus.cc:2889] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:08.678298 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 162641us
I20260709 13:10:08.682327 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3356) took 1033 ms. Trace:
W20260709 13:10:08.655097 29610 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:10:08.682914 22648 rpcz_store.cc:276] 0709 13:10:07.648578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.648747 (+   169us) service_pool.cc:224] Handling call
0709 13:10:07.659704 (+ 10957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.660013 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:08.493570 (+833557us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.681821 (+188251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.681900 (+    79us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:08.681979 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.682073 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.682231 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16428,"prepare.queue_time_us":884602,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"thread_start_us":969548,"threads_started":2}
I20260709 13:10:08.680056 22580 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:10:08.686707 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.624644 29511 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.654601 29131 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:08.735989 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.734203 29267 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.229s	user 0.009s	sys 0.005s
I20260709 13:10:08.739180 29082 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.740366 29582 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:08.740831 29582 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:08.680368 29475 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.743432 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3354) took 1124 ms. Trace:
I20260709 13:10:08.691633 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.678078 29615 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:10:08.749949 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 58486us
I20260709 13:10:08.748569 22650 rpcz_store.cc:276] 0709 13:10:07.618982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.619676 (+   694us) service_pool.cc:224] Handling call
0709 13:10:07.620391 (+   715us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:07.620990 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:07.621031 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.653395 (+ 32364us) log.cc:844] Serialized 52 byte log entry
0709 13:10:08.125574 (+472179us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:08.125629 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.125702 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.743139 (+617437us) raft_consensus.cc:1685] finished
0709 13:10:08.743163 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.743359 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":28140,"thread_start_us":383864,"threads_started":1,"wal-append.queue_time_us":830580}
W20260709 13:10:08.753412 29634 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:08.685003 29160 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.747190 29130 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.748512 29511 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.753100 29443 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.766261 29619 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:08.771868 29378 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:08.791493 29601 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 13:10:08.817453 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 302625us
I20260709 13:10:08.770324 29630 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:08.787503 29644 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:08.814793 29597 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.004s
W20260709 13:10:08.817297 29642 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 13:10:08.840829 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.847648 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:08.812942 29443 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.857224 29511 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.853413 29605 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.858253 29639 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:10:08.861377 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1083) took 1417 ms. Trace:
I20260709 13:10:08.861832 23256 rpcz_store.cc:276] 0709 13:10:07.444327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.463656 (+ 19329us) service_pool.cc:224] Handling call
0709 13:10:07.464156 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.464590 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.464614 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.472290 (+  7676us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.514183 (+ 41893us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b48000cd158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:10:08.136233 (+622050us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:08.136302 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.136517 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.861061 (+724544us) raft_consensus.cc:1685] finished
0709 13:10:08.861086 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.861314 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13523,"raft.queue_time_us":9867,"raft.run_cpu_time_us":2021,"raft.run_wall_time_us":36363,"spinlock_wait_cycles":37183232,"thread_start_us":663567,"threads_started":1,"wal-append.queue_time_us":977415}
W20260709 13:10:08.863714 29581 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.095s	user 0.009s	sys 0.004s
I20260709 13:10:08.864275 29581 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.865058 29378 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:08.865978 29588 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.003s
I20260709 13:10:08.866442 29588 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.867470 22497 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:08.845863 29536 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.847373 29597 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:08.868952 29599 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.850399 29636 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:08.870810 29616 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:10:08.872242 29474 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.843s	user 0.008s	sys 0.000s
I20260709 13:10:08.872332 29616 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:08.858304 29605 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.784539 29582 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.874155 29582 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:08.875077 29180 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:08.875454 29180 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:08.876041 29392 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.001s
I20260709 13:10:08.877516 29598 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.841640 29644 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:08.875488 29605 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:08.835043 29137 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.878492 29575 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.879676 29644 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:10:08.876572 29180 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.886238 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:08.887115 29072 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:08.896185 29435 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:08.899477 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:08.901352 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:08.903178 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:08.906234 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:08.906848 23256 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:08.888940 29523 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.134s	user 0.007s	sys 0.006s
I20260709 13:10:08.917318 29180 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:08.905167 29395 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:08.905433 29571 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:08.892406 29160 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:08.879984 29392 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.872756 29474 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:08.864740 29581 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:08.998432 29523 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.134804 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:08.907797 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 349838us
I20260709 13:10:09.044822 29588 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:09.089206 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.129572 29476 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.064s	user 0.013s	sys 0.015s
W20260709 13:10:09.090005 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.090315 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:09.091190 23256 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:10:09.091533 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:08.933318 23260 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:09.096179 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.096277 29653 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:09.096661 29435 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:09.097105 29636 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.098201 29084 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:09.098692 29293 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.100247 29481 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.102128 29082 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:09.114229 29629 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.288s	user 0.009s	sys 0.004s
I20260709 13:10:09.105676 29658 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:09.107191 29654 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:09.107403 29646 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:10:09.100572 22651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3355) took 1452 ms (client timeout 1821 ms). Trace:
W20260709 13:10:09.185058 22651 rpcz_store.cc:269] 0709 13:10:07.648145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.648376 (+   231us) service_pool.cc:224] Handling call
0709 13:10:09.100332 (+1451956us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54002f8854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:09.100502 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962911616}
I20260709 13:10:09.126011 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.186004 22580 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:09.126902 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:09.131899 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:09.089780 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.187677 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 60844.8us
I20260709 13:10:09.189761 29571 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:09.153950 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:09.190752 22579 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:09.155601 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.168094 22652 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:09.198709 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3358) took 1130 ms. Trace:
I20260709 13:10:09.199132 22654 rpcz_store.cc:276] 0709 13:10:08.068156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.068357 (+   201us) service_pool.cc:224] Handling call
0709 13:10:08.068735 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.069120 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.069146 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.085729 (+ 16583us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.451160 (+365431us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.451236 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.451320 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.198490 (+747170us) raft_consensus.cc:1685] finished
0709 13:10:09.198517 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.198650 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":351138,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":21285,"thread_start_us":356450,"threads_started":1,"wal-append.queue_time_us":828227}
I20260709 13:10:09.132674 29475 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:09.175973 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:09.168149 29084 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:09.178020 23255 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:09.178793 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.163527 22572 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:09.168764 29476 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.176813 29293 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.255218 29293 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.200518 29082 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.254377 29084 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.257017 29476 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:09.174039 29435 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.259151 29435 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.264160 29082 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.264381 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.265493 23255 raft_consensus.cc:2410] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:10:09.268029 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.268639 23256 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:09.269553 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.270186 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.270893 23264 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:09.273032 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:09.280391 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:09.286935 29180 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.287653 29180 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.290733 29180 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:09.113381 22398 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.351929 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:09.353986 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:09.355441 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:09.358466 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:09.103787 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.364820 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1458) took 1178 ms. Trace:
I20260709 13:10:09.365847 22469 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:09.366748 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1452) took 1318 ms. Trace:
I20260709 13:10:09.368338 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1459) took 1168 ms. Trace:
I20260709 13:10:09.368805 22497 rpcz_store.cc:276] 0709 13:10:08.200257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.685755 (+485498us) service_pool.cc:224] Handling call
0709 13:10:08.686428 (+   673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.867834 (+181406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.364567 (+496733us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54001a8454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.368109 (+  3542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415845760}
I20260709 13:10:09.367333 22496 rpcz_store.cc:276] 0709 13:10:08.048167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.174631 (+126464us) service_pool.cc:224] Handling call
0709 13:10:08.174959 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.175279 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.175302 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.175746 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.516083 (+340337us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:10:08.599533 (+ 83450us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.814435 (+214902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.814532 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.980845 (+166313us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:09.365902 (+385057us) raft_consensus.cc:1685] finished
0709 13:10:09.366094 (+   192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.366478 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7510,"prepare.queue_time_us":24803,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":5044,"raft.queue_time_us":150670,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":14292,"spinlock_wait_cycles":8068352,"thread_start_us":492507,"threads_started":2,"wal-append.queue_time_us":608304}
I20260709 13:10:09.377451 22505 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:10:09.378096 22505 pending_rounds.cc:85] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 12
I20260709 13:10:09.365638 22502 rpcz_store.cc:276] 0709 13:10:08.186298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.624522 (+438224us) service_pool.cc:224] Handling call
0709 13:10:08.624887 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.769473 (+144586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.770165 (+   692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.771635 (+  1470us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.152083 (+380448us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:09.152157 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.152333 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.363991 (+211658us) raft_consensus.cc:1685] finished
0709 13:10:09.364096 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.364521 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3513,"raft.queue_time_us":159913,"raft.run_cpu_time_us":464,"raft.run_wall_time_us":25797,"spinlock_wait_cycles":46976,"thread_start_us":419040,"threads_started":2,"wal-append.queue_time_us":452592}
I20260709 13:10:09.374181 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3376) took 2186 ms. Trace:
I20260709 13:10:09.383010 22503 rpcz_store.cc:276] 0709 13:10:07.187931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.239870 (+ 51939us) service_pool.cc:224] Handling call
0709 13:10:07.262045 (+ 22175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.284211 (+ 22166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.284256 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.284809 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.735898 (+451089us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:07.735940 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.373401 (+1637461us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b54000f8554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.373469 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.373582 (+   113us) raft_consensus.cc:1685] finished
0709 13:10:09.373596 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.373990 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26231,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":49974656,"thread_start_us":450619,"threads_started":1,"wal-append.queue_time_us":678299}
I20260709 13:10:09.378398 22505 pending_rounds.cc:107] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:10:09.386340 22505 raft_consensus.cc:2889] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.377204 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3399) took 2090 ms. Trace:
I20260709 13:10:09.387172 22499 rpcz_store.cc:276] 0709 13:10:07.287026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.029667 (+742641us) service_pool.cc:224] Handling call
0709 13:10:08.030062 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.394285 (+364223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.376635 (+982350us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540033e5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.377007 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835873664}
I20260709 13:10:09.375773 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3390) took 2101 ms. Trace:
I20260709 13:10:09.389153 22504 rpcz_store.cc:276] 0709 13:10:07.274218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.852287 (+578069us) service_pool.cc:224] Handling call
0709 13:10:07.852545 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.959793 (+107248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.959821 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:07.959864 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:07.959896 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.375262 (+1415366us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540042b3d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.375336 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.375602 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246249344}
I20260709 13:10:09.391085 22504 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:09.391145 22505 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:09.392328 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.381350 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:09.372439 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3373) took 2185 ms. Trace:
I20260709 13:10:09.237341 22579 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:09.397001 22499 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:09.228540 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69766.5us
I20260709 13:10:09.177074 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:09.237914 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62013.9us
I20260709 13:10:09.449054 29475 raft_consensus.cc:2764] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:10:09.454715 22544 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:09.456211 29671 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:09.457206 29476 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:09.395126 22398 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 8 to 11, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 11 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.231395 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.249359 29392 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:09.245513 29443 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.248597 29474 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:09.200323 29481 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.505190 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:09.507184 29481 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.507314 29443 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:09.508049 29443 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.508582 29443 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:09.136009 29500 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:09.246938 29523 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.511535 29500 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.514957 29500 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:09.516244 29620 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.764s	user 0.000s	sys 0.002s
I20260709 13:10:09.172683 29570 raft_consensus.cc:2764] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:10:09.250416 29581 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.176170 29636 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.238354 29632 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:09.523180 29583 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.750s	user 0.000s	sys 0.003s
I20260709 13:10:09.152222 29647 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:10:09.525077 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.525355 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.526175 22574 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
I20260709 13:10:09.527423 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.415494 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:09.530824 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 169975us
I20260709 13:10:09.528734 29636 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:09.531304 29474 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.418540 29607 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.534806 29518 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:09.535171 29607 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.420486 29582 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:09.537210 29582 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:09.539335 29339 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:09.539870 29339 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:09.537657 29582 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:09.442929 29588 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:09.443727 29571 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:09.542913 29571 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:09.542460 29582 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.543411 29571 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:09.544217 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.400835 22500 rpcz_store.cc:276] 0709 13:10:07.187152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.222643 (+ 35491us) service_pool.cc:224] Handling call
0709 13:10:07.254102 (+ 31459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.264726 (+ 10624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.264759 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.280240 (+ 15481us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.784885 (+504645us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:07.784949 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.371524 (+1586575us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54000f8f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.371636 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.371721 (+    85us) raft_consensus.cc:1685] finished
0709 13:10:09.371744 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.372226 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23853952,"thread_start_us":484794,"threads_started":1,"wal-append.queue_time_us":827940}
I20260709 13:10:09.544600 22651 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:09.476792 29649 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:09.485286 23260 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:09.546087 29649 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.486428 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:09.546628 29649 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:09.486693 29180 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.487298 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.531174 29435 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.548096 22496 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:10:09.548724 29435 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.549362 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.457206 29671 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:09.175486 29653 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:09.551802 29671 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.552151 29653 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.539665 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.426451 22504 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:09.563326 22504 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:09.545583 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.568723 22500 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:09.570485 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:09.550186 22496 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:10:09.553042 29293 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.573575 29647 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:09.490464 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.573871 29293 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.488600 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:09.531566 29523 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.576493 29628 raft_consensus.cc:3055] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:09.576707 29523 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.548048 29180 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.576807 29293 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.577045 29628 raft_consensus.cc:740] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:09.457995 29476 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:09.570609 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1079) took 2172 ms. Trace:
I20260709 13:10:09.584491 29628 consensus_queue.cc:260] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.585415 23263 rpcz_store.cc:276] 0709 13:10:07.397822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.397990 (+   168us) service_pool.cc:224] Handling call
0709 13:10:07.416360 (+ 18370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.179913 (+763553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.570055 (+1390142us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b5400837554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.570421 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751578880}
I20260709 13:10:09.586127 29628 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:09.586378 29476 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.582439 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.587807 29339 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.589898 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:09.556021 22654 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:09.591459 22496 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:09.556816 29131 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.580595 29523 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.593647 29607 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:09.594329 29572 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:09.595229 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.598685 22651 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:09.601267 29084 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:09.604804 22645 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:09.566260 29616 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:09.608150 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.609170 22645 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
W20260709 13:10:09.610579 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45568.4us
I20260709 13:10:09.611946 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1082) took 2173 ms. Trace:
I20260709 13:10:09.613370 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:09.591696 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3351) took 1979 ms. Trace:
I20260709 13:10:09.612489 23261 rpcz_store.cc:276] 0709 13:10:07.438227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.438376 (+   149us) service_pool.cc:224] Handling call
0709 13:10:07.473771 (+ 35395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.051903 (+578132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.051950 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.060506 (+  8556us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.516371 (+455865us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:08.516415 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.516493 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.515520 (+999027us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b240033ae08. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324d09d 00007fec25e7f10e 00007fec25e9688c 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221
0709 13:10:09.611401 (+ 95881us) raft_consensus.cc:1685] finished
0709 13:10:09.611423 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.611721 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29527,"raft.queue_time_us":34613,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4862,"spinlock_wait_cycles":7591296,"thread_start_us":1011688,"threads_started":2,"wal-append.queue_time_us":679949}
I20260709 13:10:09.615056 22398 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 9 to 11, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 11 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.572688 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:09.554543 29435 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.570605 22500 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 13:10:09.464972 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 99392.1us
I20260709 13:10:09.618022 22652 rpcz_store.cc:276] 0709 13:10:07.612338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.612963 (+   625us) service_pool.cc:224] Handling call
0709 13:10:07.613353 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.198296 (+1584943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.530436 (+332140us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400237b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.591495 (+ 61059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3575089408}
W20260709 13:10:09.622406 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49933.7us
I20260709 13:10:09.596771 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:09.544502 29582 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.638777 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:09.639851 29616 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:10:09.643672 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.643436 22398 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 14 to 17, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 17 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:09.644330 29616 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:09.644846 29616 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:09.645143 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.646492 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.646164 29616 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:09.643451 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.645282 22398 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 11 to 16, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 16 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:09.648073 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:09.584632 29180 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.659950 22496 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:09.592402 29131 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:09.693080 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.648711 29572 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:09.684811 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 88241.1us
I20260709 13:10:09.696635 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.692513 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.638722 29523 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.691815 22648 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:09.673058 22649 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:09.693517 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:09.695421 29616 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:09.721053 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 93520.1us
I20260709 13:10:09.743603 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:09.745265 29518 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:09.745818 29518 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.746264 29518 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:09.746417 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.749032 29548 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:10:09.752255 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:09.721127 29339 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.753822 29435 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:09.754400 29435 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:09.755841 29435 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.757522 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.757937 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:09.760988 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.761261 29082 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:09.761794 29082 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.762181 29082 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:09.721753 29632 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:09.765564 29632 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.728660 29413 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:10:09.699987 29607 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.723886 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:09.696079 22398 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 16 to 20, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.725287 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:09.724947 29605 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:09.773270 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.729117 22500 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:10:09.729707 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 59130.7us
W20260709 13:10:09.730801 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.731281 29131 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:09.691442 29370 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:10:09.783243 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.784760 29370 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:09.785323 29370 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:09.785472 29558 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.786254 29160 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.733153 29523 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.683822 29365 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:09.786186 29558 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.790326 29523 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.791242 29160 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.732466 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.794078 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.794813 22504 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:09.795747 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.796391 22504 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:09.786597 29370 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:09.774417 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81410.2us
I20260709 13:10:09.798864 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:09.799132 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.799823 22496 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:09.800753 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.801153 29644 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:09.802825 29644 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:09.774747 29395 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:09.773566 29607 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.803651 29558 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.784698 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:09.731917 29654 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:09.805786 29607 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.786183 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:09.806354 29607 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:09.806744 29607 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:09.807588 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:09.807734 29607 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.738286 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.768808 29632 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.782047 22398 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:09.736667 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.808604 29673 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:09.771641 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:09.810400 22653 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:09.841675 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:09.809882 22645 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:09.842878 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.842129 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:09.848945 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:09.801594 22496 raft_consensus.cc:2393] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:10:09.853125 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129558us
W20260709 13:10:09.859962 22543 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.821s (SENT) [suppressed 5 similar messages]
I20260709 13:10:09.856038 29649 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.862783 29632 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.863758 29632 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.865139 29082 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.866389 22646 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:09.867777 29082 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:09.868320 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.868835 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:09.869208 22645 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:09.870358 22650 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:09.873574 22574 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:09.876464 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:09.877261 29628 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:09.877627 29669 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:09.877807 29628 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.878376 29628 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:09.867143 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56017.2us
I20260709 13:10:09.881534 29649 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.882148 22619 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:09.883397 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:09.883509 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:09.884181 29395 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:09.885527 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:09.885907 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.886426 29395 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:09.887516 29131 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:09.868530 29082 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:09.887416 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 116054us
I20260709 13:10:09.886976 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:09.852607 22398 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.888002 29131 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:09.794092 29160 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.830070 29673 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:09.892133 29202 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:09.886976 29395 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:09.848748 29572 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:09.854084 29523 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.772826 29443 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:09.912644 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.865056 29607 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:09.922145 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.852519 29571 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:09.904554 29673 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:09.866408 29632 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:09.907521 29202 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.925740 22500 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:09.927171 22579 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:09.915360 29072 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:09.966292 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:09.959841 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44056.1us
I20260709 13:10:09.916030 29669 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:09.925338 29395 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:09.954109 29082 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:09.933100 29523 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:10.002897 22496 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.003507 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:09.970153 22571 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:09.969673 22398 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 12 to 15, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 15 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.970547 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:09.974557 23257 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:10:09.927824 29365 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:09.982723 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.007802 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:09.990607 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.938115 29370 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:09.962961 29202 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:09.908380 29605 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:10:10.014091 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:09.976123 29072 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.015005 22577 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.011775 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:09.962670 29632 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:10.043970 22398 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 11 to 15, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 15 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:10.046659 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:10.058090 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.055945 22652 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
W20260709 13:10:10.071805 22497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.006s	sys 0.020s
W20260709 13:10:10.072731 22497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.006s	sys 0.020s
I20260709 13:10:10.046463 29072 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:10.001677 29500 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:10:10.048931 29082 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:10.093164 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:10.094353 22572 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:10.094275 22398 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 10 to 19. New cstate: current_term: 19 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:10.097496 29671 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.098295 29671 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:10.105044 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 221739us
I20260709 13:10:10.106043 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:10.107259 22402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 317) took 45867 ms (client timeout 15000 ms). Trace:
W20260709 13:10:10.108789 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.109954 29367 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.110605 29367 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.111099 29523 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:10.121871 22499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.054s
W20260709 13:10:10.122268 22499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.000s	sys 0.054s
I20260709 13:10:10.127246 22500 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:10.096485 22398 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 10 to 17, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 17 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.072110 29632 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.057763 29131 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:10.207046 22654 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.007s	sys 0.022s
I20260709 13:10:10.088800 29558 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:10:10.210471 22398 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:10.242683 23263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.007s	sys 0.033s
W20260709 13:10:10.243796 23263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.008s	sys 0.033s
W20260709 13:10:10.215584 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.238965 22654 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.007s	sys 0.022s
W20260709 13:10:10.256193 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 396260us
I20260709 13:10:10.242420 22398 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 12 to 15, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 15 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:10.210894 29476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.010s	sys 0.019s
I20260709 13:10:10.127175 29082 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.206851 29367 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:10.240317 29671 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:10.295663 22398 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:10.289701 29518 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
W20260709 13:10:10.299043 23264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.014s
W20260709 13:10:10.312417 23264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.011s	sys 0.015s
I20260709 13:10:10.240387 29582 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:10.296540 29476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.010s	sys 0.020s
I20260709 13:10:10.310489 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:10.336490 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 449607us
I20260709 13:10:10.339507 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:10.321668 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:10.324435 29605 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:10.324275 29571 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:10.332659 29443 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:10.330681 29653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.034s	sys 0.044s
W20260709 13:10:10.393177 29315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.002s	sys 0.021s
W20260709 13:10:10.396519 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57094.4us
I20260709 13:10:10.318145 29518 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:10.411892 29677 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:10:10.412716 29676 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:10:10.413157 29697 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:10.428843 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:10.413460 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 265471us
I20260709 13:10:10.356727 29476 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:10.407007 22501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.020s	sys 0.016s
I20260709 13:10:10.414970 22398 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 13 to 17, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 17 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:10.442224 22501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.021s	sys 0.017s
I20260709 13:10:10.341425 29582 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.356796 29605 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.414115 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:10.353929 29674 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:10.387974 29131 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:10.342376 29523 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.068s
W20260709 13:10:10.107947 22402 rpcz_store.cc:269] 0709 13:09:24.240071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.240384 (+   313us) service_pool.cc:224] Handling call
0709 13:09:24.790851 (+550467us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:10:10.106905 (+45316054us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:58.735230 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:58.770436 (+ 35206us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:58.770474 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:09:58.770491 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:58.771792 (+  1301us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:58.771875 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:58.771903 (+    28us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:09:58.778779 (+  6876us) tablet.cc:701] Row locks acquired
0709 13:09:58.779313 (+   534us) write_op.cc:260] PREPARE: finished
0709 13:09:58.783337 (+  4024us) write_op.cc:270] Start()
0709 13:09:58.786788 (+  3451us) write_op.cc:276] Timestamp: P: 1783602598781461 usec, L: 0
0709 13:09:58.787274 (+   486us) op_driver.cc:348] REPLICATION: starting
0709 13:09:58.981251 (+193977us) log.cc:844] Serialized 5975 byte log entry
0709 13:10:00.181685 (+1200434us) op_driver.cc:464] REPLICATION: finished
0709 13:10:00.413111 (+231426us) write_op.cc:301] APPLY: starting
0709 13:10:00.469713 (+ 56602us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:00.962458 (+492745us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:00.962582 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:01.487742 (+525160us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:01.619073 (+131331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:10:01.625850 (+  6777us) write_op.cc:312] APPLY: finished
0709 13:10:01.880447 (+254597us) log.cc:844] Serialized 139 byte log entry
0709 13:10:02.207553 (+327106us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.225602 (+ 18049us) write_op.cc:454] Released schema lock
0709 13:10:02.225701 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:02.226275 (+   574us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.226304 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":617741,"reported_tablets":48,"spinlock_wait_cycles":372133760,"child_traces":[["op",{"apply.queue_time_us":189810,"apply.run_cpu_time_us":44252,"apply.run_wall_time_us":1845307,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66887,"num_ops":15,"prepare.queue_time_us":1015445,"prepare.run_cpu_time_us":38395,"prepare.run_wall_time_us":668117,"raft.queue_time_us":341461,"raft.run_cpu_time_us":96634,"raft.run_wall_time_us":130795,"replication_time_us":1394213,"thread_start_us":1770323,"threads_started":5,"wal-append.queue_time_us":1018183,"wal-append.run_cpu_time_us":69161,"wal-append.run_wall_time_us":2665640}]]}
W20260709 13:10:10.407061 29315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.002s	sys 0.021s
W20260709 13:10:10.356010 29180 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.004s	sys 0.016s
W20260709 13:10:10.417661 29435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.028s	sys 0.018s
W20260709 13:10:10.467262 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 420713us
I20260709 13:10:10.412741 29082 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:10.450517 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 490804us
W20260709 13:10:10.406813 29653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.036s	sys 0.044s
I20260709 13:10:10.465796 22398 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 12 to 17, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 17 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:10.429708 29697 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:10.467329 29435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.029s	sys 0.019s
W20260709 13:10:10.494760 22620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.024s
W20260709 13:10:10.495157 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 183611us
I20260709 13:10:10.495253 29435 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:10.495414 22398 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 8 to 14, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 14 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.495986 29435 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.497251 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:10.498993 23259 raft_consensus.cc:1275] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:10.499683 23262 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:10:10.495187 22620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.003s	sys 0.024s
W20260709 13:10:10.501652 29682 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:10:10.502528 22398 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:10.501488 29697 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:10.467013 29180 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.005s	sys 0.017s
I20260709 13:10:10.509848 23263 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:10.466249 29558 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:10.459966 29605 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:10.527225 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.519112 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3415) took 1144 ms. Trace:
I20260709 13:10:10.537304 22502 rpcz_store.cc:276] 0709 13:10:09.375025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.386664 (+ 11639us) service_pool.cc:224] Handling call
0709 13:10:09.394331 (+  7667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.529268 (+134937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.529304 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.529958 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.839579 (+309621us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:09.839642 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.874735 (+ 35093us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003fbe54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:09.874788 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.504571 (+629783us) raft_consensus.cc:1685] finished
0709 13:10:10.504596 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.519021 (+ 14425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4739,"raft.queue_time_us":6432,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"spinlock_wait_cycles":294367488,"thread_start_us":308828,"threads_started":1,"wal-append.queue_time_us":514664}
I20260709 13:10:10.549213 22577 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:10.551473 29649 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:10.551769 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.552312 29649 consensus_queue.cc:1243] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:10:10.552443 29664 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:10:10.553350 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.553864 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.554726 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.555037 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.504148 22398 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: config changed from index 10 to 12, term changed from 12 to 16, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130), fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.556093 29082 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:10.556540 29082 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:10.556977 29082 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:10.557628 29523 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:10.556767 22398 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 11 to 18, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.558039 29523 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:10.558451 29523 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:10.559193 22398 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:10.560946 22398 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.562716 22398 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 13 to 18, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.565908 22500 raft_consensus.cc:1240] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:10:10.598161 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:10.515060 29674 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:10.653991 29678 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:10:10.655175 29683 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:10:10.656059 29632 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:10.664031 29607 consensus_meta.cc:287] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.002s
I20260709 13:10:10.664618 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:10.665437 29675 log.cc:927] Time spent T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
W20260709 13:10:10.667081 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.018s	sys 0.034s
W20260709 13:10:10.687156 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.018s	sys 0.034s
W20260709 13:10:10.544605 29673 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.003s
W20260709 13:10:10.551818 29685 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:10:10.566589 29616 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.827s	user 0.014s	sys 0.000s
W20260709 13:10:10.687511 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 565687us
I20260709 13:10:10.728730 22573 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:10.757934 22498 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:10.721729 29674 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:10.585644 29476 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:10.760286 22470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.017s	sys 0.006s
W20260709 13:10:10.776144 22470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.017s	sys 0.006s
W20260709 13:10:10.760493 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 162458us
I20260709 13:10:10.722651 29632 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:10.722404 29673 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.775081 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3414) took 1400 ms. Trace:
I20260709 13:10:10.761368 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3422) took 1371 ms. Trace:
I20260709 13:10:10.772552 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3368) took 1165 ms. Trace:
W20260709 13:10:10.774215 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.760411 22471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.019s
W20260709 13:10:10.796137 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.760959 22500 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:10.799837 22500 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:10.765245 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3424) took 1374 ms. Trace:
W20260709 13:10:10.797925 22471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.004s	sys 0.019s
I20260709 13:10:10.795043 22503 rpcz_store.cc:276] 0709 13:10:09.374683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.385218 (+ 10535us) service_pool.cc:224] Handling call
0709 13:10:09.385789 (+   571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:09.413529 (+ 27740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.413565 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:09.438799 (+ 25234us) log.cc:844] Serialized 52 byte log entry
0709 13:10:09.814575 (+375776us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:09.814640 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.814739 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.774841 (+960102us) raft_consensus.cc:1685] finished
0709 13:10:10.774865 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.775022 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40712,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"thread_start_us":402091,"threads_started":2,"wal-append.queue_time_us":653411}
W20260709 13:10:10.779747 22648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.013s	sys 0.060s
W20260709 13:10:10.808673 22648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.013s	sys 0.060s
I20260709 13:10:10.810499 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:10.768996 29665 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:10:10.817713 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 297243us
I20260709 13:10:10.801286 22499 rpcz_store.cc:276] 0709 13:10:09.390530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.419854 (+ 29324us) service_pool.cc:224] Handling call
0709 13:10:09.420573 (+   719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.470163 (+ 49590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.470218 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.565373 (+ 95155us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.122616 (+557243us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:10.122658 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.122730 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.764959 (+642229us) raft_consensus.cc:1685] finished
0709 13:10:10.764990 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.765167 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6785,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":150,"thread_start_us":601875,"threads_started":2,"wal-append.queue_time_us":792764}
I20260709 13:10:10.795260 22651 rpcz_store.cc:276] 0709 13:10:09.606892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.608838 (+  1946us) service_pool.cc:224] Handling call
0709 13:10:09.609348 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.640751 (+ 31403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.640803 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.674235 (+ 33432us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.048481 (+374246us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:10.048543 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.048652 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.772291 (+723639us) raft_consensus.cc:1685] finished
0709 13:10:10.772319 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.772475 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14103,"raft.queue_time_us":31924,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":28030,"thread_start_us":365601,"threads_started":1,"wal-append.queue_time_us":650411}
I20260709 13:10:10.794996 22505 rpcz_store.cc:276] 0709 13:10:09.389771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.391996 (+  2225us) service_pool.cc:224] Handling call
0709 13:10:09.392436 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.471639 (+ 79203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.471682 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.646661 (+174979us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.011748 (+365087us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:10.011782 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.011848 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.761107 (+749259us) raft_consensus.cc:1685] finished
0709 13:10:10.761142 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.761293 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14148,"raft.queue_time_us":22568,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"spinlock_wait_cycles":24832,"thread_start_us":411973,"threads_started":2,"wal-append.queue_time_us":663329}
I20260709 13:10:10.829198 29518 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:10.829648 29674 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:10.775213 29698 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.830586 22504 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:10.790241 29293 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:10.831327 29705 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:10.831632 29293 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:10.832015 29705 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:10.832948 29628 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.954s	user 0.010s	sys 0.004s
I20260709 13:10:10.821043 29582 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:10.833436 29628 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:10.833973 29202 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.008s
I20260709 13:10:10.834187 29705 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:10.814257 29632 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.834646 22576 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:10.834444 29202 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.835624 29082 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:10.836382 29632 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:10.837232 23258 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:10.837747 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3411) took 1464 ms. Trace:
I20260709 13:10:10.774574 29703 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:10.838882 23262 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:10.765775 29702 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
W20260709 13:10:10.838376 29395 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.000s
W20260709 13:10:10.841611 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.838150 22498 rpcz_store.cc:276] 0709 13:10:09.373422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.373680 (+   258us) service_pool.cc:224] Handling call
0709 13:10:09.374219 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.758657 (+1384438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.837530 (+ 78873us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001d97d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:10.837693 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788779264}
I20260709 13:10:10.848840 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.855537 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:10.831367 22500 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:10.795464 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3371) took 1141 ms. Trace:
I20260709 13:10:10.862365 22500 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:10.862648 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:10.858708 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3933) took 1246 ms. Trace:
I20260709 13:10:10.830498 29518 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:10:10.865653 23264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.021s
W20260709 13:10:10.926036 23264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.006s	sys 0.021s
I20260709 13:10:10.866120 22496 rpcz_store.cc:276] 0709 13:10:09.612268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.001055 (+388787us) service_pool.cc:224] Handling call
0709 13:10:10.002761 (+  1706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.807570 (+804809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.807683 (+   113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.807835 (+   152us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:10.807913 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.858505 (+ 50592us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.858641 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10745,"raft.queue_time_us":160555,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":26807,"thread_start_us":490024,"threads_started":1}
W20260709 13:10:10.865844 29624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.021s
W20260709 13:10:10.992693 29624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.021s
I20260709 13:10:10.834046 29476 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:10.837776 29082 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:11.027807 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:11.028549 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:10.887301 29339 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.134s	user 0.013s	sys 0.004s
W20260709 13:10:11.042109 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.044915 22498 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:10.830456 29605 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:10.859302 22654 rpcz_store.cc:276] 0709 13:10:09.653612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.653744 (+   132us) service_pool.cc:224] Handling call
0709 13:10:09.654214 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.654722 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:10.245959 (+591237us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.789628 (+543669us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.789841 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.789903 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:10.789979 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.793066 (+  3087us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.795399 (+  2333us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":636406,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":10864,"raft.queue_time_us":82854,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"spinlock_wait_cycles":24320,"thread_start_us":1043343,"threads_started":2}
I20260709 13:10:11.049031 23264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1098) took 1536 ms. Trace:
W20260709 13:10:11.056281 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.017s	sys 0.027s
W20260709 13:10:11.056756 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.017s	sys 0.027s
I20260709 13:10:10.855459 29572 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.186s
I20260709 13:10:11.066749 29339 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:11.066977 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3436) took 1253 ms. Trace:
I20260709 13:10:11.054417 23264 rpcz_store.cc:276] 0709 13:10:09.508417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.508690 (+   273us) service_pool.cc:224] Handling call
0709 13:10:09.509597 (+   907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.510235 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:10.314406 (+804171us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.041494 (+727088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.041560 (+    66us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:11.044887 (+  3327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.044956 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.045088 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105894,"prepare.queue_time_us":788169,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":118250,"thread_start_us":1386523,"threads_started":2}
I20260709 13:10:11.097566 29339 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.097554 22496 rpcz_store.cc:276] 0709 13:10:09.813086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.049532 (+1236446us) service_pool.cc:224] Handling call
0709 13:10:11.066298 (+ 16766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.066545 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.066583 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.066642 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:11.066696 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.066774 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.066902 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.099874 29339 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:11.100140 29697 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.002s
I20260709 13:10:11.049427 29202 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:11.101624 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 252856us
I20260709 13:10:11.103467 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:11.072839 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:11.074009 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 665973us
I20260709 13:10:10.860399 29395 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:10.841383 29703 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.071524 29628 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:11.137614 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.032s	sys 0.031s
I20260709 13:10:11.151328 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:11.160794 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.032s	sys 0.031s
I20260709 13:10:10.830483 29674 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.166389 23257 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:11.160485 22398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.023s	sys 0.051s
W20260709 13:10:11.168638 22398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.023s	sys 0.051s
I20260709 13:10:11.161513 22500 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:10:11.170261 22500 pending_rounds.cc:85] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 11
I20260709 13:10:11.170624 22500 pending_rounds.cc:107] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:10:11.170989 22500 raft_consensus.cc:2889] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:11.168735 22543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.029s	sys 0.032s
W20260709 13:10:11.172477 22543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.029s	sys 0.032s
W20260709 13:10:11.172796 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 648693us
W20260709 13:10:11.152768 22649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.032s	sys 0.038s
W20260709 13:10:11.180171 22649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.032s	sys 0.039s
I20260709 13:10:11.060997 29435 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.050276 29705 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:11.154000 29365 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:11.201745 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 467093us
I20260709 13:10:11.100623 29697 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:11.201421 29572 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:11.207486 29476 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:11.208076 29476 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:11.207830 29572 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.208554 29476 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.210328 29572 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.210999 29624 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:11.210757 29084 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:11.211587 29624 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:11.211622 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:11.212054 29084 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:11.212443 29339 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:11.213140 29339 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.212724 29624 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:11.215034 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:11.218175 29686 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:10:11.219024 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:11.219901 29684 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.352s	user 0.000s	sys 0.003s
I20260709 13:10:11.220059 29443 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:11.220247 22574 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:11.220561 29443 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:11.221621 29443 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:11.223145 29443 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:11.226284 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3382) took 1364 ms. Trace:
I20260709 13:10:11.226644 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3423) took 1836 ms. Trace:
W20260709 13:10:11.235250 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 132082us
W20260709 13:10:11.239614 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 126277us
W20260709 13:10:11.247262 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.250499 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:11.257097 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.227807 22649 rpcz_store.cc:276] 0709 13:10:09.861710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.870122 (+  8412us) service_pool.cc:224] Handling call
0709 13:10:09.870459 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.870809 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:10.289664 (+418855us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.225651 (+935987us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.225846 (+   195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.225888 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:11.225943 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.226037 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.226206 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43389,"prepare.queue_time_us":540123,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":46257,"thread_start_us":1233209,"threads_started":2}
I20260709 13:10:11.230541 22497 rpcz_store.cc:276] 0709 13:10:09.390140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.398607 (+  8467us) service_pool.cc:224] Handling call
0709 13:10:09.399082 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.430694 (+ 31612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.430725 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.520117 (+ 89392us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.076696 (+556579us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:10.076770 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.076883 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.219076 (+1142193us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:11.226320 (+  7244us) raft_consensus.cc:1685] finished
0709 13:10:11.226345 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.226581 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27792,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"spinlock_wait_cycles":213646592,"thread_start_us":583670,"threads_started":2,"wal-append.queue_time_us":1262907}
I20260709 13:10:11.229182 29644 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:11.247246 29435 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:11.250888 29072 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.160s	user 0.011s	sys 0.002s
W20260709 13:10:11.283182 23260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.049s	sys 0.094s
W20260709 13:10:11.297027 23260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.050s	sys 0.094s
I20260709 13:10:11.251042 29582 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:11.291693 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:11.306396 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:11.318993 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3383) took 1438 ms. Trace:
I20260709 13:10:11.319597 22652 rpcz_store.cc:276] 0709 13:10:09.862223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.868587 (+  6364us) service_pool.cc:224] Handling call
0709 13:10:11.300466 (+1431879us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540017f2d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:11.300907 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428381056}
I20260709 13:10:11.321462 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:11.205796 29365 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.206377 29607 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:10:11.325354 22497 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:11.309938 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3433) took 1522 ms. Trace:
I20260709 13:10:11.299532 29705 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:11.333961 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 523521us
W20260709 13:10:11.334733 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49451.6us
I20260709 13:10:11.338897 29605 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:11.340677 22577 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:10:11.331849 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 70512.3us
W20260709 13:10:11.342185 23255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.032s	sys 0.068s
W20260709 13:10:11.368391 23255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.033s	sys 0.068s
I20260709 13:10:11.302199 29673 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:11.353086 23263 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.001s
W20260709 13:10:11.334138 29710 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:10:11.304311 29582 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:11.334256 29339 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.373143 22500 rpcz_store.cc:276] 0709 13:10:09.787759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.743356 (+955597us) service_pool.cc:224] Handling call
0709 13:10:10.760803 (+ 17447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.309570 (+548767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.309861 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.356900 29711 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:11.380116 29711 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.381381 29725 consensus_queue.cc:1059] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:11.382892 29711 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:11.383477 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:11.357918 29680 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:10:11.360143 29365 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.384258 29540 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:11.299943 29072 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.362514 29705 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.363574 29703 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.364560 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:11.366034 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:11.369956 22502 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.050s	sys 0.120s
I20260709 13:10:11.366245 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3434) took 1578 ms. Trace:
I20260709 13:10:11.371397 23263 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:11.374979 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1103) took 1453 ms. Trace:
W20260709 13:10:11.353861 23261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.004s	sys 0.008s
W20260709 13:10:11.398151 22502 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.051s	sys 0.120s
W20260709 13:10:11.398388 23261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.005s	sys 0.008s
I20260709 13:10:11.377306 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:11.386605 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3409) took 2022 ms. Trace:
I20260709 13:10:11.400395 22500 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 12.
W20260709 13:10:11.389158 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 180448us
I20260709 13:10:11.393802 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:11.399525 23261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1102) took 1481 ms. Trace:
I20260709 13:10:11.395171 22497 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:11.395787 22503 rpcz_store.cc:276] 0709 13:10:09.788029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.826053 (+1038024us) service_pool.cc:224] Handling call
0709 13:10:10.856013 (+ 29960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.856392 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.856446 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.860134 (+  3688us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.284671 (+424537us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:11.284717 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.284791 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.366019 (+ 81228us) raft_consensus.cc:1685] finished
0709 13:10:11.366040 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.366185 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4892,"raft.queue_time_us":441,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":152347,"thread_start_us":225059,"threads_started":1,"wal-append.queue_time_us":278982}
I20260709 13:10:11.405684 22499 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.405644 23261 rpcz_store.cc:276] 0709 13:10:09.918100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.918282 (+   182us) service_pool.cc:224] Handling call
0709 13:10:09.958685 (+ 40403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.981170 (+ 22485us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:10:10.534655 (+553485us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.399013 (+864358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.399093 (+    80us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:11.399158 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.399266 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.399450 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32430,"prepare.queue_time_us":398612,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":31,"raft.queue_time_us":218775,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":59,"thread_start_us":1209329,"threads_started":2}
I20260709 13:10:11.407965 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 1110) took 1029 ms. Trace:
I20260709 13:10:11.408774 23263 rpcz_store.cc:276] 0709 13:10:10.366721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.366947 (+   226us) service_pool.cc:224] Handling call
0709 13:10:11.396043 (+1029096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.384747 29540 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:11.420583 23256 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 22: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:11.396260 23255 rpcz_store.cc:276] 0709 13:10:09.921380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.921528 (+   148us) service_pool.cc:224] Handling call
0709 13:10:09.961712 (+ 40184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.999790 (+ 38078us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:10:10.465615 (+465825us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.371884 (+906269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.371954 (+    70us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:11.372012 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.372096 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.374897 (+  2801us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":378891,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":55,"raft.queue_time_us":3144,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7229,"thread_start_us":1284299,"threads_started":2,"wal-append.queue_time_us":879757}
I20260709 13:10:11.425933 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:11.400269 22501 rpcz_store.cc:276] 0709 13:10:09.364659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.368548 (+  3889us) service_pool.cc:224] Handling call
0709 13:10:09.369222 (+   674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.460627 (+ 91405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.460663 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.474267 (+ 13604us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.442812 (+968545us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:10.442875 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.442971 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.386316 (+943345us) raft_consensus.cc:1685] finished
0709 13:10:11.386349 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.386534 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56749,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":260,"thread_start_us":1055979,"threads_started":2,"wal-append.queue_time_us":1346542}
I20260709 13:10:11.384308 29702 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:10:11.431152 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47765.2us
I20260709 13:10:11.434116 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:11.424139 29370 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.407s	user 0.010s	sys 0.007s
I20260709 13:10:11.419402 29395 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:11.415383 29720 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.409164 29607 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:10:11.449970 22543 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:11.426295 29674 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.452198 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:11.385532 29582 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:11.455371 22500 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:11.458289 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:11.462170 22501 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:10:11.463176 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:11.464461 29523 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.005s
I20260709 13:10:11.464982 29523 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:11.467746 29523 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:11.473157 29731 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:11.473919 29731 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:11.474942 29731 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.538002 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3437) took 1664 ms. Trace:
I20260709 13:10:11.538544 22496 rpcz_store.cc:276] 0709 13:10:09.813351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.099625 (+1286274us) service_pool.cc:224] Handling call
0709 13:10:11.100087 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.116161 (+ 16074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.116208 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.152299 (+ 36091us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.409053 (+256754us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:11.409096 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.409165 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.477812 (+ 68647us) raft_consensus.cc:1685] finished
0709 13:10:11.477839 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.477995 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40273,"raft.queue_time_us":38683,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9795,"thread_start_us":207129,"threads_started":1,"wal-append.queue_time_us":295519}
I20260709 13:10:11.542522 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:11.544605 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:11.581017 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 115718us
I20260709 13:10:11.582129 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:11.546522 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3435) took 1733 ms. Trace:
I20260709 13:10:11.583900 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:11.583598 22505 rpcz_store.cc:276] 0709 13:10:09.812730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.038727 (+1225997us) service_pool.cc:224] Handling call
0709 13:10:11.113591 (+ 74864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.167914 (+ 54323us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:11.344402 (+176488us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.546078 (+201676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.546139 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:11.546191 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.546278 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.546448 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286893,"thread_start_us":233187,"threads_started":2}
W20260709 13:10:11.469918 29131 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.003s	user 0.012s	sys 0.004s
I20260709 13:10:11.460733 29202 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:11.630097 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48086.3us
W20260709 13:10:11.634172 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 176507us
I20260709 13:10:11.642861 22496 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 24: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:10:11.688191 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.442564 29540 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.586612 29674 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:11.711498 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:11.728801 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:11.639448 29702 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.634182 29605 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:11.743158 29744 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:10:11.744124 29607 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:11.743434 29365 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:11.745224 29365 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.748376 29365 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:11.744694 29607 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:11.749995 29729 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:11.750157 29607 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:11.743098 29743 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:11.753549 29743 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.743055 22496 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:11.639062 29500 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:11.641415 29582 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:11.753953 29743 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:11.784386 22500 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:11.787740 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:11.789188 22496 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:11.771108 29674 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:11.795260 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 83593.8us
W20260709 13:10:11.799618 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.806051 22499 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
W20260709 13:10:11.925338 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.926728 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.800840 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.783679 29443 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.560s	user 0.015s	sys 0.000s
W20260709 13:10:11.927307 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.972676 22647 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.003s
I20260709 13:10:11.974255 22647 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:10:11.938249 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:11.987213 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3439) took 2173 ms. Trace:
I20260709 13:10:11.987845 22500 rpcz_store.cc:276] 0709 13:10:09.813917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.970434 (+2156517us) service_pool.cc:224] Handling call
0709 13:10:11.986612 (+ 16178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.986827 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.986855 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.986902 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:11.986929 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.986995 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.987133 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:11.990049 22544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.071s	sys 0.215s
W20260709 13:10:11.990445 22544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.071s	sys 0.215s
W20260709 13:10:11.991643 22501 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:10:11.940682 29072 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:11.992059 22501 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:11.772972 29605 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:11.788594 29500 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:11.990716 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 551754us
W20260709 13:10:12.008894 22545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.080s	sys 0.215s
W20260709 13:10:12.009498 22545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.080s	sys 0.215s
I20260709 13:10:11.788232 29702 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:12.009867 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 564956us
I20260709 13:10:12.019107 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3440) took 2172 ms. Trace:
I20260709 13:10:12.019682 22500 rpcz_store.cc:276] 0709 13:10:09.841766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.007488 (+2165722us) service_pool.cc:224] Handling call
0709 13:10:12.007806 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.008015 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.008058 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.008117 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:12.013981 (+  5864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.014079 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.014253 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.021502 22500 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:12.022327 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3441) took 2147 ms. Trace:
I20260709 13:10:12.022703 22500 rpcz_store.cc:276] 0709 13:10:09.874834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.020951 (+2146117us) service_pool.cc:224] Handling call
0709 13:10:12.021277 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.022028 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.022263 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.024163 22500 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:12.012576 29711 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:12.033298 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3443) took 2157 ms. Trace:
W20260709 13:10:12.036192 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 98060.8us
I20260709 13:10:12.035486 22500 rpcz_store.cc:276] 0709 13:10:09.875573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.023620 (+2148047us) service_pool.cc:224] Handling call
0709 13:10:12.023946 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.032952 (+  9006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.033214 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.038995 23227 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:12.042467 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3444) took 2065 ms. Trace:
I20260709 13:10:12.031142 29719 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.045420 22500 rpcz_store.cc:276] 0709 13:10:09.977545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.039629 (+2062084us) service_pool.cc:224] Handling call
0709 13:10:12.040701 (+  1072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.040962 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.041006 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.041562 (+   556us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:12.041718 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.041811 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.042398 (+   587us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:12.048391 29476 consensus_meta.cc:287] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.001s
I20260709 13:10:12.048954 29476 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.051404 29476 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.040027 29180 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.061328 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3445) took 1946 ms. Trace:
I20260709 13:10:12.042282 29741 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.051435 29739 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:10:12.061867 22500 rpcz_store.cc:276] 0709 13:10:10.114687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.060289 (+1945602us) service_pool.cc:224] Handling call
0709 13:10:12.060697 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.060985 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.061023 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.061077 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:12.061116 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.061168 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.061273 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.076110 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3446) took 1276 ms. Trace:
I20260709 13:10:12.077548 22500 rpcz_store.cc:276] 0709 13:10:10.799525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.074615 (+1275090us) service_pool.cc:224] Handling call
0709 13:10:12.075605 (+   990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.075787 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.075812 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.075854 (+    42us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:12.075892 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.075946 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.076052 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.082450 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.081446 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3447) took 1281 ms. Trace:
I20260709 13:10:12.053989 29731 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:12.083673 22500 rpcz_store.cc:276] 0709 13:10:10.799877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.080066 (+1280189us) service_pool.cc:224] Handling call
0709 13:10:12.080524 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.080824 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.080847 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.080919 (+    72us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:12.080988 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.081098 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.081353 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.089257 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.077870 29745 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.092221 29746 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.093014 29746 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.095610 29746 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:12.099406 29735 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:10:12.100899 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1111) took 1689 ms. Trace:
I20260709 13:10:12.101408 23260 rpcz_store.cc:276] 0709 13:10:10.421166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.428902 (+  7736us) service_pool.cc:224] Handling call
0709 13:10:10.475061 (+ 46159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.297514 (+822453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.297563 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.332702 (+ 35139us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.457601 (+124899us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:11.457670 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.457773 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.100522 (+642749us) raft_consensus.cc:1685] finished
0709 13:10:12.100554 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.100793 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":278562,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":881114,"threads_started":2,"wal-append.queue_time_us":616854}
W20260709 13:10:12.142407 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 51113.8us
I20260709 13:10:12.056133 29719 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.143126 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.161214 29674 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.092278 29745 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.166356 29745 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.167295 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.168051 22499 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
W20260709 13:10:12.170378 23256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 1108) took 2095 ms (client timeout 2522 ms). Trace:
W20260709 13:10:12.170848 23256 rpcz_store.cc:269] 0709 13:10:10.074728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.083496 (+  8768us) service_pool.cc:224] Handling call
0709 13:10:12.170148 (+2086652us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54006d1854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:12.170278 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038071680}
I20260709 13:10:12.171301 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.181665 23229 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:12.182917 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:12.145926 22468 connection.cc:256] RPC call timeout handler was delayed by -3.9042643569999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:10:12.185171 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1471) took 1360 ms. Trace:
I20260709 13:10:12.185611 22499 rpcz_store.cc:276] 0709 13:10:10.827684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.168819 (+1341135us) service_pool.cc:224] Handling call
0709 13:10:12.173097 (+  4278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.184710 (+ 11613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.184752 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.184816 (+    64us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:12.184909 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.184976 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.185117 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.189332 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.190172 22576 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 22: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:12.190882 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1473) took 1362 ms. Trace:
I20260709 13:10:12.195092 22503 rpcz_store.cc:276] 0709 13:10:10.828367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.190028 (+1361661us) service_pool.cc:224] Handling call
0709 13:10:12.190328 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.190522 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.190546 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.190607 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:12.190637 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.190695 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.190803 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.200313 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.201318 22574 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:12.077554 29741 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:12.191234 29644 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.898s	user 0.013s	sys 0.000s
I20260709 13:10:12.104317 29731 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.140259 29160 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 13:10:12.208016 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57634.5us
I20260709 13:10:12.194023 29707 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:12.193894 29072 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:12.213600 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1470) took 1389 ms. Trace:
I20260709 13:10:12.219112 22572 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
W20260709 13:10:12.210248 29740 log.cc:927] Time spent T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 13:10:12.210381 29644 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:12.221832 29707 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:12.216009 29072 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.235878 29607 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.230456 29605 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.239843 29607 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.242663 29731 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.244088 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1474) took 1415 ms. Trace:
I20260709 13:10:12.244704 22503 rpcz_store.cc:276] 0709 13:10:10.828671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.207929 (+1379258us) service_pool.cc:224] Handling call
0709 13:10:12.217079 (+  9150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.235519 (+ 18440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.235546 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.243686 (+  8140us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:10:12.243754 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.243845 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.244007 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.247587 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1476) took 1173 ms. Trace:
W20260709 13:10:12.249927 29748 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:10:12.261984 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:12.265566 29693 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.769s	user 0.007s	sys 0.028s
I20260709 13:10:12.270700 29741 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.277557 29719 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.235004 29072 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:12.248076 22503 rpcz_store.cc:276] 0709 13:10:11.073940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.246339 (+1172399us) service_pool.cc:224] Handling call
0709 13:10:12.246861 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.247103 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.247141 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.247201 (+    60us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:12.247249 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.247350 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.247507 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.290076 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:12.291076 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44266.9us
I20260709 13:10:12.293365 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.294055 23264 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:12.295800 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.295753 23227 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:12.298998 29131 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:10:12.300218 29293 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.300566 29131 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:12.301823 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:12.303593 29706 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:12.304265 29706 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.304705 29706 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:12.305970 29721 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.968s	user 0.003s	sys 0.010s
I20260709 13:10:12.307899 23262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 906) took 1807 ms. Trace:
W20260709 13:10:12.303660 29692 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.544s	user 0.005s	sys 0.034s
I20260709 13:10:12.308332 23262 rpcz_store.cc:276] 0709 13:10:10.500746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.500902 (+   156us) service_pool.cc:224] Handling call
0709 13:10:10.511452 (+ 10550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.839289 (+327837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.307606 (+1468317us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400836654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:12.307837 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752555264}
I20260709 13:10:12.319140 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.322253 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.322697 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:12.324011 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:12.325582 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.326242 23261 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
W20260709 13:10:12.328248 29752 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.231s	user 0.003s	sys 0.000s
I20260709 13:10:12.328598 29719 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:12.329140 29719 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.329514 29719 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:12.332365 29202 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.332963 29202 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:12.333251 29761 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:12.333835 29761 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.336618 29761 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.323050 23259 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:10:12.338644 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3449) took 1149 ms. Trace:
I20260709 13:10:12.342242 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3438) took 2528 ms. Trace:
I20260709 13:10:12.342749 22496 rpcz_store.cc:276] 0709 13:10:09.813637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.819028 (+2005391us) service_pool.cc:224] Handling call
0709 13:10:11.819408 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:11.932649 (+113241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.932701 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:11.953046 (+ 20345us) log.cc:844] Serialized 52 byte log entry
0709 13:10:12.069686 (+116640us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:12.080416 (+ 10730us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.080636 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.080717 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.327678 (+246961us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b240017a2d8. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec230949c4 00007fec23092acb 00007fec2324ddc9 00007fec2324da55 00007fec2324d09d 00007fec25e7f10e 00007fec25e9688c 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221
0709 13:10:12.339641 (+ 11963us) raft_consensus.cc:1685] finished
0709 13:10:12.342023 (+  2382us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.342169 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10461,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":4525,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":59659,"spinlock_wait_cycles":39320448,"thread_start_us":62726,"threads_started":1,"wal-append.queue_time_us":106446}
I20260709 13:10:12.345650 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1472) took 1517 ms. Trace:
I20260709 13:10:12.346099 22499 rpcz_store.cc:276] 0709 13:10:10.828081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.189378 (+1361297us) service_pool.cc:224] Handling call
0709 13:10:12.189732 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.190120 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.190150 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.190658 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.345033 (+154375us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b18003510a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1
0709 13:10:12.345193 (+   160us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:12.345228 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.345299 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.345357 (+    58us) raft_consensus.cc:1685] finished
0709 13:10:12.345368 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.345594 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3440,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":2511,"spinlock_wait_cycles":2673920,"thread_start_us":15166,"threads_started":1,"wal-append.queue_time_us":44198}
I20260709 13:10:12.347774 22574 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:12.348285 29540 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:12.350003 29714 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.022s	user 0.001s	sys 0.012s
I20260709 13:10:12.350852 22496 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:12.339308 22503 rpcz_store.cc:276] 0709 13:10:11.189725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.294944 (+1105219us) service_pool.cc:224] Handling call
0709 13:10:12.303000 (+  8056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.303228 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:12.303564 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.338273 (+ 34709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.338333 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:12.338390 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.338455 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.338566 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5586,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":165,"thread_start_us":34197,"threads_started":1}
W20260709 13:10:12.324275 29582 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.001s
I20260709 13:10:12.346926 29706 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.235597 29707 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.352133 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3938) took 1100 ms. Trace:
I20260709 13:10:12.353420 22496 rpcz_store.cc:276] 0709 13:10:11.251692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.344584 (+1092892us) service_pool.cc:224] Handling call
0709 13:10:12.350680 (+  6096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.351862 (+  1182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.352076 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.352851 29720 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:10:12.357362 22503 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:12.360424 22503 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:12.362064 29761 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:10:12.363286 29743 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.370875 29706 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.371357 29743 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.372248 22580 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:12.373541 29072 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.375967 29072 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.377682 29702 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.357565 29720 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:12.381114 29720 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:12.382133 29720 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.384138 29720 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:12.386699 29689 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.650s	user 0.013s	sys 0.013s
W20260709 13:10:12.357568 22504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 3442) took 2482 ms (client timeout 1623 ms). Trace:
W20260709 13:10:12.390206 22504 rpcz_store.cc:269] 0709 13:10:09.875211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.908155 (+ 32944us) service_pool.cc:224] Handling call
0709 13:10:12.357330 (+2449175us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54000f9954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:12.357467 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978607872}
I20260709 13:10:12.390625 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3431) took 2604 ms. Trace:
I20260709 13:10:12.398249 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.398595 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.400360 29540 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:10:12.402704 29500 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.404259 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.405579 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:12.406206 22504 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:12.406905 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.403247 29540 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:12.411809 29540 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:12.412954 29540 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.414692 29540 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:12.214190 22500 rpcz_store.cc:276] 0709 13:10:10.824146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.091319 (+1267173us) service_pool.cc:224] Handling call
0709 13:10:12.091577 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.104275 (+ 12698us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:12.141456 (+ 37181us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.213066 (+ 71610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.213159 (+    93us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:12.213233 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.213326 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.213517 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36706,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":112,"thread_start_us":71082,"threads_started":1}
I20260709 13:10:12.410979 29616 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:12.421353 29616 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:12.421741 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.422343 29616 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.422408 22500 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 24.
I20260709 13:10:12.434135 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 903) took 1937 ms. Trace:
I20260709 13:10:12.434321 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.434530 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:12.426009 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:12.426391 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.436565 23261 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 11.
W20260709 13:10:12.423257 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.426894 29715 log.cc:927] Time spent T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.209s	user 0.009s	sys 0.009s
I20260709 13:10:12.437530 22500 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:12.391301 22502 rpcz_store.cc:276] 0709 13:10:09.786654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.643448 (+856794us) service_pool.cc:224] Handling call
0709 13:10:10.643785 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.644173 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:10:11.398825 (+754652us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.389773 (+990948us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b1800082c00. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a
0709 13:10:12.390115 (+   342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.390191 (+    76us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:12.390268 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.390367 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.390547 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":786106,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":1694,"spinlock_wait_cycles":128499968,"thread_start_us":816084,"threads_started":2,"wal-append.queue_time_us":480176}
I20260709 13:10:12.432082 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:12.437749 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 1.15994e+06us
I20260709 13:10:12.429556 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.400358 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:12.440801 22501 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:12.435113 29202 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.446309 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:12.446996 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.430050 22504 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:12.434557 23257 rpcz_store.cc:276] 0709 13:10:10.497113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.497267 (+   154us) service_pool.cc:224] Handling call
0709 13:10:10.497610 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.169934 (+672324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.433906 (+1263972us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b540035d754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:12.434079 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507656576}
I20260709 13:10:12.447885 22469 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:12.464677 22505 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:12.467617 22580 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:12.471243 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.484627 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3451) took 1084 ms. Trace:
I20260709 13:10:12.428464 29367 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:12.490787 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.441967 29725 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:12.423430 29616 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:12.441174 29072 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:12.471637 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:12.472026 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.490187 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.470144 29705 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:12.500535 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.493394 29370 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:12.507426 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 1.12896e+06us
I20260709 13:10:12.499279 29725 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.494275 29367 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:12.510095 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3379) took 2747 ms. Trace:
W20260709 13:10:12.516453 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.488400 29761 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:10:12.506138 22579 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:12.468344 29500 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:10:12.515807 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 44295.5us
I20260709 13:10:12.520468 29500 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:12.518438 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.490849 22503 rpcz_store.cc:276] 0709 13:10:11.400601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.362077 (+961476us) service_pool.cc:224] Handling call
0709 13:10:12.362396 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.362581 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:12.363157 (+   576us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.483232 (+120075us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.484143 (+   911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.484208 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:12.484272 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.484367 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.484542 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18957,"prepare.queue_time_us":706,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":2837,"raft.queue_time_us":25025,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5712,"spinlock_wait_cycles":22279680,"thread_start_us":99327,"threads_started":1,"wal-append.queue_time_us":140183}
I20260709 13:10:12.497076 29082 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:10:12.525437 29624 consensus_queue.cc:1048] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:12.526667 29742 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:12.514513 29395 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.520893 29500 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:12.528549 23227 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:12.505620 29705 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.506971 29370 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.532615 23227 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:12.534978 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 324399us
I20260709 13:10:12.502172 29072 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.507197 29339 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.456254 29719 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.515868 29725 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:12.516417 29669 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.541273 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:12.516057 29703 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.530782 29742 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.514288 29726 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.545630 29761 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:10:12.562997 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.541229 29705 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.591233 29571 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.591854 29571 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.594172 29571 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.595000 29571 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.595810 29571 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.596233 29726 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.533692 29707 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:12.598541 29726 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.543100 29370 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:12.542450 29072 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:12.546005 29476 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.607362 23256 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:12.554764 29742 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:12.610606 29705 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.604820 29761 raft_consensus.cc:697] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:12.613092 29705 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.613152 29761 consensus_queue.cc:237] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.616979 29476 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.619333 29476 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.545854 29339 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.621050 29650 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:12.620653 29742 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.551332 29669 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.650414 29719 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.621727 29339 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.644213 29367 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.651954 29367 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.607730 29703 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.632423 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:12.547489 29395 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.621663 29650 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:12.599046 29571 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.669660 23229 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:12.672137 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3945) took 2912 ms. Trace:
I20260709 13:10:12.658061 29476 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.671655 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3941) took 1371 ms. Trace:
I20260709 13:10:12.672549 22573 rpcz_store.cc:276] 0709 13:10:09.759951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.760120 (+   169us) service_pool.cc:224] Handling call
0709 13:10:09.760481 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.729401 (+968920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.669127 (+1939726us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b5400279cd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:12.672058 (+  2931us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087556992}
I20260709 13:10:12.678452 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:12.678969 29742 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.667712 29628 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:12.678320 29650 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.693148 29160 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.693699 29160 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.694115 29395 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.694959 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.695822 22579 raft_consensus.cc:2410] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:12.696497 29160 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.696707 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.697844 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.698036 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.699743 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.676456 22499 rpcz_store.cc:276] 0709 13:10:11.300395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.349273 (+1048878us) service_pool.cc:224] Handling call
0709 13:10:12.349671 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.355582 (+  5911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.355621 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.383189 (+ 27568us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.533384 (+150195us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:12.670505 (+137121us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.671333 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.671404 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.671457 (+    53us) raft_consensus.cc:1685] finished
0709 13:10:12.671468 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.671602 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":4242,"thread_start_us":272028,"threads_started":2,"wal-append.queue_time_us":225033}
I20260709 13:10:12.687391 29703 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.700752 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.675680 29720 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:12.706077 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.706696 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.709702 29435 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:10:12.710120 22647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3373) took 3055 ms (client timeout 1670 ms). Trace:
I20260709 13:10:12.712183 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.672806 29669 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.716051 22649 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
W20260709 13:10:12.717782 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 209488us
W20260709 13:10:12.714993 22647 rpcz_store.cc:269] 0709 13:10:09.654500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.688215 (+ 33715us) service_pool.cc:224] Handling call
0709 13:10:12.709877 (+3021662us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400394754. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:12.710010 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2927683456}
I20260709 13:10:12.718547 22618 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:12.719931 29722 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:12.722188 29722 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.724119 29722 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.724046 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.720854 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.727363 22645 raft_consensus.cc:2410] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:10:12.727324 22650 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:12.731102 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.732378 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.734040 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.737092 22652 raft_consensus.cc:2410] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 13:10:12.735838 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.737594 22579 raft_consensus.cc:2393] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:12.740142 22651 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:12.739195 22654 raft_consensus.cc:2393] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:12.721066 29720 raft_consensus.cc:697] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:12.728969 29082 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.719014 29476 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.754108 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.758510 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.769731 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:12.770710 22654 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.704550 29725 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.768201 29339 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.773483 22645 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:12.775547 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.749873 29650 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:12.737803 29717 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:10:12.784097 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.788353 22573 raft_consensus.cc:2410] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:12.790376 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:12.791385 22652 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:12.792598 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 74125.1us
I20260709 13:10:12.794199 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:12.778398 29624 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.797976 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.798472 29722 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:12.801052 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.798738 22650 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:10:12.778604 29395 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.753428 29370 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.802629 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:12.798722 29293 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.813364 29727 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.814211 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:12.790263 29741 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.768725 29082 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.751204 29435 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.824532 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:12.824928 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:12.826115 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:12.869174 29744 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:12.816223 29395 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.869927 29744 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.852288 29703 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:12.808144 29518 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:10:12.859185 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.907541 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.909219 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.910056 22573 raft_consensus.cc:2393] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:12.910868 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.911311 29697 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.911597 22573 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:12.912479 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.913635 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.915822 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:12.918758 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:12.920308 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.921149 22505 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:12.922693 29674 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:12.923307 29674 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.924095 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:12.924830 22496 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:12.929634 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.931344 22573 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:10:12.932302 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:12.932519 22573 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:12.876495 29725 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.877377 29370 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:12.878329 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.879406 22574 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:12.879911 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:12.881966 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.882705 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.883605 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.884763 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:12.516835 22648 rpcz_store.cc:276] 0709 13:10:09.758304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.776164 (+ 17860us) service_pool.cc:224] Handling call
0709 13:10:09.781755 (+  5591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.782169 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:10.132130 (+349961us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.251646 (+1119516us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.366997 (+115351us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b180047ba80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec29cf33c7 00007fec263059a7 00007fec263150bf 00007fec26315038
0709 13:10:11.371589 (+  4592us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.428119 (+1056530us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b180047ba80. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:12.505344 (+ 77225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.505401 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:12.505450 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.505521 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.505632 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1313663,"prepare.queue_time_us":700508,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":145,"raft.queue_time_us":1160343,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":8077,"spinlock_wait_cycles":70745216,"thread_start_us":1345613,"threads_started":3,"wal-append.queue_time_us":891351,"wal-append.run_cpu_time_us":3952,"wal-append.run_wall_time_us":1332888}
I20260709 13:10:12.856241 29293 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.891849 29744 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:12.892045 29202 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:12.894362 29500 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.784261 29339 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.827456 29727 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:12.900799 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:12.901283 29082 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:12.903715 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 78937.6us
I20260709 13:10:12.929770 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:12.973086 23262 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:12.933132 23259 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:12.905175 29703 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.932936 23227 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:12.815325 29624 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.795849 29650 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:12.936821 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.939779 22500 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:12.864274 22654 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:10:12.980029 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.989023 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:12.994153 23260 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:10:12.995253 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62412.3us
I20260709 13:10:12.980708 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.941800 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:12.941790 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 117337us
I20260709 13:10:12.997689 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:12.947909 29644 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:12.947827 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.948158 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.948547 22578 raft_consensus.cc:2410] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:10:12.949093 22501 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:12.947921 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:12.943675 22574 pending_rounds.cc:85] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 10
I20260709 13:10:13.009752 22574 pending_rounds.cc:107] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:13.008586 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.010069 22574 raft_consensus.cc:2889] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.957687 23256 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:12.967592 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:12.970479 22496 raft_consensus.cc:2410] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:10:12.949939 29722 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:13.026146 29722 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:13.026721 29722 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.028469 29650 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.029225 29632 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.945248 29518 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.029789 29632 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.031796 29632 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:13.001562 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.039085 22652 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24.
I20260709 13:10:13.002853 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:13.013639 22505 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:13.014231 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.017526 29202 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:13.018123 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.018817 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.019503 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.086138 22646 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:13.019837 22653 pending_rounds.cc:85] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 9
I20260709 13:10:13.086859 22653 pending_rounds.cc:107] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:10:13.087201 22653 raft_consensus.cc:2889] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:13.008180 29644 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:13.022234 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.023504 22648 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:13.024123 22498 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:13.025298 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.975636 29703 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:13.032660 29717 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:12.999053 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:13.039085 22575 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:13.110265 23257 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:13.033417 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.075870 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:13.111045 23261 raft_consensus.cc:2368] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16.
I20260709 13:10:13.081482 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:12.831300 29720 consensus_queue.cc:237] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.039247 22499 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:13.059978 22580 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:13.034508 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:13.087935 22505 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:13.130578 29702 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.145664 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.146296 22650 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:13.084434 29772 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:13.147346 29772 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.147722 29772 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:13.135442 29717 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.150547 29717 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:13.151757 29727 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:13.153806 29293 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:13.124097 29644 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.083411 29722 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.026721 29624 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.095158 29628 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:13.097651 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.101830 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.185227 22652 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:13.031401 29518 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.107013 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.189569 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.189888 22647 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:13.091164 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 84766us
I20260709 13:10:12.992274 29523 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.130707 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:13.130967 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.132402 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.137730 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.195858 23263 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:13.141652 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.145610 29726 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:13.196756 22571 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:13.089932 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:13.165381 23257 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:13.175369 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.036983 29395 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.193675 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.004747 29697 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.175s
I20260709 13:10:13.197764 22497 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:13.197999 22649 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:10:13.208460 23261 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:10:13.210732 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:12.993366 29082 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.188s
I20260709 13:10:13.252853 22572 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:13.252553 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46021.7us
I20260709 13:10:13.253865 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.254688 22648 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:13.262293 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.262693 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:13.263042 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 67757.6us
I20260709 13:10:13.248975 29476 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.268910 29744 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:10:13.270555 29500 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.273113 29339 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:13.279425 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.280910 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.282114 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.284437 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:13.285010 29548 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:13.285442 29548 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:13.286368 29548 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.288090 29548 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:13.288455 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.290549 22497 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:13.293118 29750 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:13.294672 22543 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:13.296803 29084 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:13.297099 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.296820 22578 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:13.298516 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.299219 22497 raft_consensus.cc:1275] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:13.299924 29765 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.299817 29180 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:13.295562 29772 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.312024 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.307762 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:13.206138 29726 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:13.313620 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 390480us
I20260709 13:10:13.313722 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.319849 22652 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.284621 29650 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:13.299356 22649 raft_consensus.cc:2376] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13. Re-sending same reply.
I20260709 13:10:13.309181 23262 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
W20260709 13:10:13.316279 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.298578 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.311197 22647 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:13.303398 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.322062 23261 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 22: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:13.337880 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.339581 22646 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:12.947060 29741 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.343914 22618 leader_election.cc:400] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16.
I20260709 13:10:13.345202 22618 leader_election.cc:403] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.346408 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.347618 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.348794 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.349630 22649 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 22: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:13.349788 29644 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.350415 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.351301 22651 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:13.350641 29772 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:13.351198 22649 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 24.
I20260709 13:10:13.206787 29131 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:10:13.183583 29702 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.352906 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.355424 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:13.352193 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 49517.4us
I20260709 13:10:13.361797 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.367523 22648 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:13.270221 29763 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:10:13.300606 29765 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.301828 29674 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.378988 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.336778 29395 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:13.375404 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:13.343169 29370 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:13.348485 29703 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.405669 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:13.391093 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:13.340396 29476 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:13.335402 29726 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:13.400048 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:13.351908 29644 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.402347 29650 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:10:13.404307 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:13.395421 29072 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.754s	user 0.008s	sys 0.002s
I20260709 13:10:13.410127 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.400077 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.412236 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:13.413189 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:13.427482 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:13.428340 22648 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:10:13.393262 29395 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:13.403439 29518 raft_consensus.cc:2764] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:10:13.431699 22543 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.377043 29697 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:13.416198 22647 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:13.428378 22503 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
W20260709 13:10:13.429906 22577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.040s
I20260709 13:10:13.411571 22572 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
W20260709 13:10:13.437318 22577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.008s	sys 0.041s
I20260709 13:10:13.438612 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.401152 22652 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:13.443794 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.453070 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.425899 29707 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:13.439406 29367 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.004s
I20260709 13:10:13.411851 29523 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:10:13.457880 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.412076 29500 consensus_queue.cc:1048] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:10:13.458014 22498 raft_consensus.cc:1240] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:13.461159 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 426688us
I20260709 13:10:13.465512 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:13.441661 29084 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:13.467711 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.466224 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.475170 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.415231 29476 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.446552 29315 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.417943 29072 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.446523 29772 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 15. Current term is 16.
W20260709 13:10:13.479327 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.447528 29725 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:13.509085 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.538137 22648 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:13.540035 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.548043 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.551326 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.552793 23264 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 24. Current term is 25.
I20260709 13:10:13.491442 29644 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:13.557464 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.557902 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.556128 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:13.488941 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.560355 22649 raft_consensus.cc:2410] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:13.489425 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.490054 22650 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:13.495360 29741 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.496616 29082 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:10:13.496938 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.497494 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.568387 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:13.498503 29523 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:13.499782 29646 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:13.500101 29315 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.503738 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.506464 29476 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.509058 29395 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.510402 29649 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:13.510638 29765 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.511792 29763 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:13.513716 29703 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:13.515282 29443 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:13.594981 29443 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:13.595954 29443 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.596575 29315 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.517756 22579 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:13.519675 29702 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.599267 29750 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:13.558476 22646 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:13.570710 22651 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:13.570909 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.571130 29082 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:13.571568 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.604497 22650 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:13.589901 29395 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.605389 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.606158 22650 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:13.486835 22619 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.575295 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.576210 22652 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:13.607307 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.577551 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.609409 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.562242 29644 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:13.593495 22572 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:13.575452 29646 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:13.600973 22647 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:13.571379 23260 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:13.613510 29646 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.613570 22649 raft_consensus.cc:2376] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16. Re-sending same reply.
I20260709 13:10:13.615867 29644 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.617007 22654 raft_consensus.cc:1240] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:13.617254 29644 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:13.615063 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.609758 22618 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 24. Current term is 25.
I20260709 13:10:13.625387 22618 leader_election.cc:403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:13.602630 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 56836.8us
I20260709 13:10:13.574194 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.640558 22651 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:13.634270 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:13.648790 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:13.649766 22650 raft_consensus.cc:2393] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:13.657250 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.668164 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.674571 22652 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:13.671945 22651 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:13.667708 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:13.667420 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 278821us
I20260709 13:10:13.677482 22646 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:13.677870 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.668730 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.687448 23258 raft_consensus.cc:1240] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:13.687377 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.689481 22651 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:13.688586 22545 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:10:13.692535 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 82985.1us
I20260709 13:10:13.692799 22650 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:13.696059 22650 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:13.697364 22650 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:13.698787 22651 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:13.700852 22648 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:10:13.603541 29763 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:13.712033 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:13.712085 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.713207 22580 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:13.730508 22646 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:13.736094 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.740911 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:13.741401 29072 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.700165 29649 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:10:13.745481 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.746219 22575 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:13.747071 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.748169 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:13.710041 29523 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:13.749248 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.749653 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.749882 22574 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:13.751060 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:13.752653 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.752853 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:13.686834 29765 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:13.757992 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106175us
I20260709 13:10:13.699671 29669 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:13.685962 29801 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:13.763370 22580 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
W20260709 13:10:13.761957 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 275197us
I20260709 13:10:13.767036 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.761873 29674 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:13.784071 29476 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.784674 29476 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.785706 29646 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.786966 29476 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:13.787904 29646 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:13.789137 29082 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.789702 29646 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:13.790233 29646 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:13.791225 29646 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:13.762951 29315 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:13.802597 29315 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.803032 29315 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:13.803500 29763 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:13.793820 29781 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:13.768496 29774 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:13.811765 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44851.7us
W20260709 13:10:13.801283 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 144126us
W20260709 13:10:13.813802 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 370258us
W20260709 13:10:13.822041 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 408896us
W20260709 13:10:13.823572 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.826350 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.831175 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:13.817432 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:13.839216 29646 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:13.810361 29801 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:13.817142 29772 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:13.817488 29774 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:13.823603 29788 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:13.832450 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:13.850455 29084 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:13.795349 29674 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:13.880570 29774 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:13.947582 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:13.841389 29717 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:10:13.880913 29788 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:13.855384 29726 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:13.999028 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 294742us
I20260709 13:10:13.841406 29370 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:14.049358 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.095295 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:14.099061 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 278995us
I20260709 13:10:14.100288 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.058043 29744 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:14.050196 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.067415 29435 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:14.050410 22651 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:14.050663 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.840898 29339 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:10:13.845286 29776 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:14.050124 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 217790us
W20260709 13:10:14.074574 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.074522 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 257173us
W20260709 13:10:14.110281 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 279204us
I20260709 13:10:14.115104 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:14.117400 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:14.063937 29518 raft_consensus.cc:2764] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:10:14.126834 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.125671 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:13.986764 29801 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.123521 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:14.124770 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.127277 22652 raft_consensus.cc:2393] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 24: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:14.075176 29788 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:14.133245 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:14.141841 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.143896 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:14.110524 29789 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.293s	user 0.004s	sys 0.006s
I20260709 13:10:14.109087 29443 consensus_queue.cc:1059] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:10:14.157577 29084 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.159220 29726 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:14.161505 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:14.162339 22646 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:14.163757 22646 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:14.165162 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3389) took 1146 ms. Trace:
I20260709 13:10:14.165581 22653 rpcz_store.cc:276] 0709 13:10:13.019147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.019266 (+   119us) service_pool.cc:224] Handling call
0709 13:10:13.019632 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:13.136013 (+116381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.136044 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:13.157367 (+ 21323us) log.cc:844] Serialized 52 byte log entry
0709 13:10:13.572350 (+414983us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:13.602624 (+ 30274us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.635619 (+ 32995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.635728 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.164941 (+529213us) raft_consensus.cc:1685] finished
0709 13:10:14.164966 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.165105 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":716,"prepare.queue_time_us":32114,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":17110,"raft.queue_time_us":78047,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":51026,"spinlock_wait_cycles":2432,"thread_start_us":414523,"threads_started":1,"wal-append.queue_time_us":637536}
W20260709 13:10:14.169096 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 44415.8us
I20260709 13:10:14.170091 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:14.171146 29644 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.553s	user 0.018s	sys 0.003s
I20260709 13:10:14.172119 22649 raft_consensus.cc:2410] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:10:14.174019 22649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3412) took 1014 ms. Trace:
I20260709 13:10:14.174367 22649 rpcz_store.cc:276] 0709 13:10:13.159697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.614715 (+455018us) service_pool.cc:224] Handling call
0709 13:10:14.173779 (+559064us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400298bd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:14.173921 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263950720}
I20260709 13:10:14.174679 29628 raft_consensus.cc:3055] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:14.175112 29628 raft_consensus.cc:740] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:14.152837 29180 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:14.178695 29797 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:14.179282 29797 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:14.181254 29370 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.182919 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:14.183657 22498 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:14.182992 29523 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 24. Current term is 25.
I20260709 13:10:14.187608 22543 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.062377 29131 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.191704 22652 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:14.128512 29765 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:14.194468 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52696.5us
W20260709 13:10:14.197507 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53716.7us
I20260709 13:10:14.197738 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:14.199538 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66370.6us
I20260709 13:10:14.133189 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1227) took 1954 ms. Trace:
I20260709 13:10:14.180241 29797 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.202471 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:14.206998 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 106644us
I20260709 13:10:14.213080 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.193936 29726 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:14.218526 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.196705 29339 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:14.199069 29720 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:14.208390 29741 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:14.208129 22577 rpcz_store.cc:276] 0709 13:10:12.168692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.185627 (+ 16935us) service_pool.cc:224] Handling call
0709 13:10:12.906299 (+720672us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b58000fa298. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6eee 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:10:12.906448 (+   149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.906823 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:10:12.907126 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.619841 (+712715us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.620476 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.620643 (+   167us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:13.857177 (+236534us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.049542 (+192365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.049720 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.122542 (+ 72822us) raft_consensus.cc:1685] finished
0709 13:10:14.122574 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.122757 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41783,"prepare.queue_time_us":2004,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":280989,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":22043,"spinlock_wait_cycles":7443200,"thread_start_us":948283,"threads_started":3,"wal-append.queue_time_us":699576}
I20260709 13:10:14.227874 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:14.207115 29523 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:14.193508 29772 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:10:14.245635 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44938.7us
I20260709 13:10:14.208603 29443 consensus_queue.cc:1243] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer fa2f181263f446a6962b649f9348c15f log is divergent from this leader: its last log entry 20.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260709 13:10:14.246410 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119659us
I20260709 13:10:14.249687 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:14.251693 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:14.221616 29706 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.263446 29706 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.264901 29802 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:14.241119 29741 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:14.266255 29741 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:14.266295 29802 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:14.267957 29765 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:14.268343 29765 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:14.269675 29806 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:14.271483 29443 consensus_queue.cc:1059] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:14.273669 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:14.274315 23258 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:14.276741 29765 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.278496 29443 raft_consensus.cc:3055] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:14.278931 29443 raft_consensus.cc:740] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:14.279757 29443 consensus_queue.cc:260] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.281186 29339 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:14.281633 29339 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:14.282099 29339 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:14.282331 29443 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.285394 22499 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:10:14.289645 22576 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:14.292507 29788 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:14.293491 29809 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:14.281586 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.297398 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.298168 29772 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.298636 29697 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:10:14.300518 29816 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:10:14.301702 29792 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.567s	user 0.005s	sys 0.000s
I20260709 13:10:14.302826 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3400) took 1177 ms. Trace:
I20260709 13:10:14.303241 22654 rpcz_store.cc:276] 0709 13:10:13.125258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.666334 (+541076us) service_pool.cc:224] Handling call
0709 13:10:13.700058 (+ 33724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.759751 (+ 59693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.759794 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.802776 (+ 42982us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.047049 (+244273us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:14.047097 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.047175 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.302564 (+255389us) raft_consensus.cc:1685] finished
0709 13:10:14.302589 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.302763 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75797,"raft.queue_time_us":46638,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6289,"thread_start_us":243876,"threads_started":1,"wal-append.queue_time_us":381547}
I20260709 13:10:14.305259 22645 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:14.224900 29795 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:14.226648 29435 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:14.260910 29131 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.262403 29674 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:14.248485 29523 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.323201 29180 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:14.323957 29523 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:14.325161 29082 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.326350 29697 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:14.249491 29518 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:14.260421 29476 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:14.306842 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2889) took 1040 ms. Trace:
I20260709 13:10:14.308696 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:14.309726 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 96723.9us
I20260709 13:10:14.347525 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.230598 29644 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:14.262498 29650 consensus_queue.cc:1059] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:14.333076 22498 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
W20260709 13:10:14.329831 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 108055us
I20260709 13:10:14.254648 29803 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:14.335896 29703 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.393535 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 130744us
I20260709 13:10:14.346175 22645 rpcz_store.cc:276] 0709 13:10:13.267100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.715470 (+448370us) service_pool.cc:224] Handling call
0709 13:10:14.304959 (+589489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.305716 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.306643 (+   927us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54002990d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:14.306783 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307099392}
I20260709 13:10:14.314802 29435 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:14.311553 29395 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.013s
I20260709 13:10:14.397564 23229 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:14.338672 29788 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:14.405181 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96634.3us
I20260709 13:10:14.406206 22619 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:14.380893 29674 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:14.403278 29435 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:14.346050 29131 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:14.429082 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 158957us
I20260709 13:10:14.379441 29518 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:10:14.408800 29794 log.cc:927] Time spent T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
I20260709 13:10:14.396044 29776 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:10:14.432878 29315 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.007s
I20260709 13:10:14.423050 29644 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:10:14.438006 29804 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:10:14.457257 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59808.7us
I20260709 13:10:14.402379 29703 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.465512 29395 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:14.466128 29395 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:14.466622 29395 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:14.466775 29703 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:14.464361 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58270.5us
I20260709 13:10:14.472564 29518 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.412849 29795 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:14.440061 29799 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:14.486085 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:14.488212 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:14.488935 23259 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:14.492362 22499 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:14.494865 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.496901 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:14.500809 29813 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:10:14.509616 29817 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:14.511010 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:14.463732 29644 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:14.521632 29644 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:14.525430 29833 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:14.527746 29820 log.cc:927] Time spent T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:14.483014 29774 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:14.529986 29808 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:10:14.531810 29815 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:14.533476 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 3965) took 1029 ms. Trace:
I20260709 13:10:14.535122 29800 raft_consensus.cc:3055] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:14.534029 22571 rpcz_store.cc:276] 0709 13:10:13.503576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.546552 (+ 42976us) service_pool.cc:224] Handling call
0709 13:10:13.562528 (+ 15976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.562900 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.562940 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.597585 (+ 34645us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.055939 (+458354us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:14.055980 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.056048 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.533176 (+477128us) raft_consensus.cc:1685] finished
0709 13:10:14.533196 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.533379 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22884,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5284,"thread_start_us":437680,"threads_started":1,"wal-append.queue_time_us":809367}
I20260709 13:10:14.535739 29800 raft_consensus.cc:740] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:14.538576 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 135016us
I20260709 13:10:14.471413 29315 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.542838 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.544793 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:14.539676 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 91851.6us
I20260709 13:10:14.546120 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.546931 22501 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:14.519292 29072 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:14.569440 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:14.571144 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:14.573377 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:14.568413 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.574540 22499 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:14.567386 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.576107 22504 raft_consensus.cc:2410] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:14.580519 22497 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:14.500257 29628 consensus_queue.cc:260] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.582767 22571 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:14.591856 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 47550.8us
W20260709 13:10:14.592264 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.592489 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:14.594327 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:10:14.595383 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 233330us
I20260709 13:10:14.597131 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.588055 29072 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:14.590145 29837 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:14.608968 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.609824 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:14.604635 22619 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.605374 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:14.607340 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 67997.9us
I20260709 13:10:14.612138 22505 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:14.613606 22505 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:14.599192 29702 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:14.536818 29800 consensus_queue.cc:260] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.614684 22505 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.634667 22505 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.619168 29837 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.633965 22543 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.636440 29702 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:14.609455 29788 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:14.645622 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.609673 29774 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:14.607414 29131 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:14.646718 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:14.647805 22652 raft_consensus.cc:1240] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:14.601981 29697 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:10:14.659703 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.655440 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.660534 22504 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:14.661278 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:14.662307 22501 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:14.664057 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.664157 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.599390 29763 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:10:14.660418 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:14.618813 29703 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:14.664820 22500 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:14.632787 29726 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.672029 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.676324 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:14.688783 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 83498.2us
I20260709 13:10:14.689430 22654 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
W20260709 13:10:14.676918 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.690240 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:14.676015 29772 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:14.621739 29674 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:10:14.692991 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.696481 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3397) took 1650 ms. Trace:
I20260709 13:10:14.696825 22647 rpcz_store.cc:276] 0709 13:10:13.045785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.622972 (+577187us) service_pool.cc:224] Handling call
0709 13:10:13.623365 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:13.670860 (+ 47495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.670906 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:13.671638 (+   732us) log.cc:844] Serialized 52 byte log entry
0709 13:10:14.045770 (+374132us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:14.093183 (+ 47413us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.093482 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.093592 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.278231 (+184639us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4800190158. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2b224aa1 00007fec2b21bb37 00007fec2b21b9ca 00007fec2b31326f 00007fec2b312f37 00007fec2b32755c 00007fec2b327508 00007fec2b327488 00007fec2b327443 00007fec2b3266ec 00007fec2a250a96
0709 13:10:14.281435 (+  3204us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b180003f100. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:14.696241 (+414806us) raft_consensus.cc:1685] finished
0709 13:10:14.696263 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.696420 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59515,"prepare.queue_time_us":47166,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":84408,"raft.run_cpu_time_us":3793,"raft.run_wall_time_us":591690,"spinlock_wait_cycles":50294400,"thread_start_us":288808,"threads_started":1,"wal-append.queue_time_us":621613}
I20260709 13:10:14.672921 29370 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:14.701347 22650 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
I20260709 13:10:14.677194 29774 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:14.701143 22501 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:14.704066 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.675716 29831 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:14.708148 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.709713 22501 raft_consensus.cc:1275] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:14.707054 22499 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:14.657192 29832 consensus_queue.cc:1059] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:10:14.721969 29315 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:14.701143 29788 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:14.708809 29772 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:14.760239 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3473) took 1376 ms. Trace:
I20260709 13:10:14.761642 22503 rpcz_store.cc:276] 0709 13:10:13.383714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.436783 (+ 53069us) service_pool.cc:224] Handling call
0709 13:10:13.455845 (+ 19062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.504934 (+ 49089us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:10:13.505197 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.839024 (+333827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:13.839096 (+    72us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:13.839162 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.434822 (+595660us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b18002612e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231dc2a6 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419
0709 13:10:14.759862 (+325040us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b5400108454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:14.759937 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.760151 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3990,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":96,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6805,"spinlock_wait_cycles":119373952,"thread_start_us":333469,"threads_started":1,"wal-append.queue_time_us":696208}
I20260709 13:10:14.763113 29765 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:14.765890 29843 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:14.766389 29843 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:14.766770 29843 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:14.772804 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 3977) took 1037 ms. Trace:
I20260709 13:10:14.773520 22579 rpcz_store.cc:276] 0709 13:10:13.734980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.735767 (+   787us) service_pool.cc:224] Handling call
0709 13:10:14.772504 (+1036737us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54000e6d54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:14.772717 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674599680}
I20260709 13:10:14.792958 29628 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:14.800175 29835 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:10:14.802052 29706 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:14.803998 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:14.810007 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.732478 29824 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:10:14.696360 29726 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:14.737473 29836 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:10:14.832516 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.705732 29339 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.829984 22618 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:14.833949 22500 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:14.845158 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.846009 22496 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
W20260709 13:10:14.826270 29082 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.004s
I20260709 13:10:14.851977 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:14.699329 29072 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.821125 29697 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:14.852968 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:14.709726 29702 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.860459 22648 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:10:14.865687 22648 pending_rounds.cc:85] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 11
I20260709 13:10:14.865572 22650 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:14.866060 22648 pending_rounds.cc:107] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:10:14.866307 22648 raft_consensus.cc:2889] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:14.838726 29832 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.868036 29832 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:14.869997 29395 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.870916 29832 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:14.872565 29435 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.874842 29435 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:14.877593 29395 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:14.852093 29518 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:14.878319 29518 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.878692 29518 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:14.882588 29726 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:14.893043 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:14.893990 22654 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:14.901693 23227 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:14.918809 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66925.8us
I20260709 13:10:14.921060 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.922191 22496 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
W20260709 13:10:14.895285 29741 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.628s	user 0.014s	sys 0.000s
W20260709 13:10:14.904513 29846 log.cc:927] Time spent T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:10:14.863256 23264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "691cccbd0258483ebe19e1581674cc94"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:10:14.959667 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:14.955120 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:14.961361 22652 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
W20260709 13:10:14.963591 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 273400us
I20260709 13:10:14.963717 22496 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:10:14.949738 29826 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:14.972280 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 279397us
I20260709 13:10:14.928138 29848 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:14.979110 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.972955 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.908389 29832 consensus_queue.cc:1059] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:10:14.984699 29703 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.985683 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:14.986002 22505 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:10:14.986663 22505 pending_rounds.cc:85] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 7
I20260709 13:10:14.986804 29703 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:14.987197 22505 pending_rounds.cc:107] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:10:14.987274 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.987776 22505 raft_consensus.cc:2889] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:14.988396 29703 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:14.988993 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:14.951049 29741 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:14.982887 29523 consensus_meta.cc:287] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.000s
I20260709 13:10:14.977284 29826 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.966843 29644 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.017860 29826 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:15.019428 29644 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:14.977339 29848 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.020210 29848 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:15.021906 29854 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.022080 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:15.022846 22496 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:10:15.022991 29854 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.023643 29854 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.002442 29674 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.025668 29674 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.027968 29674 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.003752 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.009049 29697 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:14.975512 29837 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.012125 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.015683 29072 raft_consensus.cc:3055] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:15.016773 29843 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:14.983546 29840 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.033933 29072 raft_consensus.cc:740] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:15.036911 29840 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.038050 29072 consensus_queue.cc:260] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.039319 29840 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.039425 29072 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:15.042038 29854 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.042732 29339 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.043529 29518 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.044142 22572 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:15.045449 29741 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.045993 29518 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:15.040633 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.994867 29703 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:15.031315 29523 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.051316 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:15.053661 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.054396 22497 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:15.056362 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:15.057089 22499 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:15.058000 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.058452 29843 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.059376 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.060617 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.061174 22496 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:15.058534 22499 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:10:15.063362 23260 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:15.065019 22618 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:15.065132 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:10:15.065258 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92423.3us
I20260709 13:10:15.066481 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:15.064424 29703 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:15.072527 29703 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.082547 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:15.082345 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:15.085460 22654 raft_consensus.cc:2376] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23. Re-sending same reply.
I20260709 13:10:15.085032 22647 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 13: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:15.093354 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.094521 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:15.094751 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 434345us
I20260709 13:10:15.096714 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:15.093376 29703 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.097798 22647 raft_consensus.cc:2368] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:10:15.099016 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:15.100364 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:15.106067 22501 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:15.106580 22501 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:15.109221 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:15.109829 22468 connection.cc:256] RPC call timeout handler was delayed by -1.7222045570000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:10:15.110437 22468 connection.cc:256] RPC call timeout handler was delayed by -1.6925045570000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 13:10:15.110848 22468 connection.cc:256] RPC call timeout handler was delayed by -1.6628045569999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:10:15.111294 22468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.719s (SENT) [suppressed 9 similar messages]
I20260709 13:10:15.113363 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:15.116005 22496 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:15.117334 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:15.109886 22652 raft_consensus.cc:2376] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19. Re-sending same reply.
I20260709 13:10:15.118498 22645 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:15.107477 22501 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.118645 29650 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:15.127573 22501 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:15.084231 29803 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:15.130816 22499 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:15.131493 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:15.095196 29697 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.141573 29697 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.141857 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.142573 22576 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:15.142968 29703 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.143883 29697 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.095728 29801 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:15.145025 29801 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:15.145285 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.146021 29801 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.147185 29644 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.147722 29644 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.084983 29858 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:15.149143 29858 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:15.138990 22578 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:10:15.139874 29856 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:15.113991 29523 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.119544 29729 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.134407 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:15.108541 29826 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.148110 29801 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:15.157166 22497 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:15.157048 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.130385 29395 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:15.170059 29644 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.170399 29395 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:15.171360 29395 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.160605 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:15.132040 29803 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.179528 29803 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.165392 22619 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:15.174973 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.176501 22576 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:15.184348 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.184396 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:15.185711 22501 raft_consensus.cc:1275] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:10:15.186165 22501 pending_rounds.cc:85] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 12
I20260709 13:10:15.186517 22501 pending_rounds.cc:107] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:10:15.186781 22501 raft_consensus.cc:2889] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.188287 23264 raft_consensus.cc:606] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Received request to transfer leadership to TS 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:15.188783 23264 raft_consensus.cc:614] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:15.189055 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.189625 22499 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.193933 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:15.165083 29848 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.151042 29858 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.203033 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:15.203663 22653 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:15.205049 29717 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:15.205587 29717 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:15.205224 23258 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:15.210908 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.217346 22651 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:15.219338 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:15.225788 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.231676 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.232735 22572 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:15.236990 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.238583 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.173607 29339 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:15.244055 22500 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:15.244345 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:15.176992 29703 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.255748 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.252842 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:15.204754 29848 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.259960 22578 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:15.260835 22499 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:10:15.162621 29729 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.250659 29726 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:15.243854 29697 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.161077 29856 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.274127 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:15.276895 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0625045570000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2891s for a response
I20260709 13:10:15.205595 29523 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:10:15.251974 29837 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.305744 22619 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:15.281062 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:15.244024 29864 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:15.281400 29750 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.297394 29703 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:15.298599 29800 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:15.308429 22653 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:15.259958 29788 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.262719 29339 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:15.319845 22653 raft_consensus.cc:1240] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:15.270064 29650 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:10:15.315529 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:15.278292 29865 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.261493 29858 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:15.319267 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:15.385308 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69833.3us
I20260709 13:10:15.320152 29644 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:15.257766 29717 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:15.425164 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 105980us
I20260709 13:10:15.608042 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:15.444108 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 163129us
I20260709 13:10:15.637605 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:15.380348 29776 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 13:10:15.604044 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.319571 29819 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:15.606575 29729 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:15.438885 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.603417 29339 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:15.650808 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:15.651532 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.383170 29703 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:15.313472 29837 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.655130 29837 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.655296 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:15.418640 29726 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:15.656144 29726 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.656720 29726 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:15.659157 29872 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260709 13:10:15.662956 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1439) took 2293 ms. Trace:
I20260709 13:10:15.383008 29795 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:15.484810 22571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813ede727198414390a20d5845e75e07"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36082
I20260709 13:10:15.322331 29822 consensus_queue.cc:1048] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:10:15.303261 29697 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.672025 29864 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:15.672744 29697 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.673631 29697 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.674201 29697 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.513726 29826 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.675524 29826 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.676061 29826 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.483831 29865 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.678759 29865 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.679982 29865 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:15.518435 29856 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.485054 29844 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:15.681105 29844 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:15.664651 29795 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.682276 29795 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:15.682130 29844 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.629619 29858 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.318357 29750 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.652688 29703 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.383246 29788 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:15.636775 22649 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:15.663527 22648 rpcz_store.cc:276] 0709 13:10:13.375959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.743520 (+367561us) service_pool.cc:224] Handling call
0709 13:10:13.743839 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:14.903551 (+1159712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.662644 (+759093us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400411c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:15.662878 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2567061760}
I20260709 13:10:15.628827 22653 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:10:15.691527 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:15.682345 29702 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.597088 29848 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.686331 22571 raft_consensus.cc:606] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Received request to transfer leadership
I20260709 13:10:15.686494 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:15.697605 22571 raft_consensus.cc:614] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:15.622394 29877 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:10:15.691699 29881 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:15.646394 29866 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:15.672775 29864 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:15.605003 29803 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.685634 29858 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.644165 29818 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.689317 29837 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.711086 29840 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.719676 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:15.719548 29729 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:15.719857 29726 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.720474 22650 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:15.721939 29697 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.706836 29866 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:15.701747 29848 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.743521 29726 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.735817 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:15.759276 22578 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:15.743908 29706 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:15.748065 29866 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:15.765029 29706 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.765467 29706 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.767906 29830 raft_consensus.cc:3055] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:15.768371 29830 raft_consensus.cc:740] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:15.769061 29729 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:15.777746 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.778434 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.780012 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.781060 22577 raft_consensus.cc:2368] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20.
I20260709 13:10:15.782722 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.771050 29750 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.769275 29830 consensus_queue.cc:260] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.784176 23264 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:10:15.789271 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.785043 22576 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:15.730727 29818 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.792673 22579 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:10:15.736989 29840 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.734148 29837 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.793303 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.800033 29830 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.781824 29649 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.807657 22577 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:15.792420 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.796183 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.798676 22505 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:15.809614 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:15.811992 22575 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:10:15.812842 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.813786 22579 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:15.814774 22576 raft_consensus.cc:2368] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:10:15.816716 29649 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.819408 29649 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.821089 29803 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.817265 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:15.777185 29729 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.824640 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.825393 22502 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:15.824355 22504 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:15.787711 29800 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.800545 29072 consensus_queue.cc:1175] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" responder_term: 13 status { last_received { term: 12 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:15.848048 29866 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.849318 29788 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:10:15.828945 29729 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.835947 29800 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.882040 22649 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:15.886898 22653 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:10:15.880509 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:15.887084 29818 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.899502 22502 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:15.900115 29443 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:15.899767 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:15.887982 29848 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.835285 29826 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:15.901539 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:15.918005 22504 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:15.918228 29858 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:15.901490 22653 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.919685 29837 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:15.877615 29811 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.921023 29811 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:15.889146 29884 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.928431 22572 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:15.896230 29315 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:15.903512 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:15.902958 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:15.927913 29873 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.488s	user 0.002s	sys 0.000s
I20260709 13:10:15.907136 29084 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:15.905606 29750 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:10:15.905687 29443 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.944386 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:15.910395 29706 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.937918 23262 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:15.904277 29801 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.943405 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:15.955847 23261 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:15.958482 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:15.959035 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:15.878440 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.007392 22653 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:16.009714 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:15.940882 29315 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:16.014127 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:16.022076 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.026774 22499 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:16.022971 23255 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:15.944057 29829 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:16.028527 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:16.030414 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.031391 22497 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:15.924970 29884 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:15.967932 29819 raft_consensus.cc:697] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:10:16.042565 29873 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:16.055866 22619 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:15.953444 29801 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:16.041473 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.059891 22649 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:16.045897 29644 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:16.037354 22653 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:16.061129 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 393688us
I20260709 13:10:16.076501 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:16.071488 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 297995us
I20260709 13:10:16.089257 29837 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:16.090220 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:16.091753 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.967816 29864 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.094795 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:16.058784 29650 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:16.058962 29811 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.071676 29644 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.071394 29818 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:16.054194 29829 consensus_queue.cc:1048] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:10:16.117213 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:16.117728 29887 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:16.118213 29887 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:16.118700 29887 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:16.095806 29840 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:16.094338 29865 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:16.124079 22645 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:10:16.126458 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.113883 29818 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.129155 29800 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:16.129549 29883 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:10:16.130882 29706 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:16.134693 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.139801 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 130238us
I20260709 13:10:16.146490 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.149621 22653 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:16.113426 29644 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.158994 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.101706 29826 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
W20260709 13:10:16.138958 29831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.000s	sys 0.020s
I20260709 13:10:16.131767 29650 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:16.180827 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237992us
I20260709 13:10:16.134656 29818 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:16.139653 29866 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.160157 29840 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:16.170207 29750 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.169440 29811 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.171633 29084 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.169740 29870 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:16.180260 29706 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.182861 29831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.001s	sys 0.020s
I20260709 13:10:16.194571 22497 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:16.210471 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 93330.4us
I20260709 13:10:16.220782 29811 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.227420 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:16.172811 29795 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.133776 29819 consensus_queue.cc:237] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.206264 29840 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.241312 29840 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:16.192790 29844 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.251482 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 161725us
I20260709 13:10:16.253482 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:16.224947 29443 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.229471 29831 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:16.270423 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 97849.5us
I20260709 13:10:16.272354 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:16.270377 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 106192us
I20260709 13:10:16.274394 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:16.245800 29811 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.221029 29750 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:16.278141 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.278723 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.224012 29084 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:16.293286 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.256526 29897 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:16.292343 29848 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:16.238876 29870 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.229235 29706 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.293483 29811 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:10:16.304409 29848 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.305364 29795 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.306717 29848 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:16.308168 29864 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.260244 29900 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:10:16.309196 29831 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.310019 29084 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.310648 29729 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.312278 29870 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.256919 29844 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.312968 29909 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:16.313635 29909 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.314376 29844 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.286892 29801 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.315948 29909 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.314395 29706 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.267776 29650 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.317662 29750 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.292518 29866 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:16.275990 29884 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.284003 29907 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.319621 29644 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.321707 29901 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:16.322455 29901 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:16.324057 22650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2910) took 1242 ms (client timeout 1629 ms). Trace:
W20260709 13:10:16.324587 22650 rpcz_store.cc:269] 0709 13:10:15.082132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.094247 (+ 12115us) service_pool.cc:224] Handling call
0709 13:10:16.323810 (+1229563us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b540017f2d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:16.323985 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437856512}
I20260709 13:10:16.298851 29897 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:16.325628 29897 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:16.325901 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.327068 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:16.328020 22617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.009s	sys 0.014s
W20260709 13:10:16.328368 22617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.009s	sys 0.014s
I20260709 13:10:16.328074 22650 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:16.330789 22469 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:16.319660 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:16.336305 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:16.328691 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 908508us
I20260709 13:10:16.338752 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:16.342379 29339 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:16.347945 22468 leader_election.cc:400] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:10:16.349171 22468 leader_election.cc:403] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:16.356474 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 171916us
I20260709 13:10:16.361150 22645 raft_consensus.cc:1240] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:16.361613 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 87584.1us
W20260709 13:10:16.364037 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 86693.4us
I20260709 13:10:16.324569 29644 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.374905 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.407230 22579 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
W20260709 13:10:16.406193 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58369.4us
I20260709 13:10:16.375074 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:16.347230 29864 raft_consensus.cc:2764] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
I20260709 13:10:16.374662 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.353389 29866 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:16.413841 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 51346.3us
I20260709 13:10:16.409085 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:16.412808 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52501us
W20260709 13:10:16.413426 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 48685.8us
I20260709 13:10:16.420600 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.411336 22577 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:16.357159 29909 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.415663 22578 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:16.415132 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:16.416632 29880 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.826s	user 0.000s	sys 0.005s
I20260709 13:10:16.357264 29907 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:16.369012 29776 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:16.560562 29890 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:10:16.458019 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49011.9us
I20260709 13:10:16.362665 29729 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:16.417261 29888 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:10:16.560755 29891 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 13:10:16.609313 29865 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:16.633833 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.640053 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.608983 29887 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:16.627562 29907 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.644070 29887 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:16.644286 22654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2912) took 1547 ms (client timeout 1949 ms). Trace:
I20260709 13:10:16.644547 29907 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.603545 29840 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:16.615589 22651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 1451) took 1407 ms (client timeout 1644 ms). Trace:
I20260709 13:10:16.486104 29885 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.645186 22651 rpcz_store.cc:269] 0709 13:10:15.208185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.244104 (+ 35919us) service_pool.cc:224] Handling call
0709 13:10:16.615356 (+1371252us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400236254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:16.615523 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852230912}
I20260709 13:10:16.645423 29885 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.646651 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:16.601177 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 176061us
W20260709 13:10:16.485702 29910 log.cc:927] Time spent T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:10:16.611361 29858 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:16.649060 29916 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:10:16.607820 29818 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.649255 29858 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.617697 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.371824 29795 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:16.449285 29866 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:16.609921 29831 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:16.610677 29702 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.914s	user 0.012s	sys 0.018s
I20260709 13:10:16.653239 29831 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:16.653469 23260 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:16.620196 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:16.654277 22580 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.654197 29831 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.620141 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.657836 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.659116 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.660108 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:16.661131 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.632831 29776 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.662108 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.662696 22574 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 12.
I20260709 13:10:16.663188 29776 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.663532 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:16.622856 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 175338us
I20260709 13:10:16.648563 22578 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:16.664773 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:16.665560 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.626608 22577 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:16.629913 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.628690 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:16.626804 22545 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:16.620301 29703 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:16.610697 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.604771 29897 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:16.644784 22654 rpcz_store.cc:269] 0709 13:10:15.096526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.098677 (+  2151us) service_pool.cc:224] Handling call
0709 13:10:16.644090 (+1545413us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:16.644231 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329077632}
I20260709 13:10:16.646643 29840 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.649187 22651 raft_consensus.cc:1240] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:16.651165 22653 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:16.610770 29717 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:16.652472 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 3987) took 1603 ms. Trace:
I20260709 13:10:16.684629 22650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:10:16.685716 22650 raft_consensus.cc:606] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:16.686060 22650 raft_consensus.cc:614] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:16.669492 22580 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
W20260709 13:10:16.674382 22468 connection.cc:256] RPC call timeout handler was delayed by -1.588419421000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 13:10:16.675664 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:16.678243 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:16.683341 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.684455 22496 rpcz_store.cc:276] 0709 13:10:15.049615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.116751 (+ 67136us) service_pool.cc:224] Handling call
0709 13:10:15.117128 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.117516 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.117553 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.118311 (+   758us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.317487 (+199176us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:15.317525 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.317605 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.415985 (+1098380us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:16.651959 (+235974us) raft_consensus.cc:1685] finished
0709 13:10:16.651980 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.652404 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":6807808,"thread_start_us":198868,"threads_started":1,"wal-append.queue_time_us":362996}
I20260709 13:10:16.681087 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.694260 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.696790 22575 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:16.664285 29866 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:16.698086 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.701975 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:16.702894 22575 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:16.703156 22571 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 21. Ops: []
I20260709 13:10:16.704401 22575 raft_consensus.cc:1275] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:10:16.683121 29898 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:16.706425 29898 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:16.706985 29898 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.687810 29703 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.683668 29916 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:16.711184 22651 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25.
I20260709 13:10:16.684002 29907 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:16.715703 29703 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.718582 29909 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.684278 29917 consensus_queue.cc:1059] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:16.719163 29916 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.713937 29750 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:10:16.719767 29897 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.726078 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.733083 22650 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:16.734311 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.735973 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.729498 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.716781 29819 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:16.737479 29819 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.738174 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.739871 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.730947 29916 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:16.740260 29819 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.743291 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:16.749398 29913 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:16.743477 29900 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:16.745652 29750 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:16.752080 29750 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:16.753007 29750 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.741852 29650 raft_consensus.cc:3055] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:16.754721 29650 raft_consensus.cc:740] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:16.695729 29717 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.755622 29650 consensus_queue.cc:260] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.756819 29650 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.757689 29717 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.745591 29885 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:16.754153 29750 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:16.761675 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:16.762351 22498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 3982) took 1750 ms (client timeout 1771 ms). Trace:
I20260709 13:10:16.762830 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:16.762794 22498 rpcz_store.cc:269] 0709 13:10:15.011569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.011720 (+   151us) service_pool.cc:224] Handling call
0709 13:10:16.762147 (+1750427us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540033e0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:16.762269 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3651173248}
I20260709 13:10:16.764581 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:16.740635 22651 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.754117 29858 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:16.769821 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.773468 29865 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:16.774111 29865 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.751106 29916 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.720844 29907 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.777577 29907 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:16.778381 29916 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:16.779629 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.771298 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:16.788807 22649 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:16.790030 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.791437 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.791867 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.792143 22649 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:16.792651 22645 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 24: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:16.793485 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.794252 22645 raft_consensus.cc:2410] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:16.794956 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.795647 22645 raft_consensus.cc:2368] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20.
I20260709 13:10:16.796013 22575 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:16.796480 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.779825 29898 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.770079 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.787194 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.797514 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:16.813812 22650 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:16.773430 22498 raft_consensus.cc:2410] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:10:16.816591 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.817632 22498 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:16.818394 22653 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:16.819628 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.820291 22571 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:16.812319 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.813745 22654 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:16.797880 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:16.825331 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.826133 22496 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:16.826864 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.827792 22498 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:16.830432 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.831281 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.834031 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.845456 22496 raft_consensus.cc:2410] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:10:16.835506 22645 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:16.847132 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:16.849133 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.850057 22645 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:16.823545 29795 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 16. Current term is 17.
I20260709 13:10:16.841384 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.852303 22505 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:16.853549 22498 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:16.853633 29649 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.857388 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.858279 22502 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:16.829149 29866 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.865006 22654 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:16.866756 22496 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:16.868698 22496 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:16.870353 29822 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.870986 29822 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:16.873543 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:16.899385 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 212435us
I20260709 13:10:16.919188 22502 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:10:16.920099 22498 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:16.860047 29829 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:16.874464 29774 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.924814 22468 leader_election.cc:400] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20.
I20260709 13:10:16.857461 29649 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:16.928579 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 132869us
I20260709 13:10:16.928344 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:16.927520 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:16.930136 22504 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.930429 22497 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 18: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:16.930501 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:16.933215 22500 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:16.933525 29774 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:16.945531 29822 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.945890 29774 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:16.931581 29829 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:16.946868 29893 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.703s	user 0.003s	sys 0.000s
I20260709 13:10:16.950213 22504 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:16.952407 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.952557 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.953142 22504 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:16.954919 29818 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:16.957583 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:16.957998 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.961882 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 933) took 1897 ms. Trace:
I20260709 13:10:16.962466 23258 rpcz_store.cc:276] 0709 13:10:15.064569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.064782 (+   213us) service_pool.cc:224] Handling call
0709 13:10:16.961692 (+1896910us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54007021d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:16.961825 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320051968}
I20260709 13:10:16.971954 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:16.975418 22651 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:16.976513 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:16.976531 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:16.978019 22468 leader_election.cc:400] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:10:16.978372 22468 leader_election.cc:403] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:10:16.980175 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:16.982170 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.983109 22645 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
W20260709 13:10:16.983445 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.987783 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:16.988462 22502 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:16.986065 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:16.992208 22500 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:16.994372 22497 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:16.996411 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:16.999017 22575 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:16.999292 22504 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:10:16.994707 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.010300 22571 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:17.012130 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:17.012835 22575 raft_consensus.cc:3060] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:17.000110 29856 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.018471 29856 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:17.021570 29934 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:10:17.022221 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.023419 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.024009 22571 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:17.025120 29856 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.024783 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.028960 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:16.998096 29927 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:17.033401 29866 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:16.985127 29831 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:17.036778 29788 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:16.988391 29909 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.044857 22571 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
W20260709 13:10:17.053376 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 58737.6us
I20260709 13:10:16.987036 29819 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:10:17.059535 29831 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:17.065507 29831 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:17.066330 22572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2787) took 1289 ms (client timeout 1557 ms). Trace:
W20260709 13:10:17.066787 22572 rpcz_store.cc:269] 0709 13:10:15.776946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.789009 (+ 12063us) service_pool.cc:224] Handling call
0709 13:10:17.066100 (+1277091us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400257454. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:17.066240 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318224768}
I20260709 13:10:17.068739 22572 raft_consensus.cc:1275] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:10:17.069149 22572 pending_rounds.cc:85] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 9
I20260709 13:10:17.069712 22572 pending_rounds.cc:107] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 13.10
W20260709 13:10:17.035287 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50319.4us
I20260709 13:10:17.074883 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.056095 29907 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.057668 29927 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:17.054632 29897 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:17.058161 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.985638 29717 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:16.986019 29822 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:17.060529 29865 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:17.071653 29895 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.828s	user 0.000s	sys 0.002s
I20260709 13:10:17.075138 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.054550 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:17.072520 29858 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:10:17.048187 22575 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:17.095340 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.063169 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.080300 22572 raft_consensus.cc:2889] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.985313 29774 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:10:17.097560 29717 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:17.097992 29650 consensus_queue.cc:1059] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:17.098603 29717 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.081717 29435 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:17.101051 29435 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:10:17.102288 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47818us
I20260709 13:10:17.103937 22617 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:17.085440 22496 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:10:17.105414 29865 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.105814 29819 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:17.106307 29819 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.106730 29819 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:17.099128 29650 raft_consensus.cc:3055] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:10:17.109043 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46210.6us
I20260709 13:10:17.103670 29831 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.111001 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.084324 29907 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.081101 29885 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:17.117200 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.110857 22468 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25.
I20260709 13:10:17.089268 29795 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:10:17.087679 29829 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.128662 22468 leader_election.cc:403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.127482 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.133358 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.134807 29900 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:17.142454 29911 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:17.176538 29900 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:17.176846 29911 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.177034 29900 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:17.177256 29939 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:17.177402 29911 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:17.177721 29939 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.178164 29939 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.114208 29865 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:17.180366 29865 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25.
I20260709 13:10:17.119470 29750 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:17.181082 29750 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.181458 29750 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:17.176040 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66107.4us
I20260709 13:10:17.185557 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.206368 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.111855 29788 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:17.109344 29650 raft_consensus.cc:740] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:17.170830 29774 raft_consensus.cc:2804] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:17.174325 29831 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.217528 29909 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:17.142589 29811 raft_consensus.cc:2764] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:10:17.217636 29788 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:17.223433 29788 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.211247 29865 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:17.229867 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.231401 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.232385 29909 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:17.170588 29927 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.232795 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.125782 29917 raft_consensus.cc:2764] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:10:17.243891 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 148615us
I20260709 13:10:17.209120 29829 consensus_queue.cc:1059] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:10:17.209183 29856 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:10:17.212170 29818 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:10:17.251483 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:17.233523 29909 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:17.251317 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 141414us
I20260709 13:10:17.255146 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.246707 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.259013 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.260049 22468 leader_election.cc:400] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20.
I20260709 13:10:17.260316 22468 leader_election.cc:403] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.249763 29831 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.254024 29858 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.281683 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.267606 29909 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:17.287241 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.269107 29865 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.289060 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:17.293167 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109221us
I20260709 13:10:17.296425 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.296499 22545 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:17.278343 29897 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20.
W20260709 13:10:17.304198 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49153.5us
I20260709 13:10:17.291523 29866 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:17.289292 29907 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:17.307699 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 52503.5us
I20260709 13:10:17.299516 29776 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:17.279774 29750 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.283465 29819 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.310712 29774 raft_consensus.cc:697] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:17.312494 29856 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:17.316955 22575 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:17.269236 29650 consensus_queue.cc:260] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.289448 29858 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.328202 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.329484 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.311987 29865 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:17.319875 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.333431 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:17.337296 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.337508 22497 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:17.338260 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:17.338667 22501 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:17.335661 22504 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:10:17.310530 29866 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:17.340546 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.340708 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.341440 22502 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:17.313974 29941 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.342756 29907 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:17.346302 29897 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:17.346961 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:17.318485 29942 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:17.317739 29944 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.358963 29950 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:17.359493 29944 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.361675 29944 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:17.319307 29948 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:17.350435 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:17.362506 29750 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:17.362528 29948 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:17.364614 29948 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.366324 29948 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:17.358914 29942 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:17.369660 29942 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.353665 29953 consensus_queue.cc:1048] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:10:17.372215 29833 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:17.372608 29833 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:17.373540 29833 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.374857 29833 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:17.375319 29772 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:17.375736 29772 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:17.378819 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.379931 22496 raft_consensus.cc:2393] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:17.383665 29909 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:17.351933 22501 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:17.352770 22645 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:17.327510 29856 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:17.354120 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:17.357029 22504 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:17.385818 29856 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:17.387104 29856 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:17.390242 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1145) took 1463 ms. Trace:
I20260709 13:10:17.390785 23257 rpcz_store.cc:276] 0709 13:10:15.927338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.927486 (+   148us) service_pool.cc:224] Handling call
0709 13:10:15.937326 (+  9840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.937548 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:10:16.138183 (+200635us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.336428 (+198245us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.389677 (+1053249us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18002bbdc0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec23188c0a 00007fec2c8c8219 00007fec23210a40 00007fec2320b4e4 00007fec2320b455 00007fec262f3060 00007fec26305716 00007fec26316287 00007fec26316208
0709 13:10:17.389855 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.389906 (+    51us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:17.389956 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.390028 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.390180 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6599,"prepare.queue_time_us":498040,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":91,"raft.queue_time_us":7443,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":12022,"spinlock_wait_cycles":7174400,"thread_start_us":383794,"threads_started":2,"wal-append.queue_time_us":188644}
I20260709 13:10:17.354667 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:17.393827 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.390375 29819 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:17.395769 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.376538 29772 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.396409 29649 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:17.399319 22499 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:17.399593 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:17.400310 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.400980 23255 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:17.378830 29939 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.402266 22504 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:17.404026 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.404191 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.405634 22651 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:17.406046 22645 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:17.407234 22651 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:10:17.408332 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.410422 22651 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:17.410427 22497 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:17.407388 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:17.414717 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.415031 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 934) took 2197 ms. Trace:
W20260709 13:10:17.415567 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.416484 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.415572 23260 rpcz_store.cc:276] 0709 13:10:15.160225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.160363 (+   138us) service_pool.cc:224] Handling call
0709 13:10:17.357525 (+2197162us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54006d2254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:17.357628 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3402729216}
I20260709 13:10:17.414738 22654 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:10:17.417224 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.414696 22645 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:17.398305 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:17.419662 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 741467us
I20260709 13:10:17.343914 29866 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.433619 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.434924 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:17.420228 23255 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:10:17.437789 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.337212 29865 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:17.438476 23255 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:17.438786 29865 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.439136 29315 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.440321 29315 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.420467 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.442060 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:17.442637 29902 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.096s	user 0.000s	sys 0.003s
I20260709 13:10:17.422909 29702 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.423112 29840 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:17.423534 29830 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.445206 29841 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.447901 29841 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.449160 22650 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:17.445324 22649 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:17.445405 29892 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:17.445611 29706 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.453203 29706 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:17.453688 29706 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.454126 29435 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.422381 22654 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:10:17.455134 22654 pending_rounds.cc:85] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 14
I20260709 13:10:17.455408 22654 pending_rounds.cc:107] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:10:17.455520 29435 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:17.455690 22654 raft_consensus.cc:2889] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:17.445952 29702 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.460110 29702 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.423923 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.446090 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.424471 29826 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:10:17.462352 22646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2915) took 2350 ms (client timeout 2224 ms). Trace:
W20260709 13:10:17.428622 29894 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.307s	user 0.000s	sys 0.003s
I20260709 13:10:17.463202 23258 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:10:17.446238 29840 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.465304 29776 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:17.425063 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.425851 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.466674 29840 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.446590 29830 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.469789 29830 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.426245 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.450827 29841 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.419723 29729 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.326603 29911 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.430742 29774 consensus_queue.cc:237] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.439555 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.503926 23255 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:17.396816 29772 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:17.416369 29650 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:17.467777 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.426342 23264 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 13:10:17.462940 22646 rpcz_store.cc:269] 0709 13:10:15.111842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.112020 (+   178us) service_pool.cc:224] Handling call
0709 13:10:17.462166 (+2350146us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400324e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:17.462291 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4477337856}
I20260709 13:10:17.465396 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3434) took 2271 ms. Trace:
I20260709 13:10:17.528424 22652 rpcz_store.cc:276] 0709 13:10:15.193839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.194821 (+   982us) service_pool.cc:224] Handling call
0709 13:10:16.325440 (+1130619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.325829 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.325856 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:16.326323 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.611293 (+284970us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:16.611341 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.611412 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.620538 (+  9126us) raft_consensus.cc:1685] finished
0709 13:10:16.620558 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.465116 (+844558us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540017f2d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:17.465334 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1451,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":2599417728,"thread_start_us":230852,"threads_started":1,"wal-append.queue_time_us":286690}
I20260709 13:10:17.529526 22579 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:17.429014 29939 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:17.424194 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.533941 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.472821 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:17.444538 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.473012 23256 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
I20260709 13:10:17.476792 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.500880 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.502593 23263 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:17.502545 22653 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:17.503948 22645 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:17.530030 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:17.530694 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:17.339776 29954 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.534118 23260 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:17.591609 23257 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:17.539315 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.592749 22580 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:17.500403 29339 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.601728 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:17.595245 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 150793us
W20260709 13:10:17.581451 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 282780us
I20260709 13:10:17.604777 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:17.607607 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.604252 29370 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:17.609313 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.493448 29776 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
W20260709 13:10:17.578740 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52491.2us
I20260709 13:10:17.533726 29885 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.580612 29954 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.593281 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.605613 22651 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:17.529287 29082 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:17.378888 29942 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.611435 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.597498 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:17.613270 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:17.503680 29844 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.104s
I20260709 13:10:17.615021 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.619374 22579 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.620220 22646 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:17.477734 29900 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:17.599818 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 123101us
I20260709 13:10:17.636240 22544 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.611011 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:17.504901 29729 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.605406 29841 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:17.623782 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:17.723822 22505 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:17.578934 29811 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 13:10:17.526172 29950 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:17.726176 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 95022.2us
I20260709 13:10:17.731882 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:17.722074 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 85951.3us
I20260709 13:10:17.737357 22579 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:17.633697 23257 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:17.739140 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:17.618317 29830 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.748697 23262 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:17.752792 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 326968us
I20260709 13:10:17.619340 29954 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.608947 29948 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 13:10:17.723733 29788 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.737864 23229 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.792773 22505 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:17.612250 29867 consensus_queue.cc:1059] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:10:17.724311 29927 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:10:17.806457 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68656.5us
I20260709 13:10:17.807683 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:17.618369 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:17.722123 29370 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:17.614530 29947 consensus_queue.cc:1059] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.131s
I20260709 13:10:17.607728 29339 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.808494 22469 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.815307 22469 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:17.753937 29644 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:17.724694 29082 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.826000 23262 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:17.810155 29649 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:10:17.826678 29946 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.209s
I20260709 13:10:17.828356 29729 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.725540 29803 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:10:17.802505 29811 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.722653 29885 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.747192 29950 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.813265 29927 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:17.869923 29927 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.874738 29829 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:17.876852 29959 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:17.877557 29959 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:17.877693 29950 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:17.878724 29959 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.845656 22650 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:17.818877 29072 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:17.881299 29072 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:17.881492 29963 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:17.881804 29072 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:17.882746 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2794) took 2090 ms. Trace:
I20260709 13:10:17.883136 22573 rpcz_store.cc:276] 0709 13:10:15.791868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.793998 (+  2130us) service_pool.cc:224] Handling call
0709 13:10:15.802746 (+  8748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.803319 (+   573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.803360 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.804067 (+   707us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.064964 (+260897us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:16.209744 (+144780us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.209971 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.210059 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.428025 (+1217966us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:17.464664 (+ 36639us) raft_consensus.cc:1685] finished
0709 13:10:17.464760 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.882560 (+417800us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b54001e55d0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:17.882686 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":346097,"prepare.run_cpu_time_us":7633,"prepare.run_wall_time_us":79534,"raft.queue_time_us":113854,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":3734,"spinlock_wait_cycles":158039680,"thread_start_us":342663,"threads_started":2,"wal-append.queue_time_us":298953}
I20260709 13:10:17.822664 29795 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.884738 29962 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:17.844748 29644 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:17.885367 29962 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.886078 29644 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.887984 29885 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:17.862048 29082 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:17.812403 29788 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.893250 29858 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:17.894294 29788 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:17.838356 29911 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.844972 29776 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:17.896365 29898 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.799388 29830 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.901331 29072 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:17.931589 22497 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:17.937125 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 268744us
W20260709 13:10:17.937937 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 372549us
W20260709 13:10:17.911270 22619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.009s	sys 0.006s
I20260709 13:10:17.910045 22654 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:17.841835 29822 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:17.859370 29729 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:17.957096 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 219090us
W20260709 13:10:17.949143 22619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.010s	sys 0.007s
W20260709 13:10:17.923938 29831 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
W20260709 13:10:17.961524 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 655926us
I20260709 13:10:17.963536 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:17.964622 22502 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.953233 29072 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:17.881975 29963 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:17.820283 29917 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:10:17.956147 23264 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
W20260709 13:10:17.972697 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 240216us
I20260709 13:10:17.973994 22576 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:17.975595 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.976933 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.984063 22579 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
W20260709 13:10:17.984076 29897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.017s	sys 0.010s
I20260709 13:10:17.985412 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.957228 29729 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.990399 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.003206 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:18.010668 22497 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 13.
I20260709 13:10:18.011793 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.991660 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:17.993568 29960 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:10:18.025440 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:17.959928 29822 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:17.959663 29900 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:17.967861 29831 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:17.980021 29962 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:18.015484 23257 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:18.017771 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:18.018364 22502 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:18.018554 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.019198 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.020121 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:17.993659 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:10:18.007139 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 175423us
I20260709 13:10:18.045332 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:18.050083 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:18.021253 29729 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:17.976083 29370 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:17.990200 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:18.006942 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:18.028735 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 218914us
W20260709 13:10:18.060245 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53388.7us
I20260709 13:10:18.031284 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.032642 23256 raft_consensus.cc:1240] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
W20260709 13:10:18.004329 29897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.018s	sys 0.010s
I20260709 13:10:18.060446 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:18.093017 29702 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:18.093400 29941 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:18.096167 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 106072us
I20260709 13:10:18.097877 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:18.077389 29072 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:10:18.087345 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 52630us
I20260709 13:10:18.093660 29702 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:18.096298 29948 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:18.023677 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.075839 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:18.102335 22501 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:18.122157 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.123435 22497 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:18.089684 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:18.103300 22645 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:18.125402 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:18.104524 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:18.127926 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.058758 29339 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:18.143151 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:18.143478 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.109318 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.145092 22496 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:18.146168 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.148042 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.058681 29885 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:18.152761 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.154294 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.155776 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.156956 22579 raft_consensus.cc:2368] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:18.157315 22575 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:18.087548 29977 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:18.159374 29977 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.162012 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.161034 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:18.053001 29942 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.174525 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.175341 22573 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:18.176317 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100659us
I20260709 13:10:18.177680 23229 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:18.158080 22649 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:18.172081 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 82481us
I20260709 13:10:18.173753 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.170235 22497 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:18.180016 22577 raft_consensus.cc:2368] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:18.089485 29951 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:18.186010 29951 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:18.186488 29435 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.000s
I20260709 13:10:18.186702 29951 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:18.189213 29315 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.001s
I20260709 13:10:18.099692 29370 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.191679 29370 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:18.088106 29962 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.149855 29866 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 13:10:18.182403 29072 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:18.092211 29897 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:18.183881 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.184394 29948 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:18.184979 29911 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:18.181200 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 55932.4us
I20260709 13:10:18.117949 29968 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:18.209233 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48580us
I20260709 13:10:18.212535 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:10:18.195518 29865 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.756s	user 0.011s	sys 0.002s
W20260709 13:10:18.224792 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47237.6us
I20260709 13:10:18.197937 29826 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:18.214672 29833 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.835s	user 0.009s	sys 0.003s
I20260709 13:10:18.226999 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.227372 29072 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:18.216490 22571 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:18.228797 29650 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.005s
I20260709 13:10:18.228955 29916 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:18.229199 29968 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:18.247718 29970 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:18.181998 29885 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.248826 29917 consensus_queue.cc:1059] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:10:18.252914 29702 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.262521 29885 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:18.215515 29706 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.004s
I20260709 13:10:18.263343 29706 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.209980 29866 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.265782 29706 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:18.266235 29866 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.266970 22503 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:18.267468 23261 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 12.
I20260709 13:10:18.268828 29917 raft_consensus.cc:3055] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:18.236451 29865 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.235648 22545 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:18.258978 29822 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:18.269673 29948 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.058239 29963 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.270877 22498 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:18.272287 29072 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.173837 29901 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:10:18.257930 23263 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
W20260709 13:10:18.256832 22449 auto_rebalancer.cc:893] Removing replace marker failed: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:18.209585 29435 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.258993 22576 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:18.197994 29962 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.248981 29830 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:18.237378 29900 consensus_queue.cc:1059] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 13:10:18.256886 29968 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.317782 29900 raft_consensus.cc:3055] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:18.269325 29917 raft_consensus.cc:740] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:18.273963 29072 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.226536 23229 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:18.276746 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 231496us
I20260709 13:10:18.320420 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:18.305835 29435 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.321301 29900 raft_consensus.cc:740] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:18.321678 29435 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.321766 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.281262 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1246) took 1841 ms. Trace:
I20260709 13:10:18.322347 29900 consensus_queue.cc:260] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.323307 29865 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:18.324194 29900 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:18.305506 29650 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:18.323233 22578 rpcz_store.cc:276] 0709 13:10:16.439709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.691328 (+251619us) service_pool.cc:224] Handling call
0709 13:10:16.691805 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.692298 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:16.720240 (+ 27942us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.870530 (+150290us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.159598 (+1289068us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b2c00010828. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:10:18.160122 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.225003 (+ 64881us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:18.225066 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.225213 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.280786 (+ 55573us) raft_consensus.cc:1685] finished
0709 13:10:18.280960 (+   174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.281171 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32784,"prepare.queue_time_us":27764,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":871,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":11250,"spinlock_wait_cycles":110514944,"thread_start_us":205563,"threads_started":2,"wal-append.queue_time_us":326374,"wal-append.run_cpu_time_us":1220,"wal-append.run_wall_time_us":1030870}
I20260709 13:10:18.325119 29650 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:18.287958 29826 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:18.291965 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 198717us
I20260709 13:10:18.326033 29650 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:18.305183 22449 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:10:18.329063 22449 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:10:18.321377 29984 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:18.330526 29984 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:18.330885 29984 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.331259 29984 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:18.333045 29969 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:18.333618 29969 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.336694 29969 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.306829 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.337744 22496 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:18.338052 23260 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:10:18.338766 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.307739 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:10:18.308719 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 49124.3us
W20260709 13:10:18.341485 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 115017us
I20260709 13:10:18.342125 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.342772 22578 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:18.342840 22468 leader_election.cc:400] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:18.343436 22468 leader_election.cc:403] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:10:18.343820 23229 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:18.257035 29972 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 13:10:18.345525 22619 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:18.363289 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.366510 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.369936 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:18.348035 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:18.374017 23258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:10:18.374675 23258 raft_consensus.cc:606] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:18.377277 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:18.377719 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:18.356709 29981 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:18.359055 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.376426 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:18.387149 22647 raft_consensus.cc:2393] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:18.391368 22577 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:18.391037 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.351184 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.392468 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.392485 29072 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:18.389637 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 180239us
I20260709 13:10:18.310227 29979 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:18.400758 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.337436 29865 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:18.415832 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.416102 22646 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:18.384722 29954 consensus_meta.cc:287] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.001s
I20260709 13:10:18.337306 29435 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.408851 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:18.383978 29985 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:18.422214 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 71162.5us
I20260709 13:10:18.361644 29971 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:18.381552 29963 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:18.384452 29776 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:18.368294 29830 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:18.403098 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:18.417760 29858 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:18.449787 22496 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:18.450796 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.337541 29897 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:10:18.453241 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 50189.1us
I20260709 13:10:18.416647 29822 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:18.455623 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.459277 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.459853 22496 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:18.458645 23227 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:18.463241 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:18.467474 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.468390 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.442934 29866 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:18.467531 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.431344 29865 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.472736 23256 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:18.326040 29826 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.474581 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:18.481920 23262 raft_consensus.cc:2393] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:18.437673 29954 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.486793 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.487213 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.405767 29981 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.493778 29983 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:18.504487 22571 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:18.503348 23259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 940) took 1071 ms. Trace:
I20260709 13:10:18.508216 22647 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:18.418363 29979 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.460740 29858 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.495112 29978 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:10:18.496111 29989 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:18.498755 29982 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:18.499483 29997 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.190s	user 0.000s	sys 0.014s
I20260709 13:10:18.455709 29830 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:18.501768 22496 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:18.509869 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:18.440141 29917 consensus_queue.cc:260] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.509341 29866 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:18.478173 29833 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:18.494418 29856 consensus_meta.cc:287] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.107s	user 0.009s	sys 0.003s
I20260709 13:10:18.514163 22573 raft_consensus.cc:2368] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13.
I20260709 13:10:18.516425 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:18.490326 29885 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:18.516044 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:18.529357 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 98074.2us
I20260709 13:10:18.536072 22649 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:18.537077 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68844us
I20260709 13:10:18.507763 23259 rpcz_store.cc:276] 0709 13:10:17.431917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.462159 (+ 30242us) service_pool.cc:224] Handling call
0709 13:10:18.502521 (+1040362us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:10:18.502721 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.502898 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.502922 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.502983 (+    61us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:10:18.503030 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.503108 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.503274 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21684480}
I20260709 13:10:18.481595 29822 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:18.555842 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 186021us
I20260709 13:10:18.525231 29982 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.518783 29989 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.535233 29978 consensus_queue.cc:1243] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:18.513200 29983 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.562999 22468 leader_election.cc:400] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:18.542235 29833 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.567946 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.601269 22496 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:10:18.561040 23227 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:18.576414 29974 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.348s	user 0.000s	sys 0.002s
W20260709 13:10:18.577351 29992 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:10:18.578645 29865 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.578938 29959 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:18.499531 29951 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.584988 29954 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.561223 29885 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.642791 29885 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:18.589747 30003 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
W20260709 13:10:18.597576 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 162047us
I20260709 13:10:18.598858 22468 leader_election.cc:403] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:18.558122 29866 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:18.627802 23229 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:18.630285 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.649679 22496 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:18.650118 30004 consensus_queue.cc:1059] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:18.651149 30004 raft_consensus.cc:3055] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:18.651389 29702 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.652110 29702 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.653066 29702 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.653671 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 4028) took 1337 ms. Trace:
I20260709 13:10:18.568511 29962 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:18.627177 29833 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:18.654155 22572 rpcz_store.cc:276] 0709 13:10:17.316792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.316973 (+   181us) service_pool.cc:224] Handling call
0709 13:10:17.317313 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:17.752314 (+435001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.752348 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:17.804237 (+ 51889us) log.cc:844] Serialized 52 byte log entry
0709 13:10:18.117246 (+313009us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:18.117292 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.117370 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.575759 (+458389us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:18.653284 (+ 77525us) raft_consensus.cc:1685] finished
0709 13:10:18.653302 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.653615 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8132,"raft.queue_time_us":39123,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":31239,"spinlock_wait_cycles":16911232,"thread_start_us":692530,"threads_started":2,"wal-append.queue_time_us":404249}
I20260709 13:10:18.568579 29982 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:18.656530 29435 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.658303 29962 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:18.640724 29990 consensus_queue.cc:1048] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:18.651481 30004 raft_consensus.cc:740] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:18.659855 29951 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:18.661440 22654 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:18.637233 29971 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:10:18.572973 29989 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:18.675951 29971 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:18.627516 29997 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:18.676389 29971 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:18.632747 29841 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:18.639159 29998 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:18.677350 29971 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.679172 29981 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.653743 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:18.680083 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 117198us
I20260709 13:10:18.680411 23257 raft_consensus.cc:2393] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:18.627933 29978 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:18.677496 30007 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:18.680891 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:18.681623 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:18.640161 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:18.688315 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48234.6us
I20260709 13:10:18.689066 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.690883 29991 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:18.690649 30007 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.691298 29979 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.691655 29991 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:18.691733 29844 raft_consensus.cc:3055] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:18.683441 29978 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:18.692487 29844 raft_consensus.cc:740] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:18.635686 29830 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.693535 29844 consensus_queue.cc:260] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.694518 29844 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:18.669804 29966 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.697005 29966 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:18.697631 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:18.698395 29518 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:18.692082 30008 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.699215 30008 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.699784 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:18.700939 29435 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:18.702204 29729 consensus_meta.cc:287] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.000s
I20260709 13:10:18.702708 29729 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.703855 23255 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:18.705498 29729 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:18.705384 29978 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.648290 29866 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.706740 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.709748 29962 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:10:18.710428 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.710251 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.712067 29917 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:18.697257 29703 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.745327 30007 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.717861 29971 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:18.716836 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.719396 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:18.752965 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.753631 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:18.756502 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.739820 29370 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.758951 29978 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:18.759230 29370 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.771719 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.771939 29370 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:18.775004 29866 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.760141 29703 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:18.745337 29962 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:18.778563 29962 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.779064 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:18.780315 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.748172 30004 consensus_queue.cc:260] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:18.781008 29951 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:18.782330 29950 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.782984 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:18.730484 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 112559us
I20260709 13:10:18.783619 30002 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.784118 30002 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.781661 30004 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:18.785981 29983 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.786396 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.724114 22651 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:18.741236 22468 leader_election.cc:400] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:18.741724 29831 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:18.716161 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.790695 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.791325 22502 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:18.792076 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.782821 29950 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.793475 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.739967 29858 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.724891 29991 consensus_queue.cc:1059] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:10:18.792663 22572 raft_consensus.cc:2376] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18. Re-sending same reply.
I20260709 13:10:18.792080 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:18.796990 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 55940.3us
I20260709 13:10:18.722613 22496 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
W20260709 13:10:18.794359 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 78270.2us
I20260709 13:10:18.801333 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:18.796391 23258 raft_consensus.cc:2376] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18. Re-sending same reply.
I20260709 13:10:18.802513 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:18.744652 29984 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:18.834563 22502 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 26.
I20260709 13:10:18.842260 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:18.842542 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.838392 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:18.820637 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.844462 22502 raft_consensus.cc:2393] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 12: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:18.835312 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.850416 22578 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:10:18.846032 22645 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
W20260709 13:10:18.803004 29907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.379s	user 0.046s	sys 0.031s
I20260709 13:10:18.888595 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.850510 23258 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:18.889848 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:18.889966 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.891078 22579 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:18.891021 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.876539 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.884747 23229 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:18.877583 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.892453 22572 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:18.887336 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.800410 29990 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:18.892764 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.867178 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:18.896013 22502 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.795277 29870 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:18.801326 29822 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:18.903314 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:18.909118 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:18.914587 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 354753us
W20260709 13:10:18.888401 29907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.046s	sys 0.031s
I20260709 13:10:18.916685 22648 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:18.853418 29795 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:18.922375 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:18.926862 22577 raft_consensus.cc:2393] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:18.923336 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.883736 29954 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:18.925124 22502 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:10:18.928772 22572 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 16: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:19.023293 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:18.893867 29979 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:18.849361 29951 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.900174 29956 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.851078 29826 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:10:19.006841 22577 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:19.031606 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:18.913308 29650 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:19.023300 22496 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:18.910344 29897 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:19.024389 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:19.043397 22580 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:19.043757 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:18.963901 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 60685.5us
I20260709 13:10:19.025390 22502 raft_consensus.cc:3060] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.886505 30007 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
W20260709 13:10:19.034142 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 149473us
I20260709 13:10:18.926030 29907 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:19.036769 22572 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:19.030498 29990 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:19.009146 29983 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:19.054136 22502 raft_consensus.cc:2468] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
I20260709 13:10:19.067000 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:18.919584 29870 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.068077 22648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:38438
I20260709 13:10:19.068667 22648 raft_consensus.cc:606] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:19.069053 22648 raft_consensus.cc:614] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:19.046836 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:19.084653 23261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 1159) took 1660 ms (client timeout 2008 ms). Trace:
I20260709 13:10:19.042642 29650 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.085143 23261 rpcz_store.cc:269] 0709 13:10:17.424406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.425593 (+  1187us) service_pool.cc:224] Handling call
0709 13:10:19.084469 (+1658876us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54008dead4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.084593 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1840685312}
I20260709 13:10:19.035514 29795 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.098227 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 51509.1us
I20260709 13:10:19.035306 29866 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.091418 29650 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:19.081573 30007 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:19.034132 29979 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.056401 30015 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:19.116819 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:19.074422 29776 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.004s
I20260709 13:10:19.081827 29870 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.035740 29951 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.101114 29990 raft_consensus.cc:697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:19.103350 29897 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:10:19.104104 29985 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.001s
I20260709 13:10:19.035686 29956 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.115981 30007 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:19.151515 29803 raft_consensus.cc:3055] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:19.083981 29983 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.156917 29776 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19.
I20260709 13:10:19.115590 29795 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.174898 29865 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:19.193336 29865 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.194545 29795 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.195547 29865 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.178666 29927 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:19.181631 29966 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:10:19.182416 29951 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:19.198176 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 95261.4us
W20260709 13:10:19.187567 30010 log.cc:927] Time spent T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:10:19.187711 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3474) took 1086 ms. Trace:
W20260709 13:10:19.188503 30017 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:19.188704 29831 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.173791 29803 raft_consensus.cc:740] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:19.115841 29866 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.145699 29702 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.175653 29897 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
W20260709 13:10:19.190730 30011 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:10:19.082553 29907 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.219830 29866 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.220316 22502 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:19.222393 29979 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.225642 29983 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.173095 29989 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.228048 23259 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:10:19.229791 29989 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:19.186858 30012 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:10:19.166342 29985 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:19.166067 29950 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:19.162317 30015 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.200407 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:19.246304 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.246186 30015 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.246589 29702 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:19.203632 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.190299 29990 consensus_queue.cc:237] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.234907 29956 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.238250 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.239280 29803 consensus_queue.cc:260] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:19.241626 30021 log.cc:927] Time spent T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:10:19.246666 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46350.4us
I20260709 13:10:19.248023 22651 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:19.199985 22654 rpcz_store.cc:276] 0709 13:10:18.101241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.102924 (+  1683us) service_pool.cc:224] Handling call
0709 13:10:18.103150 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.675374 (+572224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.187445 (+512071us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54002bff54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.187648 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277780224}
W20260709 13:10:19.248423 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.197954 29844 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.503s	user 0.005s	sys 0.006s
I20260709 13:10:19.198741 29984 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:19.247447 29897 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.266906 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:19.266949 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.271250 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:19.272589 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:19.275897 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:19.269430 29982 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 13:10:19.282577 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.283911 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:19.268420 29956 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:19.299221 29956 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.273542 29803 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:19.274504 29831 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:19.307827 23260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1168) took 1015 ms. Trace:
I20260709 13:10:19.308431 23260 rpcz_store.cc:276] 0709 13:10:18.292278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.297144 (+  4866us) service_pool.cc:224] Handling call
0709 13:10:18.297561 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.338411 (+ 40850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.307486 (+969075us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400837554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.307743 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50091776}
I20260709 13:10:19.310168 29977 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.310640 29962 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:19.273828 30007 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.314507 30007 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:19.319569 29833 consensus_meta.cc:287] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.009s
I20260709 13:10:19.320043 29833 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.288646 22469 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:19.320809 22575 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:10:19.291877 30004 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.002s
I20260709 13:10:19.292074 30015 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.280049 30026 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:19.294540 29729 raft_consensus.cc:3055] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:19.302349 29956 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.332578 22500 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
W20260709 13:10:19.298534 29885 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:10:19.281453 29866 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:19.334477 29729 raft_consensus.cc:740] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:19.337059 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 4021) took 1316 ms. Trace:
I20260709 13:10:19.350587 22500 rpcz_store.cc:276] 0709 13:10:18.020273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.283617 (+1263344us) service_pool.cc:224] Handling call
0709 13:10:19.336995 (+ 53378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.352497 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:19.353575 22500 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:19.354341 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 4025) took 1320 ms. Trace:
I20260709 13:10:19.354802 22500 rpcz_store.cc:276] 0709 13:10:18.033642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.352134 (+1318492us) service_pool.cc:224] Handling call
0709 13:10:19.354269 (+  2135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.356281 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:19.357355 22500 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:10:19.346343 29971 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.001s
I20260709 13:10:19.290913 29982 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.347122 29866 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.361475 23257 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 16.
W20260709 13:10:19.361816 23255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 1165) took 1347 ms (client timeout 1517 ms). Trace:
W20260709 13:10:19.365950 23255 rpcz_store.cc:269] 0709 13:10:18.014538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.017563 (+  3025us) service_pool.cc:224] Handling call
0709 13:10:19.361653 (+1344090us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54005fb9d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.361768 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517016832}
I20260709 13:10:19.366586 29866 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:19.358731 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:19.363405 22504 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:19.366886 29729 consensus_queue.cc:260] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.368053 29729 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:19.368822 22500 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:10:19.369652 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4012) took 1373 ms. Trace:
I20260709 13:10:19.370093 22500 rpcz_store.cc:276] 0709 13:10:17.996754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.368108 (+1371354us) service_pool.cc:224] Handling call
0709 13:10:19.368490 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.369337 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.369571 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.372103 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4013) took 1374 ms. Trace:
I20260709 13:10:19.372545 22500 rpcz_store.cc:276] 0709 13:10:17.997945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.371153 (+1373208us) service_pool.cc:224] Handling call
0709 13:10:19.371458 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.371745 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.371774 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.371820 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:19.371872 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.371931 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.372048 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.374392 29982 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:19.362877 29650 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.377303 29650 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.348693 29885 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.380337 29885 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:19.383092 23264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 948) took 1765 ms (client timeout 2265 ms). Trace:
I20260709 13:10:19.347916 29962 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.400811 22505 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:10:19.402779 22505 pending_rounds.cc:85] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 11
I20260709 13:10:19.403028 22505 pending_rounds.cc:107] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:10:19.403344 22505 raft_consensus.cc:2889] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.393743 22646 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 13:10:19.390218 23264 rpcz_store.cc:269] 0709 13:10:17.617981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.618117 (+   136us) service_pool.cc:224] Handling call
0709 13:10:19.382813 (+1764696us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540087c654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.382945 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339041664}
I20260709 13:10:19.406190 29833 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:19.387996 30006 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.711s	user 0.001s	sys 0.008s
W20260709 13:10:19.399159 29978 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.004s
I20260709 13:10:19.412593 29942 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:19.413264 29942 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:19.414726 29942 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.424823 30008 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.417707 22503 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:10:19.426589 22503 pending_rounds.cc:85] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 9
I20260709 13:10:19.426877 22503 pending_rounds.cc:107] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:10:19.427158 22503 raft_consensus.cc:2889] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.427937 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4016) took 1420 ms. Trace:
I20260709 13:10:19.428279 22503 rpcz_store.cc:276] 0709 13:10:18.007945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.416841 (+1408896us) service_pool.cc:224] Handling call
0709 13:10:19.417296 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.427630 (+ 10334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.427862 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.432765 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3475) took 1331 ms. Trace:
I20260709 13:10:19.425705 29942 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:19.433285 22650 rpcz_store.cc:276] 0709 13:10:18.101580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.102770 (+  1190us) service_pool.cc:224] Handling call
0709 13:10:18.104365 (+  1595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.268649 (+164284us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:10:18.286283 (+ 17634us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.291155 (+  4872us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.291352 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.291403 (+    51us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:18.291450 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.694642 (+403192us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18004293a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e522 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:19.432504 (+737862us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400325354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.432561 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.432699 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10034,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":80,"raft.queue_time_us":1295,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"spinlock_wait_cycles":380257792,"thread_start_us":21381,"threads_started":2,"wal-append.queue_time_us":4408}
I20260709 13:10:19.430579 29927 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.435431 29927 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.437827 22503 raft_consensus.cc:1240] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:19.440976 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4019) took 1429 ms. Trace:
I20260709 13:10:19.443264 22503 rpcz_store.cc:276] 0709 13:10:18.011635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.436688 (+1425053us) service_pool.cc:224] Handling call
0709 13:10:19.437643 (+   955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.440645 (+  3002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.440914 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.446112 22503 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:19.451864 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4022) took 1414 ms. Trace:
I20260709 13:10:19.452350 22503 rpcz_store.cc:276] 0709 13:10:18.032782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.445502 (+1412720us) service_pool.cc:224] Handling call
0709 13:10:19.445913 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.446508 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.446672 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.462358 29927 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.471514 29866 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:19.474905 30029 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:19.488920 22499 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:19.492162 29866 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.493185 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:19.496575 23263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 949) took 1765 ms (client timeout 1806 ms). Trace:
W20260709 13:10:19.499488 23263 rpcz_store.cc:269] 0709 13:10:17.731341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.731533 (+   192us) service_pool.cc:224] Handling call
0709 13:10:19.496399 (+1764866us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54007463d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.496517 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207774464}
I20260709 13:10:19.510113 30002 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:19.528671 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.530507 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.530714 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.531477 22652 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24.
I20260709 13:10:19.532899 29339 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.533713 29339 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.534870 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 1271) took 1068 ms. Trace:
I20260709 13:10:19.535255 22578 rpcz_store.cc:276] 0709 13:10:18.466654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.467333 (+   679us) service_pool.cc:224] Handling call
0709 13:10:19.534711 (+1067378us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54003edad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.534816 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696940416}
I20260709 13:10:19.535895 29339 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.537226 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.537531 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.537993 22652 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:19.538842 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 4041) took 1547 ms. Trace:
I20260709 13:10:19.539273 22576 rpcz_store.cc:276] 0709 13:10:17.991238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.991418 (+   180us) service_pool.cc:224] Handling call
0709 13:10:19.538711 (+1547293us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54003ac5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.538793 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565989632}
I20260709 13:10:19.542081 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.543053 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.560225 30009 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:19.541116 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:19.548260 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.549533 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:19.569041 23258 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:19.550977 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.551997 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.570302 23263 raft_consensus.cc:2393] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:19.552379 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.557358 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:19.571797 22646 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:19.572337 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:19.557461 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:19.573302 22647 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:19.573170 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:19.557384 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:19.574266 22648 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:19.558667 22652 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:19.574649 22619 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:19.575240 29939 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:19.575415 29942 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:10:19.575862 29942 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:19.576287 29942 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:19.576798 29939 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:19.580623 22646 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:19.583005 30009 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:19.584635 30009 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:19.587033 30009 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:19.586838 29942 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:19.644204 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.652827 23227 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:19.655355 23262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:10:19.658151 29830 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:19.658020 29939 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:19.658648 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3525) took 1729 ms. Trace:
I20260709 13:10:19.661829 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3522) took 1734 ms. Trace:
I20260709 13:10:19.662492 22505 rpcz_store.cc:276] 0709 13:10:17.927696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.930360 (+  2664us) service_pool.cc:224] Handling call
0709 13:10:17.930779 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.403953 (+1473174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.661008 (+257055us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54001923d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.661553 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3379728640}
I20260709 13:10:19.663697 29972 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:19.657042 23262 raft_consensus.cc:606] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:19.659478 22501 rpcz_store.cc:276] 0709 13:10:17.928752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.933593 (+  4841us) service_pool.cc:224] Handling call
0709 13:10:17.933912 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.120114 (+186202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.657868 (+1537754us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54001a8e54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.658359 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386761088}
I20260709 13:10:19.669148 23262 raft_consensus.cc:614] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:19.668710 29972 raft_consensus.cc:697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:19.679450 29979 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.680727 29979 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.680802 29339 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:19.683856 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 4029) took 1291 ms. Trace:
I20260709 13:10:19.684768 29979 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.575537 22619 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:10:19.679741 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 102959us
W20260709 13:10:19.688925 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.692569 29927 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.659871 29939 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.693961 29927 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.696507 29865 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.697768 29865 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.698673 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3524) took 1770 ms. Trace:
I20260709 13:10:19.699371 22498 rpcz_store.cc:276] 0709 13:10:17.928311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.932977 (+  4666us) service_pool.cc:224] Handling call
0709 13:10:17.933334 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.275438 (+342104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.697864 (+1422426us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54001a7f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.698376 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775673216}
W20260709 13:10:19.701370 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.702790 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4026) took 1668 ms. Trace:
I20260709 13:10:19.703547 22499 rpcz_store.cc:276] 0709 13:10:18.033841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.449994 (+1416153us) service_pool.cc:224] Handling call
0709 13:10:19.450333 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.489412 (+ 39079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.701943 (+212531us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b5400082ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.702476 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88196352}
W20260709 13:10:19.704154 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.709129 29650 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:19.710233 29650 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.710789 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:19.712296 22502 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
W20260709 13:10:19.717101 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.660061 29830 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.684778 22496 rpcz_store.cc:276] 0709 13:10:18.392130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.852888 (+460758us) service_pool.cc:224] Handling call
0709 13:10:19.682995 (+830107us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001a9354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.683536 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244325120}
I20260709 13:10:19.728014 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:19.730835 29939 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:19.692647 30007 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:19.730851 29840 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.712809 29649 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.725803 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:19.744822 29840 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.746253 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 1272) took 1279 ms. Trace:
I20260709 13:10:19.746903 22573 rpcz_store.cc:276] 0709 13:10:18.467079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.467220 (+   141us) service_pool.cc:224] Handling call
0709 13:10:19.745668 (+1278448us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54001e50d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:19.745942 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100318464}
I20260709 13:10:19.676618 29972 consensus_queue.cc:237] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.744915 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4014) took 1729 ms. Trace:
I20260709 13:10:19.754360 29865 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.735630 30007 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.758097 30007 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.762279 29911 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.762482 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 186869us
I20260709 13:10:19.765166 29947 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.763664 29911 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.770823 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:19.744592 29649 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.758687 29830 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.773352 22502 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:19.777199 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:19.777712 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:19.777038 29898 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:19.772535 29339 raft_consensus.cc:2804] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:19.769831 29650 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.769542 29947 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.791400 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.794462 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:19.794654 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3531) took 1597 ms. Trace:
I20260709 13:10:19.787226 29339 raft_consensus.cc:697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:19.798767 22498 rpcz_store.cc:276] 0709 13:10:18.194331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.729864 (+1535533us) service_pool.cc:224] Handling call
0709 13:10:19.775819 (+ 45955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.791389 (+ 15570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.791439 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.791691 (+   252us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:19.791739 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.791812 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.791948 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.750845 22500 rpcz_store.cc:276] 0709 13:10:17.998949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.373698 (+1374749us) service_pool.cc:224] Handling call
0709 13:10:19.374022 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.374224 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:19.478750 (+104526us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.727666 (+248916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.727785 (+   119us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:19.727909 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.728025 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.728379 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20848,"prepare.queue_time_us":125781,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":7796,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":6049,"thread_start_us":333873,"threads_started":2,"wal-append.queue_time_us":272706}
I20260709 13:10:19.799162 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3534) took 1525 ms. Trace:
I20260709 13:10:19.803686 22499 rpcz_store.cc:276] 0709 13:10:18.273686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.737442 (+1463756us) service_pool.cc:224] Handling call
0709 13:10:19.772680 (+ 35238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.796090 (+ 23410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.796108 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.798861 (+  2753us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:19.798907 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.798991 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.799108 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.805807 29706 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:19.808542 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:19.810222 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3526) took 1877 ms. Trace:
W20260709 13:10:19.813230 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 53968.6us
I20260709 13:10:19.810834 22504 rpcz_store.cc:276] 0709 13:10:17.929109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.942206 (+ 13097us) service_pool.cc:224] Handling call
0709 13:10:17.945038 (+  2832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.367327 (+1422289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.806434 (+439107us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540039a8d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:19.806845 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3261356800}
I20260709 13:10:19.818508 22496 raft_consensus.cc:1240] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:10:19.814108 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:19.823046 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3535) took 1493 ms. Trace:
I20260709 13:10:19.823545 22496 rpcz_store.cc:276] 0709 13:10:18.329512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.737273 (+1407761us) service_pool.cc:224] Handling call
0709 13:10:19.787599 (+ 50326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.821834 (+ 34235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.822974 (+  1140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.827154 29911 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.818815 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:19.830976 22646 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 24: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:19.818661 29927 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.843844 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:19.831373 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:19.837520 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.844794 22573 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:19.849875 23262 raft_consensus.cc:3060] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.852686 22501 raft_consensus.cc:2393] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 14: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:19.854370 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90339.5us
I20260709 13:10:19.855535 22505 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:19.850230 29942 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.853734 29840 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.865767 22498 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:19.864210 29963 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.866006 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:19.869206 22499 raft_consensus.cc:1240] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:19.868042 22500 raft_consensus.cc:1240] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:19.873647 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:19.875504 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1536) took 1427 ms. Trace:
I20260709 13:10:19.875944 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3536) took 1526 ms. Trace:
I20260709 13:10:19.875867 22500 rpcz_store.cc:276] 0709 13:10:18.446965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.814752 (+1367787us) service_pool.cc:224] Handling call
0709 13:10:19.851362 (+ 36610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.873817 (+ 22455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.873990 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.876307 22499 rpcz_store.cc:276] 0709 13:10:18.346382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.814475 (+1468093us) service_pool.cc:224] Handling call
0709 13:10:19.847285 (+ 32810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.872301 (+ 25016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.872509 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.874766 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:19.842658 29898 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:10:19.874591 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1537) took 1411 ms. Trace:
I20260709 13:10:19.878067 22504 rpcz_store.cc:276] 0709 13:10:18.462385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.832079 (+1369694us) service_pool.cc:224] Handling call
0709 13:10:19.857781 (+ 25702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.867230 (+  9449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.867265 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.873467 (+  6202us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:10:19.873516 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.873582 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.873699 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.879969 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.880326 22571 raft_consensus.cc:2410] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:10:19.877249 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:19.885563 29970 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:19.885083 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4015) took 1842 ms. Trace:
W20260709 13:10:19.888968 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 119254us
I20260709 13:10:19.889355 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.890336 23258 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:19.895632 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.897207 22469 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:19.897472 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:19.899431 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.867358 29963 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.903878 29909 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:19.907137 22648 raft_consensus.cc:1240] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 26. Current term is 27. Ops: []
I20260709 13:10:19.905480 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:19.902457 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:19.909191 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:19.896688 29649 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.907673 29909 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.888124 22497 rpcz_store.cc:276] 0709 13:10:17.999949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.397188 (+1397239us) service_pool.cc:224] Handling call
0709 13:10:19.397569 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.397802 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:19.486367 (+ 88565us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.797595 (+311228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.808831 (+ 11236us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:19.819812 (+ 10981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.823908 (+  4096us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.842104 (+ 18196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4717,"prepare.queue_time_us":105266,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":8344,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":18896,"thread_start_us":369316,"threads_started":2,"wal-append.queue_time_us":314402}
I20260709 13:10:19.913576 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.914887 22647 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:10:19.914744 23229 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:19.915467 29370 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:19.914887 22497 raft_consensus.cc:1240] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:19.915750 29909 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:19.912073 22652 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
I20260709 13:10:19.919418 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3538) took 1199 ms. Trace:
I20260709 13:10:19.905771 22619 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:19.919838 22497 rpcz_store.cc:276] 0709 13:10:18.717506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.914134 (+1196628us) service_pool.cc:224] Handling call
0709 13:10:19.914669 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.916930 (+  2261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.917149 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.918401 22646 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:19.915961 29370 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:19.925500 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:19.925560 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 132096us
I20260709 13:10:19.927515 22501 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:19.925796 29370 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.923851 29947 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:19.932972 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:19.921737 29840 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:19.931963 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56816.3us
I20260709 13:10:19.936573 22499 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:19.932796 30008 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:19.942780 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.938683 30008 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.946022 30008 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:19.931751 29649 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:19.961054 29898 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:19.961894 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:19.962044 29898 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:19.961190 29370 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:19.963016 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.966122 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:19.967026 22652 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
I20260709 13:10:19.970497 22647 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:19.974306 29970 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:19.977324 22646 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:19.978482 22468 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:19.966194 29898 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:19.981215 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:19.985193 29649 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.929980 29339 consensus_queue.cc:237] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:19.988523 29649 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:19.998353 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3539) took 1248 ms. Trace:
I20260709 13:10:19.957396 29911 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:19.957661 29947 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.965217 30046 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:10:19.999500 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1541) took 1488 ms. Trace:
I20260709 13:10:20.003322 22500 rpcz_store.cc:276] 0709 13:10:18.510884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.887800 (+1376916us) service_pool.cc:224] Handling call
0709 13:10:19.921923 (+ 34123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.965047 (+ 43124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.965071 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.994281 (+ 29210us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:19.999285 (+  5004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.999352 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.999448 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.000443 22499 rpcz_store.cc:276] 0709 13:10:18.750441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.953580 (+1203139us) service_pool.cc:224] Handling call
0709 13:10:19.997686 (+ 44106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.998001 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.998028 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.998077 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:19.998113 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.998166 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.998292 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.001109 29911 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.006611 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1539) took 1498 ms. Trace:
I20260709 13:10:20.009766 22496 rpcz_store.cc:276] 0709 13:10:18.507873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.824180 (+1316307us) service_pool.cc:224] Handling call
0709 13:10:19.866335 (+ 42155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.905072 (+ 38737us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:10:19.934272 (+ 29200us) log.cc:844] Serialized 14 byte log entry
0709 13:10:20.005638 (+ 71366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:20.005703 (+    65us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:20.005823 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.006425 (+   602us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.006546 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1704,"prepare.queue_time_us":24517,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":6124,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":152,"thread_start_us":39961,"threads_started":1,"wal-append.queue_time_us":56853}
I20260709 13:10:20.011255 29942 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:20.012163 29942 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:20.012641 29942 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:20.011559 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:20.017045 22651 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:10:20.003028 30047 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:10:20.034128 22501 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:20.037624 29947 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.041734 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:20.045624 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 85357.3us
I20260709 13:10:20.047456 29927 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:20.048020 29927 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.048396 29927 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:20.049614 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3530) took 1874 ms. Trace:
I20260709 13:10:20.050089 22503 rpcz_store.cc:276] 0709 13:10:18.175072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.453303 (+1278231us) service_pool.cc:224] Handling call
0709 13:10:19.453687 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.460326 (+  6639us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:19.631768 (+171442us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.737589 (+105821us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.811827 (+ 74238us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.811941 (+   114us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:19.811964 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.813968 (+  2004us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.049179 (+235211us) raft_consensus.cc:1685] finished
0709 13:10:20.049199 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.049402 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604,"prepare.queue_time_us":46765,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":23552,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":854,"thread_start_us":241375,"threads_started":2,"wal-append.queue_time_us":118636}
I20260709 13:10:20.053534 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.036445 23229 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:20.055979 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:20.055896 29939 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:10:20.056452 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53607.4us
I20260709 13:10:20.056926 22571 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.057415 29830 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:20.011036 29911 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:20.046952 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 68714.1us
I20260709 13:10:20.061980 22500 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:20.067003 29865 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.067766 29865 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.070254 22576 raft_consensus.cc:2410] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 13:10:20.070441 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 77720.6us
I20260709 13:10:20.071308 23262 raft_consensus.cc:2468] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 13.
I20260709 13:10:20.074334 29865 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.077100 29830 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.078708 29830 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.079330 22500 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:20.080410 29947 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.086879 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:20.095827 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:20.096192 22505 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:20.100695 22503 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:10:20.096042 22652 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:20.101799 22395 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 20. New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:20.104034 30009 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.012s
I20260709 13:10:20.105726 29909 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.107646 29972 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:20.109795 22544 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:20.113059 29370 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.113732 29370 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.115509 22574 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:10:20.116314 22574 pending_rounds.cc:85] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 13
I20260709 13:10:20.114007 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:20.118945 22497 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:20.127358 22575 raft_consensus.cc:2410] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 13:10:20.129506 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 246899us
I20260709 13:10:20.033118 29963 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.142088 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:20.142549 22578 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:20.142715 29865 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.143564 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:20.135428 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.130780 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:20.144434 23263 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.125398 22574 pending_rounds.cc:107] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:10:20.144646 30007 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:20.145294 29866 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:20.147904 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:20.137120 30045 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.225s	user 0.006s	sys 0.000s
I20260709 13:10:20.141134 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4037) took 1396 ms. Trace:
I20260709 13:10:20.141692 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.143283 29865 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.144971 22574 raft_consensus.cc:2889] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.104228 22395 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 14 to 23. New cstate: current_term: 23 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:20.139058 29942 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.155180 22497 rpcz_store.cc:276] 0709 13:10:18.744448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.923725 (+1179277us) service_pool.cc:224] Handling call
0709 13:10:19.936516 (+ 12791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.129062 (+192546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.140831 (+ 11769us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54003fb954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:20.141067 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419072896}
I20260709 13:10:20.159750 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:20.162945 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 230199us
I20260709 13:10:20.161372 29911 raft_consensus.cc:2804] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:20.161824 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:20.108234 29909 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.116458 29370 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.123301 29830 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.167626 22580 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:10:20.145335 30007 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:20.186655 30007 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.186300 22395 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.186342 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:20.188516 22395 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:20.194936 22395 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:20.197095 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53662.1us
W20260709 13:10:20.197830 22398 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 325) took 22715 ms (client timeout 15000 ms). Trace:
I20260709 13:10:20.198604 29939 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:20.199338 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:20.197384 22395 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 21. New cstate: current_term: 21 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:20.200420 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:20.201050 29909 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:10:20.170858 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.104611 30009 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.156589 22502 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:20.173344 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:20.174562 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:20.128600 29927 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.176911 29865 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.177127 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:20.177474 29942 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.178174 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:20.167759 29706 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:20.178558 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:20.179006 29072 consensus_queue.cc:1059] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 13:10:20.183677 22571 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
W20260709 13:10:20.202584 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.170043 29911 raft_consensus.cc:697] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:20.198740 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:20.201572 29909 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.230541 22505 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:20.223676 23257 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:20.231628 23263 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:20.240546 22579 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:20.241044 29072 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:20.238080 23256 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:20.233287 29909 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:20.246323 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 154625us
I20260709 13:10:20.227205 29706 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:20.224956 29979 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.257076 29830 raft_consensus.cc:3055] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:10:20.234020 29865 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:20.234843 29370 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:20.267045 29072 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.260700 29706 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:20.263259 29865 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:20.263058 29830 raft_consensus.cc:740] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:20.265468 29370 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:20.273033 29939 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:20.312331 29939 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:20.313129 29927 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.313247 29939 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.314030 29939 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:20.318260 29072 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:20.323371 22620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.324579 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:20.329841 29969 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:20.330425 29969 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.330837 29969 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:20.335918 23257 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:10:20.295358 29370 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:20.285672 29865 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.340297 22544 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:20.297825 29830 consensus_queue.cc:260] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.341553 29970 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:20.270346 29979 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.341974 29970 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.342358 29970 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:20.343757 29979 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:20.198347 22398 rpcz_store.cc:269] 0709 13:09:57.477524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.477718 (+   194us) service_pool.cc:224] Handling call
0709 13:10:20.192790 (+22715072us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:11.359567 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:11.360262 (+   695us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:11.360334 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:10:11.360348 (+    14us) tablet.cc:662] Decoding operations
0709 13:10:11.362321 (+  1973us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.362447 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.362478 (+    31us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:10:11.389948 (+ 27470us) tablet.cc:701] Row locks acquired
0709 13:10:11.414874 (+ 24926us) write_op.cc:260] PREPARE: finished
0709 13:10:11.430267 (+ 15393us) write_op.cc:270] Start()
0709 13:10:11.454674 (+ 24407us) write_op.cc:276] Timestamp: P: 1783602611424631 usec, L: 0
0709 13:10:11.460992 (+  6318us) op_driver.cc:348] REPLICATION: starting
0709 13:10:11.749233 (+288241us) log.cc:844] Serialized 9923 byte log entry
0709 13:10:12.285440 (+536207us) op_driver.cc:464] REPLICATION: finished
0709 13:10:12.429082 (+143642us) write_op.cc:301] APPLY: starting
0709 13:10:12.429180 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:12.656788 (+227608us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:12.661349 (+  4561us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:14.327953 (+1666604us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b5c002a000c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c4ed331 00007fec2c4ed221 00007fec2c4e7f6c 00007fec29c4830b 00007fec29c47fd3 00007fec29d46e34 00007fec29d3297c 00007fec29d36d61 00007fec29d36d19 00007fec29d36ca9 00007fec29d36c71
0709 13:10:14.608147 (+280194us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:14.630596 (+ 22449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:10:14.630681 (+    85us) write_op.cc:312] APPLY: finished
0709 13:10:14.631703 (+  1022us) log.cc:844] Serialized 220 byte log entry
0709 13:10:14.698691 (+ 66988us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.698897 (+   206us) write_op.cc:454] Released schema lock
0709 13:10:14.698966 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:14.741724 (+ 42758us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.816958 (+ 75234us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3407446,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":82532,"apply.run_cpu_time_us":74747,"apply.run_wall_time_us":2288302,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108727,"num_ops":25,"prepare.queue_time_us":710879,"prepare.run_cpu_time_us":77880,"prepare.run_wall_time_us":657781,"raft.queue_time_us":140568,"raft.run_cpu_time_us":9334,"raft.run_wall_time_us":37161,"replication_time_us":824212,"spinlock_wait_cycles":14269184,"thread_start_us":967898,"threads_started":5,"wal-append.queue_time_us":451188,"wal-append.run_cpu_time_us":71809,"wal-append.run_wall_time_us":2426251}]]}
W20260709 13:10:20.302686 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 131925us
I20260709 13:10:20.241302 29866 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:10:20.288107 29942 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:10:20.303795 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 130753us
I20260709 13:10:20.307370 30009 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.266444 29911 consensus_queue.cc:237] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:20.309871 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 111440us
I20260709 13:10:20.257865 29339 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:20.310611 30008 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.266872 22395 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:20.348146 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 195930us
W20260709 13:10:20.359548 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 191303us
I20260709 13:10:20.353730 29942 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:20.360731 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 113423us
W20260709 13:10:20.381846 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.386013 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:20.355448 29898 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:10:20.391103 29072 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:20.401546 29840 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:20.404173 30057 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:20.405011 30057 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.407439 30057 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:20.383193 29942 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:20.425396 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:20.414062 29649 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:10:20.426447 23256 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:20.427400 22618 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:20.441422 30062 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:20.442078 30062 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:20.442471 30062 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.443459 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:20.444382 23263 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:20.446187 22469 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:20.462436 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.473040 23256 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 25.
I20260709 13:10:20.485853 30064 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:20.486662 30064 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:20.487807 30064 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:20.490813 30058 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:10:20.493719 29830 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:20.505188 22395 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 13, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 13 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:20.509877 29072 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:20.508559 22395 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 12 to 19, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 19 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:20.510509 29072 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.511349 22395 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 3 to 14, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 14 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:20.512542 29072 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.513201 29649 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.470485 29909 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.515679 29947 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:20.530534 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49085us
I20260709 13:10:20.529304 29898 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.540759 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 165402us
W20260709 13:10:20.517971 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 71901.3us
I20260709 13:10:20.544095 22498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4032) took 1862 ms. Trace:
I20260709 13:10:20.569321 22498 rpcz_store.cc:276] 0709 13:10:18.681592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.895589 (+1213997us) service_pool.cc:224] Handling call
0709 13:10:19.921022 (+ 25433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.958953 (+ 37931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.959001 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.002676 (+ 43675us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.266996 (+264320us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:20.282031 (+ 15035us) log.cc:844] Serialized 14 byte log entry
0709 13:10:20.442456 (+160425us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:20.540379 (+ 97923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.540508 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.540574 (+    66us) raft_consensus.cc:1685] finished
0709 13:10:20.543826 (+  3252us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.544019 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18331,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":56,"raft.queue_time_us":37492,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":250,"spinlock_wait_cycles":31715200,"thread_start_us":392951,"threads_started":2,"wal-append.queue_time_us":283579}
W20260709 13:10:20.576926 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 195125us
I20260709 13:10:20.540241 29339 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:20.588660 22469 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:20.523890 30057 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:10:20.542327 30008 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:20.536548 29649 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.571542 29947 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:20.610095 22579 raft_consensus.cc:1275] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:10:20.620549 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:20.606107 22652 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:20.615927 22646 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 25. Current term is 26. Ops: []
W20260709 13:10:20.621937 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 146029us
I20260709 13:10:20.617717 23227 leader_election.cc:400] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13.
I20260709 13:10:20.604192 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:20.605996 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:20.623456 23227 leader_election.cc:403] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:20.614785 22645 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:10:20.611055 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 212385us
I20260709 13:10:20.590782 29339 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:20.545306 29898 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.608464 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:20.641664 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.606899 30065 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.613381 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:20.613000 29927 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:20.603667 29866 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.606443 29909 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.616891 29650 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:20.633486 29979 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:20.615109 29706 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.634266 29339 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.626745 29947 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.667367 30065 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.668016 22395 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 16 to 18, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:20.669700 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72745.3us
I20260709 13:10:20.669883 29866 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.670380 29942 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.671152 29909 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.615016 29972 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:10:20.679312 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81626.5us
I20260709 13:10:20.683518 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.659278 29927 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.695604 23262 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:20.666069 29650 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:20.679068 29840 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 12. Current term is 13.
W20260709 13:10:20.721120 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47708.8us
I20260709 13:10:20.668329 29957 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.657496 30061 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.110s
W20260709 13:10:20.723378 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.658782 29939 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:20.666534 30007 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.690243 29979 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:20.733506 22647 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:20.725899 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:20.778765 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 161333us
I20260709 13:10:20.724355 29927 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.785852 30077 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.787565 29911 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:20.787075 29650 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.788695 30060 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:20.790908 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65074.7us
I20260709 13:10:20.792559 30073 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.110s
I20260709 13:10:20.795976 29649 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.795078 22395 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 15 to 16, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 16 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.799578 29865 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.803464 29898 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:20.813532 30055 log.cc:927] Time spent T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:10:20.783749 29972 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.815514 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:20.817485 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:20.817845 23263 raft_consensus.cc:1240] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 13:10:20.819135 22502 raft_consensus.cc:1275] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:20.808120 29970 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:20.818151 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 150293us
I20260709 13:10:20.785147 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:20.844391 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 57329.5us
I20260709 13:10:20.724846 29909 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.783280 30067 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.861660 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 131361us
W20260709 13:10:20.848553 29969 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.007s
I20260709 13:10:20.777943 29370 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.825553 30057 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.846926 29939 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:10:20.885205 23255 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:20.889158 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:20.889683 29947 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.889906 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:20.890166 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:20.890503 29370 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.890583 22645 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.870375 30009 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.871683 29650 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.892498 29909 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.819981 29957 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.895785 29840 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:10:20.917613 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:20.913789 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:20.914037 22545 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:20.915556 30066 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.915982 30070 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:20.896771 29947 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.893147 30075 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:20.927649 22647 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:10:20.905479 29706 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.935036 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:20.925318 29909 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.938620 29865 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.928066 29979 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.941634 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.941877 29370 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:20.942422 29370 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:20.943267 30080 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.896027 30064 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.970963 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.982195 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.881268 29969 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.982589 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.983018 22580 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24.
I20260709 13:10:20.955094 30075 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.988106 30075 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:20.990370 22571 raft_consensus.cc:2410] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:10:20.994052 30070 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:20.996510 30070 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.007056 29072 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:21.007136 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.974274 30073 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:21.024003 30085 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:21.024883 30093 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:21.024678 30085 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.983242 29970 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.022441 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1542) took 1281 ms. Trace:
W20260709 13:10:21.031003 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 254620us
I20260709 13:10:21.030826 22496 rpcz_store.cc:276] 0709 13:10:19.755973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.047033 (+291060us) service_pool.cc:224] Handling call
0709 13:10:20.047470 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.047944 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.047982 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.048539 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.294849 (+246310us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:20.294902 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.294994 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:21.022135 (+727141us) raft_consensus.cc:1685] finished
0709 13:10:21.022166 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.022350 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2934,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":245870,"threads_started":1,"wal-append.queue_time_us":345254}
I20260709 13:10:21.032894 22579 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:20.938217 29909 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:21.029804 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 133431us
I20260709 13:10:21.017155 29942 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:20.954610 30009 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.058856 22572 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:21.018170 30057 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.063021 30057 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:21.057086 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.064091 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.065186 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.065415 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.954278 29370 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:20.954371 30067 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.044143 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.045900 30078 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:21.047036 22580 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:21.049345 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.026353 30080 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.030645 29865 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:21.100142 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 165255us
I20260709 13:10:21.008517 30064 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.110527 30067 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.053231 29840 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:21.056238 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.114861 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:20.944257 30066 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.057449 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.119484 22574 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:21.120294 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.122238 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.125370 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.130712 29909 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.134477 29969 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.135682 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.136945 22572 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:21.138852 29957 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.140049 29972 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.096233 30007 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.141395 30007 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:21.142161 30007 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.147428 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.148345 22579 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:21.148633 29963 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.149297 29963 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.150260 29939 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:21.150702 29939 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:21.152124 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:21.153039 29963 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:21.153225 30083 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:10:21.153776 29963 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.154356 29963 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.151728 29939 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.160161 29942 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:21.040062 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:20.977823 29947 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.165915 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:21.166317 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:21.166555 29947 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:21.036181 29830 consensus_meta.cc:287] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.004s
I20260709 13:10:21.166939 23263 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.019903 30073 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.167379 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:21.167587 30073 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:21.167986 30064 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:21.058893 30062 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.005s
I20260709 13:10:21.074002 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.168633 30062 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.101488 30065 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.057057 22395 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 10 to 18, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:21.171756 29927 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.172223 30062 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.173050 22651 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:21.172827 22395 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:21.175124 29927 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.174844 22395 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:21.074908 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.165970 23262 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:21.074796 30009 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.197439 23264 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 27.
W20260709 13:10:21.097958 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53908.7us
I20260709 13:10:21.105400 29866 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.106375 30085 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.105790 30078 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.106910 30060 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:21.106931 29865 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.042372 30090 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:21.228499 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.109731 30075 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.109891 30080 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:21.160277 29939 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:21.181770 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.182258 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:21.094622 22645 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:21.198355 22579 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
W20260709 13:10:21.197480 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.216953 23263 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:21.218607 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:21.223711 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:21.225752 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.226686 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.226716 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.227843 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.229281 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.234898 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.235736 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.236621 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.245644 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:21.198079 29963 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.238843 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.241945 22499 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:21.243582 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:21.244375 22576 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:21.245153 22544 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:21.253477 22497 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:10:21.253561 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.255219 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:21.257221 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:21.226514 29866 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.248092 22500 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:21.229564 30065 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.229426 30090 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.254635 22574 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:21.249053 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:21.260054 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.261107 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.263811 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.259330 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.262709 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.264966 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.267992 22499 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:21.269276 22499 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:10:21.200819 29947 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:10:21.277021 30094 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:10:21.277455 22395 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 18 to 23, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 23 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:21.278942 22653 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:10:21.279111 22395 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:21.280031 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.237154 30007 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.281422 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.284032 22503 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:21.268018 22500 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
W20260709 13:10:21.293049 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44099.3us
I20260709 13:10:21.260699 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.284032 22498 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:10:21.294404 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:21.296471 30009 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:21.297423 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:21.297799 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68252.9us
I20260709 13:10:21.298362 30073 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.299134 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:21.300345 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.300683 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.301421 22648 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:21.249807 30096 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.302747 30096 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:21.305627 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.305751 22650 raft_consensus.cc:1240] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:10:21.307071 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:21.309182 30072 consensus_queue.cc:1059] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:21.310042 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:21.310271 30072 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:21.310907 30091 raft_consensus.cc:3055] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:21.311085 30060 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:21.311359 30091 raft_consensus.cc:740] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:21.311619 30060 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.312098 30060 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:21.312047 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:21.312852 23258 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
W20260709 13:10:21.315061 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 273025us
I20260709 13:10:21.312413 30091 consensus_queue.cc:260] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.317606 30091 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:21.298686 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:21.322613 30057 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:21.322767 29865 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.323225 30057 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:21.291968 30080 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:10:21.325336 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.311647 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:21.339710 22497 raft_consensus.cc:1240] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:21.341006 29072 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:21.338366 22647 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:21.341445 29072 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:21.341917 29072 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:21.342260 22618 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:21.341379 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:21.343655 23263 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 25: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:21.242537 29840 consensus_queue.cc:1048] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.084s
I20260709 13:10:21.266986 29370 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:21.284159 30090 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:21.362948 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 81836.6us
I20260709 13:10:21.246415 30075 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.369359 22503 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:21.324265 30057 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.338358 30007 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:21.375862 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.346925 29865 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:21.386137 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:21.394539 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69458.8us
W20260709 13:10:21.396188 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.292327 30065 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.284106 29866 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.371631 30094 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.413079 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.380626 29942 raft_consensus.cc:2804] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:10:21.404783 22578 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:21.421397 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.419306 22497 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 22: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:21.419871 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:21.428167 22503 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:21.430990 29649 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:21.431715 29649 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.392204 30007 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:21.432961 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.421690 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.381857 29969 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:10:21.457475 30096 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.467680 29927 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.424273 29370 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:21.479717 22500 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:10:21.489298 22504 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:21.463248 29339 consensus_meta.cc:287] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.740s	user 0.015s	sys 0.004s
I20260709 13:10:21.460336 30007 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:21.496418 22500 raft_consensus.cc:1275] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:21.449196 29942 raft_consensus.cc:697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:21.450058 29830 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:21.458519 30066 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.280798 22395 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 16 to 22, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 22 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } }
I20260709 13:10:21.473889 30072 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.513154 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 101031us
I20260709 13:10:21.490931 30096 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:21.487615 30073 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:21.426910 30094 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:21.527204 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.532135 29979 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:21.533782 29963 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:21.534273 29963 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:21.535172 29963 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.536334 29963 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:21.537848 30101 log.cc:927] Time spent T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:21.541739 29942 consensus_queue.cc:237] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.541381 22395 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 13 to 23, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 23 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:21.543992 29650 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:10:21.545527 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 174751us
I20260709 13:10:21.544610 29650 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.555265 22503 raft_consensus.cc:2468] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:21.553238 30069 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:10:21.557464 29947 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.557209 30072 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.557832 29370 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.559515 30072 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:21.557988 29947 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.488359 29927 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.515883 29866 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.497942 29339 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.568588 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.543820 22395 catalog_manager.cc:5697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 17, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 17 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:21.572602 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.532208 29649 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.509258 29830 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.583268 30069 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:21.583361 22543 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:21.528062 29865 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 13:10:21.561779 30078 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.586045 22652 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:21.582851 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.588178 22571 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:21.590107 22645 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:10:21.590636 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.591295 22575 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:21.592602 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.592005 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:21.593392 22503 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:21.594638 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.595645 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.596963 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.597945 22574 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:10:21.598136 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.598851 22572 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:21.599115 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.599761 22574 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:21.602561 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.604385 22579 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:10:21.605822 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.606575 22580 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:21.563748 30061 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:10:21.618407 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.623315 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.627590 29866 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:21.577812 30066 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:10:21.642112 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.632012 22617 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:21.635159 22543 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:21.648615 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.644321 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:21.648357 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:21.651235 22574 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:21.651467 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:21.649410 22497 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:21.612511 29840 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:21.655125 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.629148 30078 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.662456 22649 raft_consensus.cc:2393] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:21.663730 30119 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:21.664227 30092 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:21.664723 30092 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.584575 30112 consensus_queue.cc:1048] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:10:21.665126 22395 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 19 to 26. New cstate: current_term: 26 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:21.667320 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 75979.7us
I20260709 13:10:21.668025 29072 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.668109 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:21.669278 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.628474 29866 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.656474 29939 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:21.664438 30119 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:21.670749 30106 log.cc:927] Time spent T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.220s	user 0.001s	sys 0.003s
I20260709 13:10:21.660173 30072 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:21.649686 30062 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:10:21.692108 29072 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:21.665158 30092 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:21.672924 30096 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:21.671095 29979 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:21.662981 30065 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.656628 30070 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:10:21.699656 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.691530 29939 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.703514 30111 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:10:21.704041 30081 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:21.750679 22649 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:21.753937 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:21.763628 22497 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:21.701931 30077 consensus_meta.cc:287] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.000s
W20260709 13:10:21.770104 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 102436us
I20260709 13:10:21.702417 30096 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.772996 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.754827 29939 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:21.776494 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:21.775314 30065 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:21.763679 30111 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:21.779695 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:21.785856 22500 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 17: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:21.787052 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:21.787739 22647 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:21.789223 29830 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:21.792986 29947 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:21.793959 30126 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:10:21.794119 30099 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:21.794829 30099 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.796929 30095 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:21.797528 30095 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:21.799563 30095 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.801563 29927 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:21.802157 30115 log.cc:927] Time spent T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:10:21.667017 22395 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 14 to 15, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 15 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:21.804371 30114 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:21.804994 29979 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:21.805748 30089 raft_consensus.cc:3055] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:21.806203 30089 raft_consensus.cc:740] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:21.774755 30096 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:21.772607 30077 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:21.810192 22575 raft_consensus.cc:2468] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:21.808903 22580 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:21.809633 22574 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:21.782243 30082 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:21.793988 30120 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:10:21.873813 30120 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:21.874233 22572 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:21.874765 30120 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:21.782140 30078 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:10:21.704638 30109 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.097s
W20260709 13:10:21.863348 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75175.9us
I20260709 13:10:21.877207 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:21.989512 22497 raft_consensus.cc:2468] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
W20260709 13:10:21.990571 23263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.015s
W20260709 13:10:21.991039 23263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.015s
I20260709 13:10:21.991768 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.992661 22574 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:21.994347 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.995308 22580 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:21.996726 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:21.997681 23229 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:21.775919 29969 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:10:21.804028 22395 catalog_manager.cc:5697] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 7 to 12, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 12 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.098488 22580 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:10:22.097929 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.093142 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:22.097010 22654 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:21.862545 29339 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:21.877952 29957 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.097802 22543 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.131:35857 timed out after 1.641s (SENT) [suppressed 23 similar messages]
I20260709 13:10:21.988066 30094 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:10:22.110237 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:22.144202 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 140029us
I20260709 13:10:22.107266 29866 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:22.126368 30091 consensus_meta.cc:287] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.007s
I20260709 13:10:22.093778 29963 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:22.147055 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.145210 30094 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:22.150713 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:22.158187 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 160558us
I20260709 13:10:22.155236 29963 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.161192 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3498) took 1049 ms. Trace:
I20260709 13:10:22.161651 22650 rpcz_store.cc:276] 0709 13:10:21.111696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.113867 (+  2171us) service_pool.cc:224] Handling call
0709 13:10:21.114251 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.306283 (+192032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.158616 (+852333us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400169c54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:22.161138 (+  2522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439680256}
I20260709 13:10:22.164198 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.166190 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:22.150452 30077 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.155478 30094 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:22.161377 30082 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:22.113656 29957 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.199576 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.202407 22650 raft_consensus.cc:2393] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 24: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:22.172214 29911 raft_consensus.cc:2764] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:10:22.165298 30081 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:22.163250 30069 raft_consensus.cc:2804] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:22.203135 30077 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.171994 29947 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:22.206835 30079 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:10:22.208386 30122 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:10:22.201311 30094 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:22.179175 29650 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:22.211036 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51621.9us
I20260709 13:10:22.214280 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.220606 22650 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:22.208447 29959 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:10:22.171555 29370 consensus_queue.cc:1059] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:10:22.225117 29370 raft_consensus.cc:3055] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:10:22.224187 30128 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:10:22.204437 30081 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.225787 29370 raft_consensus.cc:740] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:22.259711 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 92530.4us
W20260709 13:10:22.226577 30121 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.449s	user 0.002s	sys 0.000s
I20260709 13:10:22.294834 22545 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.219728 30069 raft_consensus.cc:697] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 22 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:22.314591 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 216795us
W20260709 13:10:22.393426 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 98709.8us
W20260709 13:10:22.297824 23227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.032s	sys 0.024s
I20260709 13:10:22.235528 30081 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:22.292158 30124 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.539s	user 0.002s	sys 0.000s
I20260709 13:10:22.209790 30082 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.398810 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.398808 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:22.402720 23227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.032s	sys 0.024s
W20260709 13:10:22.405280 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 756768us
W20260709 13:10:22.401702 30060 consensus_meta.cc:287] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 1.089s	user 0.006s	sys 0.009s
I20260709 13:10:22.300110 29979 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:22.303164 29650 consensus_queue.cc:1059] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.110s
I20260709 13:10:22.407351 29947 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:22.397287 30114 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:22.434428 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.427189 30082 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:22.428946 29911 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:22.393003 30065 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:22.407785 30061 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.013s
I20260709 13:10:22.446354 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:22.448092 29339 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:22.449653 29911 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:10:22.450035 30134 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:10:22.451658 30069 consensus_queue.cc:237] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.439741 30093 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:22.470319 22497 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:22.432070 30137 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:22.477414 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.457192 29650 raft_consensus.cc:3055] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:10:22.458751 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47842.2us
I20260709 13:10:22.442948 30099 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:22.469949 30061 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.013s	sys 0.014s
W20260709 13:10:22.489836 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54218.9us
I20260709 13:10:22.495674 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:22.438822 30060 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.474452 29911 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:22.501011 22545 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:22.442147 29979 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.484725 29963 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.469594 30065 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.511974 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:22.513001 22500 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:22.493794 29650 raft_consensus.cc:740] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:22.445214 29370 consensus_queue.cc:260] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.478826 29339 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:22.516381 30133 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 13:10:22.509766 30130 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:22.504832 30079 consensus_queue.cc:1048] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:10:22.516952 29963 raft_consensus.cc:2804] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:22.529176 29963 raft_consensus.cc:697] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:22.530597 29963 consensus_queue.cc:237] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.531266 30065 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:22.523952 30060 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.500420 30093 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.534826 30093 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:22.525344 29650 consensus_queue.cc:260] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.535763 29650 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:22.538546 22578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2837) took 1477 ms (client timeout 1962 ms). Trace:
W20260709 13:10:22.538998 22578 rpcz_store.cc:269] 0709 13:10:21.061628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.066154 (+  4526us) service_pool.cc:224] Handling call
0709 13:10:22.538349 (+1472195us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54003f5554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:22.538481 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525500160}
I20260709 13:10:22.543107 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.544337 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.549853 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.551061 29650 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.551504 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.494419 30137 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.552623 29650 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:22.553117 29650 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:22.553500 29650 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:22.554672 30081 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.558091 29339 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:22.560966 29911 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.562309 29650 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.563135 29911 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:22.563843 30065 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.564375 30065 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.566849 30065 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.570649 29979 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:22.572154 29370 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:22.554728 30137 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.573846 29650 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.580171 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:10:22.562122 29939 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.699s	user 0.005s	sys 0.006s
I20260709 13:10:22.594811 22500 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:22.599618 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:22.606990 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.612039 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:22.524284 30077 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:22.609370 22617 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:22.619740 23229 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:22.621047 30060 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:22.621560 30137 raft_consensus.cc:2804] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:10:22.621973 30096 consensus_meta.cc:287] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.000s
I20260709 13:10:22.622182 30137 raft_consensus.cc:697] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:22.622637 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.623322 22651 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:22.623382 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.623647 30075 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:22.624356 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.625126 22653 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:22.626052 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.626621 22653 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:22.588119 29339 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.627573 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.627452 29339 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.628533 22653 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:22.617192 22579 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:22.633675 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3514) took 1354 ms. Trace:
I20260709 13:10:22.634100 22645 rpcz_store.cc:276] 0709 13:10:21.278808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.338045 (+ 59237us) service_pool.cc:224] Handling call
0709 13:10:22.633428 (+1295383us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400237654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:22.633584 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471004544}
I20260709 13:10:22.635396 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.636123 22645 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:22.632675 30090 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.227s	user 0.011s	sys 0.002s
I20260709 13:10:22.637540 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.637390 30090 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.638898 22646 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:22.638854 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.639847 30090 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:22.640250 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.641060 30075 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.641387 29339 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:22.641568 30075 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:22.643123 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.640357 22646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3502) took 1526 ms (client timeout 1886 ms). Trace:
W20260709 13:10:22.643893 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.643818 22646 rpcz_store.cc:269] 0709 13:10:21.113728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.121842 (+  8114us) service_pool.cc:224] Handling call
0709 13:10:22.640170 (+1518328us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002da0d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:22.640300 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3485731200}
I20260709 13:10:22.645088 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.646353 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.647112 22646 raft_consensus.cc:3060] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:22.647500 22651 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:22.648056 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2975) took 1083 ms. Trace:
I20260709 13:10:22.648402 22651 rpcz_store.cc:276] 0709 13:10:21.564663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.597713 (+1033050us) service_pool.cc:224] Handling call
0709 13:10:22.647996 (+ 50283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.649416 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.650195 29972 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:22.650617 29972 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:22.652910 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 43661.7us
I20260709 13:10:22.622387 30096 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.614530 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.621078 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:22.654883 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 154013us
I20260709 13:10:22.621838 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.647616 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.650168 22651 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:22.623173 30137 consensus_queue.cc:237] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.653633 22617 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:22.659049 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2967) took 1197 ms. Trace:
I20260709 13:10:22.658732 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:22.660557 23258 raft_consensus.cc:2368] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17.
I20260709 13:10:22.662178 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.663977 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.659454 22653 rpcz_store.cc:276] 0709 13:10:21.461860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.627272 (+1165412us) service_pool.cc:224] Handling call
0709 13:10:22.658978 (+ 31706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.658453 22543 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:22.675814 23257 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:10:22.672416 22648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3516) took 1393 ms. Trace:
I20260709 13:10:22.684789 23264 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 22 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:22.685155 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.681914 22648 rpcz_store.cc:276] 0709 13:10:21.279416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.639981 (+1360565us) service_pool.cc:224] Handling call
0709 13:10:22.672323 (+ 32342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.692346 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.653874 30062 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:22.687417 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.694368 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.597324 29939 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.671442 30093 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:22.684407 30090 raft_consensus.cc:2804] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:22.706269 22646 raft_consensus.cc:2468] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:22.709681 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.706229 23256 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:22.713121 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.651487 29972 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.621599 30060 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.723454 22577 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 22: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:22.724367 22571 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:22.716910 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.729318 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.730218 22645 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:22.733249 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74651.6us
I20260709 13:10:22.689894 30072 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:22.737861 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.738845 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.739769 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2969) took 1277 ms. Trace:
I20260709 13:10:22.740343 22645 rpcz_store.cc:276] 0709 13:10:21.462694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.711249 (+1248555us) service_pool.cc:224] Handling call
0709 13:10:22.739684 (+ 28435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.736546 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.741950 23256 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:22.741955 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.734586 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:22.714581 30062 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:22.736763 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.718096 30093 raft_consensus.cc:697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:10:22.743232 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 84817.8us
I20260709 13:10:22.743387 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:22.741478 22577 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:22.745951 22545 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:22.744339 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.743743 22653 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:22.748034 23227 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.748122 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2979) took 1134 ms. Trace:
I20260709 13:10:22.748638 22653 rpcz_store.cc:276] 0709 13:10:21.613902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.721279 (+1107377us) service_pool.cc:224] Handling call
0709 13:10:22.748063 (+ 26784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.730548 30090 raft_consensus.cc:697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:22.749701 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.730854 30145 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:22.719290 30081 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.751911 22651 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:22.751796 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:22.752496 29830 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:22.753683 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.741559 29972 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:22.753800 22577 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:22.772204 23255 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:10:22.757536 30062 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.758078 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.773914 23227 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.759366 30096 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.759618 29939 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:22.759804 30142 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:10:22.745349 30007 consensus_meta.cc:287] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.232s	user 0.013s	sys 0.000s
W20260709 13:10:22.760965 30094 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.003s
I20260709 13:10:22.762343 30145 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.762768 30152 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:22.763211 23256 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:22.763614 30093 consensus_queue.cc:237] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.766083 22645 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:22.766928 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:22.774478 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:22.778719 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:22.779413 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 121035us
I20260709 13:10:22.750192 29963 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:22.780244 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:22.846451 22647 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:22.780368 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:22.850973 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2984) took 1073 ms. Trace:
W20260709 13:10:22.766366 30092 consensus_meta.cc:287] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.063s	user 0.013s	sys 0.000s
I20260709 13:10:22.794402 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.793442 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:22.851346 22647 rpcz_store.cc:276] 0709 13:10:21.777823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.774236 (+996413us) service_pool.cc:224] Handling call
0709 13:10:22.850848 (+ 76612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.857183 22653 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:22.795136 22652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3503) took 1671 ms (client timeout 1641 ms). Trace:
I20260709 13:10:22.798110 22650 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:22.800771 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:22.861452 22576 raft_consensus.cc:3060] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:22.804560 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:22.862231 22578 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:22.809177 30094 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.810901 30070 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:22.784417 30007 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:22.822002 30130 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:22.815182 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.816123 22574 raft_consensus.cc:2410] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:10:22.817368 30145 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:22.875589 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:22.877226 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.877703 30094 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.878471 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.878654 22572 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 24. Current term is 25. Ops: []
I20260709 13:10:22.879216 23256 raft_consensus.cc:2393] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 27: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:22.881752 30007 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.819022 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:22.885097 30119 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:22.885286 22497 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:22.887358 29339 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:22.887792 29339 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.888125 29339 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:22.851547 30152 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.791347 30112 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:22.791755 30149 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:22.784317 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:22.830219 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.917219 22501 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:22.833962 22505 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:22.846454 22500 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:22.846892 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.841977 22651 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:22.920390 22651 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:22.921226 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3512) took 1643 ms. Trace:
I20260709 13:10:22.921628 22651 rpcz_store.cc:276] 0709 13:10:21.278234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.919511 (+1641277us) service_pool.cc:224] Handling call
0709 13:10:22.919904 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.920887 (+   983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.921153 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.923740 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1509) took 1632 ms. Trace:
I20260709 13:10:22.923997 22576 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:22.833858 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 2968) took 1371 ms. Trace:
I20260709 13:10:22.925065 22645 rpcz_store.cc:276] 0709 13:10:21.462210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.741271 (+1279061us) service_pool.cc:224] Handling call
0709 13:10:22.833790 (+ 92519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.771816 29830 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:22.855188 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:22.926047 22497 raft_consensus.cc:2468] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:22.926780 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:22.927654 22498 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:22.856201 22496 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:22.794330 30120 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:22.865383 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:22.866448 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3510) took 1588 ms. Trace:
I20260709 13:10:22.925671 22617 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:22.935840 22650 rpcz_store.cc:276] 0709 13:10:21.277627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.797541 (+1519914us) service_pool.cc:224] Handling call
0709 13:10:22.797876 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.866065 (+ 68189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.866371 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.924269 22651 rpcz_store.cc:276] 0709 13:10:21.291834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.922654 (+1630820us) service_pool.cc:224] Handling call
0709 13:10:22.923030 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.923274 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.923314 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.923376 (+    62us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:22.923433 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.923510 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.923668 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:22.860704 22652 rpcz_store.cc:269] 0709 13:10:21.123571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.200803 (+ 77232us) service_pool.cc:224] Handling call
0709 13:10:22.794935 (+1594132us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54002daad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:22.795040 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783995776}
I20260709 13:10:22.869707 22577 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:22.812353 22618 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:22.821801 30081 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:22.855868 29963 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:10:22.786193 23227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.898089 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3511) took 1620 ms. Trace:
I20260709 13:10:22.898054 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:22.937386 22650 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
W20260709 13:10:22.938222 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 125975us
I20260709 13:10:22.940963 22647 rpcz_store.cc:276] 0709 13:10:21.277942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.872662 (+1594720us) service_pool.cc:224] Handling call
0709 13:10:22.873105 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.897712 (+ 24607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.897741 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.897783 (+    42us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:22.897813 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.897876 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.898020 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.941571 22578 raft_consensus.cc:1240] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:10:22.860494 29979 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.059s
I20260709 13:10:22.902503 30152 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:22.951159 23257 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:10:22.951666 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 53759.7us
I20260709 13:10:22.952405 22618 leader_election.cc:400] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17.
I20260709 13:10:22.953285 22618 leader_election.cc:403] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:10:22.953941 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:22.951483 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 104684us
I20260709 13:10:22.957129 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:22.959046 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:22.961206 22647 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:10:22.961615 22647 pending_rounds.cc:85] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 13
I20260709 13:10:22.961827 22647 pending_rounds.cc:107] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:10:22.901651 30109 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:22.962054 22647 raft_consensus.cc:2889] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:22.901433 30112 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:22.963083 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:22.991523 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2972) took 1491 ms. Trace:
I20260709 13:10:22.992002 22652 rpcz_store.cc:276] 0709 13:10:21.500219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.937731 (+1437512us) service_pool.cc:224] Handling call
0709 13:10:22.990926 (+ 53195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.991104 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.991131 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.991178 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:22.991223 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.991303 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.991447 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.993391 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:22.995499 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2858) took 1002 ms. Trace:
I20260709 13:10:22.999539 22580 rpcz_store.cc:276] 0709 13:10:21.992825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.112494 (+119669us) service_pool.cc:224] Handling call
0709 13:10:22.145853 (+ 33359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.149409 (+  3556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.149444 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.160482 (+ 11038us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.448303 (+287821us) spinlock_profiling.cc:243] Waited 876 us on lock 0x7b18004c5f40. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1 00007fec262b6a0f
0709 13:10:22.504264 (+ 55961us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:22.504323 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.504440 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.945114 (+440674us) raft_consensus.cc:1685] finished
0709 13:10:22.945136 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.995416 (+ 50280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":230,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5786,"spinlock_wait_cycles":2015488,"thread_start_us":55532,"threads_started":1,"wal-append.queue_time_us":416447}
I20260709 13:10:22.913592 30067 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:22.940040 30069 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:22.952134 29939 raft_consensus.cc:2804] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:22.937667 30096 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.935232 29830 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:23.010150 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2981) took 1259 ms. Trace:
I20260709 13:10:22.945343 29963 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:22.868759 30092 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.871568 30070 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.961242 29370 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:22.989410 30094 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:22.944715 30151 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:22.989799 30079 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:22.937363 30065 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:10:23.006538 30114 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:23.007292 29706 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.960696 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2966) took 1515 ms. Trace:
I20260709 13:10:23.069757 22650 rpcz_store.cc:276] 0709 13:10:21.461355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.936784 (+1475429us) service_pool.cc:224] Handling call
0709 13:10:22.937137 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.944389 (+  7252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.944636 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.024145 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3526) took 1145 ms. Trace:
I20260709 13:10:23.071662 22652 rpcz_store.cc:276] 0709 13:10:21.878834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.993093 (+1114259us) service_pool.cc:224] Handling call
0709 13:10:23.023415 (+ 30322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.023680 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.023722 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.023783 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:23.023839 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.023914 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.024064 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.011780 30067 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.025822 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.025774 29898 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:23.064055 22649 raft_consensus.cc:2368] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21.
I20260709 13:10:22.990278 30081 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:23.035199 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 91835.1us
I20260709 13:10:23.021667 22645 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:22.989635 30062 consensus_queue.cc:1059] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 13:10:23.063696 22544 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80dc0c7d4f9341eeb7472424613de2ce. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:23.084300 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 94598.9us
I20260709 13:10:23.008384 30109 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:22.937600 30090 consensus_queue.cc:237] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:23.013638 29649 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:23.080739 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 126227us
I20260709 13:10:23.085199 22652 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:10:23.103293 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.090719 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:10:23.105604 22580 raft_consensus.cc:606] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:23.106383 22505 raft_consensus.cc:1240] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:23.093266 22653 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:23.108932 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3518) took 1829 ms. Trace:
W20260709 13:10:23.097929 30132 log.cc:927] Time spent T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.792s	user 0.004s	sys 0.000s
I20260709 13:10:23.086349 22645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3525) took 1274 ms. Trace:
I20260709 13:10:23.102324 30067 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.111123 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:10:23.113270 23263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46812 (request call id 1202) took 1753 ms. Trace:
I20260709 13:10:23.113338 22580 raft_consensus.cc:606] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:23.113722 23263 rpcz_store.cc:276] 0709 13:10:21.359554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.359709 (+   155us) service_pool.cc:224] Handling call
0709 13:10:21.384263 (+ 24554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.393442 (+  9179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.393489 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.432984 (+ 39495us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.993683 (+560699us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:21.993746 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.993844 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.096901 (+1103057us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:23.112943 (+ 16042us) raft_consensus.cc:1685] finished
0709 13:10:23.112964 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.113194 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22846,"raft.queue_time_us":102299,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11263,"spinlock_wait_cycles":14982400,"thread_start_us":558007,"threads_started":1,"wal-append.queue_time_us":767510}
I20260709 13:10:23.114984 22645 rpcz_store.cc:276] 0709 13:10:21.811716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.988906 (+1177190us) service_pool.cc:224] Handling call
0709 13:10:23.021267 (+ 32361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.086102 (+ 64835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.086294 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.117022 22645 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:23.117594 30075 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.118664 22653 rpcz_store.cc:276] 0709 13:10:21.279955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.793140 (+1513185us) service_pool.cc:224] Handling call
0709 13:10:23.108850 (+315710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.119863 22653 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 25. Current term is 26. Ops: []
I20260709 13:10:23.125038 30153 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:23.126945 30156 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:23.129036 30112 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.130575 30112 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:23.136955 30111 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.139106 30111 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:23.139035 30089 consensus_queue.cc:260] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.142319 30089 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:23.145905 30154 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:23.147668 30165 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:10:23.149612 30151 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17.
W20260709 13:10:23.150460 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 47262.2us
I20260709 13:10:23.152061 22504 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:23.013686 22647 rpcz_store.cc:276] 0709 13:10:21.750485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.941957 (+1191472us) service_pool.cc:224] Handling call
0709 13:10:22.960819 (+ 18862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.006163 (+ 45344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.010079 (+  3916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.069304 30114 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:10:23.089871 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.77159e+06us
W20260709 13:10:23.137717 30155 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:10:23.169548 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.204845 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.173539 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.196087 23257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2"
dest_uuid: "fa2f181263f446a6962b649f9348c15f"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:52390
I20260709 13:10:23.012246 30096 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.204075 30114 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:23.219841 30166 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:23.221065 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83247.3us
W20260709 13:10:23.232610 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 84570.4us
I20260709 13:10:23.081557 29706 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:23.246917 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 287939us
I20260709 13:10:23.250092 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:23.251895 22653 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
W20260709 13:10:23.253839 30161 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:10:23.197497 30079 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:10:23.257599 30070 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:23.261225 30081 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:23.268429 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.273188 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:23.274123 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:23.274588 22498 raft_consensus.cc:2468] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 25.
I20260709 13:10:23.270252 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:23.276682 22579 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:23.284174 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:23.284933 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.239346 30067 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.286055 22498 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:23.288059 30144 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:23.287955 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:23.238006 30165 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:23.309274 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 315950us
I20260709 13:10:23.312042 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:23.308609 22543 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:23.313740 23257 raft_consensus.cc:606] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.314318 23257 raft_consensus.cc:614] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:23.266330 30092 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:23.265763 29706 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.318466 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:23.324693 23258 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:23.327049 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.302590 30144 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:23.264817 30145 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.336601 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:23.337512 23261 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:23.318648 30095 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:23.341173 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.321406 29939 raft_consensus.cc:697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:23.348796 29939 consensus_queue.cc:237] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:23.358592 22654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3507) took 2233 ms (client timeout 1757 ms). Trace:
W20260709 13:10:23.359299 22654 rpcz_store.cc:269] 0709 13:10:21.125105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.232139 (+107034us) service_pool.cc:224] Handling call
0709 13:10:23.358220 (+2126081us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540017f2d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:23.358412 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483806976}
I20260709 13:10:23.361384 30060 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:23.363046 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:23.364027 22647 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:23.365413 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:23.366742 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:23.367518 22645 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:10:23.368412 22573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1289) took 2106 ms. Trace:
W20260709 13:10:23.370131 22468 connection.cc:256] RPC call timeout handler was delayed by -1.3421449239999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:10:23.371071 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:23.371259 22468 connection.cc:256] RPC call timeout handler was delayed by -1.0476535079999394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 13:10:23.371843 22580 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:10:23.373917 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:23.374328 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:23.376487 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:23.376633 22654 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:10:23.377929 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:23.383399 30111 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:23.384095 30111 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.386670 30111 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.384696 30078 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:23.394543 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.372418 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.397540 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:23.392289 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.331023 30065 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.337148 30144 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:23.391391 22571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:10:23.473910 22571 raft_consensus.cc:606] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.306747 30067 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:23.405067 30170 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:23.413942 30109 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.414656 30078 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.343075 30174 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:10:23.323786 30165 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.340039 29339 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.368839 22573 rpcz_store.cc:276] 0709 13:10:21.261724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.283769 (+ 22045us) service_pool.cc:224] Handling call
0709 13:10:22.540967 (+1257198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.541395 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.541424 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.541990 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.606898 (+ 64908us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:22.606967 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.607069 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.065891 (+458822us) raft_consensus.cc:1685] finished
0709 13:10:23.065914 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.368118 (+302204us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003f5550. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:23.368320 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3710,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":2848977664,"thread_start_us":63586,"threads_started":1,"wal-append.queue_time_us":153965}
I20260709 13:10:23.486953 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.423672 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:23.424103 30159 log.cc:927] Time spent T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 13:10:23.429536 22505 raft_consensus.cc:1240] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:10:23.436510 30152 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.430253 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.430709 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.433256 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.491474 22501 raft_consensus.cc:3060] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:23.434392 30164 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:23.390900 30114 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.437559 30166 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:10:23.438341 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.318869 29370 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:10:23.441200 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 48488us
I20260709 13:10:23.396490 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:23.449290 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 76992.7us
I20260709 13:10:23.518349 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:23.472990 29979 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:23.476750 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:23.482491 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.521175 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.485231 22645 raft_consensus.cc:3055] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:23.432785 30156 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:23.476183 23261 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:23.429823 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:23.484439 30176 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:10:23.489388 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:10:23.566226 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47958.9us
I20260709 13:10:23.499634 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.570114 22497 raft_consensus.cc:2393] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:23.500978 29339 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:23.503677 30067 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.445412 29830 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.478071 30065 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.505666 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.519750 29979 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.559980 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.559362 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.555493 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.558712 22545 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:10:23.554095 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 157713us
W20260709 13:10:23.554790 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 214203us
I20260709 13:10:23.479877 30079 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:10:23.518733 30120 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.005s
I20260709 13:10:23.563673 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:23.566985 22504 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 14: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:23.570235 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:23.599661 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.573161 22500 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:23.513815 22503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.603448 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.602906 22573 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:23.556721 29706 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:23.633615 29706 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:23.634097 29706 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.635661 22574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 4095) took 1032 ms. Trace:
I20260709 13:10:23.636068 22574 rpcz_store.cc:276] 0709 13:10:22.603301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.603518 (+   217us) service_pool.cc:224] Handling call
0709 13:10:23.635430 (+1031912us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001e5fd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:23.635573 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440838912}
I20260709 13:10:23.564424 22645 raft_consensus.cc:740] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:23.637607 22645 consensus_queue.cc:260] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.638610 22645 raft_consensus.cc:3060] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:23.638866 30152 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:23.641212 29830 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:23.600343 30164 consensus_queue.cc:1243] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:23.564961 30167 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:23.600485 30177 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.644024 30065 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.643733 30177 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.645282 22498 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:10:23.593855 29979 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:23.647874 30174 raft_consensus.cc:993] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:10:23.650898 30061 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.651721 29957 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:23.651659 30061 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.653872 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.654680 22500 raft_consensus.cc:2393] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:23.654773 30061 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.659098 30114 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.662992 22575 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 25.
I20260709 13:10:23.663789 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
W20260709 13:10:23.603384 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 227314us
I20260709 13:10:23.666553 22645 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:10:23.604816 22501 raft_consensus.cc:2468] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 27.
W20260709 13:10:23.606120 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46248.2us
I20260709 13:10:23.644611 30065 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:10:23.610476 30172 log.cc:927] Time spent T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:10:23.613760 30130 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.000s
I20260709 13:10:23.592412 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:23.614210 30094 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 13:10:23.614979 30145 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:23.615684 22573 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:23.617015 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.618124 30007 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:23.619069 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1511) took 1009 ms. Trace:
I20260709 13:10:23.599426 30166 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:23.632463 30069 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:23.668617 22619 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.609576 30078 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.669991 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.636950 30119 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:23.723101 22501 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:23.646550 30177 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:23.702338 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.721624 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.695478 22650 rpcz_store.cc:276] 0709 13:10:22.609578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.081117 (+471539us) service_pool.cc:224] Handling call
0709 13:10:23.081440 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.149117 (+ 67677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.149150 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.149635 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.304475 (+154840us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:23.304514 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.304586 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.618854 (+314268us) raft_consensus.cc:1685] finished
0709 13:10:23.618876 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.619008 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60065,"raft.queue_time_us":130610,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":154437,"threads_started":1,"wal-append.queue_time_us":332002}
I20260709 13:10:23.727003 22505 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:23.673203 29963 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.001s
I20260709 13:10:23.728416 22580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:10:23.729152 22580 raft_consensus.cc:606] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Received request to transfer leadership to TS 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.728191 30119 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:23.734160 30119 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:23.735296 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2851) took 1744 ms (client timeout 2216 ms). Trace:
W20260709 13:10:23.735864 22575 rpcz_store.cc:269] 0709 13:10:21.990760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.996392 (+  5632us) service_pool.cc:224] Handling call
0709 13:10:23.735083 (+1738691us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54003f4b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:23.735227 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3830175616}
I20260709 13:10:23.736971 30196 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:23.737885 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:23.738698 22496 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:23.739753 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.742117 30174 raft_consensus.cc:1081] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:10:23.745265 29072 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.745766 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 142603us
I20260709 13:10:23.745769 29072 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.725929 30164 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:23.749044 29072 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.720607 30069 raft_consensus.cc:3060] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:23.750918 29706 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.737615 30196 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.758876 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.762619 22496 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 19: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:23.674834 30094 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:23.756404 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:23.768641 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:23.693921 30007 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.678443 30130 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:23.781384 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:23.787006 22571 raft_consensus.cc:2368] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
W20260709 13:10:23.777385 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 185072us
I20260709 13:10:23.789572 22545 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:23.787755 23259 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:23.789114 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:23.791733 23256 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:23.791368 22577 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 24. Current term is 25. Ops: []
I20260709 13:10:23.792167 23264 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:23.795475 22505 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:23.790501 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:23.800408 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:23.800848 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:23.801268 22575 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:23.805477 22651 raft_consensus.cc:1240] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:10:23.767160 30167 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:23.807497 22496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:23.784401 30188 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.788251 30007 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:23.791435 30095 raft_consensus.cc:697] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:23.808255 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 204854us
I20260709 13:10:23.783968 30078 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:10:23.816802 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 114589us
I20260709 13:10:23.779677 30120 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:23.824210 22619 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.826014 23256 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:23.817653 22501 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:23.821475 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:23.753892 29963 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.807993 30177 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:23.831440 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.831293 23256 raft_consensus.cc:1240] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:23.834601 22619 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.835096 23264 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:23.837052 22619 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.837977 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:23.832309 29959 consensus_queue.cc:1059] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:23.840137 22545 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:23.820969 30062 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:10:23.847079 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.847993 22496 raft_consensus.cc:1275] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:23.842967 29339 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:23.846051 30099 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:23.849884 30099 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.850020 30195 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:23.850384 30099 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:23.850752 30195 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.851223 30195 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:23.819590 30090 consensus_queue.cc:1059] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:10:23.832587 30164 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.854620 30196 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.855242 30196 consensus_queue.cc:1059] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:23.857685 30184 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:10:23.857947 30096 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:23.858588 30096 raft_consensus.cc:3055] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:23.860083 30119 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.861629 30095 consensus_queue.cc:237] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.864982 30096 raft_consensus.cc:740] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:23.865762 22578 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:23.839051 30091 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:23.823192 30120 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:23.824283 30152 raft_consensus.cc:2804] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:23.832407 30081 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.876731 22501 raft_consensus.cc:1240] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:23.844062 30151 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:23.844816 29706 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:23.864308 30099 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.819310 30188 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:23.882827 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 62302.2us
I20260709 13:10:23.872560 30120 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:23.831100 30078 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:23.883396 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45486.3us
I20260709 13:10:23.935236 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.865960 30096 consensus_queue.cc:260] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.893886 29979 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:23.901163 30181 raft_consensus.cc:3055] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:10:23.908083 30193 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 13:10:23.882696 30199 raft_consensus.cc:2804] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:23.885257 30177 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:23.890406 30167 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.918468 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 2970) took 2455 ms. Trace:
W20260709 13:10:23.971221 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 124225us
I20260709 13:10:23.971091 22651 rpcz_store.cc:276] 0709 13:10:21.480032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.937634 (+1457602us) service_pool.cc:224] Handling call
0709 13:10:22.938080 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.806191 (+868111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.918162 (+111971us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b540017d254. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:23.918398 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993959296}
I20260709 13:10:23.839864 29957 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:10:23.927945 22504 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:23.977309 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:23.928210 29963 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:23.937068 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:23.984730 22650 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:23.977233 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 84986.7us
I20260709 13:10:23.986296 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:23.944490 22619 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.932641 22617 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:23.967941 22575 raft_consensus.cc:1240] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:23.958921 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.957258 22579 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:10:23.988540 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44194.4us
I20260709 13:10:23.988965 22497 raft_consensus.cc:2368] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
I20260709 13:10:23.969882 22501 raft_consensus.cc:1240] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:23.972148 22545 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.979126 22646 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:23.989363 22619 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.983804 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:23.990579 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:23.984815 22580 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:10:23.991680 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:23.943059 22498 raft_consensus.cc:1275] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:10:23.991746 30062 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:23.920840 30093 raft_consensus.cc:3055] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:23.881897 30081 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:23.988341 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:10:23.994472 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 153918us
W20260709 13:10:24.001109 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68608.8us
I20260709 13:10:23.967998 30152 raft_consensus.cc:697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:23.968158 30181 raft_consensus.cc:740] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:23.950444 30065 consensus_queue.cc:1059] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:10:23.976481 30197 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:24.010036 22649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3524) took 2198 ms (client timeout 1767 ms). Trace:
I20260709 13:10:24.010465 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:24.032289 22503 raft_consensus.cc:1275] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:10:24.033358 22500 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:24.042665 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:24.043180 30130 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:24.033290 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:24.034687 23258 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:10:24.044667 30135 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:10:24.030110 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:23.992834 30145 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:24.035985 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63918.3us
I20260709 13:10:24.038614 22498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:24.044471 30061 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:24.046701 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:24.041267 22649 rpcz_store.cc:269] 0709 13:10:21.811429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.471337 (+659908us) service_pool.cc:224] Handling call
0709 13:10:24.009738 (+1538401us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54001c8ed4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:24.009941 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320594304}
I20260709 13:10:24.051373 22504 raft_consensus.cc:1240] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 24. Current term is 25. Ops: []
I20260709 13:10:24.053347 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:24.008143 30072 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:24.002725 29939 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:10:24.005477 30093 raft_consensus.cc:740] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:24.067456 30094 raft_consensus.cc:3055] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:24.068019 30094 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:24.069228 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:24.069051 30094 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:24.070304 29911 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:24.070878 30094 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.986332 30195 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.052605 29947 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:24.071563 30119 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.072189 30145 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:24.060556 30200 ts_tablet_manager.cc:933] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:24.073772 30069 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.074426 30197 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:24.075316 30144 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.004s
I20260709 13:10:24.169117 30144 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.064612 22544 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:24.171366 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 106840us
I20260709 13:10:24.077287 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:24.078037 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:24.082389 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:24.083899 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 4104) took 1227 ms. Trace:
I20260709 13:10:24.085407 23229 leader_election.cc:400] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
I20260709 13:10:24.177220 23229 leader_election.cc:403] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.176051 22578 rpcz_store.cc:276] 0709 13:10:22.856274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.943627 (+ 87353us) service_pool.cc:224] Handling call
0709 13:10:22.943907 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.866234 (+922327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.083574 (+217340us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54003abbd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:24.083798 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077742976}
I20260709 13:10:24.088089 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:24.180661 22504 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 18: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:24.090067 30153 raft_consensus.cc:993] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:10:24.097790 30096 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.011485 30199 raft_consensus.cc:697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 25 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:24.048532 30177 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.032402 30202 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:24.060941 30072 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.100589 30061 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:10:24.101583 30151 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:24.102408 30081 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.103622 22501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:24.206075 22501 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:24.056696 22648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:10:24.105378 30181 consensus_queue.cc:260] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.206825 22648 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.207341 22648 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:24.106314 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:24.106494 30079 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:24.208789 22575 raft_consensus.cc:2368] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25.
I20260709 13:10:24.108043 22576 raft_consensus.cc:3060] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:24.100641 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:24.110006 30078 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.111157 30099 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.009599 30192 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:24.059928 23255 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:24.242585 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:24.116953 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 190095us
I20260709 13:10:24.118064 22500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:24.114809 22577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f"
dest_uuid: "691cccbd0258483ebe19e1581674cc94"
mode: GRACEFUL
new_leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:39562
I20260709 13:10:24.247535 22577 raft_consensus.cc:606] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Received request to transfer leadership to TS 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:24.248190 22577 raft_consensus.cc:614] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:24.054557 29650 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:24.151369 22579 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:24.167253 30145 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:24.168428 30069 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:24.185364 22580 raft_consensus.cc:2393] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:24.064473 29972 consensus_queue.cc:1048] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.099s
W20260709 13:10:24.185999 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100955us
I20260709 13:10:24.271003 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:24.186749 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.199563 29898 raft_consensus.cc:1081] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Signalling peer 6ca917eaada84bf38a5daae9f8ffa066 to start an election
I20260709 13:10:24.192699 23227 leader_election.cc:400] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
I20260709 13:10:24.269657 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:24.225445 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 172908us
I20260709 13:10:24.236480 30164 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.195940 30185 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:24.188735 29706 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445) with higher term. Message: Invalid argument: T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 17. Current term is 18.
I20260709 13:10:24.193207 30072 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:24.157207 29947 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:24.264571 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 276284us
W20260709 13:10:24.280900 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 92937.1us
I20260709 13:10:24.275278 30191 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.336854 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:24.166100 30197 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:24.241396 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 249765us
I20260709 13:10:24.301033 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:24.252306 30202 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.343413 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:24.332947 22497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:24.346946 22497 raft_consensus.cc:2393] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:10:24.322083 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 52610.2us
I20260709 13:10:24.171279 30152 consensus_queue.cc:237] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.357635 22576 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:24.353926 22573 raft_consensus.cc:2468] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:24.351367 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:24.312124 30181 raft_consensus.cc:3060] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:24.263655 30007 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.288156 30144 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:24.375479 30206 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:10:24.279760 30151 consensus_queue.cc:1059] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:10:24.331801 29650 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:24.332206 29979 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:24.412266 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 61032.7us
I20260709 13:10:24.382197 22619 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:24.336030 30185 raft_consensus.cc:697] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:24.244096 30093 consensus_queue.cc:260] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.288481 30081 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:10:24.264830 30192 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.340608 29947 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:24.445032 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 4108) took 1171 ms. Trace:
W20260709 13:10:24.448640 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.355482 30069 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:24.496889 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:24.436383 22500 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:24.499497 22576 rpcz_store.cc:276] 0709 13:10:23.273771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.273907 (+   136us) service_pool.cc:224] Handling call
0709 13:10:24.444850 (+1170943us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54003cc8d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:24.444972 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909229952}
I20260709 13:10:24.345162 30197 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:24.507748 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:24.510048 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127925us
I20260709 13:10:24.514941 22654 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 13.
I20260709 13:10:24.445267 30099 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:24.513347 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:24.439849 30215 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.439251 30195 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.431726 30188 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:24.510892 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 351944us
I20260709 13:10:24.435916 30007 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.502859 29650 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:24.525096 22468 leader_election.cc:400] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25.
I20260709 13:10:24.536352 22468 leader_election.cc:403] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.512322 30210 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:24.512490 30061 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.545866 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:24.532542 30204 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:10:24.544443 22504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:24.360394 30092 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.166s
I20260709 13:10:24.346031 30191 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.428709 30212 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.181s
I20260709 13:10:24.572597 22504 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:24.472278 30145 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.360016 30202 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.520401 30099 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:24.572806 22647 raft_consensus.cc:2410] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 20 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 13:10:24.578236 22650 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.001s
I20260709 13:10:24.582556 22650 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:24.546047 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:24.536621 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 253497us
I20260709 13:10:24.581351 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:24.583690 22651 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
W20260709 13:10:24.573740 30120 consensus_meta.cc:287] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.004s
I20260709 13:10:24.544322 30144 raft_consensus.cc:3055] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:24.547566 30089 consensus_queue.cc:1059] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:10:24.659718 22647 raft_consensus.cc:1275] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:24.557297 30007 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 24. Current term is 25.
W20260709 13:10:24.658696 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.588526 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:24.411525 30199 consensus_queue.cc:237] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:24.683837 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 95391.7us
I20260709 13:10:24.545754 30151 consensus_queue.cc:1048] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:10:24.586618 30099 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:24.688706 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:24.545271 29650 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.655748 30144 raft_consensus.cc:740] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:24.658824 30210 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:24.659209 30078 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:24.543548 30215 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.577278 30061 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:24.766176 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 77550.2us
I20260709 13:10:24.589196 30090 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.164s
I20260709 13:10:24.771268 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:24.772168 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4051) took 1340 ms. Trace:
I20260709 13:10:24.687139 30220 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:24.759759 30130 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:24.688987 29979 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.661090 30120 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.779799 22505 rpcz_store.cc:276] 0709 13:10:23.431726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.801650 (+369924us) service_pool.cc:224] Handling call
0709 13:10:23.802003 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.815123 (+ 13120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.815156 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.818101 (+  2945us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.000492 (+182391us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:24.276240 (+275748us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.276505 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.276581 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.771916 (+495335us) raft_consensus.cc:1685] finished
0709 13:10:24.771942 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.772103 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":543532,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5678,"raft.queue_time_us":24203,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":44961,"thread_start_us":374214,"threads_started":2,"wal-append.queue_time_us":332150}
I20260709 13:10:24.812101 30130 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.814462 30120 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.815110 30130 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.816183 29979 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:24.817494 30211 raft_consensus.cc:2804] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:10:24.818594 30214 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
W20260709 13:10:24.820639 30213 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:10:24.770365 30007 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:24.818498 30191 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.780997 30129 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:24.870776 22648 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.000s
I20260709 13:10:24.875240 22648 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:24.763768 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 235277us
I20260709 13:10:24.660439 30185 consensus_queue.cc:237] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.905437 22648 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:24.854046 30211 raft_consensus.cc:697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:24.769443 30078 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:24.900557 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 371169us
I20260709 13:10:24.851688 30220 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.903060 30151 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.877827 30191 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:24.921455 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:24.923043 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:24.925104 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:24.962605 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:24.930531 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:24.921804 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:24.978366 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:24.996428 22654 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:24.996161 22646 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
W20260709 13:10:24.918902 30204 log.cc:927] Time spent T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:25.004730 22649 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:24.955741 30152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.010s	sys 0.019s
I20260709 13:10:24.864976 30144 consensus_queue.cc:260] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:24.913918 29972 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:25.018659 30229 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:24.931591 30192 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:25.019097 30225 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 13:10:25.019516 30219 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:10:25.021796 30202 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:24.900751 30129 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:25.022626 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61530.9us
I20260709 13:10:25.023646 30078 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.023537 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:25.024767 30211 consensus_queue.cc:237] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.030751 30230 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.031591 30220 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.034027 30093 raft_consensus.cc:3060] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:25.035637 30164 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.723s	user 0.005s	sys 0.005s
I20260709 13:10:25.037858 29650 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:24.961210 30130 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:24.909265 22496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb"
dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
 from {username='slave'} at 127.0.0.1:59530
W20260709 13:10:25.016405 30152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.012s	sys 0.019s
I20260709 13:10:25.298156 22496 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.299862 22496 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:25.156683 30120 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:25.007161 30226 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:25.148708 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 223693us
I20260709 13:10:25.053719 29972 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.910871 30200 tablet_copy_client.cc:323] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.227.130:41465
W20260709 13:10:25.053160 30181 consensus_meta.cc:287] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.003s
I20260709 13:10:25.024823 30061 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:25.129786 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 106353us
I20260709 13:10:25.323998 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:25.148514 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87531.7us
I20260709 13:10:24.996822 29939 consensus_queue.cc:1048] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.106s
I20260709 13:10:24.967192 30191 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:24.940129 30089 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
W20260709 13:10:25.275764 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 504568us
I20260709 13:10:25.342945 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:24.966838 30151 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.293670 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3599) took 1091 ms. Trace:
I20260709 13:10:25.343912 22505 rpcz_store.cc:276] 0709 13:10:24.202270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.811597 (+609327us) service_pool.cc:224] Handling call
0709 13:10:24.812037 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.812312 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:24.872605 (+ 60293us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.293309 (+420704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.293368 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:25.293417 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.293483 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.293612 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170836,"prepare.queue_time_us":94501,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":6377,"raft.queue_time_us":111589,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6228,"thread_start_us":309399,"threads_started":1}
W20260709 13:10:25.059032 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 95239us
I20260709 13:10:25.288705 30144 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:25.286042 30138 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.289381 29957 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:25.294663 30220 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.298648 30164 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:25.150264 30238 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.228s
I20260709 13:10:25.310257 30210 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.358997 22505 raft_consensus.cc:3055] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:25.372725 22505 raft_consensus.cc:740] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:25.366015 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:25.403869 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:25.336207 30215 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.337360 30120 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:25.309990 30130 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.332934 30078 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:25.303784 30230 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.441576 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.368592 30007 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:25.319972 30226 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.381361 30210 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:25.461628 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57869.9us
W20260709 13:10:25.462272 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 128459us
I20260709 13:10:25.463016 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:25.463757 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:25.468003 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:25.434716 30120 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:25.469844 30242 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:10:25.470549 30237 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:10:25.476438 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:25.470675 30191 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:25.471452 30235 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:10:25.471926 29830 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.413062 30138 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.414572 22505 consensus_queue.cc:260] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.377393 29957 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.409598 30220 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.491210 22505 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:25.500958 29830 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.502118 30249 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:25.502631 30249 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:25.503077 30249 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.503542 29830 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.506150 30151 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.505707 29957 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.444703 30078 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.510646 30078 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.517304 22505 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:25.518548 30138 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.524600 30230 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.467643 30152 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.480403 30075 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:25.487138 30120 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:25.483603 30065 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:25.480598 30240 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:25.531781 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 185156us
I20260709 13:10:25.498059 30191 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:10:25.548465 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.540930 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:25.489363 29939 consensus_queue.cc:1059] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:10:25.534526 30075 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.568252 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:25.569278 22648 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 26.
I20260709 13:10:25.549975 30240 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:25.561453 30075 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:25.536410 30152 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.567478 30202 raft_consensus.cc:2764] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:10:25.586817 30238 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.565676 30129 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.609395 29972 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:25.622483 29947 consensus_meta.cc:287] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 1.113s	user 0.010s	sys 0.003s
I20260709 13:10:25.586949 30145 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:25.582638 30239 consensus_queue.cc:1059] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:10:25.635725 30241 log.cc:927] Time spent T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 13:10:25.660600 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 192669us
I20260709 13:10:25.630394 30252 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:10:25.662850 29649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.582s	user 0.017s	sys 0.023s
I20260709 13:10:25.672307 30253 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.680493 30250 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:10:25.680233 30253 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:25.679760 29649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.018s	sys 0.023s
I20260709 13:10:25.655586 30145 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.687075 30246 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.687703 30246 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.683182 30165 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.689453 30075 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.690002 30230 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.668061 30089 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.690634 30230 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.690964 30089 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.691841 30075 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.693437 30089 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.693743 30215 raft_consensus.cc:3055] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:25.694339 30215 raft_consensus.cc:740] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:25.695405 30075 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:25.667918 29957 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.684907 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3602) took 1248 ms. Trace:
I20260709 13:10:25.696034 29957 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.696002 30075 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.698310 29957 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.698320 30075 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.699193 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3588) took 1630 ms. Trace:
I20260709 13:10:25.699615 22503 rpcz_store.cc:276] 0709 13:10:24.069161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.070591 (+  1430us) service_pool.cc:224] Handling call
0709 13:10:24.070871 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.232194 (+161323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.232232 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.232279 (+    47us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:24.232319 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.698932 (+1466613us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000f8554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:25.698987 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.699130 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370500864}
W20260709 13:10:25.704406 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.706462 30253 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.706575 29972 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.637693 29947 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.660364 30130 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.751782 22503 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:25.696674 22497 rpcz_store.cc:276] 0709 13:10:24.436331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.027303 (+590972us) service_pool.cc:224] Handling call
0709 13:10:25.027702 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.028133 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.028164 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.028680 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.404181 (+375501us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:25.404247 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.404354 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.684659 (+280305us) raft_consensus.cc:1685] finished
0709 13:10:25.684682 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.684822 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17604,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":374988,"threads_started":1,"wal-append.queue_time_us":511105}
I20260709 13:10:25.752807 22505 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:10:25.750504 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 209631us
I20260709 13:10:25.663054 30254 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:25.752118 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 275740us
I20260709 13:10:25.776536 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:25.709522 30129 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.707222 29972 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.665584 30138 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 13:10:25.756024 30145 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.685061 30220 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:10:25.670732 30226 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.753562 22496 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.758544 30252 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.764803 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:25.779768 22505 raft_consensus.cc:3055] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:25.811956 22505 raft_consensus.cc:740] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:25.812346 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:25.755654 30197 consensus_meta.cc:287] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.229s	user 0.011s	sys 0.003s
I20260709 13:10:25.786087 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1600) took 1334 ms. Trace:
I20260709 13:10:25.773313 30253 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.788668 30096 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.600s	user 0.009s	sys 0.005s
I20260709 13:10:25.759049 29830 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.794355 30255 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.778076 30177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.003s	sys 0.014s
I20260709 13:10:25.798978 29947 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.778156 29957 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:10:25.776278 30130 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.844511 30130 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.845436 30246 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.810292 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:25.857228 23256 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 26.
I20260709 13:10:25.810547 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:25.858656 23263 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:25.810665 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:25.815400 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:25.816304 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 51639.4us
W20260709 13:10:25.839604 30177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.004s	sys 0.014s
I20260709 13:10:25.822798 22496 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.866269 22496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:59530 (request call id 3601) took 1430 ms. Trace:
I20260709 13:10:25.823557 22505 consensus_queue.cc:260] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:10:25.824525 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 158653us
I20260709 13:10:25.778223 30065 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.827808 30249 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.818310 22499 rpcz_store.cc:276] 0709 13:10:24.451993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.321154 (+869161us) service_pool.cc:224] Handling call
0709 13:10:25.340590 (+ 19436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.355294 (+ 14704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.355349 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.356079 (+   730us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.564490 (+208411us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:25.564551 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.564655 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.785845 (+221190us) raft_consensus.cc:1685] finished
0709 13:10:25.785868 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.786026 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":320,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13698,"thread_start_us":118578,"threads_started":1,"wal-append.queue_time_us":256866}
I20260709 13:10:25.695410 30215 consensus_queue.cc:260] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.810755 30007 raft_consensus.cc:2764] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:10:25.914243 30065 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.801259 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
I20260709 13:10:25.917824 23255 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.669205 30240 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.846832 30130 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.630504 30238 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:25.848542 30072 consensus_meta.cc:287] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 1.503s	user 0.007s	sys 0.006s
I20260709 13:10:25.835139 29830 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.850517 22497 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:25.930716 22497 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:25.850507 22502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59520 (request call id 4065) took 2344 ms (client timeout 1945 ms). Trace:
I20260709 13:10:25.854857 22498 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:10:25.860762 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:25.786090 30129 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.861584 22469 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:25.933904 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 75424.2us
I20260709 13:10:25.864776 23260 raft_consensus.cc:2393] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:25.873512 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 97063.5us
I20260709 13:10:25.823860 30197 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.823122 30252 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.863377 30152 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.860934 29947 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:25.954466 29947 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.955473 22501 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:25.840407 30255 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.831002 30253 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.783174 30254 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.958096 30255 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.958622 30254 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:25.931855 30138 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.958972 30181 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.959213 30254 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:25.959261 30138 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.959764 30181 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.866588 22496 rpcz_store.cc:276] 0709 13:10:24.436035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.904495 (+468460us) service_pool.cc:224] Handling call
0709 13:10:25.866198 (+961703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:25.961740 30138 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.961915 30181 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.962345 30220 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:10:25.937387 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 76761.8us
I20260709 13:10:25.937029 30072 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:25.962790 30220 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:25.963443 30220 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:25.959507 30212 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:10:25.964321 30072 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.965658 30096 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:10:25.966579 30210 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.967116 30096 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:25.969460 30202 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:25.970034 30202 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:25.970445 30144 consensus_meta.cc:287] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.001s
I20260709 13:10:25.906960 29649 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:25.962049 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:25.927995 30099 consensus_meta.cc:287] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 1.162s	user 0.012s	sys 0.006s
I20260709 13:10:25.916725 30065 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.942363 30238 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:25.945438 29959 raft_consensus.cc:993] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: : Instructing follower 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:10:25.993422 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:25.994375 22649 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:25.945223 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:25.945909 30259 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:25.949102 30249 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.950119 29972 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.950908 29830 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.953284 30129 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:25.954933 30197 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:25.931329 22502 rpcz_store.cc:269] 0709 13:10:23.506705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.570397 (+ 63692us) service_pool.cc:224] Handling call
0709 13:10:25.850230 (+2279833us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400082ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:25.850426 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009897344}
I20260709 13:10:25.939000 22469 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:25.936398 30261 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:10:25.977526 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:25.994388 30145 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.927801 30114 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.986341 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:25.988162 22505 raft_consensus.cc:3060] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:25.920784 30267 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:25.976950 22497 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:25.958671 30253 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:26.000217 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.005944 30138 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.989169 30215 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:25.980090 30007 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:26.008154 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.011154 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.046110 22499 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:10:26.016373 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 77398.5us
I20260709 13:10:25.996049 29947 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:26.018518 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:25.976455 29649 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:26.031766 22497 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:25.991014 30099 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.009104 30152 raft_consensus.cc:1081] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Signalling peer 5e72fb99f5ee4943a91cf8e6dd73e80e to start an election
I20260709 13:10:26.009510 30094 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:26.041435 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.054524 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.020253 30065 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.059669 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.060598 30096 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.035310 29959 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.070963 22648 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:26.072106 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.081285 22649 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:26.074331 22502 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:26.075203 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.037252 30267 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:26.070511 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.020418 30145 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.083823 22499 raft_consensus.cc:2468] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
W20260709 13:10:26.076188 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 113068us
I20260709 13:10:26.002568 30259 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.042717 30253 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:26.092777 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.013293 29972 consensus_queue.cc:1048] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:10:26.035058 30114 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.112685 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.113131 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:26.057713 30268 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:26.054270 30138 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:26.098875 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:26.113538 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.124540 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.087033 30267 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:26.099291 29969 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.132733 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.132834 29969 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.132639 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.133584 23263 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:26.135339 29969 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:26.124643 30114 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.136790 29649 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.124840 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.125281 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.126518 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.141224 30202 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:26.142035 30205 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 2.044s	user 0.010s	sys 0.015s
I20260709 13:10:26.142872 22499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:26.143584 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1169) took 2385 ms. Trace:
I20260709 13:10:26.143630 22499 raft_consensus.cc:3060] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:26.131083 22502 raft_consensus.cc:2468] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:26.146255 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.147564 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:26.147821 30120 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:10:26.148236 30120 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.119963 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.076674 30096 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:26.086704 30007 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:10:26.076233 30094 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.073323 30065 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:26.077991 30093 consensus_meta.cc:287] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.781s	user 0.013s	sys 0.002s
I20260709 13:10:26.085676 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:26.148571 22502 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:10:26.130508 22505 raft_consensus.cc:1275] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:10:26.216421 22654 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:26.183976 22497 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:10:26.217520 22497 pending_rounds.cc:85] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 13
I20260709 13:10:26.217818 22497 pending_rounds.cc:107] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:10:26.218149 22497 raft_consensus.cc:2889] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:26.122454 22649 raft_consensus.cc:3060] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:26.216766 22505 pending_rounds.cc:85] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting all ops after (but not including) 16
I20260709 13:10:26.220695 22505 pending_rounds.cc:107] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting uncommitted NO_OP operation due to leader change: 23.17
W20260709 13:10:26.216542 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 130984us
I20260709 13:10:26.221089 22505 raft_consensus.cc:2889] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:26.161314 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:26.222411 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1308) took 2032 ms. Trace:
I20260709 13:10:26.222818 22578 rpcz_store.cc:276] 0709 13:10:24.190475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.190639 (+   164us) service_pool.cc:224] Handling call
0709 13:10:24.191010 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.518858 (+327848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.518893 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.518937 (+    44us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:24.518974 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.222024 (+1703050us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54003c87d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:26.222193 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.222348 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753458560}
I20260709 13:10:26.224781 22653 raft_consensus.cc:1275] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:10:26.131172 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.237289 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066"
I20260709 13:10:26.238086 22505 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:26.093393 30249 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.245606 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.144142 23257 rpcz_store.cc:276] 0709 13:10:23.758498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.760105 (+  1607us) service_pool.cc:224] Handling call
0709 13:10:23.789640 (+ 29535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.795806 (+  6166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.795838 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.796314 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.971234 (+174920us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:23.971297 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.971397 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.141286 (+2169889us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:26.143292 (+  2006us) raft_consensus.cc:1685] finished
0709 13:10:26.143314 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.143505 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8188,"raft.queue_time_us":6524,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8776,"spinlock_wait_cycles":46880512,"thread_start_us":134614,"threads_started":1,"wal-append.queue_time_us":217444}
I20260709 13:10:26.245606 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.247581 22502 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
W20260709 13:10:26.248839 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.249347 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 189594us
I20260709 13:10:26.255419 22648 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:26.144050 30099 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.222236 30096 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.285418 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.150542 30138 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.261698 22505 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:26.291826 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.292881 22505 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20.
I20260709 13:10:26.293896 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.163527 30079 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:26.224422 30065 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.259431 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:26.199947 30255 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.153146 30145 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.149567 30252 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.130147 30268 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:26.305258 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 179886us
I20260709 13:10:26.154736 30259 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.243672 30238 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.295989 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
W20260709 13:10:26.248340 30196 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:10:26.095525 29959 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:26.299546 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.300252 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.314272 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:26.314674 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.299818 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48638.3us
I20260709 13:10:26.314750 22505 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:26.315270 22654 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.113184 30253 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:26.308588 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 195527us
I20260709 13:10:26.302408 30276 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:10:26.316102 22505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.310407 30252 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.295918 30079 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.305317 30255 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.337495 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.329798 22505 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:26.319329 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:26.256048 30249 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.317929 30202 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:26.307371 30268 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:26.325439 30276 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.362579 22502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6ca917eaada84bf38a5daae9f8ffa066" is_pre_election: true
I20260709 13:10:26.325258 30274 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:26.337793 30079 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:26.368376 22502 raft_consensus.cc:2393] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:26.366096 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.372890 23263 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:26.353911 30145 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:26.318768 30238 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:26.429085 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 211590us
I20260709 13:10:26.368347 30276 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:26.338505 30252 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:26.430297 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 144159us
I20260709 13:10:26.434810 23227 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:26.378031 30145 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.445947 22647 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:26.448997 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:26.425930 30221 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:26.442207 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.442807 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.443131 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.457612 22574 raft_consensus.cc:2410] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:10:26.457453 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.443588 22576 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:26.443768 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.444198 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.461051 22571 raft_consensus.cc:2468] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:10:26.444289 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.444950 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.449795 23260 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:26.452154 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:26.453512 30093 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.453882 30072 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.464521 22572 raft_consensus.cc:2393] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:26.456843 22578 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:26.439862 30130 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:26.440352 30259 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.471110 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.465796 22580 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:26.447966 30145 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:26.473156 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.376029 30274 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.485415 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:26.488133 23258 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:26.461906 29706 raft_consensus.cc:2804] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:26.489367 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.505904 23263 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:26.433333 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:26.535131 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.538758 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:26.539242 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 106034us
I20260709 13:10:26.540200 22543 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:26.472725 30094 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.552088 23261 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:26.489465 22572 raft_consensus.cc:1240] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:26.575327 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.575985 22648 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:26.579291 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.580756 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.472112 30093 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.581387 22578 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:26.581770 22578 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:26.582571 22578 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.583420 30093 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:26.584358 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.585669 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:26.586845 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.589170 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.589774 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:26.590984 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:26.592099 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:26.593564 22571 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:26.593767 30197 consensus_queue.cc:1059] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:26.594637 30197 raft_consensus.cc:2804] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:26.594987 30197 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:26.595389 30197 raft_consensus.cc:3060] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.597057 30202 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:26.597545 30202 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:26.597919 30202 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:26.601383 30280 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:26.601574 30279 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:10:26.603065 29706 raft_consensus.cc:697] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:26.603420 30273 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:10:26.604028 29706 consensus_queue.cc:237] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.607684 22579 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 25.
I20260709 13:10:26.482788 30259 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.583549 22578 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:26.611153 30259 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.611411 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:26.612665 30249 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.613400 29959 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:10:26.614219 30249 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:26.614964 30249 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:26.617062 30215 consensus_meta.cc:287] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.558s	user 0.003s	sys 0.007s
I20260709 13:10:26.618458 30252 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:26.619047 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.620123 22651 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 26: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:26.620484 30143 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.621941 23259 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.601434 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.626297 22573 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:26.567162 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.629725 22580 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:26.640184 23258 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:26.649857 22654 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 14.
I20260709 13:10:26.652267 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:26.463608 30221 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.621031 30143 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.686368 30143 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:26.663506 22500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59530 (request call id 3597) took 2559 ms (client timeout 2113 ms). Trace:
W20260709 13:10:26.694840 22500 rpcz_store.cc:269] 0709 13:10:24.103653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.117768 (+ 14115us) service_pool.cc:224] Handling call
0709 13:10:26.663225 (+2545457us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540033efd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:26.663412 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435486080}
I20260709 13:10:26.696408 22500 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:10:26.697144 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44645.5us
I20260709 13:10:26.482621 30072 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:26.635843 30120 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.652743 30277 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:26.669776 30202 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.573762 29957 raft_consensus.cc:2804] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:26.668653 22578 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:26.674118 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:26.737915 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 63894.4us
I20260709 13:10:26.739872 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:26.692422 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:26.657435 22499 consensus_meta.cc:287] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.003s
I20260709 13:10:26.741571 22499 raft_consensus.cc:2468] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:26.743851 22651 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 14.
I20260709 13:10:26.702363 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:26.627889 30220 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.006s
I20260709 13:10:26.717487 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.748840 22654 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:26.746882 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:26.751405 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.724195 22573 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:26.672482 30197 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.727519 23259 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:26.731642 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:26.737457 30275 log.cc:927] Time spent T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:10:26.572154 30138 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:26.735646 30177 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:26.761694 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:26.817924 22578 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:26.787225 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.732692 22648 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:26.739490 30093 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.831614 22651 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:26.740008 29959 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:26.761749 30267 consensus_meta.cc:287] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.004s
I20260709 13:10:26.750743 30078 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:26.739212 30202 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:26.837682 22652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.008s	sys 0.027s
I20260709 13:10:26.840833 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.861243 22646 raft_consensus.cc:2468] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:26.849910 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.767731 30138 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.759650 30280 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:10:26.833894 30096 consensus_meta.cc:287] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.004s
I20260709 13:10:26.837951 30277 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:26.888736 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.863376 22645 raft_consensus.cc:2410] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:10:26.763572 29957 raft_consensus.cc:697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:26.885644 22578 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:26.760329 30220 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:26.902273 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 440996us
I20260709 13:10:26.903781 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.907925 22651 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:26.870003 22654 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
W20260709 13:10:26.886485 30065 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.003s
I20260709 13:10:26.909152 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.854068 30177 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.912039 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3541) took 2976 ms. Trace:
I20260709 13:10:26.905431 30277 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:26.879292 30293 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.874739 30138 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:26.876411 30253 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:26.836382 30093 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:26.927803 22653 rpcz_store.cc:276] 0709 13:10:23.935943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.936128 (+   185us) service_pool.cc:224] Handling call
0709 13:10:23.974051 (+ 37923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.225334 (+2251283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.911641 (+686307us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b54004308d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:26.911912 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5175145856}
I20260709 13:10:26.884457 30249 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.893515 30280 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:26.933485 22503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4078) took 1182 ms. Trace:
I20260709 13:10:26.898790 30078 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.941840 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.942631 22651 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:10:26.860769 30267 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.858923 29959 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.940784 22503 rpcz_store.cc:276] 0709 13:10:25.751483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.772952 (+ 21469us) service_pool.cc:224] Handling call
0709 13:10:25.773518 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.773936 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.773967 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.784316 (+ 10349us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.676434 (+892118us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b1800432a60. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b0d1
0709 13:10:26.676706 (+   272us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:26.927023 (+250317us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.927294 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.927382 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.927428 (+    46us) raft_consensus.cc:1685] finished
0709 13:10:26.933272 (+  5844us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.933425 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2392,"raft.queue_time_us":35639,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5635,"spinlock_wait_cycles":6584064,"thread_start_us":281975,"threads_started":2,"wal-append.queue_time_us":46874}
I20260709 13:10:26.935024 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.885810 30096 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.930711 30262 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:26.938799 29939 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:26.950023 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.950157 22654 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:26.957460 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:26.980827 22645 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:26.981031 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:26.947002 30078 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.934722 30065 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.972337 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:26.961231 23255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1175) took 1152 ms. Trace:
I20260709 13:10:26.955008 29959 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:26.958987 30177 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:26.957942 30151 raft_consensus.cc:3055] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:26.960585 30210 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:26.960610 30093 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:27.013516 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:27.014868 23261 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:27.003787 23255 rpcz_store.cc:276] 0709 13:10:25.808986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.809154 (+   168us) service_pool.cc:224] Handling call
0709 13:10:25.829377 (+ 20223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.927767 (+ 98390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.960961 (+1033194us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54007e1dd4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:26.961153 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202945792}
I20260709 13:10:27.004534 22651 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:26.949388 22502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4085) took 1046 ms. Trace:
I20260709 13:10:26.969431 23257 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 25. Current term is 26. Ops: []
I20260709 13:10:26.933248 30276 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.957149 30197 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:27.017115 22502 rpcz_store.cc:276] 0709 13:10:25.903182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.454611 (+551429us) service_pool.cc:224] Handling call
0709 13:10:26.474619 (+ 20008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.474894 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:26.753270 (+278376us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.948798 (+195528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.948855 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:26.948922 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.949213 (+   291us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.949335 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":451887,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1521,"raft.queue_time_us":62307,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":455883,"threads_started":2,"wal-append.queue_time_us":253647}
I20260709 13:10:27.009426 30307 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:27.029968 30210 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:27.030649 30210 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.034366 30210 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:27.035562 30079 consensus_meta.cc:287] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.001s
I20260709 13:10:26.943181 30293 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:27.040153 30079 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.042152 22574 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:27.049893 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.050613 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.957747 30280 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.055744 29959 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:27.056533 29959 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:27.059439 29959 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:27.063721 30268 consensus_meta.cc:287] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.000s
W20260709 13:10:27.065456 30299 log.cc:927] Time spent T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.002s
I20260709 13:10:27.069796 30220 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:27.072460 30306 log.cc:927] Time spent T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:10:27.072994 30120 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.074249 30297 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:10:27.073745 30120 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:26.974408 29957 consensus_queue.cc:237] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:27.078923 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 767623us
I20260709 13:10:27.079942 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.080292 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:27.080554 22573 raft_consensus.cc:1240] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:27.080974 22501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48204 (request call id 1599) took 2667 ms. Trace:
I20260709 13:10:27.081350 22501 rpcz_store.cc:276] 0709 13:10:24.413458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.826220 (+412762us) service_pool.cc:224] Handling call
0709 13:10:24.826556 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.955921 (+1129365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.068575 (+1112654us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000f9954. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:27.080906 (+ 12331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2595806976}
W20260709 13:10:27.059782 30289 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
W20260709 13:10:26.994866 30203 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.654s	user 0.029s	sys 0.009s
I20260709 13:10:27.080636 22580 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
W20260709 13:10:27.094370 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 114014us
I20260709 13:10:27.099143 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:27.004963 30151 raft_consensus.cc:740] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
W20260709 13:10:27.101461 22544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.020466 30277 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:27.102698 30145 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.004s
I20260709 13:10:27.064244 30268 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.119144 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:27.101483 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:27.097916 30203 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.761s	user 0.032s	sys 0.009s
I20260709 13:10:27.102030 22645 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:27.112911 22573 raft_consensus.cc:1275] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:10:27.093854 30253 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.097512 30114 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:27.151407 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49989.7us
I20260709 13:10:26.976681 29939 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:27.101305 30262 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:27.111562 30096 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.116557 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:27.154368 22574 raft_consensus.cc:1275] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:27.153961 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.158034 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.200435 22576 raft_consensus.cc:2368] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20.
I20260709 13:10:27.159754 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.160490 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.161550 22577 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:27.162724 22500 raft_consensus.cc:1240] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:27.175414 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:27.177192 22571 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:27.204522 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:27.208318 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:27.214444 22649 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:10:27.232403 22468 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:27.245913 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:27.272033 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.274343 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.276167 22573 raft_consensus.cc:1240] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:27.276338 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:27.277547 22649 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 26: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:27.281121 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.148296 30220 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:10:27.320214 22617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.727s (SENT) [suppressed 14 similar messages]
I20260709 13:10:27.324019 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:27.330132 22649 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.332119 22573 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:10:27.325659 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:27.164268 30197 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:27.154783 30065 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.351164 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.333403 22577 raft_consensus.cc:3060] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:27.335520 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:27.336476 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:27.334936 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.346678 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.119000 30145 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:27.269223 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:27.155089 30253 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.369329 22572 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:10:27.507880 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:27.784201 22645 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:27.271341 30210 raft_consensus.cc:2804] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:27.787164 22575 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
W20260709 13:10:27.789410 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 206024us
I20260709 13:10:27.510704 22500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3616) took 1597 ms. Trace:
I20260709 13:10:27.804939 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.805243 22500 rpcz_store.cc:276] 0709 13:10:25.913657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.699498 (+785841us) service_pool.cc:224] Handling call
0709 13:10:26.699772 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.203234 (+503462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.510289 (+307055us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001b8354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:27.510591 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064267008}
W20260709 13:10:27.481853 21390 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 22506)
I20260709 13:10:27.794690 23256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 1242) took 1661 ms. Trace:
I20260709 13:10:27.806049 22572 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:27.317734 30307 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:27.376300 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.373199 22576 raft_consensus.cc:2393] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:27.271775 30196 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:27.621032 22497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4080) took 1841 ms. Trace:
I20260709 13:10:27.819406 22497 rpcz_store.cc:276] 0709 13:10:25.779648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.780071 (+   423us) service_pool.cc:224] Handling call
0709 13:10:25.850388 (+ 70317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.218645 (+368257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.620685 (+1402040us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b5400082ad0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:27.620939 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89932544}
I20260709 13:10:27.808275 22649 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 16.
I20260709 13:10:27.806452 23256 rpcz_store.cc:276] 0709 13:10:26.123528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.138457 (+ 14929us) service_pool.cc:224] Handling call
0709 13:10:27.507649 (+1369192us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:10:27.784453 (+276804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52567936}
W20260709 13:10:27.815534 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 546399us
W20260709 13:10:27.773993 30313 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:10:27.824936 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:27.827781 23259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46820 (request call id 1001) took 1377 ms (client timeout 1727 ms). Trace:
I20260709 13:10:27.349161 30197 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:27.591535 30267 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:27.829681 22580 raft_consensus.cc:2368] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 23. Current term is 24.
I20260709 13:10:27.481230 30079 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:27.833760 30007 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:27.830760 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:27.871205 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.871897 22573 raft_consensus.cc:2393] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 17: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:27.872586 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:27.872726 30253 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:27.873420 22573 raft_consensus.cc:2410] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
W20260709 13:10:27.874068 30298 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.920s	user 0.006s	sys 0.006s
I20260709 13:10:27.538690 30120 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.794634 30065 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.874960 30065 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:27.875897 22505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4082) took 2044 ms. Trace:
I20260709 13:10:27.876195 29939 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.877292 30065 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:27.841199 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:27.828414 23259 rpcz_store.cc:269] 0709 13:10:26.450742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.451868 (+  1126us) service_pool.cc:224] Handling call
0709 13:10:27.827555 (+1375687us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400813654. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:27.827699 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365046144}
I20260709 13:10:27.425096 30078 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.848414 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:27.876328 22505 rpcz_store.cc:276] 0709 13:10:25.831777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.339697 (+507920us) service_pool.cc:224] Handling call
0709 13:10:26.340154 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.361013 (+ 20859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.361063 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.367759 (+  6696us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.827831 (+460072us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:10:27.004683 (+176852us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.348841 (+344158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.349235 (+   394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.873456 (+524221us) spinlock_profiling.cc:243] Waited 92.4 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:27.875626 (+  2170us) raft_consensus.cc:1685] finished
0709 13:10:27.875711 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.875838 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29111,"prepare.queue_time_us":146494,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":7677,"raft.queue_time_us":45299,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":4732,"spinlock_wait_cycles":212421888,"thread_start_us":882921,"threads_started":3,"wal-append.queue_time_us":574840}
I20260709 13:10:27.881160 22649 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 23: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:27.830581 30196 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:27.850577 30145 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.851719 30293 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:27.350600 30220 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.827220 30307 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:27.856560 22619 leader_election.cc:336] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Timed out: RequestConsensusVote RPC to 127.20.227.129:38445 timed out after 1.945s (SENT)
W20260709 13:10:27.904788 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48275us
I20260709 13:10:27.842221 30197 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:27.859020 30310 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.877909 30065 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:27.970827 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:27.866461 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:27.868422 30268 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:27.868749 22499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3617) took 1952 ms. Trace:
I20260709 13:10:27.318436 30151 consensus_queue.cc:260] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.993266 30151 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:27.993818 30316 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:10:27.994699 30230 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:27.995078 22654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 3010) took 1396 ms. Trace:
I20260709 13:10:27.995442 22654 rpcz_store.cc:276] 0709 13:10:26.598889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.977946 (+379057us) service_pool.cc:224] Handling call
0709 13:10:27.012962 (+ 35016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.013342 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.013374 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.028026 (+ 14652us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.368155 (+340129us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:27.368204 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.368292 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.993215 (+624923us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:27.994805 (+  1590us) raft_consensus.cc:1685] finished
0709 13:10:27.994826 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.995023 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":326,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":54598,"spinlock_wait_cycles":18295552,"thread_start_us":339517,"threads_started":1,"wal-append.queue_time_us":765176}
I20260709 13:10:27.802440 30210 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:27.997084 30210 raft_consensus.cc:3060] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:27.997332 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:27.998090 22647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37482 (request call id 1538) took 1757 ms (client timeout 1591 ms). Trace:
W20260709 13:10:27.998461 22647 rpcz_store.cc:269] 0709 13:10:26.241031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.285116 (+ 44085us) service_pool.cc:224] Handling call
0709 13:10:27.997926 (+1712810us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400412154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:27.998019 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367332608}
I20260709 13:10:27.869764 30280 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:28.001417 30315 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:28.001361 30280 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.002799 30315 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:28.003199 30315 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:28.003983 30315 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.004395 30280 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.913434 22575 raft_consensus.cc:1240] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:28.009410 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:28.009760 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:27.920321 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:27.921993 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:27.922679 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:28.012050 23262 raft_consensus.cc:2368] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 26. Current term is 27.
W20260709 13:10:27.957927 23258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.037s	sys 0.112s
W20260709 13:10:28.013854 23258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.038s	sys 0.112s
I20260709 13:10:28.014886 23258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46820 (request call id 1000) took 1564 ms. Trace:
W20260709 13:10:27.969544 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44132us
I20260709 13:10:27.846747 30262 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.851765 30138 consensus_meta.cc:287] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.001s
I20260709 13:10:27.828804 30314 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:27.976032 23264 raft_consensus.cc:2393] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 14: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:27.975591 22499 rpcz_store.cc:276] 0709 13:10:25.915943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.742565 (+826622us) service_pool.cc:224] Handling call
0709 13:10:26.743071 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.938566 (+195495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.938604 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.939143 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.105402 (+166259us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:27.105442 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.105509 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.868516 (+763007us) raft_consensus.cc:1685] finished
0709 13:10:27.868539 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.868688 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4703,"raft.queue_time_us":16516,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":50868,"thread_start_us":356070,"threads_started":2,"wal-append.queue_time_us":529552}
I20260709 13:10:27.978783 30065 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:27.903514 30196 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:27.981362 30307 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:27.987260 30197 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:27.988974 30294 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 1.141s	user 0.003s	sys 0.006s
I20260709 13:10:27.989969 30221 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:27.990922 30220 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:27.992558 23263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 1240) took 1869 ms (client timeout 2098 ms). Trace:
W20260709 13:10:28.036496 23263 rpcz_store.cc:269] 0709 13:10:26.123037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.134287 (+ 11250us) service_pool.cc:224] Handling call
0709 13:10:27.992399 (+1858112us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400855554. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:27.992504 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339331712}
I20260709 13:10:28.037676 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:27.895691 22645 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:27.897383 30007 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.005259 30310 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.008152 22649 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:28.010941 22504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59530 (request call id 3598) took 3891 ms. Trace:
I20260709 13:10:28.015333 23258 rpcz_store.cc:276] 0709 13:10:26.450447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.751203 (+300756us) service_pool.cc:224] Handling call
0709 13:10:26.777140 (+ 25937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.777441 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 13:10:26.834447 (+ 57006us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.014387 (+1179940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.014459 (+    72us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:10:28.014525 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.014629 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.014779 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57368,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"thread_start_us":1179509,"threads_started":1}
I20260709 13:10:28.027081 30315 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.024602 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.055228 22647 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
I20260709 13:10:28.025787 30144 consensus_queue.cc:1048] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
W20260709 13:10:28.027521 23264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46812 (request call id 1239) took 1904 ms (client timeout 2154 ms). Trace:
W20260709 13:10:28.029922 22617 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.013s	sys 0.021s
I20260709 13:10:28.020149 30199 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:28.043676 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:28.056424 23264 rpcz_store.cc:269] 0709 13:10:26.122782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.134287 (+ 11505us) service_pool.cc:224] Handling call
0709 13:10:27.866323 (+1732036us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b5800004598. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6eee 0000000000375939 00007fec2b24a1e0 00007fec2b3130c4 00007fec2b313131 00007fec2b2c10a0 00007fec2b2c0984 00007fec2483b6d4 00007fec2483b662
0709 13:10:28.027457 (+161134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59972992}
I20260709 13:10:28.060467 23263 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:28.052724 22504 rpcz_store.cc:276] 0709 13:10:24.120017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.682970 (+562953us) service_pool.cc:224] Handling call
0709 13:10:24.750493 (+ 67523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.763943 (+ 13450us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:24.855079 (+ 91136us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.309591 (+454512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.309672 (+    81us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:25.309744 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.010743 (+2700999us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540042a4d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:28.010790 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.010894 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108284,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":14424,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12202,"spinlock_wait_cycles":30400256,"thread_start_us":442912,"threads_started":1,"wal-append.queue_time_us":617494,"wal-append.run_cpu_time_us":1249,"wal-append.run_wall_time_us":1028092}
I20260709 13:10:28.065361 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.032109 30314 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:28.025983 30138 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:28.057101 22617 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.013s	sys 0.021s
W20260709 13:10:28.074178 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 753960us
I20260709 13:10:28.057788 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:28.026291 30262 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:28.049757 22545 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.034267 30203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.019s	sys 0.047s
W20260709 13:10:28.071981 22578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.014s	sys 0.028s
W20260709 13:10:28.091892 22578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.014s	sys 0.028s
I20260709 13:10:28.029168 30253 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:10:28.035701 30119 consensus_queue.cc:1059] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:10:28.059499 30199 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.081786 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:28.086963 22544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.037s	sys 0.078s
I20260709 13:10:28.073125 30099 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.088182 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:28.103582 22577 raft_consensus.cc:2468] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:28.098640 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:28.106673 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56939.5us
W20260709 13:10:28.094712 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.097188 22573 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:28.097465 22544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.037s	sys 0.078s
I20260709 13:10:28.069479 30220 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:28.109135 22545 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.091835 30203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.020s	sys 0.047s
I20260709 13:10:28.110831 22618 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:28.113153 22545 leader_election.cc:336] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.096705 30253 raft_consensus.cc:3055] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:28.104872 29898 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.101173 30199 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:28.127668 22545 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.107779 30120 raft_consensus.cc:3055] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:28.113718 30091 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:28.110428 30119 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:28.099390 30230 consensus_queue.cc:1059] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:10:28.107244 30099 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.132563 30253 raft_consensus.cc:740] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:28.132308 30192 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.195180 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 4124) took 1091 ms. Trace:
I20260709 13:10:28.117375 30220 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.189872 30119 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.229979 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:28.239043 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 125928us
W20260709 13:10:28.240522 22545 leader_election.cc:336] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.189464 30268 raft_consensus.cc:3055] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:10:28.196532 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 88690.7us
I20260709 13:10:28.240963 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.129110 30259 consensus_queue.cc:1048] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:10:28.236442 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.236603 22580 rpcz_store.cc:276] 0709 13:10:27.103429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.103845 (+   416us) service_pool.cc:224] Handling call
0709 13:10:28.194974 (+1091129us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003c91d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:28.195118 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452609920}
I20260709 13:10:28.242908 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.136650 29898 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.194258 30091 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:28.237090 30277 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.247424 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 136647us
I20260709 13:10:28.133325 30144 consensus_queue.cc:1048] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
W20260709 13:10:28.248694 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 215621us
I20260709 13:10:28.245414 22617 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.250221 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:28.258006 22545 leader_election.cc:336] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.197697 30230 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:28.246018 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:28.242787 30303 log.cc:927] Time spent T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 1.233s	user 0.005s	sys 0.011s
I20260709 13:10:28.242122 30119 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.192930 30120 raft_consensus.cc:740] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:28.259594 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:28.255190 22618 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:28.242930 30268 raft_consensus.cc:740] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:28.262642 30318 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:10:28.263126 30138 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.266330 30210 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.267074 22651 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 17.
I20260709 13:10:28.268165 30262 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.269212 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.270551 22650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37482 (request call id 1530) took 3511 ms. Trace:
I20260709 13:10:28.273293 30007 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.273818 22590 tablet_copy_service.cc:140] P 691cccbd0258483ebe19e1581674cc94: Received BeginTabletCopySession request for tablet 80dc0c7d4f9341eeb7472424613de2ce from peer fa2f181263f446a6962b649f9348c15f ({username='slave'} at 127.0.0.1:36354)
I20260709 13:10:28.277037 30327 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:28.298501 22590 tablet_copy_service.cc:161] P 691cccbd0258483ebe19e1581674cc94: Beginning new tablet copy session on tablet 80dc0c7d4f9341eeb7472424613de2ce from peer fa2f181263f446a6962b649f9348c15f at {username='slave'} at 127.0.0.1:36354: session id = fa2f181263f446a6962b649f9348c15f-80dc0c7d4f9341eeb7472424613de2ce
I20260709 13:10:28.298575 30327 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.259619 30253 consensus_queue.cc:260] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:28.262652 30321 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:28.242568 30192 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.243417 30322 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:28.282794 22617 leader_election.cc:400] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20.
I20260709 13:10:28.325707 22617 leader_election.cc:403] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:28.251509 30145 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:28.252946 30065 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.252466 30091 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:28.293689 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.294936 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.333617 30199 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.334750 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:28.335913 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.296583 30099 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.296336 30331 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:28.337157 30274 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.297145 30072 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:28.338671 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.295322 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:28.302170 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 4126) took 1192 ms. Trace:
I20260709 13:10:28.297636 30334 consensus_queue.cc:1048] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:10:28.337170 30239 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 19. Current term is 20.
I20260709 13:10:28.340562 30268 consensus_queue.cc:260] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.341718 30268 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:28.341862 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.334829 30210 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.349726 22573 raft_consensus.cc:2468] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:28.350308 29898 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.304483 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.345630 30255 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:28.346493 29963 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.352238 30120 consensus_queue.cc:260] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.301221 30327 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.261445 30230 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:28.346647 29706 consensus_queue.cc:1059] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:10:28.353647 30230 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:28.353955 30120 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:28.354460 29706 raft_consensus.cc:3055] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:28.354835 29706 raft_consensus.cc:740] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:28.355633 29706 consensus_queue.cc:260] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:28.309746 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 54634.5us
I20260709 13:10:28.343245 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.357125 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.358265 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.308842 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.193583 30314 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.352488 29963 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.359450 23261 raft_consensus.cc:1275] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:10:28.361093 29963 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.353164 23260 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:10:28.352227 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.358264 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.363106 22572 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 19: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:28.363482 29706 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:28.364041 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.314379 30253 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:28.367017 22646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7"
dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
 from {username='slave'} at 127.0.0.1:45762
I20260709 13:10:28.367740 22646 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:28.368127 22646 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:28.289376 29957 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:28.286651 30290 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:28.325707 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.292524 22650 rpcz_store.cc:276] 0709 13:10:24.759177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.759342 (+   165us) service_pool.cc:224] Handling call
0709 13:10:24.759724 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.476528 (+1716804us) spinlock_profiling.cc:243] Waited 944 us on lock 0x7b180003a4e0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec25ea34bc 00007fec231f148b 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320b455 00007fec262f3060 00007fec262f3bfb 00007fec262fe64b
0709 13:10:26.476673 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.476695 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.484819 (+  8124us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.935935 (+451116us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:10:26.935990 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.941026 (+  5036us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.076282 (+1135256us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:28.270308 (+194026us) raft_consensus.cc:1685] finished
0709 13:10:28.270334 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.270489 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2535,"raft.queue_time_us":146247,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":12418,"spinlock_wait_cycles":58021120,"thread_start_us":644365,"threads_started":2,"wal-append.queue_time_us":524567}
I20260709 13:10:28.310179 30335 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:28.371608 22498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48204 (request call id 1594) took 4340 ms (client timeout 1850 ms). Trace:
W20260709 13:10:28.329386 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 46721.7us
I20260709 13:10:28.351301 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:28.382025 22498 rpcz_store.cc:269] 0709 13:10:24.031531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.038305 (+  6774us) service_pool.cc:224] Handling call
0709 13:10:28.371434 (+4333129us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540033e5d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:28.371540 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4100558080}
I20260709 13:10:28.257268 30277 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.303529 22575 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:10:28.352747 30197 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.358875 23264 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
W20260709 13:10:28.318194 30308 log.cc:927] Time spent T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 1.311s	user 0.000s	sys 0.005s
I20260709 13:10:28.378961 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.381740 22580 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:28.339512 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:28.369242 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45766 (request call id 3020) took 1145 ms. Trace:
I20260709 13:10:28.381045 22469 leader_election.cc:400] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 election: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 26. Current term is 27.
I20260709 13:10:28.403844 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.410427 22651 rpcz_store.cc:276] 0709 13:10:27.224280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.224477 (+   197us) service_pool.cc:224] Handling call
0709 13:10:28.369069 (+1144592us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54001c7ad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:28.369183 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113788672}
I20260709 13:10:28.340466 22578 rpcz_store.cc:276] 0709 13:10:27.109852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.110060 (+   208us) service_pool.cc:224] Handling call
0709 13:10:27.110501 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.095394 (+984893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.095427 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.095904 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.254651 (+158747us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:28.254691 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.254765 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.301799 (+ 47034us) raft_consensus.cc:1685] finished
0709 13:10:28.301824 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.302038 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66843,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":76890,"thread_start_us":1139536,"threads_started":2,"wal-append.queue_time_us":199750}
I20260709 13:10:28.385069 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.385424 23255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.385464 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.412899 22650 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:28.413331 23256 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:10:28.383865 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.374266 23257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46826 (request call id 1183) took 1949 ms. Trace:
I20260709 13:10:28.386379 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.414175 22572 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 24: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:28.413918 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:28.414188 23257 rpcz_store.cc:276] 0709 13:10:26.425260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.425599 (+   339us) service_pool.cc:224] Handling call
0709 13:10:26.439326 (+ 13727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.022231 (+582905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.374023 (+1351792us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54007463d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:28.374203 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218521344}
I20260709 13:10:28.413491 22469 leader_election.cc:403] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 13:10:28.414834 22574 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 23: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:28.416133 22617 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:28.414834 22650 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
W20260709 13:10:28.391436 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129430us
I20260709 13:10:28.417836 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:28.418586 23262 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:28.422930 23259 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:28.431216 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:28.432664 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 51828.6us
I20260709 13:10:28.433347 22469 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:28.434737 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:28.435361 22650 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:28.437320 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.437989 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.321830 30151 raft_consensus.cc:2804] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:28.438627 22645 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:28.439376 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.441431 22647 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate 6ca917eaada84bf38a5daae9f8ffa066 in this term.
I20260709 13:10:28.418514 22646 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.439459 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.445266 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.446679 23260 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:28.447127 23259 raft_consensus.cc:2410] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 13:10:28.410199 30328 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.132s	user 0.003s	sys 0.002s
W20260709 13:10:28.390543 30333 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.051s	user 0.000s	sys 0.004s
I20260709 13:10:28.351936 30310 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.457326 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.457756 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.477999 23258 raft_consensus.cc:2468] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:28.478267 22646 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:28.471390 22650 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:28.379309 30220 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.480044 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.484797 22469 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:28.485224 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:28.489953 22545 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.491382 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:28.451452 30197 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:28.474740 30151 raft_consensus.cc:697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:28.457688 30327 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:28.458577 30334 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:10:28.446722 30335 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:28.493733 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:28.497051 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:28.443975 30221 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:10:28.437237 30239 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:10:28.392189 30290 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.458861 30072 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
I20260709 13:10:28.555820 22646 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 19: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:28.510620 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:28.513375 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.556483 22651 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:28.557108 22574 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 13.
W20260709 13:10:28.533996 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44072us
W20260709 13:10:28.558799 22545 leader_election.cc:336] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.559181 22545 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.534305 22650 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:28.562252 22577 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
W20260709 13:10:28.537902 23229 leader_election.cc:336] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.563419 23229 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.552407 23262 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:28.568132 22649 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:10:28.568457 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.565070 23229 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.570487 22469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.571242 22619 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.571780 22545 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.571973 22619 leader_election.cc:336] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.572667 22545 leader_election.cc:336] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.573074 22545 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:28.532333 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:28.538496 22543 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:28.569598 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.576460 22650 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:28.576730 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.577865 22646 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:28.578984 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.579792 22646 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:28.581481 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.574590 23257 raft_consensus.cc:2376] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17. Re-sending same reply.
I20260709 13:10:28.510768 30310 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:28.584851 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46415.2us
W20260709 13:10:28.595588 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 56907.7us
I20260709 13:10:28.585582 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:28.586958 23229 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.590487 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:28.584342 22545 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.597440 23229 leader_election.cc:336] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.598006 22545 leader_election.cc:336] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.598613 22545 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.572335 22619 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.533876 30114 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:28.554958 29649 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:28.529980 30192 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.517572 30327 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:28.596726 22650 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:28.531576 30277 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.597961 23229 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.548353 30290 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:28.601233 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.574179 30331 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.603410 22545 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.654299 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50936.7us
I20260709 13:10:28.654850 22649 raft_consensus.cc:2410] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:10:28.584237 30315 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:28.608323 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:28.590433 30081 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:28.588353 29706 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:28.605437 30281 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:28.510161 30151 consensus_queue.cc:237] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.677265 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.590417 29947 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:28.593796 30120 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:10:28.635077 23229 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.504809 30091 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:28.658782 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.691553 22574 raft_consensus.cc:2468] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 20.
I20260709 13:10:28.595811 30310 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:28.661394 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 65086.5us
I20260709 13:10:28.694687 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:28.662405 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90443.3us
I20260709 13:10:28.534760 30119 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:28.664593 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.660884 30069 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:28.611285 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.672305 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.661006 30337 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:28.701213 30337 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:28.667829 30253 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:28.701642 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:28.620548 30255 consensus_queue.cc:1048] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:10:28.619549 22651 raft_consensus.cc:2468] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
W20260709 13:10:28.690760 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55752us
I20260709 13:10:28.662631 30331 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:28.692261 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.510941 30220 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.089s
W20260709 13:10:28.696308 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 312197us
I20260709 13:10:28.667574 30315 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:28.695785 22619 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.665632 30334 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
W20260709 13:10:28.733083 22619 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.733673 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:28.734184 30315 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:28.735024 22619 leader_election.cc:336] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.707706 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.737143 22649 raft_consensus.cc:1275] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:28.738807 22649 raft_consensus.cc:1275] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:28.740154 22649 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 21. Current term is 22. Ops: []
W20260709 13:10:28.704214 23229 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.741458 23229 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.743088 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.743942 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.709900 22545 leader_election.cc:336] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.745445 22545 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.669066 30230 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.747094 22647 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 24. Current term is 25. Ops: []
W20260709 13:10:28.747128 22545 leader_election.cc:336] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.748370 30230 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.716580 22575 raft_consensus.cc:2393] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:28.691489 30327 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:28.715827 30091 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.723842 30197 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571) with higher term. Message: Invalid argument: T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 26. Current term is 27.
I20260709 13:10:28.708949 29957 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.734938 29947 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:28.709842 30238 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.715794 30119 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:28.750336 22619 leader_election.cc:336] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.762142 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:28.748588 22545 leader_election.cc:336] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.744575 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.763207 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.763331 22545 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.763638 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.750152 30253 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:28.767006 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:28.767438 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:28.697683 30310 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.698767 30120 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:28.711488 30221 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:28.735095 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:28.834771 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 67415.1us
I20260709 13:10:28.768537 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:28.835516 23257 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:10:28.764015 22545 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.770718 22619 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.836318 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:28.836881 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66177.8us
I20260709 13:10:28.837067 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:28.807207 21390 thread.cc:527] Waited for 2000ms trying to join with rpc worker (tid 22506)
W20260709 13:10:28.833835 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 132316us
W20260709 13:10:28.837831 22619 leader_election.cc:336] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.838672 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:28.771217 23229 leader_election.cc:336] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.842991 30326 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.843919 30259 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:28.844365 30259 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.844760 30259 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:28.847904 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83909.7us
W20260709 13:10:28.848723 22545 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.849344 22545 leader_election.cc:336] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.842461 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 107440us
W20260709 13:10:28.839470 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69760.7us
W20260709 13:10:28.852461 22619 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.849709 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.850065 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.837656 30315 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:28.850010 30281 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:28.850961 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.765830 30253 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:28.877013 30253 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:28.877421 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.878626 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:28.879271 30341 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:28.879714 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:28.880534 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.880806 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:28.884456 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:28.885988 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.886523 29649 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:28.886667 22545 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.887248 22545 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.887532 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:28.888221 22545 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.888727 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.770675 30220 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:28.873090 30230 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:28.761138 29957 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:28.834595 30238 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:28.888831 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:28.890455 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:28.946509 22579 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
W20260709 13:10:28.858783 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.970284 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111560us
W20260709 13:10:28.971468 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.833791 30335 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:10:28.964251 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 113373us
I20260709 13:10:28.834574 30221 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:28.962514 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85899.5us
W20260709 13:10:28.973523 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 83127.9us
W20260709 13:10:28.975132 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86931us
W20260709 13:10:28.979054 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:28.972496 23229 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:28.981227 23229 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.882666 30197 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:28.889894 29963 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:28.889580 30091 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:28.973152 29649 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:28.985126 23229 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:28.979950 30119 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:28.887883 30331 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:28.890394 30230 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:28.972297 30191 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.021843 30191 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.023296 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:28.979810 30072 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:28.843575 30326 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.028895 22647 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:29.029589 23260 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 25. Current term is 26. Ops: []
W20260709 13:10:29.017606 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.979722 30238 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:29.013648 22544 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:29.017272 23227 connection.cc:256] RPC call timeout handler was delayed by -1.0440801019999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 13:10:28.980338 30221 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:29.018600 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:29.036727 22468 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.036942 22575 raft_consensus.cc:2410] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:10:28.889613 30220 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:29.031015 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.041015 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:29.012326 29957 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:29.045415 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.045886 22544 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:29.046446 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.042968 23227 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:29.014586 29649 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.050184 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:29.050278 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:29.052095 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:29.054558 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.055594 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.060526 30344 log.cc:927] Time spent T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:29.063882 30326 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:29.017942 30120 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.064951 30069 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:29.066164 30268 raft_consensus.cc:3055] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:10:29.066605 30268 raft_consensus.cc:740] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:29.067809 30310 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.069664 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.074949 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:29.072667 22543 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:29.054997 22575 raft_consensus.cc:2376] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23. Re-sending same reply.
I20260709 13:10:29.050649 30072 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.073575 30327 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:29.077523 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:29.077915 30327 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:29.078413 22575 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:29.079066 30327 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.079536 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:29.076992 30072 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.084483 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.086490 22649 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:10:29.087718 22649 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:29.087961 30259 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.054114 29706 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.094096 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.094523 23260 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:10:29.095122 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.044292 30197 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:29.059384 22468 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.093041 22645 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:10:29.051827 29947 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:29.069146 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.096175 22649 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:29.091706 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:29.049736 30331 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:29.094127 22544 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.112349 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:29.097908 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.085506 30072 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:29.100381 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 45873.1us
I20260709 13:10:29.057734 29649 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:29.097476 30238 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.131949 22544 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:29.107963 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 48639.1us
I20260709 13:10:29.114547 22571 raft_consensus.cc:2368] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 23. Current term is 24.
I20260709 13:10:29.114934 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:29.133246 23262 raft_consensus.cc:2393] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 27: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:29.099033 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:29.115788 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46704.6us
I20260709 13:10:29.133769 23257 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 14.
W20260709 13:10:29.115645 23229 leader_election.cc:336] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.073736 30081 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:29.118539 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:29.137400 30345 log.cc:927] Time spent T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:10:29.138686 30192 consensus_queue.cc:1048] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:10:29.139745 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:29.140897 30069 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:29.052903 30210 consensus_queue.cc:1059] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.056s
I20260709 13:10:29.143100 30220 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:29.144415 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:29.116223 22545 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:29.136420 22619 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.117343 29957 consensus_queue.cc:1048] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:10:29.136694 23257 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:10:29.141034 29706 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:29.135545 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:29.146315 22619 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.145923 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:29.149243 22619 leader_election.cc:336] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:29.150491 22619 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.151355 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.114034 30079 raft_consensus.cc:2804] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:29.110358 30240 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:29.159453 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:29.157811 22619 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.148478 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:29.164551 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:29.163038 22619 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.144901 29969 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:29.110153 30310 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:29.170571 29706 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:29.114077 30331 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.112200 30202 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:29.159271 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:29.174489 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:29.146534 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.175824 30210 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:29.176330 30210 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:29.176795 30210 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:29.166566 30240 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:29.173072 30331 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:29.178047 30240 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:29.179895 30348 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:10:29.158581 30072 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:29.131261 30253 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.148720 29947 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:10:29.183297 30310 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:29.156471 30220 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.159078 30069 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:29.160461 30326 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:29.161288 30255 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:29.181535 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:29.184258 22619 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.163805 30315 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:29.160888 30192 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:10:29.166991 30260 raft_consensus.cc:2764] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:10:29.187247 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:29.168571 30079 raft_consensus.cc:697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:29.203533 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:29.207549 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:29.192994 22619 leader_election.cc:336] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:29.176424 22545 leader_election.cc:336] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.208214 22578 raft_consensus.cc:2468] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:29.198396 30253 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:29.208323 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.174350 30215 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:10:29.187844 29947 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:29.177191 30202 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:29.220773 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.221974 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.211126 22575 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
W20260709 13:10:29.214289 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.191825 30255 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.219007 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:29.226023 22578 raft_consensus.cc:2468] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 25.
I20260709 13:10:29.227221 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:29.228629 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.231069 22545 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.231894 22545 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:29.263803 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.237111 22619 leader_election.cc:336] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:29.297570 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 165693us
W20260709 13:10:29.294742 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57674us
W20260709 13:10:29.300082 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.305521 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.296057 22545 leader_election.cc:336] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.194206 30220 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.221506 29947 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:29.317489 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 182153us
I20260709 13:10:29.230086 30072 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:29.311720 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:29.313349 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 124660us
I20260709 13:10:29.314802 22578 raft_consensus.cc:1240] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:29.229914 30255 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.238600 30327 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.293581 30197 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:29.323331 22578 raft_consensus.cc:1275] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:10:29.332895 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:29.341361 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:29.345088 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 163605us
I20260709 13:10:29.348574 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:29.349200 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:29.326916 30069 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:29.362674 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.355846 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:29.331643 30197 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:29.346647 30290 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:29.342768 30310 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:29.358572 29706 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:29.380143 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:29.310526 22544 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:29.347683 30061 consensus_queue.cc:1059] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:10:29.385558 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:29.387126 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 76732.3us
I20260709 13:10:29.344159 30327 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.373534 30197 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:29.396102 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.378392 29706 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.340230 30079 consensus_queue.cc:237] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.388001 30114 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:29.405781 30069 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.408915 29969 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:29.388069 30259 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:29.409780 30317 log.cc:927] Time spent T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 1.306s	user 0.004s	sys 0.014s
I20260709 13:10:29.390708 30240 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.455664 30240 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.458603 30240 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:29.459286 30240 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:29.459892 30240 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.462023 30363 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.463268 30363 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:29.419046 30239 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:29.468369 30239 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:29.375051 30315 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:29.411831 30340 log.cc:927] Time spent T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.429s	user 0.003s	sys 0.000s
W20260709 13:10:29.412920 22579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 4127) took 2294 ms (client timeout 1727 ms). Trace:
I20260709 13:10:29.414019 30199 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:29.417901 30191 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:29.418479 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.506170 22648 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:29.419250 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.420054 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.420113 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.421856 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:29.507869 22645 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:29.389091 30364 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:10:29.424794 30220 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:29.405884 30367 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:29.435671 30310 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.441113 29706 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:29.444797 29957 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:10:29.449306 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.368324 29947 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.411453 22544 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.384387 30357 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:10:29.484938 22619 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:29.491670 22579 rpcz_store.cc:269] 0709 13:10:27.118672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.118858 (+   186us) service_pool.cc:224] Handling call
0709 13:10:29.412613 (+2293755us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54000e6854. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:29.412771 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4062625024}
I20260709 13:10:29.485431 30114 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:29.588056 22579 raft_consensus.cc:1240] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 23. Current term is 24. Ops: [21.14-23.15]
I20260709 13:10:29.508054 22654 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.423554 30327 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:29.530359 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:29.486078 30368 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:29.586004 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 180799us
W20260709 13:10:29.607822 22619 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.608652 22619 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:29.582003 30353 log.cc:927] Time spent T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:29.614836 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.469591 30239 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.618088 22648 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:29.563838 29957 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:29.620066 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 208705us
I20260709 13:10:29.577865 22590 tablet_copy_source_session.cc:215] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:29.634043 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 271424us
I20260709 13:10:29.644824 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.645888 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.651432 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.607760 30215 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:29.426294 30337 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.583034 30197 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.663529 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:29.663787 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.615775 30202 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:29.666832 23227 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:29.668100 23257 raft_consensus.cc:1275] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:29.569099 30210 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.631093 30238 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:29.590477 30367 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.699553 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:29.710847 22652 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:29.705590 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:29.652822 29947 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:29.678815 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:29.670058 30221 consensus_meta.cc:287] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.633s	user 0.014s	sys 0.000s
I20260709 13:10:29.665119 30239 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:29.625749 30360 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:29.713951 23262 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 17.
I20260709 13:10:29.708231 22648 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 25.
I20260709 13:10:29.715834 22654 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:10:29.661355 30220 raft_consensus.cc:2804] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:29.727524 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.712692 30202 raft_consensus.cc:2804] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:29.710369 30362 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:29.710767 30061 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:29.665645 30215 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.753032 30369 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:29.753314 22590 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:36354 (request call id 1313) took 1635 ms. Trace:
I20260709 13:10:29.661022 30327 consensus_queue.cc:1059] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:10:29.668797 30192 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:10:29.723601 30337 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:29.767683 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:29.769438 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:29.770228 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:29.774495 22574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2900) took 1306 ms (client timeout 1658 ms). Trace:
W20260709 13:10:29.825121 22574 rpcz_store.cc:269] 0709 13:10:28.467942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.558000 (+ 90058us) service_pool.cc:224] Handling call
0709 13:10:29.774303 (+1216303us) spinlock_profiling.cc:243] Waited 94.2 ms on lock 0x7b54003c87d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:29.774430 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216632192}
I20260709 13:10:29.665349 30363 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:10:29.734375 30220 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:29.726078 30221 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.751331 30202 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:29.651537 30315 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.829439 22645 raft_consensus.cc:2393] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:29.822099 22651 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:29.839924 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:29.823776 30378 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:10:29.854965 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.855360 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.856033 22648 raft_consensus.cc:2468] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:29.856199 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:29.858593 22645 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:29.722142 30114 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:29.828979 30343 log.cc:927] Time spent T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.846s	user 0.000s	sys 0.008s
W20260709 13:10:29.898749 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.903746 22580 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:29.788219 30362 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.945283 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:29.813876 22590 rpcz_store.cc:276] 0709 13:10:28.183617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.250975 (+ 67358us) service_pool.cc:224] Handling call
0709 13:10:29.505355 (+1254380us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54003acad4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec263053f7 00007fec2b29b036 00007fec2b2a4a3e 00007fec22b6827b 00007fec2b2a49ba 00007fec2b29facc 00007fec2b29ac7b 00007fec2b28f8d1 00007fec2a3434b4 00007fec2a343442
0709 13:10:29.752992 (+247637us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590005632}
I20260709 13:10:29.914240 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.194617 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 4166) took 1482 ms. Trace:
I20260709 13:10:29.871678 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:29.861428 22571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 4163) took 1150 ms. Trace:
I20260709 13:10:30.195381 22576 rpcz_store.cc:276] 0709 13:10:28.712085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.559552 (+847467us) service_pool.cc:224] Handling call
0709 13:10:29.573650 (+ 14098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.574057 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:29.574084 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.574587 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.719927 (+145340us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:29.719970 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.720043 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.193958 (+473915us) raft_consensus.cc:1685] finished
0709 13:10:30.194003 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.194362 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":144954,"threads_started":1,"wal-append.queue_time_us":216281}
I20260709 13:10:30.197623 22579 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:30.193151 22572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 4160) took 1482 ms. Trace:
I20260709 13:10:30.200037 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.199262 22572 rpcz_store.cc:276] 0709 13:10:28.710135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.423442 (+713307us) service_pool.cc:224] Handling call
0709 13:10:29.423791 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.424218 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.424261 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.424829 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.843687 (+418858us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:29.843740 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.843817 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.192325 (+348508us) raft_consensus.cc:1685] finished
0709 13:10:30.192418 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.192832 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1166,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"thread_start_us":259426,"threads_started":1,"wal-append.queue_time_us":416478}
I20260709 13:10:30.202317 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.202713 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:30.203867 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:30.201237 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 329532us
I20260709 13:10:30.205456 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.207197 22572 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 24: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:30.196363 22571 rpcz_store.cc:276] 0709 13:10:28.710829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.884220 (+173391us) service_pool.cc:224] Handling call
0709 13:10:29.861126 (+976906us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400258354. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:29.861342 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527496960}
W20260709 13:10:30.214800 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.217245 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.222421 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.224298 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:29.915680 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:30.227911 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:30.232780 22545 consensus_peers.cc:597] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:30.234145 22545 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:30.235321 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 290153us
W20260709 13:10:30.235816 22545 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:30.220836 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.081073 29957 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.255120 29957 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:30.212436 30398 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.840724 30220 raft_consensus.cc:3060] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:30.236729 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:29.989542 29969 consensus_meta.cc:287] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.004s
I20260709 13:10:30.266669 29939 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.051158 30221 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:29.983484 30215 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.309152 29650 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:30.314126 29650 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.313401 30398 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:29.965173 30197 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.012909 30385 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.299875 30393 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:30.299779 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.301421 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:29.987710 30331 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.000s
I20260709 13:10:29.962950 30372 raft_consensus.cc:2804] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:29.963572 30367 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.304813 30290 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:30.305608 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 69101.2us
I20260709 13:10:30.326009 30290 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:29.983724 30144 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:30.045954 30255 consensus_meta.cc:287] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.003s
I20260709 13:10:30.326639 30290 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.327327 30144 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.327430 30255 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.301066 30337 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:29.965543 30371 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:30.331657 23258 raft_consensus.cc:1240] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 25. Current term is 26. Ops: []
I20260709 13:10:30.014545 30384 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.298208 23259 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:30.332824 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41932 (request call id 4158) took 1623 ms. Trace:
I20260709 13:10:30.291606 22572 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:30.333523 22578 rpcz_store.cc:276] 0709 13:10:28.709602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.343908 (+634306us) service_pool.cc:224] Handling call
0709 13:10:29.344333 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.346991 (+  2658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.347033 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.347553 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.654680 (+307127us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:29.654721 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.654800 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.332218 (+677418us) raft_consensus.cc:1685] finished
0709 13:10:30.332256 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.332555 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6633,"raft.queue_time_us":3046,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":8568,"thread_start_us":283206,"threads_started":1,"wal-append.queue_time_us":448262}
I20260709 13:10:30.337419 30372 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.338047 30372 raft_consensus.cc:3060] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:30.332849 30384 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.338311 30221 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.339090 30221 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.340493 30384 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:30.282774 22545 leader_election.cc:336] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.969033 30363 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.369s
W20260709 13:10:30.341862 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 121311us
I20260709 13:10:30.342278 30221 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:30.321990 30357 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:30.342885 23262 raft_consensus.cc:2468] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 14.
I20260709 13:10:30.314664 29650 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:29.855360 30327 consensus_queue.cc:1243] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:10:30.026392 29649 consensus_meta.cc:287] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.866s	user 0.015s	sys 0.001s
W20260709 13:10:30.323536 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:30.324357 30331 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:30.347424 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 84030us
I20260709 13:10:29.838747 30240 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:29.859579 30369 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:30.349973 30399 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.350935 30399 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.963786 30370 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:30.354601 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41936 (request call id 2890) took 2059 ms (client timeout 1519 ms). Trace:
I20260709 13:10:30.354303 30370 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:30.355068 22577 rpcz_store.cc:269] 0709 13:10:28.294965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.295104 (+   139us) service_pool.cc:224] Handling call
0709 13:10:30.354095 (+2058991us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54003b3154. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:30.354361 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460464000}
I20260709 13:10:30.356389 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.308107 30362 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.356968 30331 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.025864 30268 consensus_queue.cc:260] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.358590 22654 raft_consensus.cc:2368] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:30.359146 30268 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:30.079460 30364 raft_consensus.cc:3055] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:30.360286 30364 raft_consensus.cc:740] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:30.075245 29706 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.362139 30364 consensus_queue.cc:260] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:29.851534 30202 raft_consensus.cc:3060] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:30.371065 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.352214 29649 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.373524 29706 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:30.375262 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.375857 29649 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:29.914238 30199 consensus_queue.cc:1048] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.436s
I20260709 13:10:30.322919 30385 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.313117 29939 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.108335 30238 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:30.350955 30369 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.390009 30079 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:30.390667 30079 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.391070 30079 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.392036 30369 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.392671 30370 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.394800 29939 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:30.362990 29969 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:30.395676 30276 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.396204 22576 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.364571 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:30.326257 30398 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.377204 22575 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:30.336781 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.346603 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.395133 22543 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:30.380795 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 143963us
I20260709 13:10:30.388760 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:30.405125 22578 raft_consensus.cc:2393] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 23: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:30.405728 30399 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.406334 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.406760 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.407708 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:30.425259 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.428566 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.429924 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:30.430797 22577 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:30.431794 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.432435 30385 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:30.433768 22545 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:29.837638 30061 consensus_queue.cc:1048] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.565s
I20260709 13:10:30.442770 22576 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:10:30.447227 30202 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.435489 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:30.449765 22645 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:30.451144 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:30.451629 29947 consensus_meta.cc:287] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.726s	user 0.015s	sys 0.000s
I20260709 13:10:30.437291 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:30.452998 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 102747us
I20260709 13:10:30.453331 23258 raft_consensus.cc:2468] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 19.
I20260709 13:10:30.454895 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:30.455156 30144 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.457360 22577 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:30.458155 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2905) took 1387 ms. Trace:
I20260709 13:10:30.458598 22577 rpcz_store.cc:276] 0709 13:10:29.070944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.456187 (+1385243us) service_pool.cc:224] Handling call
0709 13:10:30.456710 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.457814 (+  1104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.458062 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:30.462244 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:30.464283 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:30.476498 22572 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:30.477622 30191 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:30.478188 30191 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:30.478281 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83358.8us
I20260709 13:10:30.478642 30191 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:30.479271 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.493010 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.493530 30144 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:30.493867 23258 raft_consensus.cc:2468] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 18.
I20260709 13:10:30.494041 30144 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.494508 30144 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:30.495378 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:30.495607 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.497148 22574 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
W20260709 13:10:30.498154 23229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.500046 22543 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.498729 30385 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:30.509236 22648 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:30.509135 30384 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:10:30.509943 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 163566us
I20260709 13:10:30.511834 22649 raft_consensus.cc:1240] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:30.522627 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.524298 30337 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:30.526744 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.527431 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:30.527835 30387 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:30.528282 23260 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.529604 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.513201 22653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45766 (request call id 3011) took 3913 ms. Trace:
I20260709 13:10:30.514077 30334 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:30.532773 30387 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:30.533627 30387 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.516999 30120 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.534075 30387 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:30.534591 23262 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:30.534492 30120 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.535889 30255 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.517277 30210 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:30.539283 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.541934 22648 raft_consensus.cc:1240] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:30.538019 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41932 (request call id 4149) took 1832 ms. Trace:
I20260709 13:10:30.544250 22575 rpcz_store.cc:276] 0709 13:10:28.706811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.236261 (+529450us) service_pool.cc:224] Handling call
0709 13:10:30.537771 (+1301510us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400256f54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262ff2fa 00007fec2b2c0b17 00007fec2483b6d4 00007fec2483b662 00007fec2483b591 00007fec2483b50c 00007fec2483a7c2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:30.537940 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425543424}
I20260709 13:10:30.546026 22575 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:30.547832 22575 raft_consensus.cc:1275] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:30.518055 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.553085 30379 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:30.554015 30379 consensus_queue.cc:1059] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:30.555631 23227 leader_election.cc:336] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Timed out: RequestConsensusVote RPC to 127.20.227.130:41465 timed out after 1.509s (SENT)
I20260709 13:10:30.548046 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2901) took 1478 ms. Trace:
I20260709 13:10:30.557266 22580 rpcz_store.cc:276] 0709 13:10:29.070063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.589875 (+519812us) service_pool.cc:224] Handling call
0709 13:10:29.861636 (+271761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.951333 (+ 89697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.547621 (+596288us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400258350. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fa8ad 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6 00007fec2463526f
0709 13:10:30.547865 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623933696}
I20260709 13:10:30.560267 22580 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:30.501150 30369 raft_consensus.cc:3060] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.564904 22654 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:30.565939 30399 consensus_queue.cc:1059] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:30.532809 22653 rpcz_store.cc:276] 0709 13:10:26.599258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.978431 (+379173us) service_pool.cc:224] Handling call
0709 13:10:26.978960 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.979521 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:27.010799 (+ 31278us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.355107 (+1344308us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b180047f4a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec231f0e07 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b 00007fec25e9ad23 00007fec25e9b23a 00007fec26305a2a
0709 13:10:28.693581 (+338474us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.411199 (+717618us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec25e9686e 00007fec25e95bb6 00007fec25e957d8 00007fec25e9f221 00007fec25e9f1d9 00007fec25e9f169
0709 13:10:30.509069 (+1097870us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b2c0013e058. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec24bf4a11 00007fec24c04372 00007fec26336a01 00007fec262fb43a 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2
0709 13:10:30.510020 (+   951us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.510299 (+   279us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:30.510722 (+   423us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.511038 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.511230 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.512655 (+  1425us) raft_consensus.cc:1685] finished
0709 13:10:30.512695 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.512916 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44316,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":117,"raft.queue_time_us":2252,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":25276,"spinlock_wait_cycles":62301568,"thread_start_us":338311,"threads_started":1,"wal-append.queue_time_us":1735193}
I20260709 13:10:30.566994 30334 raft_consensus.cc:3055] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:30.567406 30334 raft_consensus.cc:740] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:30.556098 30310 raft_consensus.cc:3055] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:30.568341 30334 consensus_queue.cc:260] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.569167 30310 raft_consensus.cc:740] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:30.569391 23257 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260709 13:10:30.570250 30310 consensus_queue.cc:260] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.571367 30310 raft_consensus.cc:3060] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.573390 30334 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:30.556381 30388 raft_consensus.cc:3055] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:30.577421 30388 raft_consensus.cc:740] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:30.578627 30388 consensus_queue.cc:260] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.580006 30364 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.580137 30388 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:30.582365 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 101527us
I20260709 13:10:30.583426 22543 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.586882 30355 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:30.587803 30355 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:30.588261 30355 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.587893 30387 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:30.582605 30404 log.cc:927] Time spent T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:10:30.517578 22469 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:30.556377 23260 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 15.
I20260709 13:10:30.503159 29649 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:30.592563 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2904) took 1521 ms. Trace:
I20260709 13:10:30.588716 30355 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:30.621905 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 157807us
I20260709 13:10:30.590597 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:30.625883 22572 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:10:30.620538 22579 rpcz_store.cc:276] 0709 13:10:29.070742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.613622 (+542880us) service_pool.cc:224] Handling call
0709 13:10:29.614073 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.198447 (+584374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.592163 (+393716us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54003cb4d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:30.592476 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339259136}
I20260709 13:10:30.591888 30366 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:30.633608 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.637773 22650 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:30.640702 23262 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 26: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
W20260709 13:10:30.639330 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 138387us
I20260709 13:10:30.649433 22573 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:10:30.653021 29969 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:30.654112 30369 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:30.642561 30372 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.655606 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:30.657104 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 101514us
I20260709 13:10:30.657713 22654 raft_consensus.cc:1240] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:30.659198 22648 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 24. Current term is 25. Ops: []
I20260709 13:10:30.659333 22647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3610) took 1169 ms. Trace:
I20260709 13:10:30.660032 22647 rpcz_store.cc:276] 0709 13:10:29.489521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.904335 (+414814us) service_pool.cc:224] Handling call
0709 13:10:29.905335 (+  1000us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:30.402143 (+496808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.402198 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:30.405818 (+  3620us) log.cc:844] Serialized 52 byte log entry
0709 13:10:30.502800 (+ 96982us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:30.502839 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.517992 (+ 15153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.658822 (+140830us) raft_consensus.cc:1685] finished
0709 13:10:30.658851 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.659060 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11708,"raft.queue_time_us":130772,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":32345,"thread_start_us":548410,"threads_started":2,"wal-append.queue_time_us":250783}
I20260709 13:10:30.576969 30290 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.616120 30079 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.664793 30290 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.665417 30370 raft_consensus.cc:2804] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:30.665844 30370 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:30.666278 30370 raft_consensus.cc:3060] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.666461 30372 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.666662 30362 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.667286 30362 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.667829 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:30.669492 30200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80dc0c7d4f9341eeb7472424613de2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.669960 30290 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:30.665179 22578 raft_consensus.cc:2368] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:30.675103 22653 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:30.664603 30079 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.686555 22617 leader_election.cc:400] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 23. Current term is 24.
I20260709 13:10:30.688098 22617 leader_election.cc:403] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:30.688794 22645 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 27.
W20260709 13:10:30.689257 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.587911 29650 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.695036 29969 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:30.699474 29969 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:30.699610 22543 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.700791 29649 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:30.701593 29649 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.700700 29969 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.702047 29649 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:30.702729 29969 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:30.704921 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:30.689262 30239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.006s	sys 0.006s
I20260709 13:10:30.707690 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:30.687716 30202 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:30.711396 30239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.006s	sys 0.007s
I20260709 13:10:30.762552 22469 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:30.702781 30120 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.764132 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:10:30.762162 30253 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.037s	sys 0.011s
I20260709 13:10:30.688563 30366 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:30.770913 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 83424.6us
I20260709 13:10:30.772967 30191 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:30.773741 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 142055us
I20260709 13:10:30.774470 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:30.774709 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.775817 30191 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.766309 30268 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:30.733973 29957 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.772018 29650 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.768754 30369 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:30.772315 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 56959.7us
I20260709 13:10:30.782702 22469 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:30.773233 30210 raft_consensus.cc:2804] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:30.773119 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 73673.5us
W20260709 13:10:30.773010 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 76491.7us
I20260709 13:10:30.786706 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:30.783957 30253 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.038s	sys 0.011s
I20260709 13:10:30.788480 29963 raft_consensus.cc:2804] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:30.795456 22469 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:30.796314 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:30.797761 30202 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:30.798344 30366 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:30.798599 30398 raft_consensus.cc:2804] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:30.733628 30220 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:30.792897 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 127897us
W20260709 13:10:30.802780 22652 consensus_meta.cc:287] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.970s	user 0.021s	sys 0.000s
I20260709 13:10:30.807107 22652 raft_consensus.cc:2468] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:30.807741 22652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45762 (request call id 3616) took 1306 ms. Trace:
I20260709 13:10:30.808027 22652 rpcz_store.cc:276] 0709 13:10:29.501449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.646875 (+145426us) service_pool.cc:224] Handling call
0709 13:10:30.807638 (+1160763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:30.810277 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:30.811142 23258 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.801024 29963 raft_consensus.cc:697] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:30.787119 30210 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:30.812619 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59868us
I20260709 13:10:30.799054 30398 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.822990 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:30.824988 29963 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:30.819341 30120 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:10:30.828390 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:30.803035 29957 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:30.809069 30369 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.821400 30210 raft_consensus.cc:3060] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.809096 30399 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 23. Current term is 24.
W20260709 13:10:30.838626 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.830037 30202 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:30.839231 30398 raft_consensus.cc:3060] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:30.836112 23256 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:30.834496 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3619) took 1278 ms. Trace:
I20260709 13:10:30.841477 22651 rpcz_store.cc:276] 0709 13:10:29.505731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.043729 (+537998us) service_pool.cc:224] Handling call
0709 13:10:30.044404 (+   675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.044812 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:30.309575 (+264763us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.707022 (+397447us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.733017 (+ 25995us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.762848 (+ 29831us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:30.763993 (+  1145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.768245 (+  4252us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.783903 (+ 15658us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31892,"prepare.queue_time_us":114946,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":22808,"raft.queue_time_us":17231,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":45941,"spinlock_wait_cycles":13277824,"thread_start_us":548444,"threads_started":2,"wal-append.queue_time_us":452882}
I20260709 13:10:30.843889 30202 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:30.844408 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.843914 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:30.845134 30202 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.849255 30220 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.858981 30362 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.860319 30369 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:30.865608 29957 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:30.866261 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47066.4us
W20260709 13:10:30.857770 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.877862 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.810011 30366 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:10:30.876531 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 63450.3us
W20260709 13:10:30.875792 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53016.9us
I20260709 13:10:30.886509 23259 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
W20260709 13:10:30.887527 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 85260.7us
I20260709 13:10:30.889214 30114 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:30.831892 30144 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:30.890260 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 55189.4us
I20260709 13:10:30.893898 30220 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:30.817993 30387 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:30.917518 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:30.929980 30210 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:30.930449 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:30.938441 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:30.939288 23259 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 26.
I20260709 13:10:30.910032 30114 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:30.925329 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:30.958657 30210 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:30.962841 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 188204us
I20260709 13:10:30.963762 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:30.964392 30072 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:30.955371 30120 raft_consensus.cc:2764] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:10:30.967036 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:30.968210 30215 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:30.970002 30215 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:30.970551 29939 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:30.971004 29939 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.971351 29939 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.971877 23264 raft_consensus.cc:2410] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:30.967049 30253 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:10:30.976279 29650 consensus_queue.cc:1059] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:10:30.976624 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.977603 30310 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:30.978530 30220 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:30.979290 30369 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:30.980516 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:30.964327 23258 raft_consensus.cc:2468] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:30.957041 30366 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:30.989367 23260 raft_consensus.cc:1240] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:10:30.990535 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:30.993551 22619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.938241 29649 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:30.995298 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.994818 22618 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:30.999820 29650 raft_consensus.cc:3055] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:31.007014 29650 raft_consensus.cc:740] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:31.011104 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 102352us
I20260709 13:10:30.991484 30366 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:30.995581 30253 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.023270 23259 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 27.
I20260709 13:10:31.025179 22571 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:10:31.027963 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.031302 30335 raft_consensus.cc:2804] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:31.032086 30335 raft_consensus.cc:697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:31.033365 30335 consensus_queue.cc:237] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:31.034216 22619 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:31.034797 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:31.036702 22619 leader_election.cc:336] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:31.037848 22619 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.021872 30366 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:31.049027 22619 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:31.051182 22543 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:31.051779 22619 leader_election.cc:336] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:31.053140 22619 leader_election.cc:336] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:31.055030 22619 leader_election.cc:336] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:31.055028 23229 leader_election.cc:336] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:31.056612 30400 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:31.056943 30255 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:31.038146 30210 raft_consensus.cc:2804] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:31.055251 29650 consensus_queue.cc:260] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.068634 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.069180 23256 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:31.063432 30368 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 13:10:31.024181 29963 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260709 13:10:31.067363 30210 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:31.077103 30210 raft_consensus.cc:3060] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:31.078521 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:31.079524 30368 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:31.080094 30368 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:31.066675 30114 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.081270 30387 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:31.081200 30368 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.081975 30387 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:31.083149 30387 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.085067 30239 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:31.082751 30368 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:31.089344 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.090469 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:31.091005 30369 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.089418 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:31.091590 30369 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.094219 30369 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.096071 22617 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.097361 30255 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:31.105103 30238 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:31.105976 30337 consensus_queue.cc:1048] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:31.110263 29649 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.111253 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.111907 22580 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:31.114429 30239 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:31.083731 30144 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:31.115376 22618 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.116184 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.039752 30355 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.116710 30144 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.084977 29947 raft_consensus.cc:2804] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:31.129001 22574 raft_consensus.cc:1240] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:31.129845 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 84549.3us
I20260709 13:10:31.135967 23260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:31.137818 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:31.138679 22577 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:31.138904 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:31.065650 30370 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.141741 22578 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:31.145923 29650 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:31.148681 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.139356 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:31.148680 23258 raft_consensus.cc:1240] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:31.149578 23256 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:31.067724 30253 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.138980 29947 raft_consensus.cc:697] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:31.166991 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 151570us
I20260709 13:10:31.161737 23264 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:31.168313 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:31.161238 30255 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.172212 30255 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:31.173655 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.172422 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:31.174722 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:31.182796 22469 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:31.183631 30369 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:10:31.188436 30310 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:10:31.188638 30369 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.188943 30310 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.189141 30369 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:31.189395 30310 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:31.191839 30384 consensus_queue.cc:1059] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:31.192840 30384 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:31.193197 30372 raft_consensus.cc:3055] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:31.193048 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:31.193670 30372 raft_consensus.cc:740] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:31.202746 30372 consensus_queue.cc:260] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.204226 30372 raft_consensus.cc:3060] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.206666 22651 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:10:31.209929 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:31.215255 22471 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.181562 30120 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:10:31.217069 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 301563us
I20260709 13:10:31.194306 30144 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.194814 30239 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.251729 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.223901 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:31.217177 29969 consensus_meta.cc:287] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.004s
I20260709 13:10:31.272095 22651 raft_consensus.cc:2368] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:10:31.272315 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.181087 29957 consensus_queue.cc:1059] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:10:31.290498 30210 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.293038 30192 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.293674 30192 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.296309 30192 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.297178 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:31.253067 30398 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.300464 30398 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:31.288828 22649 raft_consensus.cc:1275] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:31.288489 30144 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.289182 30239 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.300978 22645 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.219507 30120 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:31.302654 30417 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.234s	user 0.004s	sys 0.000s
I20260709 13:10:31.302834 30366 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.332649 30366 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.303663 30210 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.306038 30253 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:31.306183 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 249028us
I20260709 13:10:31.220707 30400 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:31.321844 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:31.313081 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.322688 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.328594 22646 raft_consensus.cc:2468] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:31.338420 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.341898 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:31.337200 22571 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:31.344806 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:31.347535 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75564.5us
I20260709 13:10:31.220786 29649 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.107s
I20260709 13:10:31.350102 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:31.351439 22651 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:31.330096 30120 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:31.368947 29947 consensus_queue.cc:237] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.336982 30400 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.373564 22645 raft_consensus.cc:2468] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 18.
I20260709 13:10:31.373939 30400 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:31.365038 30144 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:31.377097 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:31.374116 30239 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:31.397126 22619 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:31.379154 30398 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:31.373574 30255 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:31.405031 22619 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:31.348585 29939 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.387151 30355 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.390038 30334 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:31.424156 30370 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:31.415660 30239 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:31.380987 30072 consensus_queue.cc:1059] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:10:31.421448 30334 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.429648 30334 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:31.432297 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:31.433022 30079 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:31.433609 30079 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.432533 22543 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.434085 30072 raft_consensus.cc:3055] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:31.408368 29957 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.436818 30072 raft_consensus.cc:740] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:31.437202 22543 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.437296 29957 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.437845 30072 consensus_queue.cc:260] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.438788 22543 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.439313 30072 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.440131 29650 raft_consensus.cc:2804] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:31.436422 30281 consensus_queue.cc:1048] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
W20260709 13:10:31.445401 22619 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:31.445996 22619 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:31.445633 22468 leader_election.cc:400] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:31.446676 30281 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:31.447430 30281 raft_consensus.cc:2804] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:31.447881 30281 raft_consensus.cc:697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:31.450812 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.451632 22645 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:31.448995 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.458437 29650 raft_consensus.cc:697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:31.458747 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:31.456377 30409 log.cc:927] Time spent T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:10:31.460502 22653 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:31.497346 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:31.471753 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:31.498140 23256 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:31.461069 30253 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:31.497522 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:31.509377 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.513880 22645 raft_consensus.cc:2468] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 26.
I20260709 13:10:31.500680 22649 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:31.507963 30199 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.521803 30199 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.522125 22618 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:31.523293 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 74368us
I20260709 13:10:31.529742 29650 consensus_queue.cc:237] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.531525 22650 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:31.526889 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:31.533921 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 173262us
I20260709 13:10:31.498876 30268 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.498170 30238 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:31.498771 30239 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.457641 30398 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:10:31.498024 30379 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:10:31.542726 22618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.465515 30366 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
W20260709 13:10:31.549564 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.546747 22468 leader_election.cc:400] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
I20260709 13:10:31.550022 22468 leader_election.cc:403] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:10:31.550731 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:31.560524 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.561211 22574 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:31.561367 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.569176 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.577631 22649 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:31.578835 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 139246us
W20260709 13:10:31.590652 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 66348.8us
I20260709 13:10:31.595520 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.597956 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:31.594048 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.568501 30369 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.502290 30281 consensus_queue.cc:237] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.547923 30239 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.624850 30202 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:31.649849 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:31.627354 30144 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:31.598310 30120 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.673009 30069 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.673828 30192 raft_consensus.cc:3055] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:31.650933 30253 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:31.698510 23255 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:10:31.703130 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 165184us
I20260709 13:10:31.678155 30192 raft_consensus.cc:740] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:31.675575 29649 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:31.739543 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:31.751541 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 156104us
I20260709 13:10:31.754082 22543 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.764681 22572 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 22. Current term is 23. Ops: []
W20260709 13:10:31.744946 30372 consensus_meta.cc:287] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.003s
W20260709 13:10:31.746812 30427 log.cc:927] Time spent T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:10:31.768070 29650 raft_consensus.cc:2804] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:10:31.678570 30144 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.741559 30398 raft_consensus.cc:2804] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:31.750705 29649 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.743214 30199 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.764186 30354 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.777153 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:31.780750 22645 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
W20260709 13:10:31.781204 30433 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:10:31.781894 30435 log.cc:927] Time spent T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 13:10:31.783046 30431 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:10:31.783298 30144 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:31.784279 30437 log.cc:927] Time spent T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:10:31.784492 30354 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:31.785545 30445 log.cc:927] Time spent T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:10:31.785882 30310 consensus_meta.cc:287] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.004s
I20260709 13:10:31.786309 30310 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.786825 30354 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:31.780169 29649 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:31.789642 23263 raft_consensus.cc:1275] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:31.777355 22648 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:31.746567 30391 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:31.774258 29650 raft_consensus.cc:697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 26 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:31.792235 29650 consensus_queue.cc:237] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.788606 30310 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:31.771872 30379 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:31.795269 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.813661 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 224034us
I20260709 13:10:31.779187 30398 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
W20260709 13:10:31.806803 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 181659us
I20260709 13:10:31.802040 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.797657 30369 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:31.827291 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 107173us
I20260709 13:10:31.797808 30239 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:31.801192 30238 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.830492 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.822389 30398 raft_consensus.cc:3060] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:31.808396 30120 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:31.792855 30400 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.805346 30192 consensus_queue.cc:260] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.851330 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.852069 30192 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.852810 22646 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:31.853214 30400 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:31.857461 22544 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571): Couldn't send request to peer fa2f181263f446a6962b649f9348c15f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80dc0c7d4f9341eeb7472424613de2ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:31.862573 30450 consensus_queue.cc:1059] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:31.863790 30451 raft_consensus.cc:3055] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:31.864276 30451 raft_consensus.cc:740] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:31.865262 30451 consensus_queue.cc:260] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.863984 29649 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.869313 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.871095 29649 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.872699 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:31.872754 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.873448 22574 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:31.877599 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.836990 29963 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:10:31.891206 22574 raft_consensus.cc:2468] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:31.848114 30239 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:31.892712 22617 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.892992 30239 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.893394 30239 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:31.893739 30400 raft_consensus.cc:2804] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:31.894320 30400 raft_consensus.cc:697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:31.895226 30400 consensus_queue.cc:237] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.895545 30334 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.898053 30334 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:31.842519 30453 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:31.899040 30453 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.899420 30453 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:31.847599 30238 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.901364 30456 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:31.902676 30238 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:31.903597 30200 consensus_meta.cc:287] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
W20260709 13:10:31.904764 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 69504.6us
I20260709 13:10:31.909685 22654 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:31.915066 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.907337 30238 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:31.918629 30238 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.924916 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:31.926602 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:31.927474 23263 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:31.932154 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:31.935930 22580 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:31.937513 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:31.937533 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.938547 23262 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:31.938709 30458 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:31.939188 30458 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:31.939560 30458 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:31.932765 30453 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:31.947669 30453 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:31.948722 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:31.950637 22645 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:31.927489 30238 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:31.958248 22645 raft_consensus.cc:2468] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:31.958482 23263 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:31.949491 30458 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.961987 22544 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:31.961054 22543 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:31.965595 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:31.966442 22573 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:31.804205 30379 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:31.916972 22577 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:31.972760 29650 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:31.973675 29650 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 23 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:31.974617 30453 raft_consensus.cc:2804] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:10:31.979883 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 62405.2us
I20260709 13:10:31.987123 30390 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:31.992713 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:32.006096 30079 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:32.005931 30202 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21.
W20260709 13:10:32.016464 30072 consensus_meta.cc:287] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:10:32.019603 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:32.031953 30200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46812 (request call id 1224) took 8278 ms. Trace:
I20260709 13:10:32.033093 30310 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:32.037256 22396 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 19 to 20, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:32.033650 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:32.042349 30310 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:32.045989 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:32.026760 30114 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:32.046494 29650 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.049023 30413 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:32.049531 30413 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.049901 30413 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:32.051160 23257 raft_consensus.cc:1240] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:32.029099 30255 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:32.003087 30390 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:32.062001 30390 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.063544 30390 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:32.078154 22578 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
W20260709 13:10:32.090811 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 44963.6us
I20260709 13:10:32.074280 30253 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:32.052588 30255 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.087677 30202 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:32.032630 30200 rpcz_store.cc:276] 0709 13:10:23.753251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.768775 (+ 15524us) service_pool.cc:224] Handling call
0709 13:10:24.165826 (+397051us) ts_tablet_manager.cc:934] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
0709 13:10:30.667531 (+6501705us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:31.197174 (+529643us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:31.213028 (+ 15854us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:31.904075 (+691047us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:31.965322 (+ 61247us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:32.031756 (+ 66434us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:32.031866 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":80142,"tablet-copy.queue_time_us":191624,"thread_start_us":305856,"threads_started":2}
I20260709 13:10:32.102526 30253 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:32.118217 30200 tablet_copy_client.cc:806] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:32.119554 30200 tablet_copy_client.cc:670] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:32.085047 30337 consensus_queue.cc:1048] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:10:32.130507 30372 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:32.132288 22396 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:32.133169 30202 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:32.132448 30369 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:32.135614 22575 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:32.143352 23257 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:32.145248 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:32.145848 23264 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:32.144505 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:32.088076 30398 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.165983 22468 leader_election.cc:400] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:32.166548 22468 leader_election.cc:403] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:32.109647 30400 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.143371 30451 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:32.184204 23264 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 27.
W20260709 13:10:32.168304 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:32.160356 30072 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:32.135304 22396 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 11 to 16, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 16 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:32.167689 30458 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:32.132310 30372 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:10:32.200110 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.200347 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:32.201663 23263 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 23: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:32.188722 30337 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.191545 30210 raft_consensus.cc:3060] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:32.175187 30362 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:10:32.192553 30072 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.204341 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.216677 22653 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:32.217515 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:32.217828 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:32.218612 22646 raft_consensus.cc:2368] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:32.218806 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.219170 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:32.219471 22645 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 27.
I20260709 13:10:32.219702 22646 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:32.221087 22645 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:10:32.225116 30072 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:32.233270 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:32.206686 22619 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.191109 30239 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:32.226851 22395 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 313) took 22169 ms (client timeout 15000 ms). Trace:
I20260709 13:10:32.219261 30388 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.233201 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.201984 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.246759 22649 raft_consensus.cc:2393] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:32.239971 22648 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 15: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:32.241202 22573 raft_consensus.cc:2468] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
W20260709 13:10:32.246536 22619 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.185792 30400 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.250672 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.252975 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:32.197170 30370 consensus_queue.cc:1059] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:10:32.253700 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.251672 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:32.235873 22396 catalog_manager.cc:5697] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 12 to 19, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 19 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:32.255240 22619 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.217983 30398 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:32.256510 22653 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 26.
I20260709 13:10:32.263870 22652 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:32.265566 22647 raft_consensus.cc:1240] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 25. Current term is 26. Ops: [24.14-25.15]
I20260709 13:10:32.288375 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:32.289316 22649 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:32.290268 29939 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:32.301048 22396 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 14 to 19, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 19 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.302380 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:32.303918 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:32.305651 22650 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:32.306428 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:32.306999 22647 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:32.307117 30210 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:32.307931 30210 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.309361 30452 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:10:32.310068 30452 consensus_queue.cc:1243] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 18.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:10:32.312044 29957 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:32.312544 29957 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:32.312667 30453 raft_consensus.cc:697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:32.313105 29957 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.313671 30453 consensus_queue.cc:237] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.315359 29957 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:32.316834 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.317754 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:32.318591 22545 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.321998 22469 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:32.322520 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:32.322969 30202 raft_consensus.cc:3055] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:10:32.327663 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:32.330389 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:32.256086 30474 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:32.331386 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:32.312551 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.336535 22652 raft_consensus.cc:1275] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:10:32.237514 30337 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.337044 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:32.323356 30202 raft_consensus.cc:740] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:32.347014 29650 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.254541 30388 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.345316 22617 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:32.352651 22649 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 28.
I20260709 13:10:32.353420 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.295992 30370 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.351123 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.365101 22654 raft_consensus.cc:2393] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:32.364769 22653 raft_consensus.cc:1275] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:32.333254 29939 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:32.364876 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.308459 30210 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.364701 29957 consensus_queue.cc:1048] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:10:32.383081 30202 consensus_queue.cc:260] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.388207 30429 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:32.342327 30398 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:10:32.364833 29650 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:32.402762 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83333.5us
I20260709 13:10:32.396404 22579 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:32.397630 22649 raft_consensus.cc:1240] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:10:32.356233 30387 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:32.359510 30362 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.389850 30458 raft_consensus.cc:2804] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:32.423514 30400 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:32.420603 30369 raft_consensus.cc:3055] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:10:32.428117 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:32.434508 30387 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:32.442592 23230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.442446 22545 leader_election.cc:336] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:32.461831 22545 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.462251 22545 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:32.435622 29969 consensus_queue.cc:1048] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:10:32.443356 30473 log.cc:927] Time spent T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:32.444238 30483 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.463305 30483 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.465523 30483 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:32.453950 22653 raft_consensus.cc:1275] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:10:32.471057 22545 leader_election.cc:336] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.390808 30370 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
W20260709 13:10:32.452097 30459 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:10:32.455749 30310 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:32.445223 30429 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:32.490989 23229 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 196 similar messages]
I20260709 13:10:32.503322 22545 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:32.456599 30202 raft_consensus.cc:3060] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:32.451709 30369 raft_consensus.cc:740] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:32.453047 30458 raft_consensus.cc:697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:32.469487 30387 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:32.483816 22652 raft_consensus.cc:2955] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:10:32.484895 30453 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:32.467834 30255 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:32.532248 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61215.8us
I20260709 13:10:32.445652 30362 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.530669 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:32.530956 23259 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
W20260709 13:10:32.536635 22545 leader_election.cc:336] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.571834 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:32.541167 30120 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:32.576880 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.540683 30390 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:32.366695 22396 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 18 to 20, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 20 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.523687 30413 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.602267 22468 leader_election.cc:400] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 17. Current term is 18.
I20260709 13:10:32.626744 22647 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 27.
W20260709 13:10:32.632097 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:32.580938 30310 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:32.633679 30483 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.636505 30483 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.639092 30483 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:32.642853 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96939.6us
W20260709 13:10:32.644102 22545 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.641068 30478 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:10:32.693343 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:32.704062 30465 log.cc:927] Time spent T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:10:32.693907 30484 raft_consensus.cc:493] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.710176 30484 raft_consensus.cc:515] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.649510 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:32.660706 22545 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:32.625690 30281 raft_consensus.cc:3055] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:32.649788 22648 raft_consensus.cc:1240] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:10:32.588356 30398 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:32.717068 22652 raft_consensus.cc:1275] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:10:32.641052 30477 log.cc:927] Time spent T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
W20260709 13:10:32.715603 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54316.4us
W20260709 13:10:32.721837 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 72370.1us
I20260709 13:10:32.632160 30450 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.731899 30478 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:32.733361 30476 log.cc:927] Time spent T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:10:32.694125 22396 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.735821 30362 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:32.706261 30337 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:32.590407 30390 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.738451 30114 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:32.738754 30390 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:32.659410 30487 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:10:32.739367 30199 consensus_queue.cc:1048] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:32.739869 30253 consensus_meta.cc:287] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.002s
W20260709 13:10:32.678584 30482 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:10:32.701692 30479 log.cc:927] Time spent T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:10:32.731125 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87034.6us
I20260709 13:10:32.646293 30429 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.729441 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.696733 30388 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:32.748347 22545 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.748960 22647 raft_consensus.cc:2410] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:10:32.751323 22651 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 27. Current term is 28. Ops: []
I20260709 13:10:32.755909 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.660178 30210 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:32.717996 30281 raft_consensus.cc:740] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
W20260709 13:10:32.761978 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.763437 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.597689 30369 consensus_queue.cc:260] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.641276 30372 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.105s
I20260709 13:10:32.763381 30255 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.650931 30310 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.742569 30454 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:32.724439 29969 consensus_queue.cc:1048] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:32.754810 22396 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 11 to 15, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 15 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.625919 30458 consensus_queue.cc:237] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.774413 30413 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:32.788691 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 66890.2us
I20260709 13:10:32.740581 29957 consensus_queue.cc:1059] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:10:32.802078 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:32.804620 22619 leader_election.cc:336] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.805658 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:32.807111 29650 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:32.807530 22619 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.808025 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:32.786859 30483 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:10:32.808969 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:32.809633 30400 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:32.810708 30398 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.812808 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:32.793092 30255 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.808795 30413 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:32.814844 22647 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:32.746832 30253 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.742419 30450 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.792325 30487 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:32.825085 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 96491.2us
W20260709 13:10:32.815924 22619 leader_election.cc:336] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.829972 22653 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 24. Current term is 25. Ops: []
I20260709 13:10:32.708387 29963 raft_consensus.cc:2955] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:10:32.802735 30120 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:32.834434 22619 leader_election.cc:336] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.842459 22468 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:32.813962 29957 consensus_queue.cc:1243] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 18.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:10:32.843472 22619 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.844203 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.846864 22652 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
I20260709 13:10:32.851349 22572 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:32.852627 22575 raft_consensus.cc:1217] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Deduplicated request from leader. Original: 17.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:10:32.853150 22575 raft_consensus.cc:1240] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:10:32.851509 22579 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:32.854532 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.795275 30454 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.854364 22578 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: []
W20260709 13:10:32.856874 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.848649 22619 leader_election.cc:336] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.860056 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.822458 30491 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:10:32.865067 22619 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:32.869761 30454 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:32.873452 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:32.887090 22572 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:32.852768 30494 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:10:32.856146 30478 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:32.895102 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.846984 30202 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:10:32.845618 30120 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.901672 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.886528 30451 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:32.855093 30487 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.915990 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.916600 22647 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:32.919128 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.905843 30144 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:32.924124 22544 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:10:32.930184 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.917286 30255 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:32.949811 22574 raft_consensus.cc:1275] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:32.953073 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.956014 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:32.957290 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:32.957984 22576 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:32.958925 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:32.959599 22576 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:32.960377 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:32.960389 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:32.960896 30484 leader_election.cc:290] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:32.961591 30484 consensus_queue.cc:1059] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:32.962494 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:32.963999 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:32.942901 30496 log.cc:927] Time spent T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:10:32.962502 30484 raft_consensus.cc:3060] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:32.980660 22617 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:10:32.981432 22545 leader_election.cc:336] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.936385 30370 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:32.986140 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:32.995718 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:32.942772 30456 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:32.952066 30400 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:32.925374 30144 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:32.991391 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
W20260709 13:10:32.985965 23229 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:32.999334 30488 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:33.013514 22580 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:33.014571 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.015347 22647 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 21: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:33.004158 30387 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:32.989198 22545 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.012333 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.024075 22576 raft_consensus.cc:2393] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 18: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:33.025496 29650 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:33.026585 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45178.7us
W20260709 13:10:33.028226 23229 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:33.028453 22545 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:33.028975 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53440.6us
I20260709 13:10:33.029066 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:32.991850 30478 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:32.996042 29939 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:33.005632 30210 raft_consensus.cc:3055] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:33.009720 30200 tablet_copy_client.cc:538] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:33.042182 22545 leader_election.cc:336] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.042508 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.044601 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.047724 22578 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 22.
W20260709 13:10:33.048022 22545 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.048475 22545 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.009745 30456 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:33.044417 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.050570 22571 raft_consensus.cc:2393] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:33.051486 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:33.052201 22545 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.054289 22545 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:33.050927 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.013142 30370 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:33.028720 30494 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 28 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:33.060016 22649 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: []
W20260709 13:10:33.057493 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:33.061836 22545 leader_election.cc:336] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:33.056815 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 66414us
I20260709 13:10:33.069157 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.055968 30456 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:33.072891 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.013231 30400 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.046984 30210 raft_consensus.cc:740] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:33.118377 30498 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:10:33.118491 30210 consensus_queue.cc:260] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.120012 30210 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:33.119640 30281 consensus_queue.cc:260] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.120718 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.121372 22646 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:33.055501 29939 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:33.057663 30450 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.073045 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.065440 29969 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:33.124843 30400 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:33.056948 30495 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:10:33.057082 30079 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:33.115893 29650 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.114418 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.113269 30503 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.125624 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 59225.1us
I20260709 13:10:33.069720 30488 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:10:33.112267 30487 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.156560 29650 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:32.244637 22395 rpcz_store.cc:269] 0709 13:10:10.057330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.112972 (+ 55642us) service_pool.cc:224] Handling call
0709 13:10:12.646573 (+2533601us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:10:32.226604 (+19580031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:23.609091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:23.609827 (+   736us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:23.609884 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:10:23.609907 (+    23us) tablet.cc:662] Decoding operations
0709 13:10:23.611764 (+  1857us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:23.611869 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:23.611894 (+    25us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:10:23.890646 (+278752us) tablet.cc:701] Row locks acquired
0709 13:10:23.901662 (+ 11016us) write_op.cc:260] PREPARE: finished
0709 13:10:23.901830 (+   168us) write_op.cc:270] Start()
0709 13:10:23.902001 (+   171us) write_op.cc:276] Timestamp: P: 1783602623901766 usec, L: 0
0709 13:10:23.902047 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:10:23.902982 (+   935us) log.cc:844] Serialized 9084 byte log entry
0709 13:10:24.578522 (+675540us) op_driver.cc:464] REPLICATION: finished
0709 13:10:25.014329 (+435807us) write_op.cc:301] APPLY: starting
0709 13:10:25.026279 (+ 11950us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:25.524000 (+497721us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b180041a760. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2603a0ec 00007fec26086c0a 00007fec260864f7 00007fec26086490 00007fec2603df48 00007fec29d521bb 00007fec29d52532 00007fec29d99b93 00007fec29c46de3
0709 13:10:25.967960 (+443960us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:25.989838 (+ 21878us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:27.874920 (+1885082us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:27.875590 (+   670us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:10:27.875638 (+    48us) write_op.cc:312] APPLY: finished
0709 13:10:27.876159 (+   521us) log.cc:844] Serialized 204 byte log entry
0709 13:10:28.237115 (+360956us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.253793 (+ 16678us) write_op.cc:454] Released schema lock
0709 13:10:28.280758 (+ 26965us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:28.345974 (+ 65216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.346013 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":84950,"reported_tablets":49,"spinlock_wait_cycles":179491584,"child_traces":[["op",{"apply.queue_time_us":376975,"apply.run_cpu_time_us":64068,"apply.run_wall_time_us":3308719,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100359,"num_ops":23,"prepare.queue_time_us":250652,"prepare.run_cpu_time_us":16465,"prepare.run_wall_time_us":531936,"raft.queue_time_us":376904,"raft.run_cpu_time_us":19380,"raft.run_wall_time_us":338305,"replication_time_us":676278,"spinlock_wait_cycles":14098176,"thread_start_us":1128020,"threads_started":5,"wal-append.queue_time_us":644567,"wal-append.run_cpu_time_us":27618,"wal-append.run_wall_time_us":2278398}]]}
I20260709 13:10:33.166116 29650 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.166970 29939 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.169592 22650 raft_consensus.cc:1240] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:10:33.170032 22576 raft_consensus.cc:1240] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:10:33.170802 30144 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.135459 30281 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:33.160435 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.158931 30508 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:10:33.184500 30501 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:10:33.163599 30120 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.135867 30494 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.184549 30488 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:33.185473 30503 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:33.201627 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:33.190383 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.201341 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.202526 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.211200 23263 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:33.211373 22645 raft_consensus.cc:2410] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:10:33.202828 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.214190 23259 raft_consensus.cc:2410] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:10:33.206621 30503 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:33.195425 30493 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.345s	user 0.002s	sys 0.000s
I20260709 13:10:33.215899 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.215992 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:33.194361 30387 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:33.218750 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.206728 30072 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.213655 30253 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.220680 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.222366 30503 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:33.222944 30072 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.219877 23263 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 17.
I20260709 13:10:33.231611 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.217919 30495 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:33.209856 29957 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:33.233723 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.234663 23263 raft_consensus.cc:2410] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:33.234874 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.236501 22543 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:33.238600 29650 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:33.238981 29650 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.238904 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.239696 29650 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:33.243049 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.255179 23263 raft_consensus.cc:2393] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 18: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:33.256338 30503 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:33.231988 30199 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:33.259166 29650 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.259572 30199 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.261160 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:33.237241 30370 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:33.231832 30362 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:33.265688 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.266400 29650 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.249779 30484 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:33.248052 30487 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:33.271406 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.255571 30508 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.269501 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:33.281867 23263 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:10:33.297205 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.303704 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.322451 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.322834 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.279129 30387 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:33.328135 23263 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:33.329355 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.299789 30362 raft_consensus.cc:3060] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:33.331089 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.279651 30495 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:33.336746 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 76309.1us
I20260709 13:10:33.339197 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.330085 30484 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:33.333226 30387 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.347986 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:33.352514 22654 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:33.320462 30487 consensus_queue.cc:1059] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:10:33.334956 29963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37406 (request call id 1) took 11529 ms. Trace:
I20260709 13:10:33.338543 30508 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:33.356957 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.363955 30200 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Bootstrap starting.
I20260709 13:10:33.387764 22654 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:33.365799 30072 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:33.366767 30512 log.cc:927] Time spent T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:10:33.354769 30499 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:33.368716 30523 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:33.369293 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.365907 30506 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.370182 23264 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:10:33.370633 30495 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:33.373735 30199 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:33.375782 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.354346 30370 consensus_queue.cc:1059] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:10:33.354560 30478 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:10:33.342751 30488 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:33.354015 30239 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:33.356930 29963 rpcz_store.cc:276] 0709 13:10:21.785217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.861263 (+ 76046us) service_pool.cc:224] Handling call
0709 13:10:22.155935 (+294672us) log.cc:844] Serialized 513 byte log entry
0709 13:10:22.625894 (+469959us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b18004db660. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:22.809891 (+183997us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b54003050a0. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec2627bb26 00007fec2627549a 00007fec26274714 00007fec26254eaa 00007fec2625bd53 00007fec2625bcd9 00007fec2625bc69 00007fec2625bc31 00007fec2625adfd 000000000038f354
0709 13:10:23.217465 (+407574us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b18004db660. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec2c0d6de1 00007fec2c0e35b1 00007fec2320e3f3 00007fec232107c1 00007fec23210779 00007fec23210709 00007fec232106d1 00007fec2320f9cd 000000000038f354 000000000038f199 00007fec231f183a
0709 13:10:33.289890 (+10072425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15159,"raft.queue_time_us":19715,"raft.run_cpu_time_us":5490,"raft.run_wall_time_us":492296,"spinlock_wait_cycles":38808448,"thread_start_us":272366,"threads_started":1,"wal-append.queue_time_us":318540,"wal-append.run_cpu_time_us":1909,"wal-append.run_wall_time_us":1013841}
I20260709 13:10:33.354558 30387 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:33.360292 30487 consensus_queue.cc:1243] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:10:33.375332 30456 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.401703 30506 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.427556 30478 consensus_queue.cc:1243] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:10:33.468827 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.440774 30487 raft_consensus.cc:3055] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:33.421384 30523 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.478158 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:33.479444 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:33.469861 30488 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.423326 30495 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.483021 30528 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:33.486450 30508 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:33.490309 30478 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:33.485770 30523 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.493880 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.495987 30506 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:33.496798 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:33.505429 30505 log.cc:927] Time spent T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.328s	user 0.003s	sys 0.000s
I20260709 13:10:33.475504 30487 raft_consensus.cc:740] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:33.525300 30487 consensus_queue.cc:260] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.526561 30487 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:33.480978 30369 raft_consensus.cc:3060] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:33.517947 30456 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.520509 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:33.521505 30495 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.509045 30488 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.522667 30387 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.541954 22580 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:10:33.556844 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:33.566908 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.561471 30536 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.572491 22545 leader_election.cc:336] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.592456 22545 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:33.597174 22544 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.600265 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:33.604188 22544 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:33.605471 30429 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.604368 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:33.610193 21390 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 22530)
I20260709 13:10:33.608959 30518 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:33.612910 30387 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.616210 23262 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
W20260709 13:10:33.615902 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:33.619746 22544 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:33.622841 22577 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:10:33.623289 30488 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:33.624280 29957 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:33.625063 29957 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 23 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:33.610230 29963 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:33.626135 30489 raft_consensus.cc:2764] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:10:33.626610 30518 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:33.617599 30503 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:33.627643 30503 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.630075 30503 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.632625 30509 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.633248 30509 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.638334 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:33.644788 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:33.643112 22619 leader_election.cc:336] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.647083 22619 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.649216 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:33.650288 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:33.654608 22580 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 21: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:33.652942 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.655390 22574 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
W20260709 13:10:33.655628 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 284862us
I20260709 13:10:33.662950 22652 raft_consensus.cc:1240] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:10:33.641009 30456 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:33.666651 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.667451 30509 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:33.668120 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 68005.6us
I20260709 13:10:33.646668 30337 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.598858 30536 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:33.669783 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.669871 22619 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.671983 30144 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.626163 29957 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.681023 30379 raft_consensus.cc:3055] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:10:33.656515 30362 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:33.676833 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:33.655404 30413 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.684831 30413 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.680395 30144 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.675276 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:33.687114 23256 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:10:33.681341 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:33.682279 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.688314 22580 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 18.
I20260709 13:10:33.688410 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.618402 30429 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.670822 30399 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:33.681746 30337 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.697935 30337 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:33.699304 30483 raft_consensus.cc:3055] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:33.699780 30483 raft_consensus.cc:740] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
W20260709 13:10:33.689023 22619 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.692586 30413 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.693753 30144 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:33.703562 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.706375 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.707284 23262 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 20.
I20260709 13:10:33.676120 30456 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:33.709101 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
W20260709 13:10:33.702873 22619 leader_election.cc:336] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.715417 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:33.718505 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:33.681507 30379 raft_consensus.cc:740] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:33.687923 30488 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.731842 30489 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:33.737062 30489 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.737461 30489 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.746491 23256 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:33.750088 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.750852 22571 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:33.727741 30448 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:33.755954 22653 raft_consensus.cc:1240] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:10:33.756793 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.756421 22652 raft_consensus.cc:1240] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:10:33.761204 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.761305 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.748364 30538 raft_consensus.cc:2764] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:10:33.763834 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.765326 22652 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:10:33.761973 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.767038 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.700765 30483 consensus_queue.cc:260] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.769604 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.770262 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7452859c008745c19509f4d5d908e8f1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:33.770645 22577 raft_consensus.cc:1275] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:10:33.773056 22571 raft_consensus.cc:3060] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:33.777037 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.747676 30488 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.782543 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7264d3053b44989c5504d296ea482b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:33.792941 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.773988 30495 consensus_queue.cc:1059] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:10:33.802690 22580 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:33.785807 30370 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:10:33.766088 30448 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.818775 22469 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:33.773984 30533 log.cc:927] Time spent T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:10:33.816375 22619 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.833814 22469 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:33.837059 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.838449 22469 leader_election.cc:304] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.839318 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.840041 22469 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.838482 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:33.849419 22619 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.851452 22619 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.813441 30488 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:33.832167 30495 consensus_queue.cc:1243] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:10:33.867425 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.861778 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:33.853102 22619 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.827090 30448 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:33.825019 30362 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.855717 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.871634 22577 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:33.840631 30369 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:33.855926 30478 raft_consensus.cc:2749] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:33.856267 29939 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.774922 30379 consensus_queue.cc:260] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.811766 30456 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:33.836824 30114 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260709 13:10:33.857218 30210 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.907564 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.840240 30484 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
W20260709 13:10:33.885242 30540 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:10:33.916843 22469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 76902.5us
I20260709 13:10:33.874116 30499 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.933017 22469 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.871996 30524 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
W20260709 13:10:33.940250 22619 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:33.933029 22572 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:33.916965 30310 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:33.945341 22619 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:33.946049 22619 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:33.946693 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.949258 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:33.931010 30494 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:33.956482 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.946082 30506 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.921306 30491 consensus_queue.cc:1059] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:10:33.957567 30429 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:33.879148 30362 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:33.964349 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.974081 22647 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:33.974104 22651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45762 (request call id 3668) took 1117 ms. Trace:
I20260709 13:10:33.964511 22577 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:10:33.965240 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:33.949909 22580 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 18.
I20260709 13:10:33.974813 22651 rpcz_store.cc:276] 0709 13:10:32.852884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.853025 (+   141us) service_pool.cc:224] Handling call
0709 13:10:32.859634 (+  6609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.122900 (+263266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.122930 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.122972 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:33.123007 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.970063 (+847056us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400237b54. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262fbe01 00007fec262fa83e 00007fec2b2bf419 00007fec24836bd4 00007fec24836b62 00007fec24836a91 00007fec24836a0c 00007fec24835cc2 00007fec2463648c 00007fec246358c6
0709 13:10:33.970109 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.970228 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604976512}
I20260709 13:10:33.971055 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:33.977216 22650 raft_consensus.cc:2410] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for term 24 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260709 13:10:33.969772 22571 raft_consensus.cc:2468] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
I20260709 13:10:33.980877 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:33.982702 30253 consensus_queue.cc:1048] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:33.983433 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41936 (request call id 2937) took 1026 ms. Trace:
I20260709 13:10:33.983811 22575 rpcz_store.cc:276] 0709 13:10:32.956596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.975339 (+ 18743us) service_pool.cc:224] Handling call
0709 13:10:33.517189 (+541850us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b58000fa298. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec231d6b71 00007fec231d6a22 00007fec2c0efc09 00007fec2b249ee0 00007fec2b3130ab 00007fec2b313131 00007fec2b2d4fc0 00007fec2b2bf929 00007fec2b2bf3d2 00007fec24836bd4
0709 13:10:33.517407 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.540216 (+ 22809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.540265 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.540939 (+   674us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.607773 (+ 66834us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:33.607820 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.607884 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.983135 (+375251us) raft_consensus.cc:1685] finished
0709 13:10:33.983156 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.983375 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22329,"raft.queue_time_us":23398,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":14694,"spinlock_wait_cycles":10921216,"thread_start_us":32127,"threads_started":1,"wal-append.queue_time_us":103212}
I20260709 13:10:33.948535 30536 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:33.980278 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:33.987476 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:33.974474 29957 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.997898 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.001102 30202 raft_consensus.cc:3055] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:33.991200 30450 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:34.008505 30450 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:34.009016 30450 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:34.026724 30362 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:33.985999 29939 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:34.033250 29939 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.033715 29939 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:34.007754 30202 raft_consensus.cc:740] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:34.036665 30202 consensus_queue.cc:260] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.037213 29957 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.038475 30202 raft_consensus.cc:3060] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:33.946970 30524 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:34.046998 30487 consensus_meta.cc:287] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.005s
I20260709 13:10:34.051244 30458 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:10:34.052335 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 54840us
I20260709 13:10:33.946821 30499 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.053160 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.053969 30458 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:34.054927 30499 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.056202 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.056541 30114 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.057303 30114 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.060034 30114 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:33.991880 30388 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:34.061365 30388 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.061800 30388 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:34.062640 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.044727 30524 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.071504 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.081715 23264 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
W20260709 13:10:34.081964 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 93114.6us
I20260709 13:10:34.078135 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.085237 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:34.040652 29957 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.083587 30458 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:34.023981 30489 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.082020 22617 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:33.995079 30253 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:34.070984 30369 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.098304 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.103890 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.105890 23259 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:34.090535 30523 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:34.106313 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
W20260709 13:10:34.113575 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.090822 30362 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:34.125173 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:34.135788 29939 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.105661 30387 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:34.137619 30387 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:34.125937 22648 raft_consensus.cc:1275] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:34.125174 22647 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 13:10:34.127538 30490 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.087167 30454 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:10:34.128949 30518 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:10:34.141508 22468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.144848 22647 pending_rounds.cc:85] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 17
I20260709 13:10:34.108973 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d7ae701b84ad59f37ee479b4bd84f" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.068823 30448 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:34.159484 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 53280.4us
I20260709 13:10:34.160706 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.161468 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:34.144922 22470 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.162403 30487 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.166765 30487 consensus_queue.cc:1059] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:34.170938 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:34.097114 30458 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:34.159590 22647 pending_rounds.cc:107] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 22.18
W20260709 13:10:34.187098 22545 leader_election.cc:336] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:34.187692 22647 raft_consensus.cc:2889] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.120880 30413 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:34.105762 30144 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.191766 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:34.194379 22646 raft_consensus.cc:2368] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21.
I20260709 13:10:34.122732 30523 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.197418 30450 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.202539 30483 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:34.210166 30489 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.211619 30239 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:34.159066 30490 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.214567 30448 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.179401 30253 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:34.176342 30518 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:34.232919 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.251358 23259 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:10:34.180233 30458 raft_consensus.cc:493] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:34.251705 30490 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.251977 30458 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:34.222759 30144 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.254731 30144 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.255456 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.107016 30369 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.255450 30144 consensus_queue.cc:1048] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:10:34.258718 30369 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.243350 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.193481 30451 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:34.195503 30210 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:34.223008 30523 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:34.250620 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f42f0567ae14f62b39e69ed29a409cf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.261211 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.263480 30253 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.263995 30253 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:34.173640 30362 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.277603 22653 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:10:34.233705 30370 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:34.275689 22618 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:34.285475 22543 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.293377 22543 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.292611 29963 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.295089 30515 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:34.289441 30499 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:34.333410 30499 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.334233 30362 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.335697 30499 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.251583 30518 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.291509 30448 raft_consensus.cc:2804] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:34.336431 30458 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.298260 29939 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:34.299346 30520 consensus_queue.cc:1048] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:10:34.329813 30450 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:34.300599 30484 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.337683 23264 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:10:34.338287 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.340293 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:34.355538 23257 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:34.343127 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:34.347561 23228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.299520 22543 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:34.357398 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57937.8us
W20260709 13:10:34.368996 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 178569us
I20260709 13:10:34.337044 30448 raft_consensus.cc:697] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:34.365976 29650 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:10:34.378320 29650 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:34.317265 30515 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260709 13:10:34.365453 30114 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:34.345167 30388 raft_consensus.cc:515] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.410737 30253 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.412935 30388 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:34.421270 23229 leader_election.cc:336] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:34.365250 30484 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.429446 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.430985 23257 raft_consensus.cc:2468] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
W20260709 13:10:34.430867 23229 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:34.387671 30523 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.452081 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:34.465649 30253 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.459301 30489 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:34.480762 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:34.480751 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.481554 22651 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.490548 30484 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.493572 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:34.494333 22653 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:34.457577 30448 consensus_queue.cc:237] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.503512 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:34.516556 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 154641us
I20260709 13:10:34.504922 30391 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:10:34.503765 30458 leader_election.cc:290] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.501561 30484 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 13:10:34.523066 22651 raft_consensus.cc:2468] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:34.525056 23227 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.526109 29957 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.530454 30561 raft_consensus.cc:2804] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:34.538018 30523 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:34.536108 30562 log.cc:927] Time spent T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 13:10:34.545522 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:34.546160 23257 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:34.546411 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:34.547067 22574 raft_consensus.cc:3060] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:34.552377 23257 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:34.539011 30561 raft_consensus.cc:697] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:34.553779 22544 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:34.536203 29957 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.570153 22574 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:34.565073 30523 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:34.573761 23227 leader_election.cc:304] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:34.575631 30490 raft_consensus.cc:2804] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:34.575750 30379 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:34.576236 30490 raft_consensus.cc:697] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:34.577847 30387 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:34.581812 22653 raft_consensus.cc:2468] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
I20260709 13:10:34.577661 30490 consensus_queue.cc:237] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.566787 30561 consensus_queue.cc:237] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:34.591135 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 139625us
I20260709 13:10:34.592453 30398 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.598021 22653 raft_consensus.cc:1240] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 25. Current term is 26. Ops: []
I20260709 13:10:34.601963 23262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:34.610772 21390 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 22530)
W20260709 13:10:34.623502 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 375203us
I20260709 13:10:34.637701 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.583421 30523 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:34.586175 29957 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.620139 30362 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.669307 30523 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.652202 30528 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.646133 30491 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:34.671034 30528 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.671299 30491 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.673498 30491 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.674774 30528 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.663790 30520 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:34.675856 30520 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.679147 30200 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:34.679688 30520 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.605062 30391 consensus_queue.cc:1059] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.049s
I20260709 13:10:34.680878 30391 raft_consensus.cc:3055] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:10:34.681340 30391 raft_consensus.cc:740] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:34.681758 30200 tablet_bootstrap.cc:492] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Bootstrap complete.
I20260709 13:10:34.682644 30200 ts_tablet_manager.cc:1403] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Time spent bootstrapping tablet: real 1.319s	user 0.049s	sys 0.017s
I20260709 13:10:34.641418 30483 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:34.669782 30362 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.686058 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.593021 30398 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.691663 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.696310 23262 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:34.696923 22574 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:34.698627 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:34.703732 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.682421 30391 consensus_queue.cc:260] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.708011 30391 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:34.709743 30454 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:34.709511 30491 consensus_queue.cc:1175] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "691cccbd0258483ebe19e1581674cc94" responder_term: 25 status { last_received { term: 25 index: 18 } last_committed_idx: 17 last_received_current_leader { term: 25 index: 18 } }
I20260709 13:10:34.710454 30454 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:34.711105 30454 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:34.716138 30567 log.cc:927] Time spent T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:10:34.645545 30560 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:10:34.719110 30528 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.735610 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.736428 22574 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24.
I20260709 13:10:34.737972 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.738731 30398 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.746526 30362 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:34.746826 30528 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.750198 30528 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:34.751160 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 321825us
I20260709 13:10:34.751674 30451 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:34.751991 23259 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 17. (term mismatch)
I20260709 13:10:34.752121 30451 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.752650 23259 pending_rounds.cc:85] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 16
I20260709 13:10:34.752803 30451 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:34.739746 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.756057 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.758203 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.759008 22650 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:34.760246 30572 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:34.760934 30572 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.763105 30572 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.765362 30362 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.751943 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.766062 30362 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:34.755914 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 161057us
I20260709 13:10:34.753000 23259 pending_rounds.cc:107] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 27.17
I20260709 13:10:34.771602 23259 raft_consensus.cc:2889] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.772970 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:34.773900 22577 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:34.768002 30559 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:34.776280 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e294969b50aa438bb288b913f169f06e" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:34.777010 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:34.777169 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.717689 30566 consensus_queue.cc:1059] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:10:34.769915 22618 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:34.781714 22575 raft_consensus.cc:2410] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:10:34.786121 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.789969 22543 leader_election.cc:400] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Vote denied by peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857) with higher term. Message: Invalid argument: T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21.
I20260709 13:10:34.791282 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.795197 22654 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:34.796106 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.798807 23262 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 23. Current term is 24. Ops: [20.15-23.17]
I20260709 13:10:34.800479 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:34.796555 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.803332 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:34.807510 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.807730 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549907a9ef52413ab776c58c50b74e5d" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:34.808728 22578 raft_consensus.cc:2368] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
I20260709 13:10:34.811581 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.831604 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.831773 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.831864 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:34.831619 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.832994 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:34.833170 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.833485 22571 raft_consensus.cc:1240] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Rejecting Update request from peer 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:10:34.834442 22645 raft_consensus.cc:1240] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Rejecting Update request from peer 6ca917eaada84bf38a5daae9f8ffa066 for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:34.834489 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:34.835778 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.838183 22575 raft_consensus.cc:2410] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:10:34.806684 30239 raft_consensus.cc:2804] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:34.841626 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.818099 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.845497 22654 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:34.816561 22652 raft_consensus.cc:2393] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 16: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:34.817186 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:34.850572 22647 raft_consensus.cc:2393] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:34.850597 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:34.851186 22617 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.780179 30559 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.794073 30518 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:34.846477 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813ede727198414390a20d5845e75e07" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:34.849112 22545 leader_election.cc:336] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:34.857281 22545 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:34.794469 30528 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:34.848716 22580 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:34.834794 30253 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:34.864893 30370 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:34.849696 30499 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.855574 30559 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:34.872332 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88186.5us
I20260709 13:10:34.853045 30239 raft_consensus.cc:697] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:34.878831 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.863699 30528 raft_consensus.cc:493] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.895516 22543 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.903894 29957 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:34.904412 29957 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.856488 30483 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
W20260709 13:10:34.905381 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 54861.1us
I20260709 13:10:34.872280 30429 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:34.907333 29957 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:34.898362 30144 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:10:34.897471 29939 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:34.913977 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:34.868747 30253 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.898075 30528 raft_consensus.cc:3060] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:34.931834 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.907124 30523 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:34.884675 30499 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:34.932471 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 31de2edeb38841bfa9edd362c910f0f7: Illegal state: Replica 5e72fb99f5ee4943a91cf8e6dd73e80e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:34.940387 22619 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:34.943863 22619 leader_election.cc:336] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:34.953347 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:34.957002 30582 consensus_queue.cc:1059] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:34.957962 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:34.958199 30484 raft_consensus.cc:3060] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.965462 30362 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:34.966811 30253 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:34.971048 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110758us
I20260709 13:10:34.972144 23257 raft_consensus.cc:2410] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 13:10:34.974509 22577 raft_consensus.cc:2468] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:34.975838 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:34.978641 29650 raft_consensus.cc:3055] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:34.979331 29650 raft_consensus.cc:740] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:34.937696 30495 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:10:34.996093 30451 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:34.998631 30582 raft_consensus.cc:3055] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:34.999260 30582 raft_consensus.cc:740] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:34.935956 30398 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:34.950508 30239 consensus_queue.cc:237] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.936081 30564 raft_consensus.cc:3055] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:35.006577 22577 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:34.980294 29650 consensus_queue.cc:260] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:34.920935 30429 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.015519 29650 raft_consensus.cc:3060] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:35.022899 22648 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:35.023372 22468 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:35.025066 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:35.026046 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:35.025777 22619 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:35.028471 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.014683 30564 raft_consensus.cc:740] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:35.016640 30114 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:35.022080 30369 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.043145 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 165355us
I20260709 13:10:35.029296 30210 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:35.000388 30582 consensus_queue.cc:260] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.047174 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:35.054157 22617 leader_election.cc:400] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
I20260709 13:10:35.054644 22617 leader_election.cc:403] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.035384 30362 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:35.049311 30369 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.063931 30253 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:35.026698 30379 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:10:35.074213 30369 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.068410 30413 raft_consensus.cc:2749] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e for earlier term 18. Current term is 19.
I20260709 13:10:35.076752 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:35.078614 30451 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:35.068629 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet acc46eb991824d25bde40d1001e04798: Illegal state: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:35.049760 30454 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.066566 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:35.089725 30210 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.091486 30210 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.070184 30362 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.101394 30588 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:10:35.105322 30586 log.cc:927] Time spent T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:10:35.108240 30429 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.087707 30369 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.110702 30499 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.110354 30369 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.111316 30454 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.045511 30200 raft_consensus.cc:359] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:35.112618 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.113222 22617 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:35.115880 22648 raft_consensus.cc:1275] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:35.084700 30484 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:35.123594 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:35.124120 30429 consensus_queue.cc:1048] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:35.124796 22648 raft_consensus.cc:2393] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:35.126426 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.127691 30563 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:10:35.131771 22617 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:35.112310 30362 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:35.097188 30564 consensus_queue.cc:260] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.139436 30587 consensus_queue.cc:1059] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:35.140507 30587 consensus_queue.cc:1243] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [NON_LEADER]: Peer 691cccbd0258483ebe19e1581674cc94 log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:10:35.142781 30584 log.cc:927] Time spent T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:10:35.128686 30528 raft_consensus.cc:515] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.151934 30528 leader_election.cc:290] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.153131 30200 raft_consensus.cc:740] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Initialized, Role: LEARNER
I20260709 13:10:35.155082 30582 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:35.154369 30200 consensus_queue.cc:260] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } }
I20260709 13:10:35.116724 30499 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.157011 30499 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:35.166109 22449 auto_rebalancer.cc:629] Failed to schedule move for tablet 6f5719028ca945b2b6c1a1f140b05146: Illegal state: Replica 691cccbd0258483ebe19e1581674cc94 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:35.169126 30572 raft_consensus.cc:2804] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:35.169719 30572 raft_consensus.cc:697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:35.170641 30572 consensus_queue.cc:237] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.174160 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:35.177899 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.181865 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.179162 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:35.201857 22580 raft_consensus.cc:3060] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:35.182518 22648 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:35.200994 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:35.208370 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:35.209640 22617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.213635 23256 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:35.217202 22579 raft_consensus.cc:1275] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:35.136303 29957 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.200629 30483 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.222679 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 188580us
I20260709 13:10:35.206179 30398 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:35.230685 30483 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:35.239171 30561 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:35.239495 30483 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:35.240113 30561 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.241026 23262 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:10:35.231890 30200 ts_tablet_manager.cc:1434] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Time spent starting tablet: real 0.549s	user 0.008s	sys 0.005s
I20260709 13:10:35.242226 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:10:35.242646 30200 ts_tablet_manager.cc:1467] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Tablet startup took 559ms
I20260709 13:10:35.242875 23261 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:35.233040 29957 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.209396 30478 raft_consensus.cc:3060] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:35.244194 30561 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.249351 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.250327 22651 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:35.251231 22649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:35.252075 22649 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:35.169395 30559 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.260672 22654 raft_consensus.cc:1240] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Rejecting Update request from peer 691cccbd0258483ebe19e1581674cc94 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:35.268363 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:35.269459 22575 raft_consensus.cc:2368] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 20. Current term is 21.
I20260709 13:10:35.220427 30587 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:10:35.302764 22580 raft_consensus.cc:2468] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:35.298348 22652 raft_consensus.cc:1275] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:35.303653 22649 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:35.306623 22543 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:35.318529 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.319566 22580 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
I20260709 13:10:35.320454 29650 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:35.326098 23227 leader_election.cc:400] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 20. Current term is 21.
I20260709 13:10:35.326637 23227 leader_election.cc:403] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.297688 30499 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.329910 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
I20260709 13:10:35.303650 30484 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.313782 30520 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:35.312505 30369 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.297967 29939 consensus_queue.cc:1048] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:10:35.344966 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 133406us
I20260709 13:10:35.349472 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:35.316277 30429 consensus_queue.cc:1048] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:10:35.366065 23256 raft_consensus.cc:2955] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 LEARNER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:10:35.350164 30520 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:35.343735 30484 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.386585 30370 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.371954 30542 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:35.372997 30595 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:35.406296 30596 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.406935 30596 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.411734 30478 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:35.414868 30520 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.390486 30370 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:35.417484 30593 log.cc:927] Time spent T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:35.418607 30370 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.419687 23259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:35.243248 30200 ts_tablet_manager.cc:1469] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Trace:
0709 13:10:23.753251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.768775 (+ 15524us) service_pool.cc:224] Handling call
0709 13:10:24.165826 (+397051us) ts_tablet_manager.cc:934] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: Initiating tablet copy from peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
0709 13:10:30.667531 (+6501705us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:31.197174 (+529643us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:31.213028 (+ 15854us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:31.904075 (+691047us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:31.965322 (+ 61247us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:32.031756 (+ 66434us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:32.031866 (+   110us) inbound_call.cc:177] Queueing success response
0709 13:10:33.363518 (+1331652us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:10:34.683040 (+1319522us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:10:34.903894 (+220854us) tablet_replica.cc:261] Starting instrumentation
0709 13:10:34.904547 (+   653us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":80142,"raft.queue_time_us":27005,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8621,"tablet-copy.queue_time_us":191624,"tablet-download-pool.queue_time_us":351,"tablet-download-pool.run_cpu_time_us":1641,"tablet-download-pool.run_wall_time_us":866414,"thread_start_us":305856,"threads_started":2}
I20260709 13:10:35.398061 30595 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.421940 30595 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:35.464916 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 46708.7us
I20260709 13:10:35.412139 30559 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:35.480952 23261 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:35.398418 30542 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:35.470053 30602 log.cc:927] Time spent T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.064s	user 0.004s	sys 0.000s
I20260709 13:10:35.486531 30596 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.512969 30600 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.513705 30600 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.515486 30564 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:35.519196 30484 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.485777 30362 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.483454 30489 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465) with higher term. Message: Invalid argument: T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f for earlier term 20. Current term is 21.
I20260709 13:10:35.522974 30362 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:35.527629 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 489257us
I20260709 13:10:35.534937 30600 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.486369 30515 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.536000 30515 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.536592 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:35.538167 30515 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.538727 30597 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:35.540330 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 316387us
W20260709 13:10:35.541122 22619 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:35.541571 22619 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:35.543529 30600 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.549100 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:35.484701 30370 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.486119 30542 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:35.575843 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.573693 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.577322 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66564b8595294cedb0956a6878879f95" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:35.578094 22577 raft_consensus.cc:2393] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:35.579411 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.580307 22580 raft_consensus.cc:2410] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:10:35.544272 30600 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.503943 22590 tablet_copy_service.cc:342] P 691cccbd0258483ebe19e1581674cc94: Request end of tablet copy session fa2f181263f446a6962b649f9348c15f-80dc0c7d4f9341eeb7472424613de2ce received from {username='slave'} at 127.0.0.1:36354
I20260709 13:10:35.591552 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.593405 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.595593 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.595831 22580 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:35.553272 30588 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:35.597350 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:35.598356 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.599493 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.604056 22572 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:35.604465 22543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.605363 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.605767 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b881738a5b7f4910b375833c1cd61083" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.570284 30524 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:35.585707 30281 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:35.588581 30484 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.611953 22619 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:35.616823 22619 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:35.623790 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:35.630290 22573 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:35.624251 21390 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 22530)
I20260709 13:10:35.585534 30370 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.650197 22649 raft_consensus.cc:1275] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:10:35.650622 22649 pending_rounds.cc:85] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 16
I20260709 13:10:35.650923 22649 pending_rounds.cc:107] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:10:35.651147 22649 raft_consensus.cc:2889] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.652522 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.653237 22647 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 21.
I20260709 13:10:35.638101 22572 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:10:35.654081 22572 pending_rounds.cc:85] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Aborting all ops after (but not including) 14
I20260709 13:10:35.654337 22572 pending_rounds.cc:107] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:10:35.654580 22572 raft_consensus.cc:2889] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.656993 30600 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.620451 30281 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.660192 22578 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:35.660987 30281 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.617017 30595 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.646102 30588 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:35.667037 30595 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.616494 22590 tablet_copy_service.cc:434] P 691cccbd0258483ebe19e1581674cc94: ending tablet copy session fa2f181263f446a6962b649f9348c15f-80dc0c7d4f9341eeb7472424613de2ce on tablet 80dc0c7d4f9341eeb7472424613de2ce with peer fa2f181263f446a6962b649f9348c15f
I20260709 13:10:35.615689 29963 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:35.648068 30362 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.672298 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:35.681938 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:35.682301 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.686129 22652 raft_consensus.cc:2393] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 23: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:35.680178 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90337.8us
I20260709 13:10:35.650518 30370 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.618327 30524 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.702679 22573 raft_consensus.cc:2468] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
W20260709 13:10:35.701503 22545 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:35.625885 30484 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:35.705016 23229 leader_election.cc:336] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:35.707508 23229 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:35.712210 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:35.690433 30362 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.718879 30542 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.689083 29963 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:35.722906 29963 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445)
I20260709 13:10:35.726454 30210 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.697296 30595 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:35.728716 30524 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.729502 22575 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:35.738894 30391 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:35.737583 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 49279.9us
W20260709 13:10:35.741520 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129589us
I20260709 13:10:35.761214 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:35.740005 30520 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:35.765226 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c413dbaae364e3a919a92c57b6216ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.764202 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.765429 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78833bb30a8347f19e5f2696aacc31e1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.770213 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.770824 22653 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
I20260709 13:10:35.771600 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:35.776005 22653 raft_consensus.cc:2393] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:35.777544 23257 raft_consensus.cc:1275] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:35.781914 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.781939 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.785238 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.786654 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.764066 30542 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.789446 30559 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:35.791522 22617 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:35.793529 30413 raft_consensus.cc:2804] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:35.794093 30413 raft_consensus.cc:697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:35.795004 30413 consensus_queue.cc:237] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.799472 22653 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:35.782902 22654 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:35.802007 22654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.789599 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:35.802771 22648 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:35.801889 22653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:35.805871 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:35.804165 30210 raft_consensus.cc:493] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.768079 30520 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.842208 30520 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:35.774689 30478 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.816903 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:35.845173 30478 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.847471 30478 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:35.849172 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:35.855763 30210 raft_consensus.cc:515] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:35.852763 22573 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
I20260709 13:10:35.858009 30210 leader_election.cc:290] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:35.860529 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:35.863893 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
W20260709 13:10:35.886215 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 118588us
I20260709 13:10:35.899539 22645 raft_consensus.cc:2393] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:35.902534 30484 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:35.904001 30362 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.905810 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:35.911192 22648 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 24.
W20260709 13:10:35.913390 22545 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:35.918103 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e
W20260709 13:10:35.919538 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:35.914507 30362 raft_consensus.cc:493] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.923303 22545 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:35.936276 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 175769us
I20260709 13:10:35.924233 30587 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.949106 30587 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.951529 30587 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.953361 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.954217 22577 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:35.956255 30210 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.956825 30210 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.959170 30210 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:35.963040 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:35.964895 30518 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:35.967027 30484 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:35.967629 30484 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:35.969070 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.970285 22650 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:35.972671 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:35.977227 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:35.978286 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec411c33594ae08408279ef5c44410" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.980118 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.981690 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.923987 30490 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:35.988024 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9693f1d9b0aa4659842e296e4ccab6fb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.989101 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
W20260709 13:10:35.996628 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:36.000875 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:36.002177 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:35.998641 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abd591408b04d32a9049743f1e89547" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:36.007251 22545 leader_election.cc:336] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:35.981667 30398 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.999888 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:36.007953 22545 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:36.009357 22617 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:36.015074 22468 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.017796 22571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23ea829d43140beb6a88079029d865b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:35.933255 30362 raft_consensus.cc:515] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:36.026633 22619 leader_election.cc:336] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:36.005352 30478 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:10:36.034783 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 45779us
W20260709 13:10:36.036048 22545 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:36.036566 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:36.006451 30490 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
W20260709 13:10:36.043653 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:35.998286 30520 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.050369 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:36.051402 30520 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.051925 30451 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:36.041633 30610 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:10:36.052673 30451 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.052898 30610 consensus_queue.cc:1243] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Peer 5e72fb99f5ee4943a91cf8e6dd73e80e log is divergent from this leader: its last log entry 18.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:10:36.053334 30451 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:36.034785 30478 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.057293 30478 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:36.058720 29963 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:36.036754 30144 consensus_queue.cc:1048] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
W20260709 13:10:36.044588 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:36.019893 30202 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:36.062520 30202 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.062907 30202 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:36.004397 30281 consensus_queue.cc:1048] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:10:36.067972 30524 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:36.069136 30518 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:36.072455 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:36.072642 30114 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:36.073154 22651 raft_consensus.cc:3060] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:36.073223 30615 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.073578 30114 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.074132 30615 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.020081 30398 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.078258 22652 pending_rounds.cc:85] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting all ops after (but not including) 15
I20260709 13:10:36.078999 22652 pending_rounds.cc:107] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:10:36.079677 30398 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.080071 22571 raft_consensus.cc:1275] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:10:36.081840 30484 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:36.082351 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:36.082146 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.083007 23264 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 26.
I20260709 13:10:36.083266 22577 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 25.
I20260709 13:10:36.083920 30559 raft_consensus.cc:2804] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:36.084467 30559 raft_consensus.cc:697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:36.085631 30572 consensus_queue.cc:1048] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:36.086687 30490 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.088150 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.088784 22647 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 26.
I20260709 13:10:36.089178 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.089927 22648 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 26: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:36.090216 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:36.089178 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:36.091028 30601 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:10:36.091419 30601 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.091782 30601 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:36.092833 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:36.093739 30515 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:36.094152 30515 raft_consensus.cc:493] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting leader election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:36.094523 30515 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:36.023978 30582 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:36.085479 30559 consensus_queue.cc:237] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.079540 22652 raft_consensus.cc:2889] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:36.042093 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:36.076638 30615 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.118161 30362 leader_election.cc:290] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.104278 30451 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.076609 30114 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:36.103080 22651 raft_consensus.cc:2468] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 22.
I20260709 13:10:36.137117 30515 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.139087 30524 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:36.142999 30595 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:36.169864 22545 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:36.279915 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 131264us
W20260709 13:10:36.281090 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:36.179348 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 137287us
W20260709 13:10:36.283649 30628 log.cc:927] Time spent T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:10:36.285377 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 89488.4us
W20260709 13:10:36.283684 22619 leader_election.cc:336] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:36.287858 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:36.288563 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:36.320021 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:36.346463 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:36.321107 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:36.296204 22543 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:36.349711 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 53601.6us
I20260709 13:10:36.351086 30520 raft_consensus.cc:2804] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:36.351730 30520 raft_consensus.cc:697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:36.352705 30520 consensus_queue.cc:237] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.309918 30451 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:36.314708 30595 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.342610 30601 raft_consensus.cc:515] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.298290 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:36.418135 22646 raft_consensus.cc:2393] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 26: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:36.316200 30202 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:36.372826 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:36.419955 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47202.9us
I20260709 13:10:36.394086 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca60e389358849e7bf461e472007a7f7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:36.421146 22578 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:36.381178 30114 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:10:36.420703 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:36.428848 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.435683 30601 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.400046 30582 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.436728 30582 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:36.433347 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 399481us
I20260709 13:10:36.442322 22468 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:36.448781 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:36.449569 22651 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:10:36.453202 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.463989 22651 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 27.
I20260709 13:10:36.465657 22468 leader_election.cc:304] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:36.462296 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 77772.9us
I20260709 13:10:36.459225 30484 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:36.433471 30114 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.474915 30202 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.481266 30626 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:36.481452 30582 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:36.486011 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.483000 23227 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:36.448204 30362 raft_consensus.cc:493] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa2f181263f446a6962b649f9348c15f)
I20260709 13:10:36.488675 22578 raft_consensus.cc:2468] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 26.
I20260709 13:10:36.423553 30478 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.493230 22468 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.502192 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.504159 23264 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:36.513201 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:36.494745 30604 raft_consensus.cc:2804] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:10:36.488920 30484 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:36.497542 30597 raft_consensus.cc:2749] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:10:36.505481 30398 raft_consensus.cc:493] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.506204 30483 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:36.571488 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.572340 22646 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:36.578392 30631 log.cc:927] Time spent T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
I20260709 13:10:36.531050 30478 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.532950 30604 raft_consensus.cc:697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 27 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:36.591147 30604 consensus_queue.cc:237] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.534258 30484 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.535311 30398 raft_consensus.cc:515] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.600420 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:36.601370 30398 leader_election.cc:290] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:36.525650 22400 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 7 to 11, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 11 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.604413 22400 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:36.606709 22400 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 11 to 15, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 15 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:36.538622 22396 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 194) took 26800 ms (client timeout 15000 ms). Trace:
I20260709 13:10:36.507215 22468 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.544288 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f196f572a5c44a1adb647d7ebc64463" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:36.498920 30362 raft_consensus.cc:515] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.613829 22573 raft_consensus.cc:3060] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:10:36.614109 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 108900us
I20260709 13:10:36.615331 30362 leader_election.cc:290] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:36.615545 22468 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.616299 30362 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.549190 30281 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:36.617995 30483 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:36.618943 30210 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:36.541210 30515 leader_election.cc:290] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 election: Requested vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:36.517844 30582 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:36.580742 30114 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.619791 30362 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.620440 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.621986 30362 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.622689 30362 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:36.622061 22468 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.550763 30595 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:36.625900 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57547.9us
W20260709 13:10:36.631186 21390 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 22530)
I20260709 13:10:36.638643 22646 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 25. Current term is 26. Ops: []
W20260709 13:10:36.596518 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:36.646243 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49787.6us
I20260709 13:10:36.645282 22573 raft_consensus.cc:2468] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 27.
I20260709 13:10:36.650493 22400 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:36.609529 22396 rpcz_store.cc:269] 0709 13:10:09.748172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.748678 (+   506us) service_pool.cc:224] Handling call
0709 13:10:36.538540 (+26789862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:33.036182 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:33.037168 (+   986us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:33.037238 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:10:33.037286 (+    48us) tablet.cc:662] Decoding operations
0709 13:10:33.038616 (+  1330us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:33.038779 (+   163us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:33.038830 (+    51us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:10:33.040020 (+  1190us) tablet.cc:701] Row locks acquired
0709 13:10:33.040100 (+    80us) write_op.cc:260] PREPARE: finished
0709 13:10:33.040491 (+   391us) write_op.cc:270] Start()
0709 13:10:33.040709 (+   218us) write_op.cc:276] Timestamp: P: 1783602633040258 usec, L: 0
0709 13:10:33.040917 (+   208us) op_driver.cc:348] REPLICATION: starting
0709 13:10:33.168670 (+127753us) log.cc:844] Serialized 3242 byte log entry
0709 13:10:33.522451 (+353781us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec23096db1 00007fec23134c85 00007fec231356a2 00007fec25ea71db 00007fec25ea2aaf 00007fec231f10ac 00007fec2c04bab9 00007fec2320d69b 00007fec2320b93f 00007fec2320dc02 00007fec25e9520b
0709 13:10:33.613478 (+ 91027us) op_driver.cc:464] REPLICATION: finished
0709 13:10:33.684610 (+ 71132us) write_op.cc:301] APPLY: starting
0709 13:10:33.684947 (+   337us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:33.699459 (+ 14512us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:33.699507 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:33.900593 (+201086us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:33.948535 (+ 47942us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:10:33.958456 (+  9921us) write_op.cc:312] APPLY: finished
0709 13:10:33.958842 (+   386us) log.cc:844] Serialized 81 byte log entry
0709 13:10:33.959027 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:33.959156 (+   129us) write_op.cc:454] Released schema lock
0709 13:10:33.959227 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:33.959719 (+   492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:33.959766 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":129214,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":60305,"apply.run_cpu_time_us":16879,"apply.run_wall_time_us":275078,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":78531,"prepare.run_cpu_time_us":16683,"prepare.run_wall_time_us":536275,"raft.queue_time_us":65305,"raft.run_cpu_time_us":17109,"raft.run_wall_time_us":40115,"replication_time_us":572384,"spinlock_wait_cycles":42122112,"thread_start_us":534880,"threads_started":4,"wal-append.queue_time_us":375819,"wal-append.run_cpu_time_us":12199,"wal-append.run_wall_time_us":1416259}]]}
I20260709 13:10:36.636715 30636 raft_consensus.cc:1064] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: attempting to promote NON_VOTER fa2f181263f446a6962b649f9348c15f to VOTER
I20260709 13:10:36.657430 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.672715 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:36.652741 22400 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 11 to 14, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 14 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:36.657346 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:36.677007 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:36.698457 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.657729 30595 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:36.705225 30362 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:36.705814 22468 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.706358 30483 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:36.710724 22400 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 15, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 15 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:36.649751 30454 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 13:10:36.723415 22468 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.730242 22468 leader_election.cc:304] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.733856 22573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.737159 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.737206 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.737519 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603e708bc6b346ea93c1fb612030a16f" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.738374 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.737962 22617 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.720048 30398 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.744150 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:36.729063 30582 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:36.748912 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14caf28740540799ba1c6db058346a1" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.733208 30478 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:36.736095 30626 raft_consensus.cc:2749] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:36.763252 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:36.766633 22647 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:36.767050 22575 raft_consensus.cc:1275] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:10:36.763103 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.768735 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7684e99fff4bc297f8fbf170e45ddb" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.770841 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:36.770993 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a76a7949bf24ada8b2cc5dcacab4bf3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.771500 22578 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:36.772437 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eac3c624e2c43fc9505fe5c344151d0" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.772807 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9ab72464841aca55186beb0dbeb53" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.773205 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.773837 22579 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 21.
I20260709 13:10:36.774225 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.774825 22651 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 22.
W20260709 13:10:36.776582 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:36.778293 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.776965 22544 leader_election.cc:304] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.754866 30398 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.787452 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:36.749003 30362 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.790295 22468 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.798298 22578 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:36.790616 22646 raft_consensus.cc:2393] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:36.755714 30559 raft_consensus.cc:2804] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:10:36.800472 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:36.805913 22468 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:36.817199 22468 leader_election.cc:304] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.823884 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.824184 22573 raft_consensus.cc:1240] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Rejecting Update request from peer fa2f181263f446a6962b649f9348c15f for earlier term 25. Current term is 26. Ops: []
I20260709 13:10:36.784804 30398 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.790112 30641 raft_consensus.cc:2749] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:10:36.833593 22647 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:36.799288 30484 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:36.803418 30478 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.816385 30626 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:36.821204 30582 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:36.821763 30559 raft_consensus.cc:697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:36.849880 22468 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.835989 30202 raft_consensus.cc:2749] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:36.803640 30362 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.860365 22578 raft_consensus.cc:1275] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:10:36.869112 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:36.847136 30626 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.845772 30600 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:36.870116 22578 raft_consensus.cc:2393] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ca917eaada84bf38a5daae9f8ffa066 in current term 22: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:36.872422 22468 leader_election.cc:304] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.842772 30454 consensus_queue.cc:1059] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 13:10:36.884593 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:36.855710 30582 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:36.889341 22468 leader_election.cc:304] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:36.871109 30478 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:36.893936 22468 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.877796 30626 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:36.900993 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:36.898700 30202 raft_consensus.cc:2749] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:36.902885 30542 raft_consensus.cc:3055] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:10:36.903431 30542 raft_consensus.cc:740] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:36.904999 30484 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:36.904594 30542 consensus_queue.cc:260] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.906314 30542 raft_consensus.cc:3060] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:36.878012 30413 consensus_queue.cc:1048] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:10:36.891774 30600 raft_consensus.cc:2749] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:36.914703 30202 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:10:36.911173 30642 log.cc:927] Time spent T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.192s	user 0.000s	sys 0.002s
W20260709 13:10:36.911192 30643 log.cc:927] Time spent T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:10:36.925096 30559 consensus_queue.cc:237] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:36.946269 30582 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:36.911134 30617 consensus_queue.cc:1048] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:10:36.975435 30362 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:36.995688 30626 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:37.000738 30626 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:37.001479 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 81429.7us
I20260709 13:10:37.024911 22646 raft_consensus.cc:1275] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:10:37.038086 30281 consensus_queue.cc:1048] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:10:37.084718 22573 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 27 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:10:37.090478 30646 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.015s
I20260709 13:10:37.121567 22647 raft_consensus.cc:1275] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:10:37.123282 30542 consensus_queue.cc:1048] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:10:37.181696 22468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 273365us
I20260709 13:10:37.186585 30640 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:37.187678 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:37.189433 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:37.187276 30640 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:37.190074 22577 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:10:37.192291 30640 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:37.197964 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:37.203070 22651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:37.203691 22651 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:37.211970 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:37.217787 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:37.219727 22545 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:37.220293 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:37.231285 30484 raft_consensus.cc:493] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.232072 30484 raft_consensus.cc:515] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:37.232547 30595 raft_consensus.cc:493] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:37.234592 30595 raft_consensus.cc:515] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:37.235474 30484 leader_election.cc:290] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:37.241124 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:37.242237 30483 raft_consensus.cc:3060] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:37.224309 22651 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
I20260709 13:10:37.244184 30595 leader_election.cc:290] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:37.258162 30483 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:37.271751 22468 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066; no voters: 
I20260709 13:10:37.272945 22651 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:10:37.273903 30483 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:37.274312 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:37.276522 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:37.274449 30483 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Becoming Leader. State: Replica: 6ca917eaada84bf38a5daae9f8ffa066, State: Running, Role: LEADER
I20260709 13:10:37.346558 30636 consensus_queue.cc:237] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:37.370214 22546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.420579 30582 raft_consensus.cc:493] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.426112 30582 raft_consensus.cc:515] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:37.430209 30582 leader_election.cc:290] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:37.396256 30483 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:37.431114 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:37.452032 22648 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:37.457876 23257 raft_consensus.cc:1275] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 LEARNER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:37.460018 29957 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:37.464929 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.475023 30609 consensus_queue.cc:1048] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:37.489732 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c34f1ef8704ce29f9df924d306bc42" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:37.538465 22468 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:37.542150 23229 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 224 similar messages]
I20260709 13:10:37.541464 30582 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.011s
W20260709 13:10:37.553227 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:37.553416 23263 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 19. (term mismatch)
I20260709 13:10:37.554946 23263 pending_rounds.cc:85] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Aborting all ops after (but not including) 18
I20260709 13:10:37.555282 23263 pending_rounds.cc:107] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: Aborting uncommitted NO_OP operation due to leader change: 25.19
I20260709 13:10:37.555502 23263 raft_consensus.cc:2889] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:37.543529 30483 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:37.558750 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2410740c9458db983018bbe19dcbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:37.528121 30660 log.cc:927] Time spent T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:37.567974 22468 leader_election.cc:304] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:37.573814 22652 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:10:37.575479 30253 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 13:10:37.584395 30478 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:37.575721 30582 raft_consensus.cc:2749] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:37.599562 22572 raft_consensus.cc:1275] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:10:37.614204 30595 raft_consensus.cc:493] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.626657 22545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:37.631690 21390 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 22530)
I20260709 13:10:37.632997 30595 raft_consensus.cc:515] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:37.638515 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:37.647589 22572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5719028ca945b2b6c1a1f140b05146" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:37.650496 22574 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:37.657117 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4afa4eec9774883a53b37419c20bbf4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:37.658177 22578 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:10:37.612982 30585 consensus_queue.cc:1048] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 13:10:37.668601 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c028af0e9e408792f2900ec24e194b" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:37.663184 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:37.636771 30595 leader_election.cc:290] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:37.677438 22574 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:10:37.675910 30640 raft_consensus.cc:2955] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:37.682701 22647 raft_consensus.cc:2955] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:37.764042 23264 raft_consensus.cc:2955] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:37.791703 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 121069us
W20260709 13:10:37.825278 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:37.841785 22577 consensus_meta.cc:287] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: Time spent flushing consensus metadata: real 0.651s	user 0.015s	sys 0.000s
I20260709 13:10:37.842200 22577 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ca917eaada84bf38a5daae9f8ffa066 in term 23.
W20260709 13:10:37.856113 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63614.8us
W20260709 13:10:37.870952 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:37.843868 30595 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.891347 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:37.846779 30484 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.844883 30523 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:37.891165 30582 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:37.919199 30582 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:37.921562 30582 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:37.901651 30484 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:37.924391 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:37.925609 30484 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:37.928078 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:37.900333 30595 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:37.932567 30595 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:37.941377 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0a982f0606460f93cc934c9319409d" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:37.941785 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:37.942871 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:37.943136 22468 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:37.946168 30484 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:10:37.969539 22468 leader_election.cc:304] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:37.970386 30484 raft_consensus.cc:2749] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:37.972121 30582 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:37.975463 22400 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 318) took 43944 ms (client timeout 15000 ms). Trace:
I20260709 13:10:37.978386 22468 leader_election.cc:304] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:37.979782 22468 leader_election.cc:304] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:37.985606 30582 raft_consensus.cc:2749] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:37.987527 30595 raft_consensus.cc:2749] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:37.996850 22397 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 15 to 18, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:37.976366 22400 rpcz_store.cc:269] 0709 13:09:54.049485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.089444 (+ 39959us) service_pool.cc:224] Handling call
0709 13:10:37.975366 (+43885922us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:36.873760 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:36.874321 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:36.874507 (+   186us) write_op.cc:435] Acquired schema lock
0709 13:10:36.874526 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:36.875358 (+   832us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:36.875441 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:36.875473 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:36.879048 (+  3575us) tablet.cc:701] Row locks acquired
0709 13:10:36.882601 (+  3553us) write_op.cc:260] PREPARE: finished
0709 13:10:36.886328 (+  3727us) write_op.cc:270] Start()
0709 13:10:36.892359 (+  6031us) write_op.cc:276] Timestamp: P: 1783602636885617 usec, L: 0
0709 13:10:36.898309 (+  5950us) op_driver.cc:348] REPLICATION: starting
0709 13:10:36.971352 (+ 73043us) log.cc:844] Serialized 2485 byte log entry
0709 13:10:37.112680 (+141328us) op_driver.cc:464] REPLICATION: finished
0709 13:10:37.126716 (+ 14036us) write_op.cc:301] APPLY: starting
0709 13:10:37.126812 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:37.132945 (+  6133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:37.133051 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:37.137975 (+  4924us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:37.138232 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:10:37.138288 (+    56us) write_op.cc:312] APPLY: finished
0709 13:10:37.138556 (+   268us) log.cc:844] Serialized 65 byte log entry
0709 13:10:37.138721 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.138840 (+   119us) write_op.cc:454] Released schema lock
0709 13:10:37.138886 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:37.144088 (+  5202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.144121 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1117128,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":13768,"apply.run_cpu_time_us":10845,"apply.run_wall_time_us":12572,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29231,"num_ops":6,"prepare.queue_time_us":79156,"prepare.run_cpu_time_us":19353,"prepare.run_wall_time_us":194080,"raft.queue_time_us":40291,"raft.run_cpu_time_us":1419,"raft.run_wall_time_us":32731,"replication_time_us":214169,"spinlock_wait_cycles":408064,"thread_start_us":221922,"threads_started":4,"wal-append.queue_time_us":96346}]]}
I20260709 13:10:38.011008 30595 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:38.017639 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.019397 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de2edeb38841bfa9edd362c910f0f7" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:38.020252 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:38.023805 22577 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:38.028905 22468 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:38.029616 22397 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 13 to 16, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 16 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:38.030556 30582 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:38.034840 22468 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:38.036059 30582 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:38.041076 22650 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Refusing update from remote peer 6ca917eaada84bf38a5daae9f8ffa066: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:10:38.043044 30582 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:38.043995 30595 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:38.046653 22545 consensus_peers.cc:597] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:38.047505 22545 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:38.047909 22545 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:38.048836 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:38.053622 30523 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:38.066817 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:38.067698 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:38.068305 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:38.071089 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:38.165302 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:38.171700 30484 raft_consensus.cc:493] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.172525 30484 raft_consensus.cc:515] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:38.174999 30484 leader_election.cc:290] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:38.177423 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.178696 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8852a51dd9a84948bed8ee87ae7a9f21" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:38.182281 22468 leader_election.cc:304] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:38.183321 30484 raft_consensus.cc:2749] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:38.193089 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:38.265086 22401 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 15 to 18, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 18 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:38.272791 22397 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 312) took 55544 ms (client timeout 15000 ms). Trace:
I20260709 13:10:38.273692 30484 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.279892 30484 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:38.285296 30484 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:38.291335 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:38.309269 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096694b658e343f384dc3c1f4e4c5dac" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.330175 22468 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:38.331619 30582 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:10:38.354305 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:38.354604 22526 debug-util.cc:398] Leaking SignalData structure 0x7b080022b9a0 after lost signal to thread 21393
W20260709 13:10:38.355829 22526 debug-util.cc:398] Leaking SignalData structure 0x7b080022ac80 after lost signal to thread 22437
W20260709 13:10:38.356513 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08002b14a0 after lost signal to thread 22529
W20260709 13:10:38.356818 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08000bdf20 after lost signal to thread 22530
W20260709 13:10:38.358047 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08001838a0 after lost signal to thread 22604
W20260709 13:10:38.358338 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08003762e0 after lost signal to thread 22605
W20260709 13:10:38.359541 22526 debug-util.cc:398] Leaking SignalData structure 0x7b0800322540 after lost signal to thread 22678
W20260709 13:10:38.359959 22526 debug-util.cc:398] Leaking SignalData structure 0x7b080023efa0 after lost signal to thread 22679
W20260709 13:10:38.279598 22397 rpcz_store.cc:269] 0709 13:09:42.728585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.735907 (+  7322us) service_pool.cc:224] Handling call
0709 13:09:42.766626 (+ 30719us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:10:38.272671 (+55506045us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:38.115748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:38.116508 (+   760us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:38.116552 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:10:38.116574 (+    22us) tablet.cc:662] Decoding operations
0709 13:10:38.117355 (+   781us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:38.117434 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:38.117461 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:38.117857 (+   396us) tablet.cc:701] Row locks acquired
0709 13:10:38.117874 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:38.118013 (+   139us) write_op.cc:270] Start()
0709 13:10:38.118120 (+   107us) write_op.cc:276] Timestamp: P: 1783602638117972 usec, L: 0
0709 13:10:38.118148 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:10:38.122082 (+  3934us) log.cc:844] Serialized 935 byte log entry
0709 13:10:38.125310 (+  3228us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f6e28 00007fec29d31581 00007fec29d30d58 00007fec29d359f1 00007fec29d359a9 00007fec29d35939 00007fec29d35901 00007fec29d34b2d 000000000038f354 000000000038f199
0709 13:10:38.151563 (+ 26253us) op_driver.cc:464] REPLICATION: finished
0709 13:10:38.174111 (+ 22548us) write_op.cc:301] APPLY: starting
0709 13:10:38.174197 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:38.176052 (+  1855us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:38.176081 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:38.196182 (+ 20101us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:38.203754 (+  7572us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:10:38.203803 (+    49us) write_op.cc:312] APPLY: finished
0709 13:10:38.204043 (+   240us) log.cc:844] Serialized 33 byte log entry
0709 13:10:38.204219 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.204325 (+   106us) write_op.cc:454] Released schema lock
0709 13:10:38.204366 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:38.204796 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.204824 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126527,"reported_tablets":49,"spinlock_wait_cycles":12896640,"child_traces":[["op",{"apply.queue_time_us":22272,"apply.run_cpu_time_us":5509,"apply.run_wall_time_us":30662,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":16738,"prepare.run_cpu_time_us":5707,"prepare.run_wall_time_us":10406,"replication_time_us":32879,"spinlock_wait_cycles":6939904,"thread_start_us":43309,"threads_started":2}]]}
W20260709 13:10:38.372615 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:38.373562 22526 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc800 after lost signal to thread 23288
W20260709 13:10:38.376680 22526 debug-util.cc:398] Leaking SignalData structure 0x7b0800145140 after lost signal to thread 23289
I20260709 13:10:38.382941 30582 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:38.383603 30582 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:38.387374 30582 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:38.389123 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:38.396879 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d0b8c255a14106a3b00b5476896b2c" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:38.417778 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:38.416850 22468 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
W20260709 13:10:38.420138 22401 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 193) took 58218 ms (client timeout 15000 ms). Trace:
I20260709 13:10:38.422889 30626 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:38.449913 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:38.478576 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:38.420665 22401 rpcz_store.cc:269] 0709 13:09:40.202105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.202360 (+   255us) service_pool.cc:224] Handling call
0709 13:10:38.420061 (+58217701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:38.314362 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:38.314946 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:38.314986 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:10:38.315007 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:38.315363 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:38.315422 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:38.315461 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:38.315641 (+   180us) tablet.cc:701] Row locks acquired
0709 13:10:38.322490 (+  6849us) write_op.cc:260] PREPARE: finished
0709 13:10:38.335243 (+ 12753us) write_op.cc:270] Start()
0709 13:10:38.337004 (+  1761us) write_op.cc:276] Timestamp: P: 1783602638334531 usec, L: 0
0709 13:10:38.337035 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:10:38.337699 (+   664us) log.cc:844] Serialized 539 byte log entry
0709 13:10:38.339898 (+  2199us) op_driver.cc:464] REPLICATION: finished
0709 13:10:38.340309 (+   411us) write_op.cc:301] APPLY: starting
0709 13:10:38.340405 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:38.341401 (+   996us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:38.341508 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:38.342254 (+   746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:38.342423 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:38.342469 (+    46us) write_op.cc:312] APPLY: finished
0709 13:10:38.342647 (+   178us) log.cc:844] Serialized 25 byte log entry
0709 13:10:38.342830 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.342913 (+    83us) write_op.cc:454] Released schema lock
0709 13:10:38.342951 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:38.343350 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.343377 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15342,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":135,"apply.run_cpu_time_us":2987,"apply.run_wall_time_us":2986,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":617,"prepare.run_cpu_time_us":2869,"prepare.run_wall_time_us":23735,"replication_time_us":2711}]]}
I20260709 13:10:38.489554 30582 raft_consensus.cc:493] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.490233 30582 raft_consensus.cc:515] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:38.492599 30582 leader_election.cc:290] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:38.494823 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.497967 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d734b2b43a40138a8a0ee22b30d9ba" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:38.500138 22468 leader_election.cc:304] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:38.501389 30626 raft_consensus.cc:2749] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:38.518664 22402 catalog_manager.cc:5697] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 18 to 20, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 20 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:38.522770 22402 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 19 to 21, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 21 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:38.524341 22402 catalog_manager.cc:5697] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 20 to 21, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 21 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.526530 22402 catalog_manager.cc:5697] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.527885 22402 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 11 to 13, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 13 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.533360 22402 catalog_manager.cc:5697] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 10 to 14, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 14 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.541739 22402 catalog_manager.cc:5697] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 19 to 20, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 20 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.547315 22402 catalog_manager.cc:5697] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:38.540382 22403 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 192) took 80222 ms (client timeout 15000 ms). Trace:
W20260709 13:10:38.561062 22403 rpcz_store.cc:269] 0709 13:09:18.343075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.343526 (+   451us) service_pool.cc:224] Handling call
0709 13:10:38.540151 (+80196625us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":325131,"reported_tablets":32}
I20260709 13:10:38.560204 22402 catalog_manager.cc:5697] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:38.576597 22402 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.597282 22402 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 22 to 23, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 23 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.605188 22402 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 23 to 25, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 25 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.609370 22402 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.611105 22402 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.617445 22402 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.620038 22402 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 15 to 20, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 20 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.621654 22402 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:38.622725 22402 catalog_manager.cc:5697] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.623734 22402 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:38.632189 21390 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 22530)
I20260709 13:10:38.633351 30582 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.633935 30582 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:38.636087 30582 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:38.637861 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:38.638599 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:38.640230 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc845449beb4f859e55185200f34bd2" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.643337 22468 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:38.644483 30582 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:38.690398 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:38.704146 30582 raft_consensus.cc:493] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.704818 30582 raft_consensus.cc:515] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:38.709285 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:38.711710 30582 leader_election.cc:290] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:38.711915 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a60725e5550479db8d1e52b48126750" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.715428 22468 leader_election.cc:304] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:38.716559 30484 raft_consensus.cc:2749] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:38.750238 30484 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.750836 30484 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:38.754475 30595 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.756347 30595 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:38.758713 30595 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:38.759657 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:38.762393 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401fe414b8f443bebfed8254895d71c3" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.765300 22468 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:38.768621 30595 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:38.772719 30484 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:38.773204 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:38.774338 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90227a385eee486dbc981f55629940e4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:38.775897 22469 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:38.776742 30484 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:38.786532 22398 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:38.807731 22402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37524 (request call id 319) took 12427 ms (client timeout 15000 ms). Trace:
W20260709 13:10:38.822415 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:38.823675 22398 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 24, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 24 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.831406 22398 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:38.808272 22402 rpcz_store.cc:269] 0709 13:10:26.377922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.445503 (+ 67581us) service_pool.cc:224] Handling call
0709 13:10:38.805492 (+12359989us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:38.655014 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:38.655568 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:38.655604 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:10:38.655619 (+    15us) tablet.cc:662] Decoding operations
0709 13:10:38.658325 (+  2706us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:38.658390 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:38.658415 (+    25us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:10:38.659815 (+  1400us) tablet.cc:701] Row locks acquired
0709 13:10:38.659842 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:10:38.659985 (+   143us) write_op.cc:270] Start()
0709 13:10:38.660099 (+   114us) write_op.cc:276] Timestamp: P: 1783602638659940 usec, L: 0
0709 13:10:38.660121 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:38.660778 (+   657us) log.cc:844] Serialized 7524 byte log entry
0709 13:10:38.677266 (+ 16488us) op_driver.cc:464] REPLICATION: finished
0709 13:10:38.679724 (+  2458us) write_op.cc:301] APPLY: starting
0709 13:10:38.679826 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:38.695822 (+ 15996us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:38.695946 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:38.727523 (+ 31577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:38.727844 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:10:38.727913 (+    69us) write_op.cc:312] APPLY: finished
0709 13:10:38.728374 (+   461us) log.cc:844] Serialized 172 byte log entry
0709 13:10:38.737529 (+  9155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.737742 (+   213us) write_op.cc:454] Released schema lock
0709 13:10:38.737807 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:38.756008 (+ 18201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.766762 (+ 10754us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8174,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":2224,"apply.run_cpu_time_us":24331,"apply.run_wall_time_us":70108,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79496,"num_ops":19,"prepare.queue_time_us":292,"prepare.run_cpu_time_us":5070,"prepare.run_wall_time_us":31604,"replication_time_us":16981}]]}
I20260709 13:10:38.860960 22398 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 14 to 16, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 16 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.872154 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:38.874342 22398 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 24, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 24 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:38.875391 21390 tablet_replica.cc:333] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:38.879024 21390 raft_consensus.cc:2243] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.879637 21390 pending_rounds.cc:70] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:38.879894 21390 pending_rounds.cc:77] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305636282315902976 op_type: NO_OP noop_request { }
I20260709 13:10:38.880252 21390 raft_consensus.cc:2889] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:38.880602 21390 raft_consensus.cc:2272] T 813ede727198414390a20d5845e75e07 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.890761 21390 tablet_replica.cc:333] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:38.891635 21390 raft_consensus.cc:2243] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.892292 21390 pending_rounds.cc:70] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:38.892570 21390 pending_rounds.cc:77] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 23 index: 15 } timestamp: 7305636363447021568 op_type: NO_OP noop_request { }
I20260709 13:10:38.876806 22398 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.892920 21390 raft_consensus.cc:2889] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:38.893307 21390 raft_consensus.cc:2272] T 9e7684e99fff4bc297f8fbf170e45ddb P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.894145 22398 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 14 to 18, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.896178 22398 catalog_manager.cc:5697] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 21 to 24, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 24 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:38.898841 22398 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 17 to 19, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 19 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:38.900537 22398 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 20, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.902947 22398 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 17 to 18, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.909226 22398 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 15 to 19, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 19 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:38.914026 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:38.923418 22398 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 20 to 22, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 22 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:38.927096 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:38.926378 22398 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 14 to 19, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 19 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.917042 21390 tablet_replica.cc:333] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:38.957947 21390 raft_consensus.cc:2243] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.962037 30582 raft_consensus.cc:493] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.962595 30582 raft_consensus.cc:515] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:38.959456 30484 raft_consensus.cc:493] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.970830 30484 raft_consensus.cc:515] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:38.964684 30582 leader_election.cc:290] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:38.973737 21390 pending_rounds.cc:70] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:38.974591 21390 pending_rounds.cc:77] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 22 index: 12 } timestamp: 7305636341894049792 op_type: NO_OP noop_request { }
I20260709 13:10:38.975021 21390 raft_consensus.cc:2889] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:38.975435 21390 raft_consensus.cc:2272] T 88d0b8c255a14106a3b00b5476896b2c P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:38.979790 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:38.987905 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:38.989120 30484 leader_election.cc:290] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:38.989619 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:38.992283 21390 tablet_replica.cc:333] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:38.993214 21390 raft_consensus.cc:2243] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.993944 21390 raft_consensus.cc:2272] T 66564b8595294cedb0956a6878879f95 P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.996658 21390 tablet_replica.cc:333] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.001317 30484 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.047209 21390 raft_consensus.cc:2243] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.007342 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4979f789f48d0807b87e7a48b9a78" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:39.055788 21390 raft_consensus.cc:2272] T 80dc0c7d4f9341eeb7472424613de2ce P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.009752 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:39.022846 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:39.067498 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57804.6us
W20260709 13:10:39.067617 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44871.2us
I20260709 13:10:39.046988 30484 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:39.069065 22468 leader_election.cc:304] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:39.005563 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc46eb991824d25bde40d1001e04798" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:39.070730 30484 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:39.071240 30484 raft_consensus.cc:2749] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:39.073472 22468 leader_election.cc:304] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:39.081516 30484 raft_consensus.cc:2749] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:39.083366 22652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:39.082659 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0498259251e24450b91d38bfc4b83dbf" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:39.086867 22468 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:39.088066 30484 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:39.095993 21390 tablet_replica.cc:333] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.097148 21390 raft_consensus.cc:2243] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.098114 21390 pending_rounds.cc:70] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:39.098420 21390 pending_rounds.cc:77] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305636347347202048 op_type: NO_OP noop_request { }
I20260709 13:10:39.098788 21390 raft_consensus.cc:2889] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:39.099165 21390 raft_consensus.cc:2272] T 5c413dbaae364e3a919a92c57b6216ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.103431 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.107864 21390 tablet_replica.cc:333] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.138264 21390 raft_consensus.cc:2243] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.143445 21390 raft_consensus.cc:2272] T b881738a5b7f4910b375833c1cd61083 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.145529 22398 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 326) took 18361 ms (client timeout 15000 ms). Trace:
I20260709 13:10:39.152179 21390 tablet_replica.cc:333] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.161612 21390 raft_consensus.cc:2243] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.167230 21390 pending_rounds.cc:70] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:39.167654 21390 pending_rounds.cc:77] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 18 index: 11 } timestamp: 7305636264988651520 op_type: NO_OP noop_request { }
W20260709 13:10:39.149703 22398 rpcz_store.cc:269] 0709 13:10:20.809243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.809533 (+   290us) service_pool.cc:224] Handling call
0709 13:10:39.145448 (+18335915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:38.996708 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:38.997250 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:38.997285 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:10:38.997302 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:38.998489 (+  1187us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:38.998542 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:38.998569 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:10:38.999655 (+  1086us) tablet.cc:701] Row locks acquired
0709 13:10:38.999674 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:10:38.999809 (+   135us) write_op.cc:270] Start()
0709 13:10:38.999937 (+   128us) write_op.cc:276] Timestamp: P: 1783602638999764 usec, L: 0
0709 13:10:38.999959 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:39.000588 (+   629us) log.cc:844] Serialized 5588 byte log entry
0709 13:10:39.005223 (+  4635us) op_driver.cc:464] REPLICATION: finished
0709 13:10:39.006269 (+  1046us) write_op.cc:301] APPLY: starting
0709 13:10:39.006360 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:39.012885 (+  6525us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:39.012995 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:39.042273 (+ 29278us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:39.042590 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:10:39.042653 (+    63us) write_op.cc:312] APPLY: finished
0709 13:10:39.043042 (+   389us) log.cc:844] Serialized 129 byte log entry
0709 13:10:39.043225 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:39.043407 (+   182us) write_op.cc:454] Released schema lock
0709 13:10:39.043467 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:39.043911 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:39.043945 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3930,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":817,"apply.run_cpu_time_us":17943,"apply.run_wall_time_us":37575,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58576,"num_ops":14,"prepare.queue_time_us":22813,"prepare.run_cpu_time_us":4174,"prepare.run_wall_time_us":7543,"replication_time_us":5119}]]}
I20260709 13:10:39.173069 21390 raft_consensus.cc:2889] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:39.173580 21390 raft_consensus.cc:2272] T 1abd591408b04d32a9049743f1e89547 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.195389 21390 tablet_replica.cc:333] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.196394 21390 raft_consensus.cc:2243] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.197671 21390 raft_consensus.cc:2272] T 5b79bbacdb324d378e564aba36fc4014 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.200389 21390 tablet_replica.cc:333] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.202436 21390 raft_consensus.cc:2243] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.204053 21390 raft_consensus.cc:2272] T 40f71093a3d7477c93130a982d6233f9 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.207608 21390 tablet_replica.cc:333] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.208544 21390 raft_consensus.cc:2243] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.215880 21390 raft_consensus.cc:2272] T 77ec411c33594ae08408279ef5c44410 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.221670 21390 tablet_replica.cc:333] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.223067 21390 raft_consensus.cc:2243] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.224498 21390 raft_consensus.cc:2272] T 39009bfe483947928e10122b4bb55ca6 P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.231581 21390 tablet_replica.cc:333] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.232684 21390 raft_consensus.cc:2243] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:39.235380 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:39.244472 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:39.250666 21390 raft_consensus.cc:2272] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.262027 21390 tablet_replica.cc:333] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.264712 21390 raft_consensus.cc:2243] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.282954 21390 raft_consensus.cc:2272] T 0328fc7e60424283b5d1ea734bd5136a P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.285863 21390 tablet_replica.cc:333] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.291157 21390 raft_consensus.cc:2243] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.292029 21390 raft_consensus.cc:2272] T a4afa4eec9774883a53b37419c20bbf4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.299680 21390 tablet_replica.cc:333] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.305606 21390 raft_consensus.cc:2243] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.306646 21390 raft_consensus.cc:2272] T 096694b658e343f384dc3c1f4e4c5dac P 6ca917eaada84bf38a5daae9f8ffa066 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.310103 21390 tablet_replica.cc:333] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.316994 21390 raft_consensus.cc:2243] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.317850 21390 raft_consensus.cc:2272] T d23ea829d43140beb6a88079029d865b P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.320874 21390 tablet_replica.cc:333] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.329519 21390 raft_consensus.cc:2243] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.329114 22395 catalog_manager.cc:5697] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 15 to 19, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 19 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.331220 21390 raft_consensus.cc:2272] T 603e708bc6b346ea93c1fb612030a16f P 6ca917eaada84bf38a5daae9f8ffa066 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.332572 22395 catalog_manager.cc:5697] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:39.334249 22395 catalog_manager.cc:5697] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 21 to 22, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 22 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:39.340482 21390 tablet_replica.cc:333] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.335743 22395 catalog_manager.cc:5697] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:39.341637 21390 raft_consensus.cc:2243] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.345753 21390 pending_rounds.cc:70] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:39.346163 21390 pending_rounds.cc:77] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 20 index: 16 } timestamp: 7305636344862732288 op_type: NO_OP noop_request { }
I20260709 13:10:39.346582 21390 raft_consensus.cc:2889] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:39.347018 21390 raft_consensus.cc:2272] T 21b9ab72464841aca55186beb0dbeb53 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.350140 21390 tablet_replica.cc:333] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.353575 21390 raft_consensus.cc:2243] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.354350 21390 raft_consensus.cc:2272] T b9c028af0e9e408792f2900ec24e194b P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.377311 21390 tablet_replica.cc:333] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
W20260709 13:10:39.377733 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:39.378379 21390 raft_consensus.cc:2243] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.379228 21390 raft_consensus.cc:2272] T be7264d3053b44989c5504d296ea482b P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.384582 22395 catalog_manager.cc:5697] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 24 to 25, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 25 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:39.387203 22395 catalog_manager.cc:5697] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:39.389410 22395 catalog_manager.cc:5697] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.387903 21390 tablet_replica.cc:333] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.403842 21390 raft_consensus.cc:2243] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.403179 22395 catalog_manager.cc:5697] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 16 to 18, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 18 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.404897 21390 raft_consensus.cc:2272] T 78833bb30a8347f19e5f2696aacc31e1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.406363 22395 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index -1 to 10, term changed from 13 to 15, NON_VOTER fa2f181263f446a6962b649f9348c15f (127.20.227.132) added. New cstate: current_term: 15 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } }
I20260709 13:10:39.408135 21390 tablet_replica.cc:333] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
W20260709 13:10:39.404922 22399 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 324) took 64817 ms (client timeout 15000 ms). Trace:
W20260709 13:10:39.410810 22399 rpcz_store.cc:269] 0709 13:09:34.587914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.622322 (+ 34408us) service_pool.cc:224] Handling call
0709 13:10:39.404647 (+64782325us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":48}
I20260709 13:10:39.422206 21390 raft_consensus.cc:2243] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.423326 21390 raft_consensus.cc:2272] T 9693f1d9b0aa4659842e296e4ccab6fb P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.408300 22395 catalog_manager.cc:5697] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 19 to 23, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 23 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.426512 22395 catalog_manager.cc:5697] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:39.428663 21390 tablet_replica.cc:333] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.435833 21390 raft_consensus.cc:2243] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.436625 21390 raft_consensus.cc:2272] T 6f5719028ca945b2b6c1a1f140b05146 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.428267 22395 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:39.439517 21390 tablet_replica.cc:333] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.440423 21390 raft_consensus.cc:2243] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.439936 22395 catalog_manager.cc:5697] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 18 to 22, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 22 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.441248 21390 pending_rounds.cc:70] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:39.446528 21390 pending_rounds.cc:77] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305636335938498560 op_type: NO_OP noop_request { }
I20260709 13:10:39.447331 21390 raft_consensus.cc:2889] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:39.452570 21390 raft_consensus.cc:2272] T 31de2edeb38841bfa9edd362c910f0f7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.457108 21390 tablet_replica.cc:333] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.441870 22395 catalog_manager.cc:5697] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 20 to 21, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 21 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:39.463078 22395 catalog_manager.cc:5697] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:39.464773 22395 catalog_manager.cc:5697] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:39.469643 22395 catalog_manager.cc:5697] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 16 to 21, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 21 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.476343 22395 catalog_manager.cc:5697] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 23 to 25, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 25 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.478611 22395 catalog_manager.cc:5697] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 23 to 24, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 24 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.480805 22395 catalog_manager.cc:5697] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 26 to 27, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 27 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.475275 21390 raft_consensus.cc:2243] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.482649 22395 catalog_manager.cc:5697] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 11 to 14, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 14 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.483462 21390 raft_consensus.cc:2272] T 360d81cdb43c4dd69ba77b3db56e94e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.484375 22395 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 15 to 17, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 17 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:39.488467 22395 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 15 to 19, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 19 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:39.500952 30582 raft_consensus.cc:493] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.501650 30582 raft_consensus.cc:515] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:39.509117 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:39.508773 30582 leader_election.cc:290] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:39.509644 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3feac7af5754b40a9c951d0a8e31413" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:39.515578 21390 tablet_replica.cc:333] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.521368 22468 leader_election.cc:304] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:39.523857 30582 raft_consensus.cc:2749] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:39.525269 21390 raft_consensus.cc:2243] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:10:39.522608 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:39.526918 21390 raft_consensus.cc:2272] T ddaffb6b139e4723bd2535c363e228ff P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.532024 21390 tablet_replica.cc:333] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.540237 21390 raft_consensus.cc:2243] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.541414 21390 raft_consensus.cc:2272] T a9239c6f95c54166b454ada0dd9c1b9b P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.547811 21390 tablet_replica.cc:333] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
W20260709 13:10:39.552193 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:39.565565 21390 raft_consensus.cc:2243] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.569739 21390 raft_consensus.cc:2272] T ec33ad69c4af4d379aff74ce15c85af7 P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.581149 21390 tablet_replica.cc:333] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.595985 21390 raft_consensus.cc:2243] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.598014 21390 raft_consensus.cc:2272] T ee0a982f0606460f93cc934c9319409d P 6ca917eaada84bf38a5daae9f8ffa066 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.624686 21390 tablet_replica.cc:333] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.628006 21390 raft_consensus.cc:2243] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.628743 21390 raft_consensus.cc:2272] T a14caf28740540799ba1c6db058346a1 P 6ca917eaada84bf38a5daae9f8ffa066 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.632184 21390 tablet_replica.cc:333] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.641928 30582 raft_consensus.cc:493] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.652557 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.652936 30582 raft_consensus.cc:515] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:39.655279 30582 leader_election.cc:290] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:39.657716 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:39.659370 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7bfa694a734e68806da48189a7e004" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:39.644012 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:39.661180 22468 leader_election.cc:304] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:39.633180 21390 raft_consensus.cc:2243] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.662518 21390 raft_consensus.cc:2272] T 0a60725e5550479db8d1e52b48126750 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.673007 30582 raft_consensus.cc:2749] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:39.718204 21390 tablet_replica.cc:333] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.719442 21390 raft_consensus.cc:2243] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.720276 21390 raft_consensus.cc:2272] T f0e2410740c9458db983018bbe19dcbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.721220 30484 raft_consensus.cc:493] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.722007 30484 raft_consensus.cc:515] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } }
I20260709 13:10:39.725597 30484 leader_election.cc:290] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:39.739281 21390 tablet_replica.cc:333] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.742019 21390 raft_consensus.cc:2243] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.742887 21390 raft_consensus.cc:2272] T 8852a51dd9a84948bed8ee87ae7a9f21 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.744560 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:39.752169 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:39.769212 21390 tablet_replica.cc:333] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
W20260709 13:10:39.777599 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 95577.4us
I20260709 13:10:39.784099 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5314aa61dd7f4a7f9b148f71ea5055c4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:39.785719 22468 leader_election.cc:304] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:39.786595 30484 raft_consensus.cc:2749] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:39.792805 21390 raft_consensus.cc:2243] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.797254 21390 raft_consensus.cc:2272] T 401fe414b8f443bebfed8254895d71c3 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.798686 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:39.801115 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:39.812422 21390 tablet_replica.cc:333] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.836166 30484 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.853376 30484 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:39.853880 21390 raft_consensus.cc:2243] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.854671 21390 raft_consensus.cc:2272] T acc46eb991824d25bde40d1001e04798 P 6ca917eaada84bf38a5daae9f8ffa066 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.855849 30484 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:39.857610 21390 tablet_replica.cc:333] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.858520 21390 raft_consensus.cc:2243] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.859337 21390 raft_consensus.cc:2272] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.860776 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:39.859234 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b8b09cbd5c4d81a0453f8ca6e8b7d4" candidate_uuid: "6ca917eaada84bf38a5daae9f8ffa066" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:39.866070 22468 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ca917eaada84bf38a5daae9f8ffa066; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:39.867277 30484 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:39.870875 22394 catalog_manager.cc:5697] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 19 to 20, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 20 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.896355 21390 tablet_replica.cc:333] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.907483 21390 raft_consensus.cc:2243] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.908506 21390 raft_consensus.cc:2272] T 34b4979f789f48d0807b87e7a48b9a78 P 6ca917eaada84bf38a5daae9f8ffa066 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.902276 22395 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 314) took 5957 ms. Trace:
I20260709 13:10:39.905301 22394 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 18 to 19, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 19 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.917013 22394 catalog_manager.cc:5697] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:39.915127 21390 tablet_replica.cc:333] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.925580 21390 raft_consensus.cc:2243] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.921386 22395 rpcz_store.cc:276] 0709 13:10:33.945260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.945481 (+   221us) service_pool.cc:224] Handling call
0709 13:10:39.902163 (+5956682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:39.572650 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:39.573427 (+   777us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:39.573466 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:10:39.573486 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:39.575342 (+  1856us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:39.575549 (+   207us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:39.575580 (+    31us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:10:39.625806 (+ 50226us) tablet.cc:701] Row locks acquired
0709 13:10:39.625829 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:10:39.625986 (+   157us) write_op.cc:270] Start()
0709 13:10:39.626110 (+   124us) write_op.cc:276] Timestamp: P: 1783602639625931 usec, L: 0
0709 13:10:39.626135 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:10:39.633125 (+  6990us) log.cc:844] Serialized 9212 byte log entry
0709 13:10:39.674906 (+ 41781us) op_driver.cc:464] REPLICATION: finished
0709 13:10:39.678620 (+  3714us) write_op.cc:301] APPLY: starting
0709 13:10:39.678712 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:39.750571 (+ 71859us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:39.750693 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:39.814916 (+ 64223us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:39.815499 (+   583us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:10:39.815552 (+    53us) write_op.cc:312] APPLY: finished
0709 13:10:39.816046 (+   494us) log.cc:844] Serialized 204 byte log entry
0709 13:10:39.816909 (+   863us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:39.817132 (+   223us) write_op.cc:454] Released schema lock
0709 13:10:39.817203 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:39.819041 (+  1838us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:39.819070 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1277873,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":3461,"apply.run_cpu_time_us":29564,"apply.run_wall_time_us":140374,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100359,"num_ops":23,"prepare.queue_time_us":51767,"prepare.run_cpu_time_us":6542,"prepare.run_wall_time_us":60860,"replication_time_us":48627,"thread_start_us":53347,"threads_started":2}]]}
I20260709 13:10:39.937366 21390 raft_consensus.cc:2272] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.944037 21390 tablet_replica.cc:333] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.944948 21390 raft_consensus.cc:2243] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.945734 21390 pending_rounds.cc:70] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:39.945966 21390 pending_rounds.cc:77] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 25 index: 15 } timestamp: 7305636360530259968 op_type: NO_OP noop_request { }
I20260709 13:10:39.946338 21390 raft_consensus.cc:2889] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:39.946691 21390 raft_consensus.cc:2272] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.963692 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:39.965489 21390 tablet_replica.cc:333] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.966437 21390 raft_consensus.cc:2243] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.967154 21390 raft_consensus.cc:2272] T acc845449beb4f859e55185200f34bd2 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.969903 21390 tablet_replica.cc:333] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.970729 21390 raft_consensus.cc:2243] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.985302 21390 pending_rounds.cc:70] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:39.985597 21390 pending_rounds.cc:77] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 19 index: 12 } timestamp: 7305636365849911296 op_type: NO_OP noop_request { }
I20260709 13:10:39.985966 21390 raft_consensus.cc:2889] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:39.986327 21390 raft_consensus.cc:2272] T f6c34f1ef8704ce29f9df924d306bc42 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.988238 22394 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 195) took 9562 ms. Trace:
I20260709 13:10:39.988967 21390 tablet_replica.cc:333] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:39.995102 21390 raft_consensus.cc:2243] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.995827 21390 pending_rounds.cc:70] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:39.996084 21390 pending_rounds.cc:77] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305636372408143872 op_type: NO_OP noop_request { }
I20260709 13:10:39.996459 21390 raft_consensus.cc:2889] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:39.991466 22396 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.999210 22396 catalog_manager.cc:5697] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.991619 22394 rpcz_store.cc:276] 0709 13:10:30.425986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.426404 (+   418us) service_pool.cc:224] Handling call
0709 13:10:39.988166 (+9561762us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:39.921526 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:39.922122 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:39.922159 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:10:39.922176 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:39.922673 (+   497us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:39.922732 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:39.922757 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:39.923076 (+   319us) tablet.cc:701] Row locks acquired
0709 13:10:39.923094 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:39.923226 (+   132us) write_op.cc:270] Start()
0709 13:10:39.923353 (+   127us) write_op.cc:276] Timestamp: P: 1783602639923182 usec, L: 0
0709 13:10:39.923374 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:10:39.928563 (+  5189us) log.cc:844] Serialized 1311 byte log entry
0709 13:10:39.929475 (+   912us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26264571 00007fec262f6e28 00007fec29d31581 00007fec29d30d58 00007fec29d359f1 00007fec29d359a9 00007fec29d35939 00007fec29d35901 00007fec29d34b2d 000000000038f354 000000000038f199
0709 13:10:39.931781 (+  2306us) op_driver.cc:464] REPLICATION: finished
0709 13:10:39.932220 (+   439us) write_op.cc:301] APPLY: starting
0709 13:10:39.932300 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:39.934420 (+  2120us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:39.934450 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:39.937559 (+  3109us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:39.937722 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:10:39.937771 (+    49us) write_op.cc:312] APPLY: finished
0709 13:10:39.937986 (+   215us) log.cc:844] Serialized 41 byte log entry
0709 13:10:39.938867 (+   881us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:39.938959 (+    92us) write_op.cc:454] Released schema lock
0709 13:10:39.939006 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:39.939393 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:39.939446 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111492,"reported_tablets":34,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":221,"apply.run_cpu_time_us":5752,"apply.run_wall_time_us":7117,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12552,"num_ops":3,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":3723,"prepare.run_wall_time_us":8128,"replication_time_us":8251,"spinlock_wait_cycles":10390400}]]}
I20260709 13:10:39.996824 21390 raft_consensus.cc:2272] T 33d734b2b43a40138a8a0ee22b30d9ba P 6ca917eaada84bf38a5daae9f8ffa066 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.018196 22396 catalog_manager.cc:5697] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 16 to 25, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 25 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:40.024322 22396 catalog_manager.cc:5697] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 16 to 19, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 19 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.036602 22396 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 17 to 21, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 21 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.039219 22396 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 19, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 19 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.042251 21390 tablet_replica.cc:333] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:40.043215 21390 raft_consensus.cc:2243] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.043941 21390 pending_rounds.cc:70] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:40.044184 21390 pending_rounds.cc:77] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 17 index: 15 } timestamp: 7305636367742828544 op_type: NO_OP noop_request { }
I20260709 13:10:40.044623 21390 raft_consensus.cc:2889] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:40.045011 21390 raft_consensus.cc:2272] T 90227a385eee486dbc981f55629940e4 P 6ca917eaada84bf38a5daae9f8ffa066 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.047654 21390 tablet_replica.cc:333] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:40.048475 21390 raft_consensus.cc:2243] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.057440 22396 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 21 to 23, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 23 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.060166 22396 catalog_manager.cc:5697] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 20, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.062261 22396 catalog_manager.cc:5697] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.065438 21390 raft_consensus.cc:2272] T 3eac3c624e2c43fc9505fe5c344151d0 P 6ca917eaada84bf38a5daae9f8ffa066 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.074950 21390 tablet_replica.cc:333] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:40.075738 21390 raft_consensus.cc:2243] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:40.082041 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:40.085160 21390 raft_consensus.cc:2272] T d3feac7af5754b40a9c951d0a8e31413 P 6ca917eaada84bf38a5daae9f8ffa066 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.088155 21390 tablet_replica.cc:333] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:40.063935 22396 catalog_manager.cc:5697] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 16 to 20, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.095253 22396 catalog_manager.cc:5697] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 19 to 21, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 21 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:40.104970 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:40.106007 22396 catalog_manager.cc:5697] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 16 to 18, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 18 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.108458 22396 catalog_manager.cc:5697] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 17 to 19, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 19 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.110459 22396 catalog_manager.cc:5697] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.105075 21390 raft_consensus.cc:2243] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.113502 21390 pending_rounds.cc:70] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Trying to abort 1 pending ops.
I20260709 13:10:40.113799 21390 pending_rounds.cc:77] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066: Aborting op as it isn't in flight: id { term: 20 index: 11 } timestamp: 7305636368840724480 op_type: NO_OP noop_request { }
I20260709 13:10:40.114180 21390 raft_consensus.cc:2889] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:40.114573 21390 raft_consensus.cc:2272] T 0498259251e24450b91d38bfc4b83dbf P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.117754 21390 tablet_replica.cc:333] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066: stopping tablet replica
I20260709 13:10:40.118498 21390 raft_consensus.cc:2243] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.119199 21390 raft_consensus.cc:2272] T ea7bfa694a734e68806da48189a7e004 P 6ca917eaada84bf38a5daae9f8ffa066 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.112106 22396 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.146436 22396 catalog_manager.cc:5697] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.148191 22396 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 18 to 21, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 21 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:40.174360 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:40.229004 30686 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.229743 30686 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:40.236565 22619 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.237785 30686 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:40.240777 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:40.245705 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:40.246922 30387 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:40.320063 30601 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.321830 30601 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.331205 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:40.335004 23229 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.335659 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:40.336602 30680 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:40.340320 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:40.341674 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.342259 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:40.345757 30601 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:40.365401 22394 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 25 to 28, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 28 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.368232 22394 catalog_manager.cc:5697] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 24 to 27, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 27 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.370729 22394 catalog_manager.cc:5697] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 13 to 16, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 16 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:40.403367 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:40.464570 22394 catalog_manager.cc:5697] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: config changed from index 10 to 12, fa2f181263f446a6962b649f9348c15f (127.20.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.473915 22396 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37530 (request call id 327) took 3663 ms. Trace:
I20260709 13:10:40.474663 22396 rpcz_store.cc:276] 0709 13:10:36.809969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.810184 (+   215us) service_pool.cc:224] Handling call
0709 13:10:37.215711 (+405527us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b54003a25d4. stack: 00007fec231dc343 00007fec231dc240 00007fec22b6b1d4 00007fec2c8a9304 00007fec2c8a9299 00007fec26265090 00007fec26303f3a 00007fec2c0ba1cc 00007fec2c1b837e 00007fec2a6792a4 00007fec2a679232 00007fec2a679161 00007fec2a6790dc 00007fec2a678392 00007fec2463648c 00007fec246358c6
0709 13:10:40.473576 (+3257865us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:40.171367 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:40.171887 (+   520us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:40.171923 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:10:40.171938 (+    15us) tablet.cc:662] Decoding operations
0709 13:10:40.173385 (+  1447us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:40.173452 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:40.173478 (+    26us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:10:40.174733 (+  1255us) tablet.cc:701] Row locks acquired
0709 13:10:40.174754 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:40.174901 (+   147us) write_op.cc:270] Start()
0709 13:10:40.175046 (+   145us) write_op.cc:276] Timestamp: P: 1783602640174860 usec, L: 0
0709 13:10:40.175069 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:40.175798 (+   729us) log.cc:844] Serialized 6751 byte log entry
0709 13:10:40.185633 (+  9835us) op_driver.cc:464] REPLICATION: finished
0709 13:10:40.186825 (+  1192us) write_op.cc:301] APPLY: starting
0709 13:10:40.186915 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:40.202446 (+ 15531us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:40.202563 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:40.277882 (+ 75319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:40.301202 (+ 23320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:10:40.301266 (+    64us) write_op.cc:312] APPLY: finished
0709 13:10:40.301707 (+   441us) log.cc:844] Serialized 156 byte log entry
0709 13:10:40.302612 (+   905us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:40.302941 (+   329us) write_op.cc:454] Released schema lock
0709 13:10:40.303011 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:40.312703 (+  9692us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:40.312739 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":145441,"reported_tablets":48,"spinlock_wait_cycles":60286208,"child_traces":[["op",{"apply.queue_time_us":986,"apply.run_cpu_time_us":29496,"apply.run_wall_time_us":125843,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71128,"num_ops":17,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":4728,"prepare.run_wall_time_us":12371,"replication_time_us":10344}]]}
W20260709 13:10:40.520318 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:40.524528 30520 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.525676 30520 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:40.537830 30679 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.538760 30679 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.507275 22394 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 21 to 24, leader changed from 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 24 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
I20260709 13:10:40.546535 22394 catalog_manager.cc:5697] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 22 to 26, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 26 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.553481 30520 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:40.555666 30679 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:40.562594 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:40.569631 23263 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 15.
I20260709 13:10:40.576412 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:40.593629 30690 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.594645 30690 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.597828 30690 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:40.601092 22394 catalog_manager.cc:5697] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 17 to 22, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 22 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:40.607497 22619 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.604285 22394 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 15 to 16, leader changed from fa2f181263f446a6962b649f9348c15f (127.20.227.132) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 16 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.615895 22394 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
I20260709 13:10:40.618351 22394 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 20 to 23, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129). New cstate: current_term: 23 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:40.620543 22544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 47221.8us
I20260709 13:10:40.622125 30689 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:40.624506 30689 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.625197 30689 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:40.630487 22394 catalog_manager.cc:5697] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.638466 22650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:40.639812 22650 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
I20260709 13:10:40.636149 22394 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "6ca917eaada84bf38a5daae9f8ffa066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } }
W20260709 13:10:40.645666 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:40.670166 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:40.670913 23229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58145.7us
W20260709 13:10:40.653506 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:40.675474 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:40.678843 30691 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.679868 30691 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.682775 30691 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:40.683090 30601 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.682809 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
W20260709 13:10:40.688045 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:40.697276 30680 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.698150 30680 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.699591 30520 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.700189 30520 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:40.702693 30679 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:40.703179 30679 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.703755 30679 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:40.709019 22545 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.716339 30680 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:40.703251 30520 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:40.684496 30601 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.717051 30680 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.749977 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:40.750785 22647 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 19.
W20260709 13:10:40.742786 23229 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.745474 30688 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:10:40.763324 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 80761.4us
I20260709 13:10:40.769894 22618 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:40.773974 30690 raft_consensus.cc:2749] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:40.762512 30688 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:40.748986 30680 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:40.781332 22545 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.791764 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:40.800729 23229 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.801245 23263 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 19.
W20260709 13:10:40.802707 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:40.802963 30694 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:10:40.786944 22619 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:40.803406 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:40.809032 22545 consensus_peers.cc:597] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.812816 22545 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.777220 30601 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:40.784672 30689 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.821152 30387 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.822335 30387 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:40.825268 30694 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.830009 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:40.835362 30680 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:40.835695 30689 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:40.804666 30690 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
W20260709 13:10:40.837138 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 46031.1us
I20260709 13:10:40.837598 30690 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:40.842355 23229 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.842504 30695 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.843226 30695 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.842389 30690 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:40.845335 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:40.843781 22647 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:40.849691 23263 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 19.
I20260709 13:10:40.838639 30694 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:40.856825 30387 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:40.860715 30688 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:40.866531 30695 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:40.870322 23229 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:40.882711 22545 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:40.874676 22618 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:40.891343 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:40.893452 30689 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:40.893952 30689 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.894661 30689 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:40.870607 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:40.901428 22545 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:40.905521 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:40.913729 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 75806.1us
I20260709 13:10:40.915248 30698 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:40.915789 30698 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.916239 30698 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:40.918411 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
W20260709 13:10:40.919952 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 45603.8us
I20260709 13:10:40.922895 30686 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:40.923460 30686 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.923916 30686 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:40.925645 30702 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:40.928131 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:40.928064 30702 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.929121 22647 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 16.
I20260709 13:10:40.930285 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39009bfe483947928e10122b4bb55ca6" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:40.930951 23263 raft_consensus.cc:3060] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:40.931635 30702 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:40.932265 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:40.949597 22646 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 27.
I20260709 13:10:40.904132 30679 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:40.944169 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:40.950831 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:40.951226 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:40.951574 22576 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:40.952013 22577 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:40.951538 23256 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 27.
I20260709 13:10:40.954949 30679 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:40.980067 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:40.980896 22646 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 23.
I20260709 13:10:40.983623 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f71093a3d7477c93130a982d6233f9" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:40.984272 22646 raft_consensus.cc:3060] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:40.990899 23263 raft_consensus.cc:2468] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 16.
I20260709 13:10:40.993908 22544 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:40.994928 30694 raft_consensus.cc:2804] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:40.994685 30689 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:40.995589 30694 raft_consensus.cc:697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:40.996074 22574 raft_consensus.cc:2393] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:40.997188 30694 consensus_queue.cc:237] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.001029 22646 raft_consensus.cc:2468] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 25.
I20260709 13:10:41.002619 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.004338 30695 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:41.004796 30695 raft_consensus.cc:493] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.005228 30695 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.005151 22618 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:41.006213 30387 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:10:41.006816 30387 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.007279 30387 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:41.018577 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:41.003612 22619 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.022275 30387 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.022634 22543 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.027344 23227 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.029120 30700 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:10:41.029942 30700 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.030632 30700 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:10:41.030056 30693 raft_consensus.cc:3060] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:41.034174 30696 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:41.033923 30686 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.034657 30696 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.035274 30696 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:41.038398 30689 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:41.040477 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d81cdb43c4dd69ba77b3db56e94e4" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
W20260709 13:10:41.043008 22545 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.045001 30693 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:41.044725 30698 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.045168 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.046440 30679 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:41.046854 30679 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.047287 30679 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:41.053241 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.054858 30704 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:41.055325 30704 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.055706 30704 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:41.056108 30679 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:41.057725 22543 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:41.058594 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:41.066011 23263 raft_consensus.cc:2468] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 20.
I20260709 13:10:41.071902 30691 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:41.072404 30691 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.072824 30691 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:41.078879 30387 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 28 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:41.063092 30689 raft_consensus.cc:2804] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:10:41.091315 22619 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.092082 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:41.101881 23261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:41.066712 30686 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:41.113201 23256 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 20: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:41.069697 30679 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:41.113400 22545 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:41.134653 22545 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.113184 30700 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.142513 23261 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 28: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:41.143463 30700 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:41.145164 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:41.146057 22646 raft_consensus.cc:2393] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 28: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:41.116837 30689 raft_consensus.cc:697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 25 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:41.144608 30704 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:41.205538 30695 raft_consensus.cc:515] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:41.207034 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 57671.3us
I20260709 13:10:41.207868 30695 leader_election.cc:290] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:41.208493 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 130433us
I20260709 13:10:41.211364 30696 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:41.211644 30691 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:41.213748 30699 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.216632 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9239c6f95c54166b454ada0dd9c1b9b" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:41.235769 22647 raft_consensus.cc:3060] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.235730 30699 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.238361 30699 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:41.217314 30698 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:41.220685 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:41.239555 22646 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 24: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:41.224929 30689 consensus_queue.cc:237] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:41.229513 22544 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.233053 22648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:41.244529 22648 raft_consensus.cc:2393] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 20: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:41.245328 30523 raft_consensus.cc:2804] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:41.233526 30704 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:41.245756 30696 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:41.247833 30691 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:41.247857 30523 raft_consensus.cc:697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:41.249351 30523 consensus_queue.cc:237] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.244648 22647 raft_consensus.cc:2468] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 17.
I20260709 13:10:41.260027 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:41.261098 22574 raft_consensus.cc:2393] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 24: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
I20260709 13:10:41.263892 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:41.264748 22577 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 24: Already voted for candidate 691cccbd0258483ebe19e1581674cc94 in this term.
W20260709 13:10:41.277352 23229 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:41.278255 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:41.278890 23229 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.279314 23229 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.297372 30693 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 13:10:41.300231 23229 leader_election.cc:336] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.305364 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:41.306444 22645 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 24: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:41.312963 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.313210 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:41.313158 23229 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.319989 30693 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:10:41.327641 22619 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:41.332568 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:41.333950 22619 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.334648 22619 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:41.335819 30702 raft_consensus.cc:2749] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 13:10:41.336889 22619 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.337383 22619 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 6ca917eaada84bf38a5daae9f8ffa066, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:41.338136 30691 raft_consensus.cc:2749] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:41.320540 23227 leader_election.cc:304] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.341665 30693 raft_consensus.cc:2804] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:41.342212 30693 raft_consensus.cc:697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:41.343202 30693 consensus_queue.cc:237] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.353143 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:41.353432 22545 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:41.386149 30680 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:10:41.386333 22545 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:41.387822 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.356213 22470 connection.cc:466] server connection from 127.0.0.1:59520 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59520 (request call id 4595) could send its response
I20260709 13:10:41.390388 30679 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:10:41.392372 22619 connection.cc:573] client connection to 127.20.227.129:38445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:41.393774 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:41.394410 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.395056 22619 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:10:41.395536 22619 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.396538 30691 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:10:41.400916 22545 connection.cc:769] client connection to 127.20.227.129:38445 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:10:41.413022 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:41.413895 22619 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:10:41.414479 22619 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:41.416152 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:41.416774 30691 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:41.427675 22394 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37546 (request call id 315) took 1347 ms. Trace:
W20260709 13:10:41.450407 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.451048 22545 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:41.458729 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.459574 30523 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:41.452245 30691 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.463388 30691 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.467487 30691 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:41.428125 22394 rpcz_store.cc:276] 0709 13:10:40.080012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.080175 (+   163us) service_pool.cc:224] Handling call
0709 13:10:41.427577 (+1347402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:40.856342 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:40.857145 (+   803us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:40.857195 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:10:40.857214 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:40.858574 (+  1360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:40.858671 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:40.858711 (+    40us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:10:40.860124 (+  1413us) tablet.cc:701] Row locks acquired
0709 13:10:40.860175 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:10:40.860342 (+   167us) write_op.cc:270] Start()
0709 13:10:40.860511 (+   169us) write_op.cc:276] Timestamp: P: 1783602640860277 usec, L: 0
0709 13:10:40.860553 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:10:40.861951 (+  1398us) log.cc:844] Serialized 4875 byte log entry
0709 13:10:41.025727 (+163776us) op_driver.cc:464] REPLICATION: finished
0709 13:10:41.087982 (+ 62255us) write_op.cc:301] APPLY: starting
0709 13:10:41.088127 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:41.150305 (+ 62178us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:41.225553 (+ 75248us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:41.310594 (+ 85041us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:41.311300 (+   706us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:10:41.311567 (+   267us) write_op.cc:312] APPLY: finished
0709 13:10:41.317238 (+  5671us) log.cc:844] Serialized 113 byte log entry
0709 13:10:41.318131 (+   893us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:41.318272 (+   141us) write_op.cc:454] Released schema lock
0709 13:10:41.318344 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:41.322651 (+  4307us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:41.322698 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":113043,"reported_tablets":33,"spinlock_wait_cycles":13696,"child_traces":[["op",{"apply.queue_time_us":61959,"apply.run_cpu_time_us":25568,"apply.run_wall_time_us":234667,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54335,"num_ops":12,"prepare.queue_time_us":147339,"prepare.run_cpu_time_us":5732,"prepare.run_wall_time_us":25097,"replication_time_us":164899,"thread_start_us":137194,"threads_started":2}]]}
I20260709 13:10:41.478914 22395 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44600 (request call id 196) took 1271 ms. Trace:
I20260709 13:10:41.479540 22395 rpcz_store.cc:276] 0709 13:10:40.207713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.207880 (+   167us) service_pool.cc:224] Handling call
0709 13:10:41.478732 (+1270852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41264,"reported_tablets":28}
W20260709 13:10:41.497545 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:41.498104 22619 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:41.513574 23264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:41.514370 23264 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 28.
I20260709 13:10:41.518982 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:41.520334 30691 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:10:41.520772 30691 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Starting leader election (detected failure of leader 6ca917eaada84bf38a5daae9f8ffa066)
I20260709 13:10:41.521195 30691 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:10:41.544844 22395 catalog_manager.cc:5697] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 24 to 25, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 25 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.556757 23264 raft_consensus.cc:1275] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:41.558706 30679 consensus_queue.cc:1048] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:41.556221 22395 catalog_manager.cc:5697] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 19 to 20, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 20 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.565407 22395 catalog_manager.cc:5697] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 15 to 16, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 16 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.576537 22394 catalog_manager.cc:5697] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 16 to 17, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 17 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.576651 30691 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:41.592602 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bdeb956cf4c76aa244c0f5bbc89c2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:41.593287 23257 raft_consensus.cc:3060] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:10:41.594251 30691 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 29 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:41.602147 23257 raft_consensus.cc:2468] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 29.
I20260709 13:10:41.604056 22618 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:41.605180 30702 raft_consensus.cc:2804] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:10:41.605757 30702 raft_consensus.cc:697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:41.606760 30702 consensus_queue.cc:237] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:41.612329 22545 consensus_peers.cc:597] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.687826 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:41.693058 23257 raft_consensus.cc:1275] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:41.701331 30523 consensus_queue.cc:1048] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:41.731127 22646 raft_consensus.cc:1275] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:41.735925 30693 consensus_queue.cc:1048] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
W20260709 13:10:41.775858 22619 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:41.828845 22396 catalog_manager.cc:5697] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 28 to 29, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 29 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:41.850783 22545 consensus_peers.cc:597] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.853736 22646 raft_consensus.cc:1275] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:10:41.861928 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.867954 22545 consensus_peers.cc:597] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.881213 30523 consensus_queue.cc:1048] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:10:41.899334 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.922307 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.056078 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 95797.1us
W20260709 13:10:42.070160 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.070778 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.083050 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.083760 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.151119 22619 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:42.151686 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.193925 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.217628 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:42.246076 23257 raft_consensus.cc:1275] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:10:42.247500 30711 consensus_queue.cc:1048] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:10:42.409319 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.419440 21390 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22526)
W20260709 13:10:42.499939 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.546233 22545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111) [suppressed 413 similar messages]
W20260709 13:10:42.547469 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.577648 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.631076 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.634047 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:42.781548 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:42.865382 30693 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.865998 30693 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:42.868310 30693 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:42.877714 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:42.878799 22645 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 28.
W20260709 13:10:42.879848 23229 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:42.880587 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:42.881976 30680 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:10:42.882386 30680 raft_consensus.cc:493] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.882726 30680 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:10:42.890236 30680 raft_consensus.cc:515] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:42.897799 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec33ad69c4af4d379aff74ce15c85af7" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:42.898577 22645 raft_consensus.cc:3060] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:10:42.903311 23229 leader_election.cc:336] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:42.905041 30680 leader_election.cc:290] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:42.906975 22645 raft_consensus.cc:2468] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 29.
I20260709 13:10:42.910730 23227 leader_election.cc:304] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:42.912217 30680 raft_consensus.cc:2804] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:10:42.912786 30680 raft_consensus.cc:697] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 29 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:42.913856 30680 consensus_queue.cc:237] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:42.925271 30734 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.925901 30734 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:42.928189 30734 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:42.932574 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:42.933364 22645 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 20.
I20260709 13:10:42.934652 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:42.938277 30734 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:42.938721 30734 raft_consensus.cc:493] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.939077 30734 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:42.946274 30523 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.946866 30523 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:42.965138 30523 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:42.968340 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:42.970633 22645 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 24.
W20260709 13:10:42.979724 23229 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:43.000999 22394 catalog_manager.cc:5697] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 27 to 29, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 29 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.980268 30734 raft_consensus.cc:515] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:43.021447 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 51326.1us
I20260709 13:10:43.038630 30734 leader_election.cc:290] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:43.040055 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b79bbacdb324d378e564aba36fc4014" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:43.040747 22645 raft_consensus.cc:3060] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:43.043788 23229 leader_election.cc:336] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:43.057862 22645 raft_consensus.cc:2468] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 21.
I20260709 13:10:43.059116 23227 leader_election.cc:304] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:43.060406 30742 raft_consensus.cc:2804] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:43.062583 30742 raft_consensus.cc:697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:43.064121 30742 consensus_queue.cc:237] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:43.106196 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:43.088737 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 114932us
I20260709 13:10:43.114780 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:43.116353 30696 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:43.116816 30696 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.117204 30696 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:43.139405 30696 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:43.142715 30696 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:43.167896 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.168427 22545 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:43.169333 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:43.169756 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.170148 22545 consensus_peers.cc:597] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:43.170514 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:43.176461 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaffb6b139e4723bd2535c363e228ff" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:43.177171 22645 raft_consensus.cc:3060] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:43.182597 22645 raft_consensus.cc:2468] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691cccbd0258483ebe19e1581674cc94 in term 25.
I20260709 13:10:43.189011 30696 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.189553 30696 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:43.195595 22545 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:43.199321 22543 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:43.205893 30523 raft_consensus.cc:2804] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:43.206458 30523 raft_consensus.cc:697] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 25 LEADER]: Becoming Leader. State: Replica: 691cccbd0258483ebe19e1581674cc94, State: Running, Role: LEADER
I20260709 13:10:43.207604 30523 consensus_queue.cc:237] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:43.213521 30696 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:43.217650 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:43.223282 30731 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.223913 30731 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:43.232348 30731 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:43.235704 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94" is_pre_election: true
I20260709 13:10:43.236428 22574 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:43.238830 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:43.241930 30738 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:43.242614 30738 raft_consensus.cc:493] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.242977 30738 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:43.253432 22619 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:43.264969 22394 catalog_manager.cc:5697] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 19 to 21, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 21 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.268106 22645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "691cccbd0258483ebe19e1581674cc94" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:43.270200 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:43.273406 30738 raft_consensus.cc:515] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:43.283910 22396 catalog_manager.cc:5697] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 reported cstate change: term changed from 23 to 25, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 691cccbd0258483ebe19e1581674cc94 (127.20.227.130). New cstate: current_term: 25 leader_uuid: "691cccbd0258483ebe19e1581674cc94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.302855 22645 raft_consensus.cc:2393] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691cccbd0258483ebe19e1581674cc94 in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
I20260709 13:10:43.307585 22574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0328fc7e60424283b5d1ea734bd5136a" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "691cccbd0258483ebe19e1581674cc94"
I20260709 13:10:43.308267 22574 raft_consensus.cc:3060] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:43.317075 30738 leader_election.cc:290] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:43.317193 22574 raft_consensus.cc:2468] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:43.321190 22617 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94; no voters: 
I20260709 13:10:43.322132 30702 raft_consensus.cc:2804] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:43.342834 30702 raft_consensus.cc:697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:43.343842 30702 consensus_queue.cc:237] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:43.341972 22545 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:43.349524 22545 leader_election.cc:304] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691cccbd0258483ebe19e1581674cc94; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:43.350324 30748 raft_consensus.cc:2749] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:43.350759 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.352303 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:43.366250 22619 leader_election.cc:336] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:43.379742 22396 catalog_manager.cc:5697] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 23 to 25, leader changed from 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 25 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:43.407171 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:43.407882 23229 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:43.420025 21390 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22526)
I20260709 13:10:43.474556 22645 raft_consensus.cc:1275] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:10:43.482040 30734 consensus_queue.cc:1048] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:10:43.522758 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.528648 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:43.575644 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.585043 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:43.606344 22646 raft_consensus.cc:1275] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:43.608634 30742 consensus_queue.cc:1048] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
W20260709 13:10:43.618166 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:43.689909 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:43.715449 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:43.758301 22648 raft_consensus.cc:1275] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Refusing update from remote peer 691cccbd0258483ebe19e1581674cc94: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:10:43.773010 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 78948.5us
W20260709 13:10:43.822772 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:43.775357 30696 consensus_queue.cc:1048] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
W20260709 13:10:43.871784 22545 consensus_peers.cc:597] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:43.872634 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 87992.8us
W20260709 13:10:43.875864 22617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 91513us
W20260709 13:10:43.877126 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50835.3us
W20260709 13:10:43.901428 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:43.921018 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:43.957515 22619 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:43.983856 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:43.993753 22576 raft_consensus.cc:1275] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:10:44.025096 30768 consensus_queue.cc:1048] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:44.039710 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:44.085441 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.207744 22545 consensus_peers.cc:597] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.287739 22545 consensus_peers.cc:597] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.330902 22545 consensus_peers.cc:597] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.421785 21390 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22526)
W20260709 13:10:44.427628 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.497829 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.645352 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.654364 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.671094 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.704700 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.715059 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.835064 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:44.837106 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.930760 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.938627 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.943939 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:44.953114 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.014640 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.054888 22619 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:45.197964 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.217592 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.372828 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.378013 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.422345 21390 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22526)
W20260709 13:10:45.484375 22545 consensus_peers.cc:597] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:45.491744 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.548044 22545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56360.1us
W20260709 13:10:45.587636 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.643947 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.704192 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:45.723116 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:45.754649 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 47224.6us
W20260709 13:10:45.784238 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:45.796072 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:45.969117 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:45.950773 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:45.977180 23229 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:45.993626 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:45.991041 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.071877 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:46.164825 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:46.190388 22545 consensus_peers.cc:597] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:46.358685 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.374964 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.381701 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:46.419929 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.423388 21390 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22526)
W20260709 13:10:46.444073 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:46.463614 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:46.550282 22619 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:46.624522 22545 consensus_peers.cc:597] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.650177 22545 consensus_peers.cc:597] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.676342 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.717597 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:46.781035 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:46.836189 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:46.931093 22545 consensus_peers.cc:597] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.075397 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.173121 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.204813 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.215130 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:47.244330 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.264259 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.276705 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:47.363930 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.390138 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.423878 21390 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22526)
W20260709 13:10:47.471115 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.498174 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.517445 22619 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.546882 22545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111) [suppressed 477 similar messages]
W20260709 13:10:47.563395 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.681828 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 71232.9us
W20260709 13:10:47.727244 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.737823 22543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 45338.5us
W20260709 13:10:47.738263 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.801425 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.845597 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.873282 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:47.876945 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:48.022436 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:48.031262 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:48.104331 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:48.204521 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:48.219499 22545 consensus_peers.cc:597] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:48.228513 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:48.335791 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:35857, user_credentials={real_user=slave}} blocked reactor thread for 49197.2us
W20260709 13:10:48.389787 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:48.424373 21390 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22526)
W20260709 13:10:48.455080 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:48.460099 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:48.479367 23229 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.505337 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:48.556926 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:48.603966 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.660085 22545 consensus_peers.cc:597] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.717216 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:48.717717 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:48.820254 22618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:42571, user_credentials={real_user=slave}} blocked reactor thread for 73222.6us
W20260709 13:10:48.870780 22619 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.901367 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:49.017154 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:49.029942 22545 consensus_peers.cc:597] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.044041 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:49.424968 21390 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22526)
W20260709 13:10:49.686391 22601 debug-util.cc:398] Leaking SignalData structure 0x7b0800392f60 after lost signal to thread 21393
W20260709 13:10:49.687803 22601 debug-util.cc:398] Leaking SignalData structure 0x7b08003516a0 after lost signal to thread 22437
W20260709 13:10:49.703493 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:49.730654 22601 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5360 after lost signal to thread 22604
W20260709 13:10:49.732391 22601 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9b00 after lost signal to thread 22678
W20260709 13:10:49.734583 22601 debug-util.cc:398] Leaking SignalData structure 0x7b08002f00a0 after lost signal to thread 23288
W20260709 13:10:49.768957 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.894819 22545 consensus_peers.cc:597] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.900252 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:49.900976 22545 consensus_peers.cc:597] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.905380 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63695.9us
W20260709 13:10:49.910969 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:49.919293 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:49.929173 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:49.930320 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:49.986708 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.021893 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.030112 22619 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.030794 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.102157 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.123636 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:50.156265 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.184406 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:50.213883 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3c60 after lost signal to thread 21393
W20260709 13:10:50.215085 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfc00 after lost signal to thread 22437
W20260709 13:10:50.216447 22675 debug-util.cc:398] Leaking SignalData structure 0x7b08001164a0 after lost signal to thread 22604
W20260709 13:10:50.218405 22675 debug-util.cc:398] Leaking SignalData structure 0x7b0800081880 after lost signal to thread 22678
W20260709 13:10:50.219769 22675 debug-util.cc:398] Leaking SignalData structure 0x7b080023a840 after lost signal to thread 23288
W20260709 13:10:50.241482 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.348117 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.364566 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.391673 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.465791 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.763089 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.817237 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.927663 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.936415 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:50.937131 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:50.953575 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:50.976508 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:51.137789 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:51.211941 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:51.220198 23229 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:51.227396 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:51.261176 22545 consensus_peers.cc:597] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:51.322033 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:51.346990 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:51.391178 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:51.400417 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:51.468758 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:51.715463 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:51.725858 22619 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:51.759868 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:51.828472 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:51.849294 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:51.858045 22545 consensus_peers.cc:597] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:51.894505 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:51.910907 22545 consensus_peers.cc:597] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:51.967370 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:52.060007 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.074631 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:52.075927 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.098203 22545 consensus_peers.cc:597] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.185259 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.257963 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:52.362277 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:52.447062 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.441360 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.522445 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:52.659416 23229 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111) [suppressed 425 similar messages]
W20260709 13:10:52.696363 22619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 235256us
W20260709 13:10:52.735476 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:52.738715 22619 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.740016 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.741546 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.804908 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.823349 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.835522 22545 consensus_peers.cc:597] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.855674 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.879827 22545 consensus_peers.cc:597] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.894263 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.928987 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:52.960435 22545 consensus_peers.cc:597] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:53.182977 22545 consensus_peers.cc:597] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:53.188175 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:53.239126 22545 consensus_peers.cc:597] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:53.344095 22545 consensus_peers.cc:597] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:53.426293 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:53.449005 22545 consensus_peers.cc:597] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:53.490099 22545 consensus_peers.cc:597] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:53.541676 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800176600 after lost signal to thread 21393
W20260709 13:10:53.542927 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4860 after lost signal to thread 22437
W20260709 13:10:53.544342 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08003134e0 after lost signal to thread 22604
W20260709 13:10:53.545563 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08002407e0 after lost signal to thread 22678
W20260709 13:10:53.546876 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800364f20 after lost signal to thread 23288
W20260709 13:10:53.564507 22545 consensus_peers.cc:597] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:53.622393 23229 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.794566 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:53.822593 22545 consensus_peers.cc:597] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:53.853307 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:53.889714 22545 consensus_peers.cc:597] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:53.906224 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:53.952749 22545 consensus_peers.cc:597] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:54.051455 22545 consensus_peers.cc:597] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:54.108557 22545 consensus_peers.cc:597] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.179693 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:54.197995 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:54.249584 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:54.320365 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:54.369866 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
W20260709 13:10:54.402288 22619 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:54.405014 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:54.447547 23227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:41465, user_credentials={real_user=slave}} blocked reactor thread for 47486.9us
W20260709 13:10:54.511574 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:54.539273 22545 consensus_peers.cc:597] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:54.585317 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:54.599661 22545 consensus_peers.cc:597] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:54.615549 22545 consensus_peers.cc:597] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:10:54.629735 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:54.753175 22545 consensus_peers.cc:597] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:54.850276 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
W20260709 13:10:54.869633 22617 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.877223 22617 consensus_peers.cc:597] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.908442 22617 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.932190 23227 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.937084 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:54.940591 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:54.960418 22617 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.961262 23227 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.962777 23227 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:54.997246 22545 consensus_peers.cc:597] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:54.998446 22617 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.001228 22617 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.018013 22545 consensus_peers.cc:597] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:55.027776 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.071885 22617 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.079095 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:55.081157 22545 consensus_peers.cc:597] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:55.090369 22617 consensus_peers.cc:597] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.107673 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:55.111730 21390 tablet_replica.cc:333] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
W20260709 13:10:55.112538 22617 consensus_peers.cc:597] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.113175 21390 raft_consensus.cc:2243] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.114817 21390 raft_consensus.cc:2272] T 9e7684e99fff4bc297f8fbf170e45ddb P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.115021 22545 consensus_peers.cc:597] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:55.118942 21390 tablet_replica.cc:333] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.120066 21390 raft_consensus.cc:2243] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.122534 21390 raft_consensus.cc:2272] T 813ede727198414390a20d5845e75e07 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.126097 21390 tablet_replica.cc:333] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
W20260709 13:10:55.126544 22617 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.127168 21390 raft_consensus.cc:2243] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.132200 21390 raft_consensus.cc:2272] T 88d0b8c255a14106a3b00b5476896b2c P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.148088 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:55.148209 22617 consensus_peers.cc:597] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.153790 21390 tablet_replica.cc:333] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.154932 21390 raft_consensus.cc:2243] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.156277 21390 raft_consensus.cc:2272] T 5c413dbaae364e3a919a92c57b6216ba P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.156596 23227 consensus_peers.cc:597] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.158497 22617 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.163362 21390 tablet_replica.cc:333] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.164505 21390 raft_consensus.cc:2243] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.165705 21390 raft_consensus.cc:2272] T b881738a5b7f4910b375833c1cd61083 P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.172346 21390 tablet_replica.cc:333] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.173363 21390 raft_consensus.cc:2243] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.174945 21390 raft_consensus.cc:2272] T 40f71093a3d7477c93130a982d6233f9 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.179050 21390 tablet_replica.cc:333] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.179998 21390 raft_consensus.cc:2243] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:10:55.180624 22617 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.181375 21390 raft_consensus.cc:2272] T 77ec411c33594ae08408279ef5c44410 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.188509 21390 tablet_replica.cc:333] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.189754 21390 raft_consensus.cc:2243] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.195552 21390 raft_consensus.cc:2272] T a4afa4eec9774883a53b37419c20bbf4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.198704 21390 tablet_replica.cc:333] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.199705 21390 raft_consensus.cc:2243] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.200925 21390 raft_consensus.cc:2272] T 096694b658e343f384dc3c1f4e4c5dac P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.203987 21390 tablet_replica.cc:333] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.209600 21390 raft_consensus.cc:2243] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:55.216300 22619 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.224947 23227 consensus_peers.cc:597] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.215142 21390 raft_consensus.cc:2272] T 1f196f572a5c44a1adb647d7ebc64463 P 691cccbd0258483ebe19e1581674cc94 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.234237 21390 tablet_replica.cc:333] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.235177 21390 raft_consensus.cc:2243] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.235940 21390 raft_consensus.cc:2272] T 66564b8595294cedb0956a6878879f95 P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.241765 22617 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.244314 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:55.251053 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:55.253463 21390 tablet_replica.cc:333] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.254483 21390 raft_consensus.cc:2243] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.264459 21390 raft_consensus.cc:2272] T 80dc0c7d4f9341eeb7472424613de2ce P 691cccbd0258483ebe19e1581674cc94 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.269706 22617 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.270462 22617 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.271957 21390 tablet_replica.cc:333] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.273135 21390 raft_consensus.cc:2243] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.273883 21390 raft_consensus.cc:2272] T 603e708bc6b346ea93c1fb612030a16f P 691cccbd0258483ebe19e1581674cc94 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.276727 21390 tablet_replica.cc:333] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.277719 21390 raft_consensus.cc:2243] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.278352 21390 raft_consensus.cc:2272] T d23ea829d43140beb6a88079029d865b P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.281111 21390 tablet_replica.cc:333] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.281951 21390 raft_consensus.cc:2243] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.282645 21390 raft_consensus.cc:2272] T 0328fc7e60424283b5d1ea734bd5136a P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.285632 21390 tablet_replica.cc:333] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.286399 21390 raft_consensus.cc:2243] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.287804 21390 raft_consensus.cc:2272] T 1abd591408b04d32a9049743f1e89547 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.290627 21390 tablet_replica.cc:333] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.293044 21390 raft_consensus.cc:2243] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.295123 21390 raft_consensus.cc:2272] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.298061 21390 tablet_replica.cc:333] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.298867 21390 raft_consensus.cc:2243] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.299511 21390 raft_consensus.cc:2272] T 6f5719028ca945b2b6c1a1f140b05146 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.302363 21390 tablet_replica.cc:333] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.303218 21390 raft_consensus.cc:2243] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.303920 21390 raft_consensus.cc:2272] T 7452859c008745c19509f4d5d908e8f1 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.307157 21390 tablet_replica.cc:333] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.314250 21390 raft_consensus.cc:2243] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.315146 21390 raft_consensus.cc:2272] T d36d7ae701b84ad59f37ee479b4bd84f P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.318629 21390 tablet_replica.cc:333] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.319491 21390 raft_consensus.cc:2243] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.320909 21390 raft_consensus.cc:2272] T b9c028af0e9e408792f2900ec24e194b P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.339649 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:10:55.340764 21390 tablet_replica.cc:333] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.341686 21390 raft_consensus.cc:2243] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.342973 21390 raft_consensus.cc:2272] T 78833bb30a8347f19e5f2696aacc31e1 P 691cccbd0258483ebe19e1581674cc94 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.351976 21390 tablet_replica.cc:333] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.352919 21390 raft_consensus.cc:2243] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.354080 21390 raft_consensus.cc:2272] T 9693f1d9b0aa4659842e296e4ccab6fb P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.357221 21390 tablet_replica.cc:333] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.358402 21390 raft_consensus.cc:2243] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.359094 21390 raft_consensus.cc:2272] T ca60e389358849e7bf461e472007a7f7 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.361969 21390 tablet_replica.cc:333] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.363018 21390 raft_consensus.cc:2243] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.366174 21390 raft_consensus.cc:2272] T 549907a9ef52413ab776c58c50b74e5d P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.369208 21390 tablet_replica.cc:333] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.370352 21390 raft_consensus.cc:2243] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.371778 21390 raft_consensus.cc:2272] T 360d81cdb43c4dd69ba77b3db56e94e4 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.382591 21390 tablet_replica.cc:333] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.383522 21390 raft_consensus.cc:2243] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.384785 21390 raft_consensus.cc:2272] T ddaffb6b139e4723bd2535c363e228ff P 691cccbd0258483ebe19e1581674cc94 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.392489 21390 tablet_replica.cc:333] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.393445 21390 raft_consensus.cc:2243] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.394294 21390 raft_consensus.cc:2272] T e294969b50aa438bb288b913f169f06e P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.397387 21390 tablet_replica.cc:333] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.398177 21390 raft_consensus.cc:2243] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.399422 21390 raft_consensus.cc:2272] T 31de2edeb38841bfa9edd362c910f0f7 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.400398 22617 consensus_peers.cc:597] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.409824 23227 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.413237 21390 tablet_replica.cc:333] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.414193 21390 raft_consensus.cc:2243] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.415416 21390 raft_consensus.cc:2272] T 384f494818f741d1bb257daeaab933f2 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.425379 21390 tablet_replica.cc:333] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
W20260709 13:10:55.445032 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:55.426709 21390 raft_consensus.cc:2243] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.449599 21390 raft_consensus.cc:2272] T 39009bfe483947928e10122b4bb55ca6 P 691cccbd0258483ebe19e1581674cc94 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.454321 21390 tablet_replica.cc:333] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.460295 21390 raft_consensus.cc:2243] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.466758 21390 raft_consensus.cc:2272] T 8852a51dd9a84948bed8ee87ae7a9f21 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.470343 21390 tablet_replica.cc:333] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.471280 21390 raft_consensus.cc:2243] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.472008 21390 raft_consensus.cc:2272] T 34b4979f789f48d0807b87e7a48b9a78 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.474752 21390 tablet_replica.cc:333] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
W20260709 13:10:55.484897 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:55.485965 21390 raft_consensus.cc:2243] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.487248 21390 raft_consensus.cc:2272] T b09d79da74a54c84ab38db5f54cacc35 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.499008 21390 tablet_replica.cc:333] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.499892 21390 raft_consensus.cc:2243] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.500659 21390 raft_consensus.cc:2272] T 0a60725e5550479db8d1e52b48126750 P 691cccbd0258483ebe19e1581674cc94 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.503844 21390 tablet_replica.cc:333] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.504802 21390 raft_consensus.cc:2243] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.505954 21390 raft_consensus.cc:2272] T 401fe414b8f443bebfed8254895d71c3 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.512996 21390 tablet_replica.cc:333] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
W20260709 13:10:55.514619 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:10:55.515728 21390 raft_consensus.cc:2243] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.517045 21390 raft_consensus.cc:2272] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 691cccbd0258483ebe19e1581674cc94 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.520048 21390 tablet_replica.cc:333] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.521040 21390 raft_consensus.cc:2243] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.522238 21390 raft_consensus.cc:2272] T acc845449beb4f859e55185200f34bd2 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.526499 21390 tablet_replica.cc:333] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.527351 21390 raft_consensus.cc:2243] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.528122 21390 raft_consensus.cc:2272] T 6f42f0567ae14f62b39e69ed29a409cf P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.531210 21390 tablet_replica.cc:333] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.533161 21390 raft_consensus.cc:2243] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.533882 21390 raft_consensus.cc:2272] T ea7bfa694a734e68806da48189a7e004 P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.536917 21390 tablet_replica.cc:333] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.537936 21390 raft_consensus.cc:2243] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.539253 21390 raft_consensus.cc:2272] T f6c34f1ef8704ce29f9df924d306bc42 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.542323 21390 tablet_replica.cc:333] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.543269 21390 raft_consensus.cc:2243] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.544569 21390 raft_consensus.cc:2272] T 6530ceb18c814f10ad99777fb17a2ea1 P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.547240 21390 tablet_replica.cc:333] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.548103 21390 raft_consensus.cc:2243] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.548820 21390 raft_consensus.cc:2272] T 33d734b2b43a40138a8a0ee22b30d9ba P 691cccbd0258483ebe19e1581674cc94 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.551685 21390 tablet_replica.cc:333] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.552591 21390 raft_consensus.cc:2243] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.553840 21390 raft_consensus.cc:2272] T 0498259251e24450b91d38bfc4b83dbf P 691cccbd0258483ebe19e1581674cc94 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.556756 21390 tablet_replica.cc:333] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.557531 21390 raft_consensus.cc:2243] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.558413 21390 raft_consensus.cc:2272] T d3feac7af5754b40a9c951d0a8e31413 P 691cccbd0258483ebe19e1581674cc94 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.561269 21390 tablet_replica.cc:333] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.562078 21390 raft_consensus.cc:2243] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.563241 21390 raft_consensus.cc:2272] T 3eac3c624e2c43fc9505fe5c344151d0 P 691cccbd0258483ebe19e1581674cc94 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.571460 21390 tablet_replica.cc:333] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.572345 21390 raft_consensus.cc:2243] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.573002 21390 raft_consensus.cc:2272] T acc46eb991824d25bde40d1001e04798 P 691cccbd0258483ebe19e1581674cc94 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.573292 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:10:55.575888 21390 tablet_replica.cc:333] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94: stopping tablet replica
I20260709 13:10:55.576651 21390 raft_consensus.cc:2243] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.577337 21390 raft_consensus.cc:2272] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 691cccbd0258483ebe19e1581674cc94 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:56.140636 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:56.243822 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:10:56.258816 30789 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.259492 30789 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.268882 30789 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.273373 22617 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.274201 22619 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.274701 22619 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.275514 30838 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:56.297904 30838 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.298576 30838 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.303306 30838 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:56.304559 23256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:56.310719 22617 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.311172 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:56.311741 22619 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.312933 30815 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:56.337850 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:10:56.343650 30840 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.344240 30840 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.352811 30840 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.358820 30838 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.360086 30838 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.362785 30838 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.359375 23227 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.366011 30838 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.366683 30838 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.368942 30838 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.370558 22617 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.373929 22619 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.378681 22619 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:56.374863 23229 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.381140 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.382004 30840 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:56.383872 22617 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.389451 22619 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.389899 30838 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:56.389993 22619 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.402477 30838 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:10:56.401677 22619 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:56.410166 22619 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:56.410413 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:56.469874 23229 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:56.499790 30834 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.500412 30834 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:56.512935 23227 leader_election.cc:336] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.502667 30834 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.516402 30838 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:56.516527 23229 leader_election.cc:336] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.517239 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.517082 30838 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.518646 30834 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:56.526453 22619 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.531610 30838 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.537423 22617 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.537886 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.538651 30838 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:56.567147 30840 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.567821 30840 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.570182 30840 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.578562 23229 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:56.581602 23227 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.582207 23227 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.583060 30834 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:56.594489 30838 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.595212 30838 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.597565 30838 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.599038 30834 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.599671 30834 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:56.606868 22617 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.607715 22619 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.608129 22619 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.609061 30815 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.609333 30838 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:56.608177 23229 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.609611 30815 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.612560 30815 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.616238 30834 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:56.618719 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
W20260709 13:10:56.620081 22617 leader_election.cc:336] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.626153 23227 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.630100 22646 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 15.
W20260709 13:10:56.630259 22619 leader_election.cc:336] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.629552 23227 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.633951 30834 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.632396 22619 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.639698 30838 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:56.654179 30840 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.654783 30840 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.659401 30840 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:56.669832 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:56.676021 30815 raft_consensus.cc:493] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.676764 30815 raft_consensus.cc:515] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.679050 30815 leader_election.cc:290] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.684389 22617 leader_election.cc:336] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.706867 22619 leader_election.cc:336] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.707719 22619 leader_election.cc:304] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:56.708285 23227 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.708976 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:56.709578 30838 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.711196 30789 raft_consensus.cc:2749] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:56.711560 30838 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.713827 30838 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:56.716785 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:56.717571 23257 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 21.
I20260709 13:10:56.719993 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:56.722445 30838 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:56.722905 30838 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.723527 30838 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:56.710235 30815 raft_consensus.cc:493] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.724498 30815 raft_consensus.cc:515] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.725872 30789 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.726574 30789 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.728828 30789 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.729453 30840 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:56.732754 30815 leader_election.cc:290] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.733394 30838 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.741670 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cfd6d3ed51d40fb8cab7d75c1f29423" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:56.742302 23257 raft_consensus.cc:3060] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:56.745577 30838 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:56.748175 22617 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.750358 22619 leader_election.cc:336] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:56.750975 22619 leader_election.cc:336] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.753029 23257 raft_consensus.cc:2468] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 22.
I20260709 13:10:56.758764 30840 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.759580 30840 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.758908 22618 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:56.761206 30815 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.762058 30815 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.764585 30840 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:56.766849 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:56.767609 30843 raft_consensus.cc:2804] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:56.768236 23257 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 23.
I20260709 13:10:56.770394 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:56.771806 22646 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:10:56.772737 30815 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:56.773401 30789 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.774088 30789 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.776754 30789 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:56.779553 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:56.779793 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:56.783917 30838 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:56.785749 30838 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.786425 30838 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:56.788108 22617 leader_election.cc:336] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.788620 22617 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:56.789580 22617 leader_election.cc:336] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.790006 22617 leader_election.cc:304] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.790866 30789 raft_consensus.cc:2749] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:56.790115 30815 raft_consensus.cc:2749] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:56.792764 22617 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.797219 22617 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.797950 30840 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.798632 30840 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.800710 30789 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.803001 30789 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.803378 30840 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.804388 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:56.805234 30840 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:56.805656 30840 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.806113 30840 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:56.810482 30843 raft_consensus.cc:697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:56.810717 30834 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.811453 30834 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.811774 30843 consensus_queue.cc:237] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.814180 30834 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.818571 22619 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.822878 30789 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.819646 30834 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:56.819864 23229 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.824162 30834 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.831318 30838 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.832679 30834 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:56.833977 23229 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.833714 30840 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.835832 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:56.834002 30838 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:56.836565 23257 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 24: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:56.837901 30840 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:56.843443 22619 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:56.844686 22617 leader_election.cc:336] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.845232 22617 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:56.846017 30838 raft_consensus.cc:2749] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:10:56.850250 22617 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.850765 22617 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.851493 30843 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:56.852682 22617 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.853152 22617 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
I20260709 13:10:56.854554 30843 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:56.856293 30843 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.856789 30843 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:56.857344 23227 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.862684 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:56.863411 22646 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 24.
I20260709 13:10:56.865832 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:56.865231 22395 catalog_manager.cc:5697] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e reported cstate change: term changed from 21 to 22, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 22 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:56.866700 22646 raft_consensus.cc:2393] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 24: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:56.870532 22617 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.871814 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:56.872083 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:56.871855 30843 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:56.872547 23257 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:56.873809 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:56.874586 30838 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:56.875015 30838 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.875519 30838 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:56.881699 30840 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:56.882238 30840 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.882666 30840 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:56.883759 30838 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.889210 30838 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:56.891827 22617 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.872960 30843 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.894330 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:56.894892 30834 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.895478 30834 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.897207 30840 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.898550 23257 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in current term 25: Already voted for candidate fa2f181263f446a6962b649f9348c15f in this term.
I20260709 13:10:56.901051 30840 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:56.903985 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, fa2f181263f446a6962b649f9348c15f
W20260709 13:10:56.909588 23229 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.909850 30815 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:10:56.908689 23227 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.911808 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.912729 30850 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.912777 30843 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.915447 30843 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.912884 23227 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.916906 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.918371 30850 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:56.900905 30834 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.922034 22619 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:56.922883 22617 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.923339 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.924446 30843 raft_consensus.cc:2749] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:56.937299 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:56.938200 22646 raft_consensus.cc:2393] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fa2f181263f446a6962b649f9348c15f in current term 25: Already voted for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in this term.
W20260709 13:10:56.940434 23227 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:56.941535 23227 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.943518 30815 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.944118 30815 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.946619 30815 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:56.941704 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:10:56.942975 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:56.950800 30849 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:10:56.954808 21390 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22601)
W20260709 13:10:56.957242 22619 leader_election.cc:336] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:56.957795 22617 leader_election.cc:336] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.958240 22617 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:56.958930 23227 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.959741 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:56.960642 30849 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:10:56.961622 30815 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:10:56.962976 23227 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.963497 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.964280 30849 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.966667 30815 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.967420 30815 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:56.973950 22619 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:56.975086 30815 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:56.979777 30849 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.980406 30849 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:56.982625 30849 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:56.984370 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" is_pre_election: true
I20260709 13:10:56.985200 22646 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 23.
I20260709 13:10:56.986677 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:56.988430 30849 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:56.988914 30849 raft_consensus.cc:493] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:56.989283 30849 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:56.991050 22619 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:56.994114 23227 leader_election.cc:336] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.996083 30815 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:56.996697 22617 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:56.996603 30815 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:56.997164 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:56.997853 30838 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:56.999305 30815 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:57.000224 22619 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:57.006260 22619 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:57.007416 30849 raft_consensus.cc:515] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:57.012080 22617 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:57.012588 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:57.013299 30815 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:57.017613 22646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6530ceb18c814f10ad99777fb17a2ea1" candidate_uuid: "fa2f181263f446a6962b649f9348c15f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e"
I20260709 13:10:57.018370 22646 raft_consensus.cc:3060] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:57.025269 23227 leader_election.cc:336] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:57.034740 22646 raft_consensus.cc:2468] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2f181263f446a6962b649f9348c15f in term 24.
I20260709 13:10:57.036042 23227 leader_election.cc:304] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:57.037086 30834 raft_consensus.cc:2804] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:57.037673 30834 raft_consensus.cc:697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 24 LEADER]: Becoming Leader. State: Replica: fa2f181263f446a6962b649f9348c15f, State: Running, Role: LEADER
I20260709 13:10:57.038585 30834 consensus_queue.cc:237] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:57.044961 30849 leader_election.cc:290] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:57.073278 22395 catalog_manager.cc:5697] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 23 to 24, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to fa2f181263f446a6962b649f9348c15f (127.20.227.132). New cstate: current_term: 24 leader_uuid: "fa2f181263f446a6962b649f9348c15f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:57.191838 22619 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:57.193831 22617 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.198105 22617 consensus_peers.cc:597] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.220616 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:10:57.230234 23227 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.274998 22617 consensus_peers.cc:597] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.292155 22617 consensus_peers.cc:597] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.332765 22619 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:57.356431 22617 consensus_peers.cc:597] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.371337 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:10:57.373476 22617 consensus_peers.cc:597] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.374279 23227 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.412185 22619 consensus_peers.cc:597] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:57.437476 22617 consensus_peers.cc:597] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.453236 23257 raft_consensus.cc:1275] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:10:57.454922 30838 consensus_queue.cc:1048] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:10:57.499842 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:57.505717 23227 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.531271 22617 consensus_peers.cc:597] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.556104 22617 consensus_peers.cc:597] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.577726 22619 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:57.592350 22617 consensus_peers.cc:597] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.598232 22646 raft_consensus.cc:1275] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Refusing update from remote peer fa2f181263f446a6962b649f9348c15f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:10:57.600337 30834 consensus_queue.cc:1048] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:10:57.602725 23227 consensus_peers.cc:597] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.617018 22617 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.621500 22617 consensus_peers.cc:597] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.679653 22617 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111) [suppressed 589 similar messages]
W20260709 13:10:57.686486 22617 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.738168 23227 consensus_peers.cc:597] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.739527 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:57.761544 23227 consensus_peers.cc:597] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.813128 22619 consensus_peers.cc:597] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:57.828384 22619 consensus_peers.cc:597] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:57.851883 22617 consensus_peers.cc:597] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.864841 22617 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.918480 22619 consensus_peers.cc:597] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:57.926438 22617 consensus_peers.cc:597] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.948711 22617 consensus_peers.cc:597] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.963125 22619 consensus_peers.cc:597] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:10:57.963742 22619 consensus_peers.cc:597] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:57.985453 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:10:58.131862 23227 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:58.140792 30858 raft_consensus.cc:493] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.142921 30858 raft_consensus.cc:515] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.145118 30858 leader_election.cc:290] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.193439 22619 consensus_peers.cc:597] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:10:58.194013 22619 consensus_peers.cc:597] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:10:58.199738 30858 raft_consensus.cc:493] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.200322 30858 raft_consensus.cc:515] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.202551 30858 leader_election.cc:290] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.203577 22619 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.212296 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
I20260709 13:10:58.246249 30849 raft_consensus.cc:493] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.246994 30849 raft_consensus.cc:515] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.252480 30849 leader_election.cc:290] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.258090 23227 leader_election.cc:336] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:58.268848 22617 consensus_peers.cc:597] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.279309 23229 leader_election.cc:336] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.286535 23229 leader_election.cc:304] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:58.284410 22619 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.289054 30849 raft_consensus.cc:2749] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:58.299394 22617 leader_election.cc:336] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.302297 22617 leader_election.cc:304] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.308359 30858 raft_consensus.cc:2749] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:58.315893 30856 raft_consensus.cc:493] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.316478 30856 raft_consensus.cc:515] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.318982 30856 leader_election.cc:290] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.336655 22619 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.337571 30856 raft_consensus.cc:493] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.339764 30856 raft_consensus.cc:515] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.342430 30856 leader_election.cc:290] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:58.338922 30858 raft_consensus.cc:493] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.343174 30858 raft_consensus.cc:515] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.345607 30858 leader_election.cc:290] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:58.349007 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
W20260709 13:10:58.357887 22617 leader_election.cc:336] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.364434 22617 leader_election.cc:304] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:58.385020 22619 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:58.385919 22619 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.377935 30858 raft_consensus.cc:2749] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:58.395751 23227 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.404899 23227 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.408702 30849 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
W20260709 13:10:58.408985 22617 leader_election.cc:336] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.409704 22617 leader_election.cc:304] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.410751 30838 raft_consensus.cc:2749] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:58.409370 30849 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:58.412642 22617 leader_election.cc:336] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.413427 22617 leader_election.cc:304] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:10:58.415462 22617 leader_election.cc:336] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.415872 22617 leader_election.cc:304] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.416630 30838 raft_consensus.cc:2749] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:58.417395 30849 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:58.417560 30863 raft_consensus.cc:2749] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:58.423087 23227 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:58.427843 23229 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.428283 23229 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.429037 30849 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.432987 30838 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.433506 30838 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.436899 30838 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:58.442188 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:58.443011 23257 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:58.446731 30863 raft_consensus.cc:493] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.447660 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:58.448582 30838 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:10:58.449023 30838 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.449386 30838 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:58.447342 30863 raft_consensus.cc:515] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.480369 30849 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.480906 22619 leader_election.cc:336] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.481089 30849 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.481921 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:58.482143 30863 leader_election.cc:290] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:58.482834 30863 raft_consensus.cc:493] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.483316 30849 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:58.487298 30864 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.490149 30864 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.492267 30864 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:58.489646 23227 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:58.493755 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
W20260709 13:10:58.494246 23227 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.494407 23257 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 24.
I20260709 13:10:58.494861 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:58.483297 30863 raft_consensus.cc:515] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.495761 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:58.496594 30849 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:58.497850 30858 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:58.498312 21390 tablet_replica.cc:333] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.498287 30858 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.498893 30858 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:58.501750 22619 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.501502 21390 raft_consensus.cc:2243] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.503861 21390 raft_consensus.cc:2272] T 813ede727198414390a20d5845e75e07 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.505628 30838 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.506827 21390 tablet_replica.cc:333] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.507797 21390 raft_consensus.cc:2243] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.508431 21390 raft_consensus.cc:2272] T 9e7684e99fff4bc297f8fbf170e45ddb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.508846 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384f494818f741d1bb257daeaab933f2" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:58.509532 23257 raft_consensus.cc:3060] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:10:58.511466 21390 tablet_replica.cc:333] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
W20260709 13:10:58.513965 23227 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.487463 22617 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.507799 30858 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.517861 30863 leader_election.cc:290] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:58.516911 23257 raft_consensus.cc:2468] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 26.
I20260709 13:10:58.518553 21390 raft_consensus.cc:2243] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.519291 21390 raft_consensus.cc:2272] T 88d0b8c255a14106a3b00b5476896b2c P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.519534 30858 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:58.519747 22618 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:58.521023 30858 raft_consensus.cc:2804] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:10:58.521485 30858 raft_consensus.cc:697] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:58.522140 21390 tablet_replica.cc:333] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.522352 30858 consensus_queue.cc:237] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.523028 21390 raft_consensus.cc:2243] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.523716 21390 raft_consensus.cc:2272] T 5c413dbaae364e3a919a92c57b6216ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.527679 21390 tablet_replica.cc:333] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.528579 21390 raft_consensus.cc:2243] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.529243 21390 raft_consensus.cc:2272] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.529572 30838 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: Requested vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
I20260709 13:10:58.529062 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b09d79da74a54c84ab38db5f54cacc35" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f"
I20260709 13:10:58.530292 23257 raft_consensus.cc:3060] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:10:58.532385 21390 tablet_replica.cc:333] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.533396 21390 raft_consensus.cc:2243] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.534049 21390 raft_consensus.cc:2272] T 40f71093a3d7477c93130a982d6233f9 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.537074 21390 tablet_replica.cc:333] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
W20260709 13:10:58.537160 22617 leader_election.cc:336] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.537652 22617 leader_election.cc:304] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.537966 21390 raft_consensus.cc:2243] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.538813 21390 raft_consensus.cc:2272] T 1abd591408b04d32a9049743f1e89547 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.540320 30838 raft_consensus.cc:2749] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:10:58.542589 21390 tablet_replica.cc:333] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.543458 21390 raft_consensus.cc:2243] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.544911 21390 raft_consensus.cc:2272] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.545339 22617 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:58.546339 22617 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:58.547070 22617 leader_election.cc:336] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.547487 22617 leader_election.cc:304] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.548888 23257 raft_consensus.cc:2468] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 25.
I20260709 13:10:58.549423 21390 tablet_replica.cc:333] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.550026 22618 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, fa2f181263f446a6962b649f9348c15f; no voters: 
I20260709 13:10:58.550318 21390 raft_consensus.cc:2243] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.550953 30858 raft_consensus.cc:2804] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:10:58.551446 21390 raft_consensus.cc:2272] T a4afa4eec9774883a53b37419c20bbf4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.551433 30858 raft_consensus.cc:697] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Becoming Leader. State: Replica: 5e72fb99f5ee4943a91cf8e6dd73e80e, State: Running, Role: LEADER
I20260709 13:10:58.552569 30858 consensus_queue.cc:237] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:58.556512 22617 raft_consensus.cc:2686] T ddaffb6b139e4723bd2535c363e228ff P 5e72fb99f5ee4943a91cf8e6dd73e80e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:10:58.557327 22617 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.565833 21390 tablet_replica.cc:333] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.566859 21390 raft_consensus.cc:2243] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.567468 21390 raft_consensus.cc:2272] T 096694b658e343f384dc3c1f4e4c5dac P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.570323 21390 tablet_replica.cc:333] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.571180 21390 raft_consensus.cc:2243] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.571235 30838 raft_consensus.cc:493] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.571905 30838 raft_consensus.cc:515] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:58.586323 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:10:58.587214 21390 raft_consensus.cc:2272] T 5b79bbacdb324d378e564aba36fc4014 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.589279 30863 raft_consensus.cc:493] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.589798 30863 raft_consensus.cc:515] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.590379 21390 tablet_replica.cc:333] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.591387 21390 raft_consensus.cc:2243] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.592015 30863 leader_election.cc:290] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.598104 22619 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:58.606138 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:10:58.608091 30838 leader_election.cc:290] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.613113 22619 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.592145 21390 raft_consensus.cc:2272] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.626046 21390 tablet_replica.cc:333] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.627031 21390 raft_consensus.cc:2243] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.628458 21390 raft_consensus.cc:2272] T 0328fc7e60424283b5d1ea734bd5136a P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.637626 22617 leader_election.cc:336] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.638119 22617 leader_election.cc:304] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.638842 30838 raft_consensus.cc:2749] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:58.639115 22617 leader_election.cc:336] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:58.639487 23227 consensus_peers.cc:597] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.639573 22617 leader_election.cc:304] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.640354 30838 raft_consensus.cc:2749] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:58.645406 23227 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.647076 21390 tablet_replica.cc:333] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.648034 21390 raft_consensus.cc:2243] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.648713 21390 raft_consensus.cc:2272] T 21b9ab72464841aca55186beb0dbeb53 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.651829 21390 tablet_replica.cc:333] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.652701 21390 raft_consensus.cc:2243] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.656595 30858 raft_consensus.cc:493] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.657260 30858 raft_consensus.cc:515] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:58.660214 21390 raft_consensus.cc:2272] T be7264d3053b44989c5504d296ea482b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.661516 22392 maintenance_manager.cc:419] P b97e77c8afed466a990720a609bf1968: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033361
W20260709 13:10:58.666592 22617 leader_election.cc:336] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.668314 21390 tablet_replica.cc:333] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.669193 21390 raft_consensus.cc:2243] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.669775 21390 raft_consensus.cc:2272] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.691854 23227 consensus_peers.cc:597] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.660068 30858 leader_election.cc:290] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.716797 22619 leader_election.cc:336] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.719571 22619 leader_election.cc:304] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.722335 30867 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.724500 30867 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
W20260709 13:10:58.724502 22619 raft_consensus.cc:2686] T 78833bb30a8347f19e5f2696aacc31e1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:58.723223 21390 tablet_replica.cc:333] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.727762 21390 raft_consensus.cc:2243] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.729977 30867 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.734833 23229 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.749996 30867 raft_consensus.cc:493] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.741247 30858 raft_consensus.cc:493] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.750783 30858 raft_consensus.cc:515] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
W20260709 13:10:58.751286 23227 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.752281 23227 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.753091 30849 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:58.750607 30867 raft_consensus.cc:515] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.754302 21390 raft_consensus.cc:2272] T 9693f1d9b0aa4659842e296e4ccab6fb P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.755527 30867 leader_election.cc:290] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.760962 23229 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:58.771541 23227 leader_election.cc:336] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.772089 23227 leader_election.cc:304] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.773440 30867 raft_consensus.cc:2749] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:58.779135 23227 consensus_peers.cc:597] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.779910 21390 tablet_replica.cc:333] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.780782 21390 raft_consensus.cc:2243] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.781445 21390 raft_consensus.cc:2272] T 549907a9ef52413ab776c58c50b74e5d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.782090 30858 leader_election.cc:290] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.790069 22617 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:58.792075 22619 leader_election.cc:336] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.792542 22619 leader_election.cc:304] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.793277 30858 raft_consensus.cc:2749] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:58.798807 21390 tablet_replica.cc:333] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.801335 21390 raft_consensus.cc:2243] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.802587 21390 raft_consensus.cc:2272] T ca60e389358849e7bf461e472007a7f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.803128 23227 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.804126 23229 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:10:58.810560 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:58.809971 23227 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.805768 21390 tablet_replica.cc:333] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.815798 21390 raft_consensus.cc:2243] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.823532 30834 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.824303 30834 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.827407 30834 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:10:58.837283 22391 maintenance_manager.cc:643] P b97e77c8afed466a990720a609bf1968: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.175s	user 0.038s	sys 0.012s Metrics: {"bytes_written":6848,"delete_count":0,"lbm_write_time_us":927,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":12548,"threads_started":1,"update_count":267,"wal-append.queue_time_us":12938}
I20260709 13:10:58.839464 22392 maintenance_manager.cc:419] P b97e77c8afed466a990720a609bf1968: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.344236
W20260709 13:10:58.843380 23229 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:58.844331 30867 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:58.844951 30867 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:58.848320 30867 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:58.870205 23229 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:58.871977 23227 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.872493 23227 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.873248 30834 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.817175 21390 raft_consensus.cc:2272] T 603e708bc6b346ea93c1fb612030a16f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.885460 23227 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:58.896917 21390 tablet_replica.cc:333] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.897866 21390 raft_consensus.cc:2243] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.899158 21390 raft_consensus.cc:2272] T d23ea829d43140beb6a88079029d865b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.896323 23227 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:58.900640 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:58.901700 30834 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:58.907243 21390 tablet_replica.cc:333] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
W20260709 13:10:58.927915 23227 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.928887 21390 raft_consensus.cc:2243] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.929615 21390 raft_consensus.cc:2272] T 31de2edeb38841bfa9edd362c910f0f7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.932778 21390 tablet_replica.cc:333] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.933676 21390 raft_consensus.cc:2243] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.934651 21390 pending_rounds.cc:70] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Trying to abort 1 pending ops.
I20260709 13:10:58.934887 21390 pending_rounds.cc:77] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting op as it isn't in flight: id { term: 26 index: 18 } timestamp: 7305636489317560320 op_type: NO_OP noop_request { }
I20260709 13:10:58.935281 21390 raft_consensus.cc:2889] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:58.935645 21390 raft_consensus.cc:2272] T 384f494818f741d1bb257daeaab933f2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.939239 21390 tablet_replica.cc:333] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:58.940132 21390 raft_consensus.cc:2243] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.941655 21390 raft_consensus.cc:2272] T e294969b50aa438bb288b913f169f06e P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.054903 21390 tablet_replica.cc:333] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.055841 21390 raft_consensus.cc:2243] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.059213 22391 maintenance_manager.cc:643] P b97e77c8afed466a990720a609bf1968: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.219s	user 0.115s	sys 0.043s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28288,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":228138,"dirs.run_cpu_time_us":620,"dirs.run_wall_time_us":1795,"lbm_read_time_us":2033,"lbm_reads_lt_1ms":25,"lbm_write_time_us":1594,"lbm_writes_lt_1ms":11,"peak_mem_usage":302255,"reinsert_count":0,"thread_start_us":12268,"threads_started":2,"update_count":285}
I20260709 13:10:59.062636 22392 maintenance_manager.cc:419] P b97e77c8afed466a990720a609bf1968: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:10:59.063745 22391 maintenance_manager.cc:643] P b97e77c8afed466a990720a609bf1968: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 13:10:59.072499 30834 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:59.073171 30834 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:59.075309 30834 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:59.078025 22617 consensus_peers.cc:597] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.081360 30858 raft_consensus.cc:493] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:59.082015 30858 raft_consensus.cc:515] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } attrs { replace: true } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:59.097395 21390 raft_consensus.cc:2272] T a9239c6f95c54166b454ada0dd9c1b9b P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:59.098366 22619 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:59.100548 21390 tablet_replica.cc:333] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.122445 21390 raft_consensus.cc:2243] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.123391 21390 raft_consensus.cc:2272] T ec33ad69c4af4d379aff74ce15c85af7 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.101744 30858 leader_election.cc:290] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), fa2f181263f446a6962b649f9348c15f (127.20.227.132:42571)
W20260709 13:10:59.120143 23227 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:59.134581 23229 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:59.135717 23264 raft_consensus.cc:1275] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Refusing update from remote peer 5e72fb99f5ee4943a91cf8e6dd73e80e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:10:59.136854 23263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80dc0c7d4f9341eeb7472424613de2ce" candidate_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fa2f181263f446a6962b649f9348c15f" is_pre_election: true
I20260709 13:10:59.137677 23263 raft_consensus.cc:2468] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e72fb99f5ee4943a91cf8e6dd73e80e in term 15.
W20260709 13:10:59.139461 22617 leader_election.cc:336] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:59.140000 22617 leader_election.cc:304] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:59.141024 30858 raft_consensus.cc:2749] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.135057 23229 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:59.143826 30849 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.148250 21390 tablet_replica.cc:333] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.148542 30874 consensus_queue.cc:1048] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:59.149348 21390 raft_consensus.cc:2243] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.155651 21390 pending_rounds.cc:70] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Trying to abort 1 pending ops.
I20260709 13:10:59.156347 21390 pending_rounds.cc:77] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7305636489443553280 op_type: NO_OP noop_request { }
I20260709 13:10:59.156772 21390 raft_consensus.cc:2889] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:59.157204 21390 raft_consensus.cc:2272] T b09d79da74a54c84ab38db5f54cacc35 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.166522 30858 raft_consensus.cc:493] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:59.168629 21390 tablet_replica.cc:333] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.167196 30858 raft_consensus.cc:515] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } }
I20260709 13:10:59.169798 21390 raft_consensus.cc:2243] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.170956 21390 raft_consensus.cc:2272] T ee0a982f0606460f93cc934c9319409d P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.172705 30858 leader_election.cc:290] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
I20260709 13:10:59.175879 22394 catalog_manager.cc:5697] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f reported cstate change: term changed from 23 to 25, leader changed from 691cccbd0258483ebe19e1581674cc94 (127.20.227.130) to 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131). New cstate: current_term: 25 leader_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } } }
W20260709 13:10:59.182181 22617 leader_election.cc:336] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:59.186054 22619 leader_election.cc:336] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
I20260709 13:10:59.186642 22619 leader_election.cc:304] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e72fb99f5ee4943a91cf8e6dd73e80e; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:59.187481 30858 raft_consensus.cc:2749] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:10:59.189123 21390 tablet_replica.cc:333] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.190023 21390 raft_consensus.cc:2243] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.191097 21390 raft_consensus.cc:2272] T a14caf28740540799ba1c6db058346a1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.194813 21390 tablet_replica.cc:333] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.197599 21390 raft_consensus.cc:2243] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.200654 21390 raft_consensus.cc:2272] T f0e2410740c9458db983018bbe19dcbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.225185 21390 tablet_replica.cc:333] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.226131 21390 raft_consensus.cc:2243] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.227460 21390 raft_consensus.cc:2272] T 8852a51dd9a84948bed8ee87ae7a9f21 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.230232 21390 tablet_replica.cc:333] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.231036 21390 raft_consensus.cc:2243] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.231729 21390 raft_consensus.cc:2272] T 401fe414b8f443bebfed8254895d71c3 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.234609 21390 tablet_replica.cc:333] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.235334 21390 raft_consensus.cc:2243] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.236615 21390 raft_consensus.cc:2272] T 799bdeb956cf4c76aa244c0f5bbc89c2 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.246025 21390 tablet_replica.cc:333] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.247165 21390 raft_consensus.cc:2243] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.248749 21390 raft_consensus.cc:2272] T 80dc0c7d4f9341eeb7472424613de2ce P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.251827 21390 tablet_replica.cc:333] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.252686 21390 raft_consensus.cc:2243] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.254168 21390 raft_consensus.cc:2272] T 66564b8595294cedb0956a6878879f95 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.257234 21390 tablet_replica.cc:333] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.258131 21390 raft_consensus.cc:2243] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.259308 21390 raft_consensus.cc:2272] T d36d7ae701b84ad59f37ee479b4bd84f P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.262353 21390 tablet_replica.cc:333] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.263190 21390 raft_consensus.cc:2243] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.264426 21390 raft_consensus.cc:2272] T 7452859c008745c19509f4d5d908e8f1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.267628 21390 tablet_replica.cc:333] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.268539 21390 raft_consensus.cc:2243] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.269382 21390 raft_consensus.cc:2272] T 1f196f572a5c44a1adb647d7ebc64463 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.272507 21390 tablet_replica.cc:333] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.273425 21390 raft_consensus.cc:2243] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.274870 21390 raft_consensus.cc:2272] T 90227a385eee486dbc981f55629940e4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.277972 21390 tablet_replica.cc:333] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.278815 21390 raft_consensus.cc:2243] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.279599 21390 raft_consensus.cc:2272] T f6c34f1ef8704ce29f9df924d306bc42 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.282624 21390 tablet_replica.cc:333] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.283447 21390 raft_consensus.cc:2243] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.284322 21390 raft_consensus.cc:2272] T 6530ceb18c814f10ad99777fb17a2ea1 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.287185 21390 tablet_replica.cc:333] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.288018 21390 raft_consensus.cc:2243] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.289537 21390 raft_consensus.cc:2272] T 33d734b2b43a40138a8a0ee22b30d9ba P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.292804 21390 tablet_replica.cc:333] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.293606 21390 raft_consensus.cc:2243] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.294286 21390 raft_consensus.cc:2272] T e0b8b09cbd5c4d81a0453f8ca6e8b7d4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.296895 21390 tablet_replica.cc:333] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.297619 21390 raft_consensus.cc:2243] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.298790 21390 raft_consensus.cc:2272] T 6f42f0567ae14f62b39e69ed29a409cf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.301687 21390 tablet_replica.cc:333] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.302423 21390 raft_consensus.cc:2243] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.303725 21390 raft_consensus.cc:2272] T ea7bfa694a734e68806da48189a7e004 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.306383 21390 tablet_replica.cc:333] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.307121 21390 raft_consensus.cc:2243] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.308283 21390 raft_consensus.cc:2272] T 6f5719028ca945b2b6c1a1f140b05146 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.310957 21390 tablet_replica.cc:333] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.311697 21390 raft_consensus.cc:2243] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:59.312253 21390 raft_consensus.cc:2272] T 0498259251e24450b91d38bfc4b83dbf P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.314879 21390 tablet_replica.cc:333] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.316423 21390 raft_consensus.cc:2243] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.317678 21390 raft_consensus.cc:2272] T acc46eb991824d25bde40d1001e04798 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.320421 21390 tablet_replica.cc:333] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e: stopping tablet replica
I20260709 13:10:59.321286 21390 raft_consensus.cc:2243] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:10:59.322777 21390 raft_consensus.cc:2272] T 5314aa61dd7f4a7f9b148f71ea5055c4 P 5e72fb99f5ee4943a91cf8e6dd73e80e [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:59.342289 23229 consensus_peers.cc:597] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:59.594556 23229 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:10:59.655970 23227 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:59.667116 23229 consensus_peers.cc:597] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:10:59.735424 30849 raft_consensus.cc:493] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:10:59.736033 30849 raft_consensus.cc:515] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:59.738535 30849 leader_election.cc:290] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:10:59.745882 23227 consensus_peers.cc:597] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:59.753368 23227 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:10:59.754070 23227 leader_election.cc:336] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:10:59.754458 23227 leader_election.cc:304] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:10:59.755208 30849 raft_consensus.cc:2749] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:59.786762 23227 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:59.943157 30849 raft_consensus.cc:493] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:10:59.943790 30849 raft_consensus.cc:515] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:10:59.946221 30849 leader_election.cc:290] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:10:59.957150 23229 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:10:59.967532 23227 leader_election.cc:336] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:10:59.968072 23227 leader_election.cc:304] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:10:59.973296 30849 raft_consensus.cc:2749] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.012938 30849 raft_consensus.cc:493] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.013540 30849 raft_consensus.cc:515] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.016393 30849 leader_election.cc:290] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.024111 23229 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:00.041285 23227 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:11:00.041817 23227 leader_election.cc:304] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:11:00.042562 30849 raft_consensus.cc:2749] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:00.043656 23227 leader_election.cc:336] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.057060 30849 raft_consensus.cc:493] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.057708 30849 raft_consensus.cc:515] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.060043 30849 leader_election.cc:290] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.076526 23229 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:00.082770 23227 consensus_peers.cc:597] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.099941 23227 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:11:00.101907 23227 leader_election.cc:336] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.102451 23227 leader_election.cc:304] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:11:00.103371 30849 raft_consensus.cc:2749] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:00.135635 23229 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:00.196303 23227 consensus_peers.cc:597] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.204667 30849 raft_consensus.cc:493] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.205433 30849 raft_consensus.cc:515] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.207940 30849 leader_election.cc:290] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:11:00.217104 30849 raft_consensus.cc:493] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.217681 30849 raft_consensus.cc:515] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.221289 30849 leader_election.cc:290] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.226631 23227 leader_election.cc:336] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:11:00.228384 23227 leader_election.cc:336] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.228902 23227 leader_election.cc:304] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:11:00.229714 30849 raft_consensus.cc:2749] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:00.243454 23227 consensus_peers.cc:597] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.244086 23227 leader_election.cc:336] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:11:00.244704 23227 leader_election.cc:336] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.245136 23227 leader_election.cc:304] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:11:00.245898 30849 raft_consensus.cc:2749] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:00.288327 23229 consensus_peers.cc:597] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:11:00.359216 30849 raft_consensus.cc:493] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.359881 30849 raft_consensus.cc:515] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.371508 30849 leader_election.cc:290] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:11:00.372509 30849 raft_consensus.cc:493] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.373781 30849 raft_consensus.cc:515] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.376996 30849 leader_election.cc:290] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.396822 23229 leader_election.cc:336] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:00.405421 23227 leader_election.cc:336] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:11:00.406320 23227 leader_election.cc:336] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.406960 23227 leader_election.cc:304] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:11:00.408015 30882 raft_consensus.cc:2749] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:00.409343 23227 leader_election.cc:336] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.409955 23227 leader_election.cc:304] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:11:00.410779 30882 raft_consensus.cc:2749] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:00.421001 30882 raft_consensus.cc:493] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.421691 30882 raft_consensus.cc:515] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.424208 30882 leader_election.cc:290] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.433977 23227 leader_election.cc:336] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
W20260709 13:11:00.434841 23227 leader_election.cc:336] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.435349 23227 leader_election.cc:304] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:11:00.436254 30882 raft_consensus.cc:2749] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:00.500919 30882 raft_consensus.cc:493] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:11:00.501506 30882 raft_consensus.cc:515] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.503993 30882 leader_election.cc:290] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:11:00.511888 23229 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:00.517923 23227 leader_election.cc:336] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:11:00.518582 23227 leader_election.cc:304] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:11:00.525107 30849 raft_consensus.cc:2749] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:00.552253 23227 consensus_peers.cc:597] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f -> Peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Couldn't send request to peer 691cccbd0258483ebe19e1581674cc94. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.594514 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
I20260709 13:11:00.638411 30882 raft_consensus.cc:493] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.639287 30882 raft_consensus.cc:515] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.642773 30882 leader_election.cc:290] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:11:00.652295 30882 raft_consensus.cc:493] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.653053 30882 raft_consensus.cc:515] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.655753 30882 leader_election.cc:290] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.656442 23229 consensus_peers.cc:597] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:11:00.658129 30849 raft_consensus.cc:493] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.661736 30849 raft_consensus.cc:515] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.664309 30849 leader_election.cc:290] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
I20260709 13:11:00.666704 30849 raft_consensus.cc:493] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.667404 30849 raft_consensus.cc:515] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.671123 30849 leader_election.cc:290] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.691670 23229 leader_election.cc:336] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:00.700110 23227 leader_election.cc:336] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.702049 23227 leader_election.cc:304] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:11:00.702988 30882 raft_consensus.cc:2749] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:00.706167 23229 leader_election.cc:336] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:00.706758 23229 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:00.707845 23227 leader_election.cc:336] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.708734 23227 leader_election.cc:304] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
W20260709 13:11:00.743710 23227 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.745456 30849 raft_consensus.cc:493] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e72fb99f5ee4943a91cf8e6dd73e80e)
I20260709 13:11:00.747014 30849 raft_consensus.cc:515] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.749378 30882 raft_consensus.cc:2749] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.756279 30849 leader_election.cc:290] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465), 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857)
W20260709 13:11:00.757416 23227 leader_election.cc:336] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
I20260709 13:11:00.758323 23227 leader_election.cc:304] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:11:00.759531 30849 raft_consensus.cc:2749] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:11:00.763281 23227 leader_election.cc:336] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:11:00.763906 23227 leader_election.cc:304] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:11:00.765021 30849 raft_consensus.cc:2749] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:00.796197 21390 tablet_server.cc:179] TabletServer@127.20.227.132:0 shutting down...
W20260709 13:11:00.801829 23227 leader_election.cc:336] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111)
W20260709 13:11:00.803277 23227 leader_election.cc:336] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:11:00.803912 23227 leader_election.cc:304] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 5e72fb99f5ee4943a91cf8e6dd73e80e, 691cccbd0258483ebe19e1581674cc94
I20260709 13:11:00.804991 30849 raft_consensus.cc:2749] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:00.830628 23227 consensus_peers.cc:597] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:00.847370 30849 raft_consensus.cc:493] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:11:00.848266 30849 raft_consensus.cc:515] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:00.853765 30849 leader_election.cc:290] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:11:00.856145 23229 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:00.858466 23227 leader_election.cc:336] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:11:00.858937 23227 leader_election.cc:304] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:11:00.860277 30849 raft_consensus.cc:2749] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:00.876259 23227 consensus_peers.cc:597] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:01.047928 30882 raft_consensus.cc:493] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 691cccbd0258483ebe19e1581674cc94)
I20260709 13:11:01.048768 30882 raft_consensus.cc:515] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: false } }
I20260709 13:11:01.051290 30882 leader_election.cc:290] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445), 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465)
W20260709 13:11:01.052590 23229 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:01.057610 23229 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111)
W20260709 13:11:01.062103 23227 leader_election.cc:336] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 691cccbd0258483ebe19e1581674cc94 (127.20.227.130:41465): Network error: Client connection negotiation failed: client connection to 127.20.227.130:41465: connect: Connection refused (error 111)
I20260709 13:11:01.062623 23227 leader_election.cc:304] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2f181263f446a6962b649f9348c15f; no voters: 691cccbd0258483ebe19e1581674cc94, 6ca917eaada84bf38a5daae9f8ffa066
I20260709 13:11:01.063897 30885 raft_consensus.cc:2749] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:01.075040 23229 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:01.089190 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:01.092751 21390 tablet_replica.cc:333] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.094309 21390 raft_consensus.cc:2243] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.095930 21390 raft_consensus.cc:2272] T 80dc0c7d4f9341eeb7472424613de2ce P fa2f181263f446a6962b649f9348c15f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.096287 23227 consensus_peers.cc:597] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:01.100764 23229 consensus_peers.cc:597] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f -> Peer 6ca917eaada84bf38a5daae9f8ffa066 (127.20.227.129:38445): Couldn't send request to peer 6ca917eaada84bf38a5daae9f8ffa066. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:11:01.100797 21390 tablet_replica.cc:333] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.102003 21390 raft_consensus.cc:2243] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.103610 21390 raft_consensus.cc:2272] T 813ede727198414390a20d5845e75e07 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.107116 21390 tablet_replica.cc:333] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.108071 21390 raft_consensus.cc:2243] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.109251 21390 raft_consensus.cc:2272] T ca60e389358849e7bf461e472007a7f7 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.112792 21390 tablet_replica.cc:333] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.113801 21390 raft_consensus.cc:2243] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.115280 21390 raft_consensus.cc:2272] T 21b9ab72464841aca55186beb0dbeb53 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.119468 21390 tablet_replica.cc:333] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.120540 21390 raft_consensus.cc:2243] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:11:01.121451 23227 consensus_peers.cc:597] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:01.122283 21390 raft_consensus.cc:2272] T f0e2410740c9458db983018bbe19dcbf P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.125581 21390 tablet_replica.cc:333] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.126341 21390 raft_consensus.cc:2243] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.127233 21390 raft_consensus.cc:2272] T 7452859c008745c19509f4d5d908e8f1 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.130916 21390 tablet_replica.cc:333] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.131613 21390 raft_consensus.cc:2243] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.132243 21390 raft_consensus.cc:2272] T acc845449beb4f859e55185200f34bd2 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.135439 21390 tablet_replica.cc:333] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.136176 21390 raft_consensus.cc:2243] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.136906 21390 raft_consensus.cc:2272] T a14caf28740540799ba1c6db058346a1 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.140138 21390 tablet_replica.cc:333] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.141134 21390 raft_consensus.cc:2243] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.142118 21390 raft_consensus.cc:2272] T 384f494818f741d1bb257daeaab933f2 P fa2f181263f446a6962b649f9348c15f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.145831 21390 tablet_replica.cc:333] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.146669 21390 raft_consensus.cc:2243] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.147433 21390 raft_consensus.cc:2272] T e294969b50aa438bb288b913f169f06e P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.150398 21390 tablet_replica.cc:333] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.151194 21390 raft_consensus.cc:2243] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.152757 21390 raft_consensus.cc:2272] T 1f196f572a5c44a1adb647d7ebc64463 P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.155416 21390 tablet_replica.cc:333] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.156102 21390 raft_consensus.cc:2243] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.156922 21390 raft_consensus.cc:2272] T 3eac3c624e2c43fc9505fe5c344151d0 P fa2f181263f446a6962b649f9348c15f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.159690 21390 tablet_replica.cc:333] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.160328 21390 raft_consensus.cc:2243] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.161142 21390 raft_consensus.cc:2272] T ee0a982f0606460f93cc934c9319409d P fa2f181263f446a6962b649f9348c15f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.164153 21390 tablet_replica.cc:333] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.164786 21390 raft_consensus.cc:2243] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.166649 21390 raft_consensus.cc:2272] T d3feac7af5754b40a9c951d0a8e31413 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.169628 21390 tablet_replica.cc:333] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.170223 21390 raft_consensus.cc:2243] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.170982 21390 raft_consensus.cc:2272] T 77ec411c33594ae08408279ef5c44410 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.173897 21390 tablet_replica.cc:333] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.174520 21390 raft_consensus.cc:2243] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.175937 21390 raft_consensus.cc:2272] T 34b4979f789f48d0807b87e7a48b9a78 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.179042 21390 tablet_replica.cc:333] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.179694 21390 raft_consensus.cc:2243] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.181028 21390 raft_consensus.cc:2272] T b9c028af0e9e408792f2900ec24e194b P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.183817 21390 tablet_replica.cc:333] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.184522 21390 raft_consensus.cc:2243] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.185385 21390 raft_consensus.cc:2272] T 9cfd6d3ed51d40fb8cab7d75c1f29423 P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.188230 21390 tablet_replica.cc:333] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.188822 21390 raft_consensus.cc:2243] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.190222 21390 raft_consensus.cc:2272] T a9239c6f95c54166b454ada0dd9c1b9b P fa2f181263f446a6962b649f9348c15f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.192658 21390 tablet_replica.cc:333] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.193348 21390 raft_consensus.cc:2243] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.194816 21390 raft_consensus.cc:2272] T ec33ad69c4af4d379aff74ce15c85af7 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.197676 21390 tablet_replica.cc:333] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.198463 21390 raft_consensus.cc:2243] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f [term 9 LEARNER]: Raft consensus shutting down.
I20260709 13:11:01.199201 21390 pending_rounds.cc:70] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Trying to abort 1 pending ops.
I20260709 13:11:01.199494 21390 pending_rounds.cc:77] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7305635915037470720 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "0328fc7e60424283b5d1ea734bd5136a" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6ca917eaada84bf38a5daae9f8ffa066" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 38445 } } peers { permanent_uuid: "691cccbd0258483ebe19e1581674cc94" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "5e72fb99f5ee4943a91cf8e6dd73e80e" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 35857 } } peers { permanent_uuid: "fa2f181263f446a6962b649f9348c15f" member_type: NON_VOTER last_known_addr { host: "127.20.227.132" port: 42571 } attrs { promote: true } } } }
I20260709 13:11:01.201342 21390 raft_consensus.cc:2917] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f [term 9 LEARNER]: Aborting config change with OpId 8.7: Aborted: Op aborted
I20260709 13:11:01.202152 21390 raft_consensus.cc:2889] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f [term 9 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:11:01.202466 21390 raft_consensus.cc:2272] T 0328fc7e60424283b5d1ea734bd5136a P fa2f181263f446a6962b649f9348c15f [term 9 NON_PARTICIPANT]: Raft consensus is shut down!
W20260709 13:11:01.203898 23227 consensus_peers.cc:597] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f -> Peer 5e72fb99f5ee4943a91cf8e6dd73e80e (127.20.227.131:35857): Couldn't send request to peer 5e72fb99f5ee4943a91cf8e6dd73e80e. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:35857: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:01.206153 21390 tablet_replica.cc:333] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.206877 21390 raft_consensus.cc:2243] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.208463 21390 raft_consensus.cc:2272] T 6a76a7949bf24ada8b2cc5dcacab4bf3 P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.211700 21390 tablet_replica.cc:333] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.212417 21390 raft_consensus.cc:2243] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.213184 21390 pending_rounds.cc:70] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Trying to abort 1 pending ops.
I20260709 13:11:01.213423 21390 pending_rounds.cc:77] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7305636489443553280 op_type: NO_OP noop_request { }
I20260709 13:11:01.213780 21390 raft_consensus.cc:2889] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:01.214156 21390 raft_consensus.cc:2272] T b09d79da74a54c84ab38db5f54cacc35 P fa2f181263f446a6962b649f9348c15f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.217083 21390 tablet_replica.cc:333] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.217721 21390 raft_consensus.cc:2243] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.218905 21390 raft_consensus.cc:2272] T 0a60725e5550479db8d1e52b48126750 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.221999 21390 tablet_replica.cc:333] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.222901 21390 raft_consensus.cc:2243] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.223687 21390 raft_consensus.cc:2272] T 90227a385eee486dbc981f55629940e4 P fa2f181263f446a6962b649f9348c15f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.226212 21390 tablet_replica.cc:333] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.226872 21390 raft_consensus.cc:2243] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.228291 21390 raft_consensus.cc:2272] T 6530ceb18c814f10ad99777fb17a2ea1 P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.231817 21390 tablet_replica.cc:333] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.232450 21390 raft_consensus.cc:2243] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.233299 21390 raft_consensus.cc:2272] T d36d7ae701b84ad59f37ee479b4bd84f P fa2f181263f446a6962b649f9348c15f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.236333 21390 tablet_replica.cc:333] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.236984 21390 raft_consensus.cc:2243] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.238252 21390 raft_consensus.cc:2272] T be7264d3053b44989c5504d296ea482b P fa2f181263f446a6962b649f9348c15f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.240828 21390 tablet_replica.cc:333] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.241456 21390 raft_consensus.cc:2243] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.242368 21390 raft_consensus.cc:2272] T 6f42f0567ae14f62b39e69ed29a409cf P fa2f181263f446a6962b649f9348c15f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.245042 21390 tablet_replica.cc:333] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.245659 21390 raft_consensus.cc:2243] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.246333 21390 raft_consensus.cc:2272] T b881738a5b7f4910b375833c1cd61083 P fa2f181263f446a6962b649f9348c15f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.249179 21390 tablet_replica.cc:333] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.249720 21390 raft_consensus.cc:2243] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.250905 21390 raft_consensus.cc:2272] T 5b79bbacdb324d378e564aba36fc4014 P fa2f181263f446a6962b649f9348c15f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.253661 21390 tablet_replica.cc:333] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.254235 21390 raft_consensus.cc:2243] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.254925 21390 raft_consensus.cc:2272] T 799bdeb956cf4c76aa244c0f5bbc89c2 P fa2f181263f446a6962b649f9348c15f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.257944 21390 tablet_replica.cc:333] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.258585 21390 raft_consensus.cc:2243] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.259821 21390 raft_consensus.cc:2272] T 549907a9ef52413ab776c58c50b74e5d P fa2f181263f446a6962b649f9348c15f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.262137 21390 tablet_replica.cc:333] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.262728 21390 raft_consensus.cc:2243] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.263535 21390 raft_consensus.cc:2272] T 360d81cdb43c4dd69ba77b3db56e94e4 P fa2f181263f446a6962b649f9348c15f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.266299 21390 tablet_replica.cc:333] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f: stopping tablet replica
I20260709 13:11:01.266844 21390 raft_consensus.cc:2243] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.267342 21390 raft_consensus.cc:2272] T 39009bfe483947928e10122b4bb55ca6 P fa2f181263f446a6962b649f9348c15f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:02.079164 23285 debug-util.cc:398] Leaking SignalData structure 0x7b080009dd80 after lost signal to thread 21393
W20260709 13:11:02.080448 23285 debug-util.cc:398] Leaking SignalData structure 0x7b0800248800 after lost signal to thread 22437
W20260709 13:11:02.081220 23285 debug-util.cc:398] Leaking SignalData structure 0x7b0800189140 after lost signal to thread 23288
W20260709 13:11:02.343338 21390 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23285)
I20260709 13:11:03.077251 21390 tablet_server.cc:196] TabletServer@127.20.227.132:0 shutdown complete.
I20260709 13:11:03.161113 21390 master.cc:562] Master@127.20.227.190:45599 shutting down...
W20260709 13:11:03.202185 22449 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:11:03.202572 22449 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:11:03.202829 22449 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:11:03.211130 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:03.212018 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:03.212414 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P b97e77c8afed466a990720a609bf1968: stopping tablet replica
W20260709 13:11:03.796023 22434 debug-util.cc:398] Leaking SignalData structure 0x7b0800307d60 after lost signal to thread 21393
W20260709 13:11:03.797269 22434 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9ec0 after lost signal to thread 22437
I20260709 13:11:04.105396 21390 master.cc:584] Master@127.20.227.190:45599 shutdown complete.
I20260709 13:11:04.154541 21390 test_util.cc:182] -----------------------------------------------
I20260709 13:11:04.154808 21390 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602379708834-21390-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (260491 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:11:04.158207 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:43499
I20260709 13:11:04.159335 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:04.165735 30886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.165831 30887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.166273 30889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:04.167513 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:04.171840 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:04.172061 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:04.172268 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602664172252 us; error 0 us; skew 500 ppm
I20260709 13:11:04.172900 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:04.175560 21390 webserver.cc:533] Webserver started at http://127.20.227.190:34485/ using document root <none> and password file <none>
I20260709 13:11:04.176107 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:04.176301 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:04.176584 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:04.177954 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "0746e06264bc46e0b368986ee35b6398"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.182802 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:04.186565 30894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.187564 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:04.187924 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "0746e06264bc46e0b368986ee35b6398"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.188290 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:04.213116 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:04.214587 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:04.260812 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:43499
I20260709 13:11:04.261026 30945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:43499 every 8 connection(s)
I20260709 13:11:04.265314 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.276527 30946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398: Bootstrap starting.
I20260709 13:11:04.281725 30946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.286303 30946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398: No bootstrap required, opened a new log
I20260709 13:11:04.288796 30946 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0746e06264bc46e0b368986ee35b6398" member_type: VOTER }
I20260709 13:11:04.289279 30946 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.289556 30946 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0746e06264bc46e0b368986ee35b6398, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.290269 30946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0746e06264bc46e0b368986ee35b6398" member_type: VOTER }
I20260709 13:11:04.290781 30946 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:04.291033 30946 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:04.291252 30946 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.296350 30946 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0746e06264bc46e0b368986ee35b6398" member_type: VOTER }
I20260709 13:11:04.297159 30946 leader_election.cc:304] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0746e06264bc46e0b368986ee35b6398; no voters: 
I20260709 13:11:04.299152 30946 leader_election.cc:290] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:04.299743 30949 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.301466 30949 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 1 LEADER]: Becoming Leader. State: Replica: 0746e06264bc46e0b368986ee35b6398, State: Running, Role: LEADER
I20260709 13:11:04.302759 30949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0746e06264bc46e0b368986ee35b6398" member_type: VOTER }
I20260709 13:11:04.304137 30946 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:04.309193 30950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0746e06264bc46e0b368986ee35b6398. Latest consensus state: current_term: 1 leader_uuid: "0746e06264bc46e0b368986ee35b6398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0746e06264bc46e0b368986ee35b6398" member_type: VOTER } }
I20260709 13:11:04.309307 30951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0746e06264bc46e0b368986ee35b6398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0746e06264bc46e0b368986ee35b6398" member_type: VOTER } }
I20260709 13:11:04.310647 30951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:04.310746 30950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:04.316632 30956 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:04.323274 30956 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:04.324581 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:04.333199 30956 catalog_manager.cc:1383] Generated new cluster ID: c56dc4852e514dae8e7ad3e9787cee95
I20260709 13:11:04.333550 30956 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:04.355536 30956 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:04.356964 30956 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:04.373960 30956 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398: Generated new TSK 0
I20260709 13:11:04.374673 30956 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:04.392154 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:04.398769 30967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.399782 30968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.402944 30970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:04.403266 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:04.405853 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:04.406102 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:04.406292 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602664406274 us; error 0 us; skew 500 ppm
I20260709 13:11:04.406929 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:04.410279 21390 webserver.cc:533] Webserver started at http://127.20.227.129:43111/ using document root <none> and password file <none>
I20260709 13:11:04.410837 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:04.411068 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:04.411352 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:04.412611 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "116e6baff6234eadbc262b5fb70cfd5b"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.418066 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:04.422289 30975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.423339 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:04.423765 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "116e6baff6234eadbc262b5fb70cfd5b"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.424141 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:04.442008 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:04.443397 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:04.445112 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:04.447551 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:04.447827 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.448088 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:04.448290 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.494064 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:36611
I20260709 13:11:04.494184 31037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:36611 every 8 connection(s)
I20260709 13:11:04.499574 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:04.508724 31043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.508913 31042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.511302 31045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:04.513574 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:04.515964 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:04.516193 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:04.516332 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602664516321 us; error 0 us; skew 500 ppm
I20260709 13:11:04.516950 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:04.520120 21390 webserver.cc:533] Webserver started at http://127.20.227.130:36291/ using document root <none> and password file <none>
I20260709 13:11:04.520702 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:04.520933 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:04.521216 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:04.521700 31038 heartbeater.cc:344] Connected to a master server at 127.20.227.190:43499
I20260709 13:11:04.522167 31038 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:04.522629 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "13bb23988f5940e5ba175699ca30e0d6"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.523036 31038 heartbeater.cc:507] Master 127.20.227.190:43499 requested a full tablet report, sending...
I20260709 13:11:04.525543 30911 ts_manager.cc:194] Registered new tserver with Master: 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:04.528050 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:11:04.528158 30911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48374
I20260709 13:11:04.532434 31050 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.533600 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:04.533921 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "13bb23988f5940e5ba175699ca30e0d6"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.534281 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:04.544109 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:04.545691 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:04.547364 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:04.550359 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:04.550727 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.551024 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:04.551183 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.598057 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:37997
I20260709 13:11:04.598181 31112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:37997 every 8 connection(s)
I20260709 13:11:04.603399 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:04.612233 31116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.613744 31117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.615583 31119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:04.616289 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:04.617430 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:04.617707 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:04.617719 31113 heartbeater.cc:344] Connected to a master server at 127.20.227.190:43499
I20260709 13:11:04.618018 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602664617999 us; error 0 us; skew 500 ppm
I20260709 13:11:04.618245 31113 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:04.618800 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:04.619166 31113 heartbeater.cc:507] Master 127.20.227.190:43499 requested a full tablet report, sending...
I20260709 13:11:04.621974 21390 webserver.cc:533] Webserver started at http://127.20.227.131:33901/ using document root <none> and password file <none>
I20260709 13:11:04.622305 30911 ts_manager.cc:194] Registered new tserver with Master: 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:04.622740 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:04.623056 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:04.623412 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:04.624318 30911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48376
I20260709 13:11:04.625056 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "e0094be1075d460cafd5160946c09aed"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.630308 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:04.634217 31124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.635203 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:04.635484 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "e0094be1075d460cafd5160946c09aed"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.635788 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:04.667588 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:04.668841 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:04.670462 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:04.673022 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:04.673234 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.673523 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:04.673731 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.721832 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:45509
I20260709 13:11:04.721833 31186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:45509 every 8 connection(s)
I20260709 13:11:04.727066 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:04.735757 31190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:04.746079 31191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:04.748113 31187 heartbeater.cc:344] Connected to a master server at 127.20.227.190:43499
I20260709 13:11:04.748993 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:04.748979 31187 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:04.751363 31187 heartbeater.cc:507] Master 127.20.227.190:43499 requested a full tablet report, sending...
W20260709 13:11:04.752799 31193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:04.754055 30911 ts_manager.cc:194] Registered new tserver with Master: e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:04.754206 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:04.754576 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:04.754827 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602664754808 us; error 0 us; skew 500 ppm
I20260709 13:11:04.755677 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:04.756107 30911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48386
I20260709 13:11:04.759182 21390 webserver.cc:533] Webserver started at http://127.20.227.132:38181/ using document root <none> and password file <none>
I20260709 13:11:04.759728 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:04.759900 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:04.760105 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:04.761307 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-3-root/instance:
uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.766168 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:11:04.771036 31198 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.772149 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:11:04.772469 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-3-root
uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:04.772740 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:04.792670 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:04.794071 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:04.795364 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:04.797802 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:04.797996 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.798309 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:04.798488 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:04.848940 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.132:45991
I20260709 13:11:04.849114 31260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.132:45991 every 8 connection(s)
I20260709 13:11:04.865692 31261 heartbeater.cc:344] Connected to a master server at 127.20.227.190:43499
I20260709 13:11:04.866161 31261 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:04.867120 31261 heartbeater.cc:507] Master 127.20.227.190:43499 requested a full tablet report, sending...
I20260709 13:11:04.869513 30911 ts_manager.cc:194] Registered new tserver with Master: dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:04.869774 21390 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017061434s
I20260709 13:11:04.871105 30911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48394
I20260709 13:11:04.900127 30911 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48402:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:11:05.177443 31150 tablet_service.cc:1511] Processing CreateTablet for tablet a348c59d23d847cd8e01296e609f0e8c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:05.179008 31150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a348c59d23d847cd8e01296e609f0e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.182135 31151 tablet_service.cc:1511] Processing CreateTablet for tablet 6c75c9a447d34afbadebde99ab3d010b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:05.183598 31151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c75c9a447d34afbadebde99ab3d010b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.186210 31152 tablet_service.cc:1511] Processing CreateTablet for tablet 61b038abfe774f34a24e07139da4520b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:05.191315 31149 tablet_service.cc:1511] Processing CreateTablet for tablet 72c808b493dc45a290985c48d06f1dcb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:05.193998 31148 tablet_service.cc:1511] Processing CreateTablet for tablet 8d55d9d82c1b4132bc6b1dfa24082de4 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:05.195055 31226 tablet_service.cc:1511] Processing CreateTablet for tablet 591d8edfc1be4d78be4cab40b1e156cd (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:05.196563 31226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591d8edfc1be4d78be4cab40b1e156cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.196388 31147 tablet_service.cc:1511] Processing CreateTablet for tablet 10a49c820fa64c7bbd18b86ed3d16bb3 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:05.198096 31225 tablet_service.cc:1511] Processing CreateTablet for tablet 6c75c9a447d34afbadebde99ab3d010b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:05.199535 31225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c75c9a447d34afbadebde99ab3d010b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.200400 31146 tablet_service.cc:1511] Processing CreateTablet for tablet 15ad993bfbea46e0a43ffcb149c68de7 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:05.203184 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c808b493dc45a290985c48d06f1dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.204911 31147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a49c820fa64c7bbd18b86ed3d16bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.206724 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b038abfe774f34a24e07139da4520b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.207976 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d55d9d82c1b4132bc6b1dfa24082de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.208117 31224 tablet_service.cc:1511] Processing CreateTablet for tablet a348c59d23d847cd8e01296e609f0e8c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:05.209607 31224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a348c59d23d847cd8e01296e609f0e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.209666 31221 tablet_service.cc:1511] Processing CreateTablet for tablet 10a49c820fa64c7bbd18b86ed3d16bb3 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:05.211189 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a49c820fa64c7bbd18b86ed3d16bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.211340 31222 tablet_service.cc:1511] Processing CreateTablet for tablet 8d55d9d82c1b4132bc6b1dfa24082de4 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:05.213632 31003 tablet_service.cc:1511] Processing CreateTablet for tablet 591d8edfc1be4d78be4cab40b1e156cd (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:05.214092 31002 tablet_service.cc:1511] Processing CreateTablet for tablet 61b038abfe774f34a24e07139da4520b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:05.215103 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591d8edfc1be4d78be4cab40b1e156cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.215221 30996 tablet_service.cc:1511] Processing CreateTablet for tablet e6ac6de9f3474deaa670077135f894f7 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:05.216722 30996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ac6de9f3474deaa670077135f894f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.216773 31001 tablet_service.cc:1511] Processing CreateTablet for tablet 6c75c9a447d34afbadebde99ab3d010b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:05.218369 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c75c9a447d34afbadebde99ab3d010b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.218077 31220 tablet_service.cc:1511] Processing CreateTablet for tablet e6ac6de9f3474deaa670077135f894f7 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:05.220081 31223 tablet_service.cc:1511] Processing CreateTablet for tablet cfc60351fa2144dda7548a307178a27b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:05.222163 30999 tablet_service.cc:1511] Processing CreateTablet for tablet cfc60351fa2144dda7548a307178a27b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:05.223620 30999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc60351fa2144dda7548a307178a27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.226330 30997 tablet_service.cc:1511] Processing CreateTablet for tablet 15ad993bfbea46e0a43ffcb149c68de7 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:05.229415 31219 tablet_service.cc:1511] Processing CreateTablet for tablet b094ad0db83444268d00301854825ce5 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:05.231530 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 61b038abfe774f34a24e07139da4520b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:05.232059 30998 tablet_service.cc:1511] Processing CreateTablet for tablet 8d55d9d82c1b4132bc6b1dfa24082de4 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:05.227871 30997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ad993bfbea46e0a43ffcb149c68de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.233898 31078 tablet_service.cc:1511] Processing CreateTablet for tablet 591d8edfc1be4d78be4cab40b1e156cd (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:05.234079 31076 tablet_service.cc:1511] Processing CreateTablet for tablet a348c59d23d847cd8e01296e609f0e8c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:05.236718 31075 tablet_service.cc:1511] Processing CreateTablet for tablet 72c808b493dc45a290985c48d06f1dcb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:05.212672 31000 tablet_service.cc:1511] Processing CreateTablet for tablet 72c808b493dc45a290985c48d06f1dcb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:05.238107 30998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d55d9d82c1b4132bc6b1dfa24082de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.239008 31000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c808b493dc45a290985c48d06f1dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.238852 31071 tablet_service.cc:1511] Processing CreateTablet for tablet e6ac6de9f3474deaa670077135f894f7 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:05.240363 31002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b038abfe774f34a24e07139da4520b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.241176 31146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ad993bfbea46e0a43ffcb149c68de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.242287 31073 tablet_service.cc:1511] Processing CreateTablet for tablet 10a49c820fa64c7bbd18b86ed3d16bb3 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:05.245424 31219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b094ad0db83444268d00301854825ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.247180 31074 tablet_service.cc:1511] Processing CreateTablet for tablet cfc60351fa2144dda7548a307178a27b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:05.245028 31072 tablet_service.cc:1511] Processing CreateTablet for tablet 15ad993bfbea46e0a43ffcb149c68de7 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:05.234091 30995 tablet_service.cc:1511] Processing CreateTablet for tablet b094ad0db83444268d00301854825ce5 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:05.250065 31222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d55d9d82c1b4132bc6b1dfa24082de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.250243 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b094ad0db83444268d00301854825ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.254710 31223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc60351fa2144dda7548a307178a27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.258751 31070 tablet_service.cc:1511] Processing CreateTablet for tablet 36995fac4a8745f1ae1c292c94f4f813 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:05.259881 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ac6de9f3474deaa670077135f894f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.254565 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b038abfe774f34a24e07139da4520b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.260953 31078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591d8edfc1be4d78be4cab40b1e156cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.261786 31070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36995fac4a8745f1ae1c292c94f4f813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.262468 31074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc60351fa2144dda7548a307178a27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.263121 31073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a49c820fa64c7bbd18b86ed3d16bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.263773 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ac6de9f3474deaa670077135f894f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.269304 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a348c59d23d847cd8e01296e609f0e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.273862 31072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ad993bfbea46e0a43ffcb149c68de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.275494 31218 tablet_service.cc:1511] Processing CreateTablet for tablet 36995fac4a8745f1ae1c292c94f4f813 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:05.278548 30994 tablet_service.cc:1511] Processing CreateTablet for tablet d463c852ffa846c0a6cabd5e29c4c32d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:05.280081 30994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d463c852ffa846c0a6cabd5e29c4c32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.281016 31069 tablet_service.cc:1511] Processing CreateTablet for tablet d463c852ffa846c0a6cabd5e29c4c32d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:05.282635 31069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d463c852ffa846c0a6cabd5e29c4c32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.285367 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c808b493dc45a290985c48d06f1dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.289305 31218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36995fac4a8745f1ae1c292c94f4f813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.294813 31145 tablet_service.cc:1511] Processing CreateTablet for tablet b094ad0db83444268d00301854825ce5 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:05.295183 31217 tablet_service.cc:1511] Processing CreateTablet for tablet be55665ac28642f4b97c7716efcb8e47 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:05.296461 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b094ad0db83444268d00301854825ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.296657 31217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be55665ac28642f4b97c7716efcb8e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.298926 31144 tablet_service.cc:1511] Processing CreateTablet for tablet 36995fac4a8745f1ae1c292c94f4f813 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:05.300447 31144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36995fac4a8745f1ae1c292c94f4f813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.302855 31143 tablet_service.cc:1511] Processing CreateTablet for tablet d463c852ffa846c0a6cabd5e29c4c32d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:05.304513 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d463c852ffa846c0a6cabd5e29c4c32d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:05.318794 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:05.377727 31217 tablet_service.cc:1511] Processing CreateTablet for tablet cb456ded01cd478bb026e7177d35b17c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:05.379680 31217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb456ded01cd478bb026e7177d35b17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.458106 30996 tablet_service.cc:1511] Processing CreateTablet for tablet cb456ded01cd478bb026e7177d35b17c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:05.458214 30995 tablet_service.cc:1511] Processing CreateTablet for tablet be55665ac28642f4b97c7716efcb8e47 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:05.459678 30996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb456ded01cd478bb026e7177d35b17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.456321 31075 tablet_service.cc:1511] Processing CreateTablet for tablet be55665ac28642f4b97c7716efcb8e47 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:05.478295 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be55665ac28642f4b97c7716efcb8e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.479362 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3f639e54a041fdb1c2d051bed72073 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:05.480839 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3f639e54a041fdb1c2d051bed72073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.485121 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be55665ac28642f4b97c7716efcb8e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.484375 31069 tablet_service.cc:1511] Processing CreateTablet for tablet d19e2ee8edef4c659be9276658c65913 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:05.492141 31069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19e2ee8edef4c659be9276658c65913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.494632 31282 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:05.525043 30898 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 56072.9us
I20260709 13:11:05.526885 31149 tablet_service.cc:1511] Processing CreateTablet for tablet cb456ded01cd478bb026e7177d35b17c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:05.527666 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 76957cc6f9014c59b535bb48b9ff4b79 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:05.528491 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb456ded01cd478bb026e7177d35b17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.529140 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76957cc6f9014c59b535bb48b9ff4b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.529254 31152 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3f639e54a041fdb1c2d051bed72073 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:05.531920 31038 heartbeater.cc:499] Master 127.20.227.190:43499 was elected leader, sending a full tablet report...
I20260709 13:11:05.538882 30998 tablet_service.cc:1511] Processing CreateTablet for tablet 76957cc6f9014c59b535bb48b9ff4b79 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:05.540257 30998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76957cc6f9014c59b535bb48b9ff4b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.544430 31283 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:05.488760 31003 tablet_service.cc:1511] Processing CreateTablet for tablet d19e2ee8edef4c659be9276658c65913 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:05.562155 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19e2ee8edef4c659be9276658c65913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.566314 31146 tablet_service.cc:1511] Processing CreateTablet for tablet d19e2ee8edef4c659be9276658c65913 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:05.568084 31282 tablet_bootstrap.cc:654] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.479362 31226 tablet_service.cc:1511] Processing CreateTablet for tablet 76957cc6f9014c59b535bb48b9ff4b79 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:05.578671 31281 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:05.579910 31283 tablet_bootstrap.cc:654] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.581347 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3f639e54a041fdb1c2d051bed72073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.581743 31148 tablet_service.cc:1511] Processing CreateTablet for tablet bb04a7b75afd4166aee199de5f812c01 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:05.583086 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb04a7b75afd4166aee199de5f812c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.577527 31226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76957cc6f9014c59b535bb48b9ff4b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.588191 31221 tablet_service.cc:1511] Processing CreateTablet for tablet bb04a7b75afd4166aee199de5f812c01 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:05.589721 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb04a7b75afd4166aee199de5f812c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.575639 31223 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3f639e54a041fdb1c2d051bed72073 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:05.593729 31223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3f639e54a041fdb1c2d051bed72073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.605754 31284 tablet_bootstrap.cc:492] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:05.605350 30995 tablet_service.cc:1511] Processing CreateTablet for tablet bb04a7b75afd4166aee199de5f812c01 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:05.606894 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb04a7b75afd4166aee199de5f812c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.608835 31146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19e2ee8edef4c659be9276658c65913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.616432 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 2d927c6d703d46e2b498aab379411581 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:05.630941 31113 heartbeater.cc:499] Master 127.20.227.190:43499 was elected leader, sending a full tablet report...
I20260709 13:11:05.632035 31220 tablet_service.cc:1511] Processing CreateTablet for tablet 2d927c6d703d46e2b498aab379411581 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:05.635998 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d927c6d703d46e2b498aab379411581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.634554 31149 tablet_service.cc:1511] Processing CreateTablet for tablet 2d927c6d703d46e2b498aab379411581 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:05.637292 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d927c6d703d46e2b498aab379411581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.657513 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d927c6d703d46e2b498aab379411581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.640839 31284 tablet_bootstrap.cc:654] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.679193 31076 tablet_service.cc:1511] Processing CreateTablet for tablet e9171d33cb114ba2850a02216ed350a1 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:05.673139 31002 tablet_service.cc:1511] Processing CreateTablet for tablet e9171d33cb114ba2850a02216ed350a1 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:05.680840 31002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9171d33cb114ba2850a02216ed350a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.680840 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9171d33cb114ba2850a02216ed350a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.684607 31282 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:05.685209 31282 ts_tablet_manager.cc:1403] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.191s	user 0.025s	sys 0.021s
I20260709 13:11:05.675343 31281 tablet_bootstrap.cc:654] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.706133 31217 tablet_service.cc:1511] Processing CreateTablet for tablet b86383b831804250835ad3b3d8f3f44c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:05.707686 31217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86383b831804250835ad3b3d8f3f44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.707383 31282 raft_consensus.cc:359] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:05.709860 31145 tablet_service.cc:1511] Processing CreateTablet for tablet e9171d33cb114ba2850a02216ed350a1 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:05.712365 30996 tablet_service.cc:1511] Processing CreateTablet for tablet b86383b831804250835ad3b3d8f3f44c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:05.716363 31283 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:05.714148 31282 raft_consensus.cc:385] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.723016 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9171d33cb114ba2850a02216ed350a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.717904 31069 tablet_service.cc:1511] Processing CreateTablet for tablet b86383b831804250835ad3b3d8f3f44c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:05.725970 31069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86383b831804250835ad3b3d8f3f44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.727391 31146 tablet_service.cc:1511] Processing CreateTablet for tablet 4024d7ca443348189e2bce2cafeca403 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:05.728742 31146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4024d7ca443348189e2bce2cafeca403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.738821 31226 tablet_service.cc:1511] Processing CreateTablet for tablet 4024d7ca443348189e2bce2cafeca403 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:05.740309 31226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4024d7ca443348189e2bce2cafeca403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.718936 31282 raft_consensus.cc:740] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.742523 31282 consensus_queue.cc:260] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:05.743574 30995 tablet_service.cc:1511] Processing CreateTablet for tablet 4024d7ca443348189e2bce2cafeca403 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:05.749863 31077 tablet_service.cc:1511] Processing CreateTablet for tablet e03e12bc43e64de9b904105f3a74f98e (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:05.751297 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e12bc43e64de9b904105f3a74f98e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.751196 31152 tablet_service.cc:1511] Processing CreateTablet for tablet e03e12bc43e64de9b904105f3a74f98e (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:05.752769 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e12bc43e64de9b904105f3a74f98e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.753336 30996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86383b831804250835ad3b3d8f3f44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.722010 31283 ts_tablet_manager.cc:1403] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.178s	user 0.014s	sys 0.005s
I20260709 13:11:05.758539 31001 tablet_service.cc:1511] Processing CreateTablet for tablet 907cbf2380f64d5fb28bc0d5b47a0505 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:05.761195 31187 heartbeater.cc:499] Master 127.20.227.190:43499 was elected leader, sending a full tablet report...
I20260709 13:11:05.759577 31220 tablet_service.cc:1511] Processing CreateTablet for tablet e03e12bc43e64de9b904105f3a74f98e (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:05.762161 31219 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca5c8e4b4b9485a8be8282fb6372669 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:05.762540 31149 tablet_service.cc:1511] Processing CreateTablet for tablet 907cbf2380f64d5fb28bc0d5b47a0505 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:05.763638 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e12bc43e64de9b904105f3a74f98e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.762241 31075 tablet_service.cc:1511] Processing CreateTablet for tablet 907cbf2380f64d5fb28bc0d5b47a0505 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:05.765067 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907cbf2380f64d5fb28bc0d5b47a0505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.769241 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907cbf2380f64d5fb28bc0d5b47a0505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.769331 31219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca5c8e4b4b9485a8be8282fb6372669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.771432 31283 raft_consensus.cc:359] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:05.775192 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907cbf2380f64d5fb28bc0d5b47a0505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.793380 31283 raft_consensus.cc:385] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.796954 31283 raft_consensus.cc:740] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.798084 31283 consensus_queue.cc:260] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:05.795406 31281 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:05.794332 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4024d7ca443348189e2bce2cafeca403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.787109 31284 tablet_bootstrap.cc:492] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:05.806296 31284 ts_tablet_manager.cc:1403] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.201s	user 0.026s	sys 0.000s
I20260709 13:11:05.806968 30998 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca5c8e4b4b9485a8be8282fb6372669 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:05.808425 30998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca5c8e4b4b9485a8be8282fb6372669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.809568 31284 raft_consensus.cc:359] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:05.810360 31284 raft_consensus.cc:385] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.810485 31281 ts_tablet_manager.cc:1403] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.232s	user 0.006s	sys 0.013s
I20260709 13:11:05.810747 31284 raft_consensus.cc:740] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.818183 31284 consensus_queue.cc:260] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:05.826982 31281 raft_consensus.cc:359] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:05.827947 31281 raft_consensus.cc:385] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.828358 31281 raft_consensus.cc:740] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.830570 31281 consensus_queue.cc:260] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:05.854053 31282 ts_tablet_manager.cc:1434] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.168s	user 0.023s	sys 0.021s
I20260709 13:11:05.856302 31283 ts_tablet_manager.cc:1434] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.004s
I20260709 13:11:05.858672 31283 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:05.859215 31284 ts_tablet_manager.cc:1434] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.004s
I20260709 13:11:05.860508 31284 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:05.867331 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca5c8e4b4b9485a8be8282fb6372669 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:05.868934 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca5c8e4b4b9485a8be8282fb6372669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.870189 31220 tablet_service.cc:1511] Processing CreateTablet for tablet ec1733f1f71041d8a04cc61010a93c40 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:05.871770 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1733f1f71041d8a04cc61010a93c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.876297 31261 heartbeater.cc:499] Master 127.20.227.190:43499 was elected leader, sending a full tablet report...
I20260709 13:11:05.882742 31283 tablet_bootstrap.cc:654] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.885617 31145 tablet_service.cc:1511] Processing CreateTablet for tablet ec1733f1f71041d8a04cc61010a93c40 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:05.887158 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1733f1f71041d8a04cc61010a93c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.887353 31003 tablet_service.cc:1511] Processing CreateTablet for tablet ec1733f1f71041d8a04cc61010a93c40 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:05.888787 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1733f1f71041d8a04cc61010a93c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.889882 31149 tablet_service.cc:1511] Processing CreateTablet for tablet 915f9be628344ac09e3d93a385ebbfdb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:05.891870 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915f9be628344ac09e3d93a385ebbfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.901319 31281 ts_tablet_manager.cc:1434] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.004s
I20260709 13:11:05.902009 31076 tablet_service.cc:1511] Processing CreateTablet for tablet 915f9be628344ac09e3d93a385ebbfdb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:05.857623 31282 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:05.908324 31219 tablet_service.cc:1511] Processing CreateTablet for tablet 915f9be628344ac09e3d93a385ebbfdb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:05.909893 31219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915f9be628344ac09e3d93a385ebbfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.911079 31284 tablet_bootstrap.cc:654] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.913408 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915f9be628344ac09e3d93a385ebbfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.915674 31283 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:05.916379 31283 ts_tablet_manager.cc:1403] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.007s
I20260709 13:11:05.902555 31281 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:05.928974 30996 tablet_service.cc:1511] Processing CreateTablet for tablet 9411f721c7ce43a8be90b329495cf898 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:05.929509 31075 tablet_service.cc:1511] Processing CreateTablet for tablet 9411f721c7ce43a8be90b329495cf898 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:05.930434 30996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9411f721c7ce43a8be90b329495cf898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.930971 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9411f721c7ce43a8be90b329495cf898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.932612 31283 raft_consensus.cc:359] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:05.933517 31283 raft_consensus.cc:385] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.933887 31283 raft_consensus.cc:740] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.935042 31283 consensus_queue.cc:260] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:05.939077 31282 tablet_bootstrap.cc:654] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.942221 31283 ts_tablet_manager.cc:1434] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 13:11:05.943640 31283 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:05.951454 31292 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.952119 31292 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:05.957147 31281 tablet_bootstrap.cc:654] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.964017 31292 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:05.971611 31284 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:05.972278 31284 ts_tablet_manager.cc:1403] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.010s
I20260709 13:11:05.975976 31284 raft_consensus.cc:359] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:05.976893 31284 raft_consensus.cc:385] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.977502 31283 tablet_bootstrap.cc:654] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.981768 31149 tablet_service.cc:1511] Processing CreateTablet for tablet 9411f721c7ce43a8be90b329495cf898 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:05.977322 31284 raft_consensus.cc:740] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.983024 31220 tablet_service.cc:1511] Processing CreateTablet for tablet 77215be4400643a880f8163084e38aee (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:11:05.983615 31188 tablet.cc:2406] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:05.983472 31284 consensus_queue.cc:260] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:05.984516 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77215be4400643a880f8163084e38aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.985721 30998 tablet_service.cc:1511] Processing CreateTablet for tablet 77215be4400643a880f8163084e38aee (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:05.987236 30998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77215be4400643a880f8163084e38aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.989650 31283 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:05.990386 31283 ts_tablet_manager.cc:1403] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 13:11:05.993769 31283 raft_consensus.cc:359] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:05.995679 31283 raft_consensus.cc:385] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.996088 31283 raft_consensus.cc:740] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.995261 31284 ts_tablet_manager.cc:1434] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:11:05.997355 31284 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:05.997975 31076 tablet_service.cc:1511] Processing CreateTablet for tablet 77215be4400643a880f8163084e38aee (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:05.999404 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77215be4400643a880f8163084e38aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.001452 31283 consensus_queue.cc:260] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.005676 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9411f721c7ce43a8be90b329495cf898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.010124 31283 ts_tablet_manager.cc:1434] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:06.011437 31291 raft_consensus.cc:493] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.012076 31291 raft_consensus.cc:515] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:06.015434 31291 leader_election.cc:290] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:06.017385 31284 tablet_bootstrap.cc:654] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.017805 31283 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:06.030086 31283 tablet_bootstrap.cc:654] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.031140 31281 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:06.031999 31281 ts_tablet_manager.cc:1403] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.003s
I20260709 13:11:06.035688 31281 raft_consensus.cc:359] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.036664 31281 raft_consensus.cc:385] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.037052 31281 raft_consensus.cc:740] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.041672 31281 consensus_queue.cc:260] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.053017 31289 raft_consensus.cc:493] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.044793 31281 ts_tablet_manager.cc:1434] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:11:06.060022 31282 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:06.066534 31220 tablet_service.cc:1511] Processing CreateTablet for tablet 05c2897f341b4f1c8c3d2a7956814756 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:06.059806 31291 raft_consensus.cc:493] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.067365 31282 ts_tablet_manager.cc:1403] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.210s	user 0.014s	sys 0.001s
I20260709 13:11:06.067734 31291 raft_consensus.cc:515] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.070135 31291 leader_election.cc:290] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:06.066582 31145 tablet_service.cc:1511] Processing CreateTablet for tablet 05c2897f341b4f1c8c3d2a7956814756 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:06.071296 31282 raft_consensus.cc:359] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.072064 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c2897f341b4f1c8c3d2a7956814756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.063472 31289 raft_consensus.cc:515] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.072021 31282 raft_consensus.cc:385] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.075670 31289 leader_election.cc:290] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.082783 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c2897f341b4f1c8c3d2a7956814756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.078088 31281 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:06.091070 31075 tablet_service.cc:1511] Processing CreateTablet for tablet fa0ff9b94c054250a66182155d62b0fc (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:06.077003 31282 raft_consensus.cc:740] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.093633 31282 consensus_queue.cc:260] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.095808 31282 ts_tablet_manager.cc:1434] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:11:06.096124 31152 tablet_service.cc:1511] Processing CreateTablet for tablet fa0ff9b94c054250a66182155d62b0fc (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:06.097556 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0ff9b94c054250a66182155d62b0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.102326 31003 tablet_service.cc:1511] Processing CreateTablet for tablet 83e9c5f498864f4a9ef1dcf9e952e10c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:06.103724 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e9c5f498864f4a9ef1dcf9e952e10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.107177 31282 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:06.115099 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:06.117502 31202 leader_election.cc:343] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.117344 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 83e9c5f498864f4a9ef1dcf9e952e10c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:06.119218 31281 tablet_bootstrap.cc:654] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.119393 31290 raft_consensus.cc:493] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.119946 31290 raft_consensus.cc:515] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:06.122121 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:06.127089 31202 leader_election.cc:343] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.127605 31202 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:06.113255 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0ff9b94c054250a66182155d62b0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.128561 31292 raft_consensus.cc:2749] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.129366 30998 tablet_service.cc:1511] Processing CreateTablet for tablet 05c2897f341b4f1c8c3d2a7956814756 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:06.137032 31289 raft_consensus.cc:493] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.146250 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e9c5f498864f4a9ef1dcf9e952e10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.146461 30998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c2897f341b4f1c8c3d2a7956814756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.166517 31217 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbb400d6df043169f05f3dac26057e0 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:06.167336 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d463c852ffa846c0a6cabd5e29c4c32d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:06.168545 31217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbb400d6df043169f05f3dac26057e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.170274 31146 tablet_service.cc:1511] Processing CreateTablet for tablet 83e9c5f498864f4a9ef1dcf9e952e10c (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:06.171501 31076 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbb400d6df043169f05f3dac26057e0 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:06.173394 31284 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:06.177271 31148 tablet_service.cc:1511] Processing CreateTablet for tablet e1064b7411424cda96d26036597d7585 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:06.158854 31290 leader_election.cc:290] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:06.154213 31289 raft_consensus.cc:515] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.189711 31283 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:06.190300 31283 ts_tablet_manager.cc:1403] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.173s	user 0.011s	sys 0.014s
I20260709 13:11:06.193552 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbb400d6df043169f05f3dac26057e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.193918 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1064b7411424cda96d26036597d7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.179893 31291 raft_consensus.cc:493] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.196977 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:06.197257 31291 raft_consensus.cc:515] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:06.197284 30996 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbb400d6df043169f05f3dac26057e0 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:06.198837 30996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbb400d6df043169f05f3dac26057e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.199855 31291 leader_election.cc:290] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:06.201026 31219 tablet_service.cc:1511] Processing CreateTablet for tablet fa0ff9b94c054250a66182155d62b0fc (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:06.204742 31219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0ff9b94c054250a66182155d62b0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.213424 31146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e9c5f498864f4a9ef1dcf9e952e10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.214375 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d463c852ffa846c0a6cabd5e29c4c32d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:06.187922 31284 ts_tablet_manager.cc:1403] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.191s	user 0.038s	sys 0.025s
I20260709 13:11:06.222142 31069 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff5428cc42d4f7281ae35788233dee8 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:06.223016 31145 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff5428cc42d4f7281ae35788233dee8 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:06.223912 31069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff5428cc42d4f7281ae35788233dee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.224614 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff5428cc42d4f7281ae35788233dee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.225343 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:06.226078 31160 raft_consensus.cc:2468] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:06.227448 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:06.228252 31282 tablet_bootstrap.cc:654] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.229614 30995 tablet_service.cc:1511] Processing CreateTablet for tablet e1064b7411424cda96d26036597d7585 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:06.256300 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1064b7411424cda96d26036597d7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.230077 31001 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1fdd08f91a438a9f88c5a2bc59326b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:11:06.230412 31054 leader_election.cc:343] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:06.259968 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 78082.6us
I20260709 13:11:06.260403 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1fdd08f91a438a9f88c5a2bc59326b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.231212 31053 leader_election.cc:304] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:06.261471 31291 raft_consensus.cc:2804] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:06.261626 31053 leader_election.cc:343] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.261919 31291 raft_consensus.cc:493] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.262285 31291 raft_consensus.cc:3060] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:06.262404 31053 leader_election.cc:343] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.262934 31053 leader_election.cc:304] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:06.237023 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1fdd08f91a438a9f88c5a2bc59326b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:06.266405 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1fdd08f91a438a9f88c5a2bc59326b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.244719 31143 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1fdd08f91a438a9f88c5a2bc59326b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:06.225929 31283 raft_consensus.cc:359] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.269181 31283 raft_consensus.cc:385] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.269560 31283 raft_consensus.cc:740] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.253495 31289 leader_election.cc:290] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:06.261672 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:06.269743 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1fdd08f91a438a9f88c5a2bc59326b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:06.270323 31054 leader_election.cc:343] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.275282 31291 raft_consensus.cc:515] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:06.315553 31221 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff5428cc42d4f7281ae35788233dee8 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:06.317690 31226 tablet_service.cc:1511] Processing CreateTablet for tablet e1064b7411424cda96d26036597d7585 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:06.296100 31284 raft_consensus.cc:359] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.319695 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff5428cc42d4f7281ae35788233dee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.324330 31291 leader_election.cc:290] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:06.325081 31291 raft_consensus.cc:2749] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:06.325177 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:06.321175 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ac6de9f3474deaa670077135f894f7" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:06.323179 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:06.323419 31223 tablet_service.cc:1511] Processing CreateTablet for tablet 35e351de7e26472fa16a05408cd1bef6 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:06.329281 31226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1064b7411424cda96d26036597d7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.331293 31002 tablet_service.cc:1511] Processing CreateTablet for tablet 35e351de7e26472fa16a05408cd1bef6 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:06.332829 31002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e351de7e26472fa16a05408cd1bef6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:06.310043 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 47675.3us
I20260709 13:11:06.334522 31070 tablet_service.cc:1511] Processing CreateTablet for tablet 35e351de7e26472fa16a05408cd1bef6 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:06.341547 31070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e351de7e26472fa16a05408cd1bef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.343708 31223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e351de7e26472fa16a05408cd1bef6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:06.335142 30979 leader_election.cc:343] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.343266 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:06.345196 31162 raft_consensus.cc:3060] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:06.349288 30979 leader_election.cc:343] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.349079 31222 tablet_service.cc:1511] Processing CreateTablet for tablet 199428020b7342f1b3d816182baa55e4 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:06.350704 31222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199428020b7342f1b3d816182baa55e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.270522 31283 consensus_queue.cc:260] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.336452 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a49c820fa64c7bbd18b86ed3d16bb3" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:06.356038 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ac6de9f3474deaa670077135f894f7" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:06.356765 31088 raft_consensus.cc:2468] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:06.334935 31145 tablet_service.cc:1511] Processing CreateTablet for tablet 199428020b7342f1b3d816182baa55e4 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:06.358289 30979 leader_election.cc:304] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:06.359395 31289 raft_consensus.cc:2804] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.359809 31289 raft_consensus.cc:493] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.360154 31289 raft_consensus.cc:3060] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.358708 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199428020b7342f1b3d816182baa55e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:06.366878 31128 leader_election.cc:343] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.371942 31289 raft_consensus.cc:515] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.375268 31281 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:06.375892 31281 ts_tablet_manager.cc:1403] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.298s	user 0.016s	sys 0.016s
I20260709 13:11:06.377611 31162 raft_consensus.cc:2468] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:06.381489 31281 raft_consensus.cc:359] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.382335 31281 raft_consensus.cc:385] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.382653 31281 raft_consensus.cc:740] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.383503 31281 consensus_queue.cc:260] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.385993 31053 leader_election.cc:304] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:06.387027 31317 raft_consensus.cc:2804] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.388082 31317 raft_consensus.cc:697] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:06.389933 31317 consensus_queue.cc:237] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:06.395288 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a49c820fa64c7bbd18b86ed3d16bb3" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:06.327898 31284 raft_consensus.cc:385] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:06.396798 31128 leader_election.cc:343] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.397475 31128 leader_election.cc:304] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:06.398347 31290 raft_consensus.cc:2749] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.398650 31284 raft_consensus.cc:740] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.399612 31284 consensus_queue.cc:260] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.407111 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ac6de9f3474deaa670077135f894f7" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
W20260709 13:11:06.408666 30979 leader_election.cc:343] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.409399 31284 ts_tablet_manager.cc:1434] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.191s	user 0.008s	sys 0.001s
I20260709 13:11:06.410651 31284 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:06.362177 31283 ts_tablet_manager.cc:1434] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.172s	user 0.002s	sys 0.009s
I20260709 13:11:06.413524 31283 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:06.413877 31289 leader_election.cc:290] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.415194 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ac6de9f3474deaa670077135f894f7" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:06.415853 31088 raft_consensus.cc:3060] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.309185 31054 leader_election.cc:304] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:06.417591 31291 raft_consensus.cc:2749] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:06.418591 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 148327us
W20260709 13:11:06.419845 31054 leader_election.cc:343] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.420482 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:06.421255 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:06.422386 31054 leader_election.cc:343] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:06.422961 30978 leader_election.cc:343] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.423486 30978 leader_election.cc:304] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:06.423731 31088 raft_consensus.cc:2468] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:06.424397 31289 raft_consensus.cc:2749] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.424927 30979 leader_election.cc:304] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:06.425778 31289 raft_consensus.cc:2804] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.434216 31282 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:06.434811 31282 ts_tablet_manager.cc:1403] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.338s	user 0.010s	sys 0.006s
I20260709 13:11:06.436916 30998 tablet_service.cc:1511] Processing CreateTablet for tablet 199428020b7342f1b3d816182baa55e4 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:06.438385 30998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199428020b7342f1b3d816182baa55e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.438347 31282 raft_consensus.cc:359] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.458009 31282 raft_consensus.cc:385] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.458436 31282 raft_consensus.cc:740] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.445905 31148 tablet_service.cc:1511] Processing CreateTablet for tablet aab6881f32b9471485c79ae279c00120 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:06.460390 31076 tablet_service.cc:1511] Processing CreateTablet for tablet aab6881f32b9471485c79ae279c00120 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:06.461690 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab6881f32b9471485c79ae279c00120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.462397 31284 tablet_bootstrap.cc:654] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.463068 31281 ts_tablet_manager.cc:1434] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.004s
I20260709 13:11:06.461690 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab6881f32b9471485c79ae279c00120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.467801 31003 tablet_service.cc:1511] Processing CreateTablet for tablet 32fc226fc7844c9096a579b3a8c05060 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:06.471184 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32fc226fc7844c9096a579b3a8c05060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.475008 31283 tablet_bootstrap.cc:654] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.476675 31282 consensus_queue.cc:260] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.493105 30996 tablet_service.cc:1511] Processing CreateTablet for tablet c5496455d6ea451dadd260868b97d356 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:06.494006 31292 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.507730 31289 raft_consensus.cc:697] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:06.510834 31069 tablet_service.cc:1511] Processing CreateTablet for tablet c5496455d6ea451dadd260868b97d356 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:06.512408 31069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5496455d6ea451dadd260868b97d356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.494685 31292 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.513491 31152 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b31ab53d447b3ab5bd993b7c992bf (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:06.515297 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b31ab53d447b3ab5bd993b7c992bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.515856 31292 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.509214 30996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5496455d6ea451dadd260868b97d356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.520092 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:06.519986 31221 tablet_service.cc:1511] Processing CreateTablet for tablet c5496455d6ea451dadd260868b97d356 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:06.521332 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:06.521540 31075 tablet_service.cc:1511] Processing CreateTablet for tablet 32fc226fc7844c9096a579b3a8c05060 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:06.522858 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32fc226fc7844c9096a579b3a8c05060. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:06.523069 31202 leader_election.cc:343] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.524346 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5496455d6ea451dadd260868b97d356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.515079 31143 tablet_service.cc:1511] Processing CreateTablet for tablet 32fc226fc7844c9096a579b3a8c05060 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:11:06.525475 31202 leader_election.cc:343] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.525887 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32fc226fc7844c9096a579b3a8c05060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.526005 31202 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:06.527418 31292 raft_consensus.cc:2749] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.523749 30909 catalog_manager.cc:5697] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.548593 31222 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b31ab53d447b3ab5bd993b7c992bf (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:06.550159 31222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b31ab53d447b3ab5bd993b7c992bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.550356 31002 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b31ab53d447b3ab5bd993b7c992bf (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:06.552170 31002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b31ab53d447b3ab5bd993b7c992bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.542737 31281 tablet_bootstrap.cc:492] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:06.561992 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 078186d5ab1e4886903ffb8cd15f46d9 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:06.563419 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078186d5ab1e4886903ffb8cd15f46d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.557916 31220 tablet_service.cc:1511] Processing CreateTablet for tablet aab6881f32b9471485c79ae279c00120 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:06.575141 31289 consensus_queue.cc:237] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.585496 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab6881f32b9471485c79ae279c00120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.587308 31283 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:06.587877 31283 ts_tablet_manager.cc:1403] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.020s
I20260709 13:11:06.591393 31283 raft_consensus.cc:359] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:06.592196 31283 raft_consensus.cc:385] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.591996 31146 tablet_service.cc:1511] Processing CreateTablet for tablet 078186d5ab1e4886903ffb8cd15f46d9 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:06.592511 31283 raft_consensus.cc:740] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.601150 31146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078186d5ab1e4886903ffb8cd15f46d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.600808 31221 tablet_service.cc:1511] Processing CreateTablet for tablet 078186d5ab1e4886903ffb8cd15f46d9 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:06.602293 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078186d5ab1e4886903ffb8cd15f46d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.601948 31001 tablet_service.cc:1511] Processing CreateTablet for tablet 2137325b94b3480bbf698a17ddd2e312 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:06.603271 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2137325b94b3480bbf698a17ddd2e312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.609144 31290 raft_consensus.cc:493] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.609849 31290 raft_consensus.cc:515] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.599159 31282 ts_tablet_manager.cc:1434] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.163s	user 0.011s	sys 0.005s
I20260709 13:11:06.616478 31282 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:06.620378 31222 tablet_service.cc:1511] Processing CreateTablet for tablet f2f82c954e654c919b31a5619dae274b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:06.621025 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 2137325b94b3480bbf698a17ddd2e312 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:06.622013 31222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f82c954e654c919b31a5619dae274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.622430 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2137325b94b3480bbf698a17ddd2e312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.623908 31281 tablet_bootstrap.cc:654] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.632952 31143 tablet_service.cc:1511] Processing CreateTablet for tablet 2137325b94b3480bbf698a17ddd2e312 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:06.634992 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2137325b94b3480bbf698a17ddd2e312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.657058 31077 tablet_service.cc:1511] Processing CreateTablet for tablet f2f82c954e654c919b31a5619dae274b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:06.657248 30995 tablet_service.cc:1511] Processing CreateTablet for tablet f2f82c954e654c919b31a5619dae274b (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:06.651350 31290 leader_election.cc:290] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.658763 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f82c954e654c919b31a5619dae274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.662194 31145 tablet_service.cc:1511] Processing CreateTablet for tablet a281d1ba3bb943d39ecfbb7aa5310350 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:06.663641 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a281d1ba3bb943d39ecfbb7aa5310350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.670605 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:06.671439 31088 raft_consensus.cc:2468] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:06.648551 31283 consensus_queue.cc:260] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:06.673241 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f82c954e654c919b31a5619dae274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.675380 31283 ts_tablet_manager.cc:1434] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.000s
I20260709 13:11:06.676576 31283 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:06.678311 31128 leader_election.cc:304] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:06.685703 31284 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:06.686419 31284 ts_tablet_manager.cc:1403] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.276s	user 0.024s	sys 0.019s
I20260709 13:11:06.682155 31290 raft_consensus.cc:2804] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.697304 31290 raft_consensus.cc:493] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.697687 31290 raft_consensus.cc:3060] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.700363 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:06.703763 31128 leader_election.cc:343] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.691761 30910 catalog_manager.cc:5697] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.712066 31282 tablet_bootstrap.cc:654] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.731199 31290 raft_consensus.cc:515] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.713069 31289 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.732707 31289 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.735253 31289 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.735106 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:06.745167 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:06.746238 31284 raft_consensus.cc:359] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.744335 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:06.746742 30979 leader_election.cc:343] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.747272 31235 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:06.748543 30979 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:06.749509 31284 raft_consensus.cc:385] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.749868 31284 raft_consensus.cc:740] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.750646 31221 tablet_service.cc:1511] Processing CreateTablet for tablet a281d1ba3bb943d39ecfbb7aa5310350 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:06.752351 30995 tablet_service.cc:1511] Processing CreateTablet for tablet a281d1ba3bb943d39ecfbb7aa5310350 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:06.754302 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a281d1ba3bb943d39ecfbb7aa5310350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.754890 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a281d1ba3bb943d39ecfbb7aa5310350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.753166 31289 raft_consensus.cc:2804] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.748759 31283 tablet_bootstrap.cc:654] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.757302 31289 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.759855 31289 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:06.757217 31128 leader_election.cc:343] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.762661 31284 consensus_queue.cc:260] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.765492 31145 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa32971139947f1a694bda08ee6848d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:06.773882 31281 tablet_bootstrap.cc:492] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:06.774518 31281 ts_tablet_manager.cc:1403] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.266s	user 0.034s	sys 0.015s
I20260709 13:11:06.774307 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa32971139947f1a694bda08ee6848d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:06.776003 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa32971139947f1a694bda08ee6848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.776533 31220 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa32971139947f1a694bda08ee6848d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:11:06.777587 31054 consensus_peers.cc:597] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:06.778002 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa32971139947f1a694bda08ee6848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.779832 31282 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:06.780817 31281 raft_consensus.cc:359] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:06.781687 31281 raft_consensus.cc:385] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.781981 31281 raft_consensus.cc:740] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.782060 31290 leader_election.cc:290] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.782635 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:06.783293 31088 raft_consensus.cc:3060] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.782925 31281 consensus_queue.cc:260] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:06.771886 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa32971139947f1a694bda08ee6848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.785681 31290 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.786299 31290 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.780946 31282 ts_tablet_manager.cc:1403] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.011s
I20260709 13:11:06.793179 31282 raft_consensus.cc:359] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.794411 31289 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.814378 31289 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.796059 31281 ts_tablet_manager.cc:1434] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.005s
I20260709 13:11:06.815809 31281 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:06.797021 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:06.812690 31282 raft_consensus.cc:385] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.817512 31282 raft_consensus.cc:740] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
W20260709 13:11:06.818377 31128 leader_election.cc:343] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.820302 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
W20260709 13:11:06.821919 30979 leader_election.cc:343] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.823235 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:06.823920 31235 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.829559 31284 ts_tablet_manager.cc:1434] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.002s
I20260709 13:11:06.830818 31284 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:06.800204 31088 raft_consensus.cc:2468] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:06.808214 31001 tablet_service.cc:1511] Processing CreateTablet for tablet 4f666ffe90c44600a3394d80de817540 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:06.811204 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:06.833724 31317 raft_consensus.cc:493] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.835099 31128 leader_election.cc:343] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.834615 31317 raft_consensus.cc:515] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:06.833830 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f666ffe90c44600a3394d80de817540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.837899 31281 tablet_bootstrap.cc:654] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.839908 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ad993bfbea46e0a43ffcb149c68de7" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:06.812067 31290 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:06.835650 31128 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:06.847555 31128 leader_election.cc:304] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:06.849488 31071 tablet_service.cc:1511] Processing CreateTablet for tablet 4f666ffe90c44600a3394d80de817540 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:06.850802 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f666ffe90c44600a3394d80de817540. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:06.853686 31054 leader_election.cc:343] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.855508 31317 leader_election.cc:290] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:06.818436 31282 consensus_queue.cc:260] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.851050 31290 raft_consensus.cc:2749] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.857342 31331 raft_consensus.cc:2804] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.857486 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ad993bfbea46e0a43ffcb149c68de7" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:06.859807 31053 leader_election.cc:343] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.860280 31053 leader_election.cc:304] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:06.860953 31282 ts_tablet_manager.cc:1434] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:11:06.862191 31282 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:06.863338 31145 tablet_service.cc:1511] Processing CreateTablet for tablet 4f666ffe90c44600a3394d80de817540 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:06.866125 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f666ffe90c44600a3394d80de817540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.866775 31317 raft_consensus.cc:2749] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.871656 31077 tablet_service.cc:1511] Processing CreateTablet for tablet a09ce39cf2764cd2b2f8457b146e657d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:06.873874 31221 tablet_service.cc:1511] Processing CreateTablet for tablet a09ce39cf2764cd2b2f8457b146e657d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:06.874531 31292 raft_consensus.cc:493] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.875415 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09ce39cf2764cd2b2f8457b146e657d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.875039 31292 raft_consensus.cc:515] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.878960 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:06.881273 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:06.882030 31013 raft_consensus.cc:2468] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
W20260709 13:11:06.882483 31202 leader_election.cc:343] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.877811 31331 raft_consensus.cc:697] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:06.882876 31003 tablet_service.cc:1511] Processing CreateTablet for tablet a09ce39cf2764cd2b2f8457b146e657d (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:06.883644 31202 leader_election.cc:304] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:06.877375 31292 leader_election.cc:290] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:06.884370 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09ce39cf2764cd2b2f8457b146e657d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.884714 31292 raft_consensus.cc:2804] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.884382 31235 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:06.886358 30979 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:06.887585 31289 raft_consensus.cc:2804] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.888111 31289 raft_consensus.cc:697] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:06.888353 31283 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:06.888917 31283 ts_tablet_manager.cc:1403] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.213s	user 0.028s	sys 0.023s
I20260709 13:11:06.888998 31289 consensus_queue.cc:237] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:06.890604 31317 consensus_queue.cc:1048] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:06.892956 31143 tablet_service.cc:1511] Processing CreateTablet for tablet 1785d313b1f24abb861e4028d92c4bcb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:06.894368 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785d313b1f24abb861e4028d92c4bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.882812 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09ce39cf2764cd2b2f8457b146e657d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.885155 31292 raft_consensus.cc:493] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.883875 31331 consensus_queue.cc:237] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.902091 31292 raft_consensus.cc:3060] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.902729 31282 tablet_bootstrap.cc:654] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.917496 31220 tablet_service.cc:1511] Processing CreateTablet for tablet 1785d313b1f24abb861e4028d92c4bcb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:06.918772 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785d313b1f24abb861e4028d92c4bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.937358 31284 tablet_bootstrap.cc:654] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:06.940675 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 57127.3us
I20260709 13:11:06.942915 31283 raft_consensus.cc:359] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.944128 31283 raft_consensus.cc:385] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.944540 31283 raft_consensus.cc:740] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.948261 31281 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:06.949512 31281 ts_tablet_manager.cc:1403] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.003s
I20260709 13:11:06.948256 31283 consensus_queue.cc:260] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:06.963517 30908 catalog_manager.cc:5697] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:06.989748 31145 tablet_service.cc:1511] Processing CreateTablet for tablet b140d661f41949f9b1fd260999e50999 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:06.991139 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b140d661f41949f9b1fd260999e50999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.007171 31071 tablet_service.cc:1511] Processing CreateTablet for tablet b140d661f41949f9b1fd260999e50999 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:07.008226 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b140d661f41949f9b1fd260999e50999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.011379 31001 tablet_service.cc:1511] Processing CreateTablet for tablet 1785d313b1f24abb861e4028d92c4bcb (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:07.012190 31336 raft_consensus.cc:493] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.016889 31283 ts_tablet_manager.cc:1434] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.128s	user 0.017s	sys 0.010s
I20260709 13:11:07.013736 31292 raft_consensus.cc:515] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.018146 31220 tablet_service.cc:1511] Processing CreateTablet for tablet b140d661f41949f9b1fd260999e50999 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:07.019585 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b140d661f41949f9b1fd260999e50999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.020475 31292 leader_election.cc:290] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:07.021193 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:07.021886 31088 raft_consensus.cc:3060] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.021919 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785d313b1f24abb861e4028d92c4bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.028098 31069 tablet_service.cc:1511] Processing CreateTablet for tablet 73c1509877e94c6a94893dd51dba1748 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:07.030440 31069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c1509877e94c6a94893dd51dba1748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.030591 31282 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.031152 31282 ts_tablet_manager.cc:1403] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.169s	user 0.021s	sys 0.004s
I20260709 13:11:07.021793 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:07.033849 31013 raft_consensus.cc:3060] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.039775 31282 raft_consensus.cc:359] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.014851 31336 raft_consensus.cc:515] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.046437 31282 raft_consensus.cc:385] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.047015 31282 raft_consensus.cc:740] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.053757 31003 tablet_service.cc:1511] Processing CreateTablet for tablet 73c1509877e94c6a94893dd51dba1748 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:07.055730 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c1509877e94c6a94893dd51dba1748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.018136 31283 tablet_bootstrap.cc:492] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.020701 31281 raft_consensus.cc:359] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.065690 31281 raft_consensus.cc:385] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.066028 31281 raft_consensus.cc:740] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.065284 30908 catalog_manager.cc:5697] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.066807 31282 consensus_queue.cc:260] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.068022 31088 raft_consensus.cc:2468] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:07.072930 31143 tablet_service.cc:1511] Processing CreateTablet for tablet 73c1509877e94c6a94893dd51dba1748 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:07.074404 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c1509877e94c6a94893dd51dba1748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.077793 31336 leader_election.cc:290] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:07.078529 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:07.082036 31202 leader_election.cc:343] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.070125 31284 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:07.098280 31282 ts_tablet_manager.cc:1434] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.067s	user 0.011s	sys 0.002s
I20260709 13:11:07.099485 31282 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:07.101120 31202 leader_election.cc:304] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:07.100982 31281 consensus_queue.cc:260] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.104276 31281 ts_tablet_manager.cc:1434] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.154s	user 0.009s	sys 0.009s
I20260709 13:11:07.105140 31292 raft_consensus.cc:2804] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.104167 31013 raft_consensus.cc:2468] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:07.111617 31283 tablet_bootstrap.cc:654] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.115517 31282 tablet_bootstrap.cc:654] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.097297 31284 ts_tablet_manager.cc:1403] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.267s	user 0.012s	sys 0.028s
I20260709 13:11:07.122807 31284 raft_consensus.cc:359] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.123560 31281 tablet_bootstrap.cc:492] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:07.125828 30995 tablet_service.cc:1511] Processing CreateTablet for tablet 76022e8458f3433295d3ed60bf4abb60 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:07.127389 30995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76022e8458f3433295d3ed60bf4abb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.129308 31289 consensus_queue.cc:1048] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.123590 31284 raft_consensus.cc:385] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.117408 31292 raft_consensus.cc:697] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:07.157670 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 76022e8458f3433295d3ed60bf4abb60 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:07.159303 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76022e8458f3433295d3ed60bf4abb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.138974 31284 raft_consensus.cc:740] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.165792 31284 consensus_queue.cc:260] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.177794 31284 ts_tablet_manager.cc:1434] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 13:11:07.188335 31284 tablet_bootstrap.cc:492] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:07.194100 31283 tablet_bootstrap.cc:492] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:07.194777 31283 ts_tablet_manager.cc:1403] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.045s
I20260709 13:11:07.198050 31283 raft_consensus.cc:359] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.202852 31283 raft_consensus.cc:385] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.203281 31283 raft_consensus.cc:740] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.204983 31348 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.205641 31283 consensus_queue.cc:260] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.205469 31348 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.208642 31348 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:07.204326 31292 consensus_queue.cc:237] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.211398 31283 ts_tablet_manager.cc:1434] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:11:07.211884 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:07.212545 31283 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.212589 31013 raft_consensus.cc:2468] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:07.215113 31202 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:07.215955 31348 raft_consensus.cc:2804] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.216347 31348 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.220255 31145 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccfbc32da67458799cc341fb3277d37 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:07.222582 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccfbc32da67458799cc341fb3277d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.224938 31348 raft_consensus.cc:3060] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.226306 31220 tablet_service.cc:1511] Processing CreateTablet for tablet 76022e8458f3433295d3ed60bf4abb60 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:07.227545 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76022e8458f3433295d3ed60bf4abb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.230832 31001 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccfbc32da67458799cc341fb3277d37 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:07.232398 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccfbc32da67458799cc341fb3277d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.238752 31221 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccfbc32da67458799cc341fb3277d37 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:07.240211 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccfbc32da67458799cc341fb3277d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.254873 31143 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1997fc1c544e87afea39d3052e547a (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:07.256372 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1997fc1c544e87afea39d3052e547a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:07.257753 30979 consensus_peers.cc:597] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.260108 31222 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1997fc1c544e87afea39d3052e547a (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:07.264454 31003 tablet_service.cc:1511] Processing CreateTablet for tablet e3b9a38986234993ab664c4bc0812651 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:07.265954 31222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1997fc1c544e87afea39d3052e547a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.266849 31348 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.219098 31281 tablet_bootstrap.cc:654] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.265954 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b9a38986234993ab664c4bc0812651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.276662 31071 tablet_service.cc:1511] Processing CreateTablet for tablet e3b9a38986234993ab664c4bc0812651 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:07.277379 31069 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1997fc1c544e87afea39d3052e547a (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:07.277983 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b9a38986234993ab664c4bc0812651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.278640 31069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1997fc1c544e87afea39d3052e547a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.280918 31284 tablet_bootstrap.cc:654] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.281744 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.282954 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.286696 30911 catalog_manager.cc:5697] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.300890 31146 tablet_service.cc:1511] Processing CreateTablet for tablet e3b9a38986234993ab664c4bc0812651 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:07.302325 31146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b9a38986234993ab664c4bc0812651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.305226 31348 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:07.305480 31283 tablet_bootstrap.cc:654] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:07.325093 31201 leader_election.cc:343] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:07.327415 31201 leader_election.cc:343] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.328111 31201 leader_election.cc:304] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:07.328294 31220 tablet_service.cc:1511] Processing CreateTablet for tablet 79f63569bde3451593d530f6be062a16 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:07.330139 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f63569bde3451593d530f6be062a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.336969 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:07.353160 31348 raft_consensus.cc:2749] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.353669 31343 raft_consensus.cc:493] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.354367 31343 raft_consensus.cc:515] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.355324 31282 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.355887 31282 ts_tablet_manager.cc:1403] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.257s	user 0.005s	sys 0.013s
I20260709 13:11:07.372000 31281 tablet_bootstrap.cc:492] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:07.372848 31281 ts_tablet_manager.cc:1403] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.250s	user 0.038s	sys 0.032s
W20260709 13:11:07.375826 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:07.376142 31281 raft_consensus.cc:359] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.376958 31281 raft_consensus.cc:385] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:07.377050 30979 consensus_peers.cc:597] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.377321 31281 raft_consensus.cc:740] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.378248 31281 consensus_queue.cc:260] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.372079 31282 raft_consensus.cc:359] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.380177 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:07.386327 31013 raft_consensus.cc:3060] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.387750 31003 tablet_service.cc:1511] Processing CreateTablet for tablet 79f63569bde3451593d530f6be062a16 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:07.389119 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f63569bde3451593d530f6be062a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.389762 31343 leader_election.cc:290] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:07.390455 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 79f63569bde3451593d530f6be062a16 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:07.391793 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f63569bde3451593d530f6be062a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.394366 31001 tablet_service.cc:1511] Processing CreateTablet for tablet ecda26a7c7224e67bdad8915bf964ca0 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:11:07.365528 31201 leader_election.cc:343] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.379642 31145 tablet_service.cc:1511] Processing CreateTablet for tablet ecda26a7c7224e67bdad8915bf964ca0 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:07.401420 31145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecda26a7c7224e67bdad8915bf964ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.408706 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a49c820fa64c7bbd18b86ed3d16bb3" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.409521 31162 raft_consensus.cc:2468] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:07.409761 31284 tablet_bootstrap.cc:492] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:07.409639 31220 tablet_service.cc:1511] Processing CreateTablet for tablet ecda26a7c7224e67bdad8915bf964ca0 (DEFAULT_TABLE table=test-workload [id=eb5ae34ceba745b8ba6269a0d7b4cfdd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:07.409008 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecda26a7c7224e67bdad8915bf964ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.410383 31284 ts_tablet_manager.cc:1403] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.231s	user 0.012s	sys 0.021s
I20260709 13:11:07.410887 31220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecda26a7c7224e67bdad8915bf964ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.413843 31284 raft_consensus.cc:359] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.414760 31284 raft_consensus.cc:385] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.414911 31053 leader_election.cc:304] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:07.415177 31284 raft_consensus.cc:740] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.415863 31343 raft_consensus.cc:2804] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.416338 31343 raft_consensus.cc:493] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.416929 31343 raft_consensus.cc:3060] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.422083 31283 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:07.422731 31283 ts_tablet_manager.cc:1403] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.210s	user 0.009s	sys 0.013s
W20260709 13:11:07.410979 31128 consensus_peers.cc:597] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:07.395522 31282 raft_consensus.cc:385] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.430369 31283 raft_consensus.cc:359] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.431277 31283 raft_consensus.cc:385] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.431553 31283 raft_consensus.cc:740] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.432338 31283 consensus_queue.cc:260] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.416060 31284 consensus_queue.cc:260] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.439465 31283 ts_tablet_manager.cc:1434] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:11:07.443883 31356 consensus_queue.cc:1048] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.446169 31281 ts_tablet_manager.cc:1434] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:11:07.446002 31331 consensus_queue.cc:1048] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.454052 31281 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:07.457358 31331 raft_consensus.cc:493] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.458045 31331 raft_consensus.cc:515] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.433245 31282 raft_consensus.cc:740] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.449445 31343 raft_consensus.cc:515] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.452968 31283 tablet_bootstrap.cc:492] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.460752 31331 leader_election.cc:290] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:07.461760 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:07.461426 31282 consensus_queue.cc:260] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.462570 31356 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.463037 31356 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.464054 31282 ts_tablet_manager.cc:1434] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.108s	user 0.003s	sys 0.005s
I20260709 13:11:07.465126 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:07.466173 31236 raft_consensus.cc:2468] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
W20260709 13:11:07.468605 31128 leader_election.cc:343] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.469892 31128 leader_election.cc:304] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:07.471000 31331 raft_consensus.cc:2804] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.471439 31331 raft_consensus.cc:493] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.468590 31283 tablet_bootstrap.cc:654] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.471822 31331 raft_consensus.cc:3060] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.473987 31282 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:07.471843 31343 leader_election.cc:290] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:07.475425 31281 tablet_bootstrap.cc:654] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.476348 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a49c820fa64c7bbd18b86ed3d16bb3" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:07.477072 31161 raft_consensus.cc:3060] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.485030 31356 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:07.488173 31282 tablet_bootstrap.cc:654] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.488071 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:07.493630 30979 leader_election.cc:343] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.490473 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.494768 31162 raft_consensus.cc:2468] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:07.496784 30978 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:07.505165 31356 raft_consensus.cc:2804] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.505745 31356 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.506357 31356 raft_consensus.cc:3060] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.519440 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a49c820fa64c7bbd18b86ed3d16bb3" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
W20260709 13:11:07.521672 31054 leader_election.cc:343] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.523550 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a49c820fa64c7bbd18b86ed3d16bb3" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:07.525624 31054 leader_election.cc:343] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.533293 31161 raft_consensus.cc:2468] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:07.534922 31053 leader_election.cc:304] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:07.532845 31013 raft_consensus.cc:2468] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
W20260709 13:11:07.542826 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 46986us
I20260709 13:11:07.548338 31202 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: e0094be1075d460cafd5160946c09aed
I20260709 13:11:07.548890 31340 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.549594 31283 tablet_bootstrap.cc:492] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:07.543681 31343 raft_consensus.cc:2804] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.550112 31283 ts_tablet_manager.cc:1403] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.097s	user 0.007s	sys 0.033s
I20260709 13:11:07.549410 31340 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.553328 31340 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:07.554137 31283 raft_consensus.cc:359] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.554736 31283 raft_consensus.cc:385] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.555020 31283 raft_consensus.cc:740] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.550760 31348 raft_consensus.cc:2804] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.555723 31283 consensus_queue.cc:260] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.556149 31348 raft_consensus.cc:697] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:07.556339 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:07.557091 31348 consensus_queue.cc:237] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.557818 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:07.559521 31054 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:07.560322 31340 raft_consensus.cc:2749] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.561455 31343 raft_consensus.cc:697] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:07.561981 31283 ts_tablet_manager.cc:1434] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:11:07.562359 31343 consensus_queue.cc:237] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.563059 31283 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.565439 31282 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.565995 31282 ts_tablet_manager.cc:1403] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.008s
I20260709 13:11:07.568096 31283 tablet_bootstrap.cc:654] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.569530 31282 raft_consensus.cc:359] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.570333 31282 raft_consensus.cc:385] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.570660 31282 raft_consensus.cc:740] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.573516 31281 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:07.574108 31281 ts_tablet_manager.cc:1403] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.120s	user 0.017s	sys 0.026s
I20260709 13:11:07.575330 31331 raft_consensus.cc:515] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.578325 31284 ts_tablet_manager.cc:1434] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.168s	user 0.015s	sys 0.001s
I20260709 13:11:07.579277 31331 leader_election.cc:290] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:07.583451 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:07.584177 31235 raft_consensus.cc:3060] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.584980 31283 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:07.585476 31283 ts_tablet_manager.cc:1403] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:11:07.585520 31281 raft_consensus.cc:359] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.585601 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:07.587201 31282 consensus_queue.cc:260] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.588251 31356 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.593551 31282 ts_tablet_manager.cc:1434] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:11:07.594767 31282 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:07.595582 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:07.596335 31161 raft_consensus.cc:3060] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.602454 31282 tablet_bootstrap.cc:654] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.595875 30911 catalog_manager.cc:5697] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.605577 31284 tablet_bootstrap.cc:492] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:07.606972 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:07.607848 31356 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:07.611094 31283 raft_consensus.cc:359] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.612018 31283 raft_consensus.cc:385] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.612368 31283 raft_consensus.cc:740] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.613554 31284 tablet_bootstrap.cc:654] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.613313 31283 consensus_queue.cc:260] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:07.614521 31128 leader_election.cc:343] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.588570 31281 raft_consensus.cc:385] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.615291 31281 raft_consensus.cc:740] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.617604 31283 ts_tablet_manager.cc:1434] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:11:07.619134 31235 raft_consensus.cc:2468] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:07.618907 31281 consensus_queue.cc:260] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.620035 31236 raft_consensus.cc:3060] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.621210 31161 raft_consensus.cc:2468] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:07.623057 30978 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:07.624208 31356 raft_consensus.cc:2804] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.624761 31356 raft_consensus.cc:697] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:07.626776 31128 leader_election.cc:304] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:07.627868 31283 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.627926 31365 raft_consensus.cc:2804] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.628751 31365 raft_consensus.cc:697] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:07.627221 30911 catalog_manager.cc:5697] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.630493 31365 consensus_queue.cc:237] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.625651 31356 consensus_queue.cc:237] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.638126 31283 tablet_bootstrap.cc:654] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.648415 31284 tablet_bootstrap.cc:492] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:07.649056 31284 ts_tablet_manager.cc:1403] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.007s
I20260709 13:11:07.631201 31236 raft_consensus.cc:2468] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:07.650731 31348 consensus_queue.cc:1048] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.653983 31281 ts_tablet_manager.cc:1434] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.002s
I20260709 13:11:07.655148 31281 tablet_bootstrap.cc:492] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:07.652366 31284 raft_consensus.cc:359] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.658347 31284 raft_consensus.cc:385] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.658758 31284 raft_consensus.cc:740] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.659869 31284 consensus_queue.cc:260] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.664566 31282 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.665279 31282 ts_tablet_manager.cc:1403] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.006s
I20260709 13:11:07.668290 31282 raft_consensus.cc:359] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.669045 31282 raft_consensus.cc:385] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.669428 31282 raft_consensus.cc:740] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.668920 31292 raft_consensus.cc:493] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.670274 31282 consensus_queue.cc:260] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.670199 31292 raft_consensus.cc:515] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.672729 31282 ts_tablet_manager.cc:1434] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:07.673868 31282 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:07.674392 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36995fac4a8745f1ae1c292c94f4f813" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:07.675413 31283 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:07.674638 31284 ts_tablet_manager.cc:1434] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:11:07.681734 31283 ts_tablet_manager.cc:1403] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.011s
I20260709 13:11:07.682292 31284 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:07.685075 31283 raft_consensus.cc:359] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.685937 31283 raft_consensus.cc:385] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.686385 31283 raft_consensus.cc:740] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.686486 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36995fac4a8745f1ae1c292c94f4f813" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.687417 31161 raft_consensus.cc:2468] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:07.687336 31283 consensus_queue.cc:260] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.689119 31201 leader_election.cc:304] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:07.689719 31283 ts_tablet_manager.cc:1434] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:11:07.689996 31348 raft_consensus.cc:2804] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.690470 31348 raft_consensus.cc:493] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.690754 31365 raft_consensus.cc:493] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.690997 31283 tablet_bootstrap.cc:492] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.691535 31282 tablet_bootstrap.cc:654] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.691320 31365 raft_consensus.cc:515] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.692274 30910 catalog_manager.cc:5697] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.689877 31284 tablet_bootstrap.cc:654] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.694168 31292 leader_election.cc:290] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:07.694396 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ad993bfbea46e0a43ffcb149c68de7" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:07.694906 31087 raft_consensus.cc:2468] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:07.695056 31013 raft_consensus.cc:2468] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:07.690900 31348 raft_consensus.cc:3060] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.697305 31128 leader_election.cc:304] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:07.698230 31368 raft_consensus.cc:2804] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.698606 31368 raft_consensus.cc:493] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.698946 31368 raft_consensus.cc:3060] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.699359 31283 tablet_bootstrap.cc:654] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.709370 31282 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.704731 31348 raft_consensus.cc:515] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.710158 31282 ts_tablet_manager.cc:1403] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.000s
I20260709 13:11:07.712821 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36995fac4a8745f1ae1c292c94f4f813" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:07.713605 31087 raft_consensus.cc:3060] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.715794 31284 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:07.716651 31284 ts_tablet_manager.cc:1403] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 13:11:07.719185 31281 tablet_bootstrap.cc:654] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.722236 31284 raft_consensus.cc:359] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.723963 31284 raft_consensus.cc:385] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.724254 31365 leader_election.cc:290] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:07.720714 31282 raft_consensus.cc:359] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.725111 31282 raft_consensus.cc:385] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.725384 31282 raft_consensus.cc:740] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.724673 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ad993bfbea46e0a43ffcb149c68de7" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:07.727595 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36995fac4a8745f1ae1c292c94f4f813" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:07.726064 30911 catalog_manager.cc:5697] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.728385 31161 raft_consensus.cc:3060] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.730472 31368 raft_consensus.cc:515] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.734045 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ad993bfbea46e0a43ffcb149c68de7" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:07.734689 31013 raft_consensus.cc:3060] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.724283 31284 raft_consensus.cc:740] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.738252 31284 consensus_queue.cc:260] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.726064 31282 consensus_queue.cc:260] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.727010 31086 raft_consensus.cc:2468] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:07.740552 31087 raft_consensus.cc:2468] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:07.741214 31282 ts_tablet_manager.cc:1434] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:11:07.741489 31368 leader_election.cc:290] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:07.742219 31282 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:07.741394 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ad993bfbea46e0a43ffcb149c68de7" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:07.744939 31085 raft_consensus.cc:3060] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.747221 31284 ts_tablet_manager.cc:1434] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:11:07.747826 31013 raft_consensus.cc:2468] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:07.748406 31284 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:07.727313 31348 leader_election.cc:290] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:07.752410 31128 leader_election.cc:304] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:07.753631 31368 raft_consensus.cc:2804] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.754359 31368 raft_consensus.cc:697] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:07.755095 31161 raft_consensus.cc:2468] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:07.755242 31368 consensus_queue.cc:237] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.755419 31283 tablet_bootstrap.cc:492] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:07.757169 31283 ts_tablet_manager.cc:1403] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.015s
I20260709 13:11:07.757874 31202 leader_election.cc:304] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:07.761390 31343 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.764629 31284 tablet_bootstrap.cc:654] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.764236 31343 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.764021 31282 tablet_bootstrap.cc:654] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.768329 31348 raft_consensus.cc:2804] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.769165 31348 raft_consensus.cc:697] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:07.773691 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:07.771533 31348 consensus_queue.cc:237] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
W20260709 13:11:07.775547 31054 leader_election.cc:343] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.777935 31343 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:07.762814 31085 raft_consensus.cc:2468] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:07.779677 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:07.781931 31054 leader_election.cc:343] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.782446 31054 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:07.783263 31343 raft_consensus.cc:2749] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.785441 31283 raft_consensus.cc:359] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.786407 31283 raft_consensus.cc:385] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.786808 31283 raft_consensus.cc:740] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.789162 31282 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.789036 31382 consensus_queue.cc:1048] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.789760 31282 ts_tablet_manager.cc:1403] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.003s
I20260709 13:11:07.792025 31284 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:07.792610 31284 ts_tablet_manager.cc:1403] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.004s
I20260709 13:11:07.793221 31281 tablet_bootstrap.cc:492] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:07.793686 31281 ts_tablet_manager.cc:1403] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.003s
I20260709 13:11:07.794224 31283 consensus_queue.cc:260] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.795346 31284 raft_consensus.cc:359] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.796056 31284 raft_consensus.cc:385] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.795910 31281 raft_consensus.cc:359] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.796460 31283 ts_tablet_manager.cc:1434] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:11:07.809578 31283 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.796396 31284 raft_consensus.cc:740] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.798519 31281 raft_consensus.cc:385] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.813275 31281 raft_consensus.cc:740] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.813732 31284 consensus_queue.cc:260] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.815044 31283 tablet_bootstrap.cc:654] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.814114 31281 consensus_queue.cc:260] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:07.816183 31284 ts_tablet_manager.cc:1434] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:11:07.816910 31281 ts_tablet_manager.cc:1434] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:11:07.802764 31368 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.817586 31284 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:07.817870 31281 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:07.817989 31368 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.820317 31368 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:07.802659 31282 raft_consensus.cc:359] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.820930 31282 raft_consensus.cc:385] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.821259 31282 raft_consensus.cc:740] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.803637 30908 catalog_manager.cc:5697] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.822081 31282 consensus_queue.cc:260] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.822701 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:07.824291 31282 ts_tablet_manager.cc:1434] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:11:07.825506 31282 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:07.826669 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:07.828351 31013 raft_consensus.cc:2393] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 1: Already voted for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in this term.
I20260709 13:11:07.831384 31128 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:07.832835 31282 tablet_bootstrap.cc:654] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.833734 31368 raft_consensus.cc:3060] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.833554 30909 catalog_manager.cc:5697] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.854725 31368 raft_consensus.cc:2749] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.855782 31284 tablet_bootstrap.cc:654] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.859642 31283 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:07.860430 31283 ts_tablet_manager.cc:1403] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.028s
I20260709 13:11:07.864771 31283 raft_consensus.cc:359] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.866091 31283 raft_consensus.cc:385] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.866573 31283 raft_consensus.cc:740] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.873224 31085 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.883615 31281 tablet_bootstrap.cc:654] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.884914 31356 raft_consensus.cc:493] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.885979 31356 raft_consensus.cc:515] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.890450 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:07.891824 31356 leader_election.cc:290] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:07.867870 31283 consensus_queue.cc:260] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.894405 31283 ts_tablet_manager.cc:1434] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:11:07.897747 31283 tablet_bootstrap.cc:492] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:07.894279 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.902537 30978 leader_election.cc:304] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:07.904978 31356 raft_consensus.cc:2749] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.910852 31356 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.911369 31356 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.911815 31284 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:07.912338 31284 ts_tablet_manager.cc:1403] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.033s
I20260709 13:11:07.912232 31013 raft_consensus.cc:3060] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.914671 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:07.915374 31236 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:07.915927 31284 raft_consensus.cc:359] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.916657 31284 raft_consensus.cc:385] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.916976 31284 raft_consensus.cc:740] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.917009 30979 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:07.918603 31289 raft_consensus.cc:2804] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.918972 31289 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.919304 31289 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.919974 31284 consensus_queue.cc:260] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.920745 31343 raft_consensus.cc:493] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.921438 31343 raft_consensus.cc:515] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.925652 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19e2ee8edef4c659be9276658c65913" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:07.928048 31054 leader_election.cc:343] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.929483 31356 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:07.931644 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19e2ee8edef4c659be9276658c65913" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:07.933414 31053 leader_election.cc:343] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.933918 31053 leader_election.cc:304] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:07.934872 31340 raft_consensus.cc:2749] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.935283 31289 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.931113 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:07.930871 31284 ts_tablet_manager.cc:1434] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:07.930769 31343 leader_election.cc:290] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:07.936661 31087 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:07.938671 31282 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.939349 31282 ts_tablet_manager.cc:1403] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.114s	user 0.029s	sys 0.039s
I20260709 13:11:07.939833 31283 tablet_bootstrap.cc:654] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.942467 31282 raft_consensus.cc:359] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.943257 31282 raft_consensus.cc:385] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.943540 31282 raft_consensus.cc:740] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.943717 31284 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:07.944407 31321 raft_consensus.cc:493] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.944200 31282 consensus_queue.cc:260] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:07.944926 31321 raft_consensus.cc:515] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.946395 31282 ts_tablet_manager.cc:1434] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:07.947152 31321 leader_election.cc:290] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:07.947511 31282 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:07.952078 31284 tablet_bootstrap.cc:654] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.954270 31282 tablet_bootstrap.cc:654] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.954766 31348 consensus_queue.cc:1048] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.957954 31281 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:07.958480 31281 ts_tablet_manager.cc:1403] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.016s
I20260709 13:11:07.958844 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.960649 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:07.962447 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:07.965972 31085 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.962132 31281 raft_consensus.cc:359] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.966447 31281 raft_consensus.cc:385] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:07.966288 30978 leader_election.cc:343] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.966917 31281 raft_consensus.cc:740] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.967689 31281 consensus_queue.cc:260] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.968559 31236 raft_consensus.cc:2468] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:07.963797 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:07.969269 31235 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.970983 30979 leader_election.cc:304] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: e0094be1075d460cafd5160946c09aed
I20260709 13:11:07.971607 31282 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:07.972115 31281 ts_tablet_manager.cc:1434] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:07.972191 31356 raft_consensus.cc:2804] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.972880 31356 raft_consensus.cc:493] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.973308 31281 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:07.975291 31343 consensus_queue.cc:1048] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.973294 31356 raft_consensus.cc:3060] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.982976 31281 tablet_bootstrap.cc:654] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.984426 31368 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.985013 31368 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.987146 31368 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:07.989399 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:07.991271 31128 leader_election.cc:343] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.989679 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:07.989338 31282 ts_tablet_manager.cc:1403] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.005s
W20260709 13:11:07.993278 31128 leader_election.cc:343] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.993459 31343 raft_consensus.cc:493] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.993974 31128 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:07.994185 31343 raft_consensus.cc:515] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:07.995064 31282 raft_consensus.cc:359] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.995770 31282 raft_consensus.cc:385] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.996045 31282 raft_consensus.cc:740] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.996956 31282 consensus_queue.cc:260] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:07.997645 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d463c852ffa846c0a6cabd5e29c4c32d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:07.998312 31011 raft_consensus.cc:2468] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:07.998526 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d463c852ffa846c0a6cabd5e29c4c32d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:07.999289 31282 ts_tablet_manager.cc:1434] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:07.999420 31160 raft_consensus.cc:2468] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:08.000306 31282 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:08.000682 31236 raft_consensus.cc:3060] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.002019 31343 leader_election.cc:290] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:08.003233 31365 raft_consensus.cc:2749] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.999589 31054 leader_election.cc:304] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:08.007196 31235 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:07.959167 31289 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:08.010180 31321 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.009480 31085 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:08.011308 31348 consensus_queue.cc:1048] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:11:08.018783 30979 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:08.018694 31321 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.023036 31321 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.024721 31321 raft_consensus.cc:2804] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.023777 31284 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:08.025193 31321 raft_consensus.cc:697] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:08.014648 31282 tablet_bootstrap.cc:654] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.026489 31321 consensus_queue.cc:237] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.029052 31284 ts_tablet_manager.cc:1403] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.000s
I20260709 13:11:08.031769 31343 raft_consensus.cc:2804] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.052851 31343 raft_consensus.cc:493] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.050688 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.060812 31161 raft_consensus.cc:2468] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:08.059017 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.061688 31356 raft_consensus.cc:515] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.062870 30978 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.063956 31356 leader_election.cc:290] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.064584 31356 raft_consensus.cc:2804] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.065837 31343 raft_consensus.cc:3060] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.065665 31356 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:08.069355 30979 leader_election.cc:343] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.076493 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:08.077242 31235 raft_consensus.cc:3060] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.079445 31281 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:08.079993 31281 ts_tablet_manager.cc:1403] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.107s	user 0.023s	sys 0.030s
I20260709 13:11:08.070051 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:08.084607 31281 raft_consensus.cc:359] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.085682 31281 raft_consensus.cc:385] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.086619 31281 raft_consensus.cc:740] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
W20260709 13:11:08.086891 31128 consensus_peers.cc:597] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:08.088088 31281 consensus_queue.cc:260] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.072024 31356 raft_consensus.cc:3060] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.093025 31281 ts_tablet_manager.cc:1434] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:11:08.094112 31281 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:08.099985 31283 tablet_bootstrap.cc:492] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:08.100394 31281 tablet_bootstrap.cc:654] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.100567 31283 ts_tablet_manager.cc:1403] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.203s	user 0.040s	sys 0.045s
I20260709 13:11:08.103892 31283 raft_consensus.cc:359] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.109723 31283 raft_consensus.cc:385] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.110241 31283 raft_consensus.cc:740] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.112941 31340 consensus_queue.cc:1048] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.114372 31283 consensus_queue.cc:260] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.123353 31283 ts_tablet_manager.cc:1434] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:11:08.125594 31283 tablet_bootstrap.cc:492] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
W20260709 13:11:08.123803 30978 leader_election.cc:343] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.161106 31282 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:08.161911 31282 ts_tablet_manager.cc:1403] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.009s
I20260709 13:11:08.167624 31284 raft_consensus.cc:359] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.168975 31284 raft_consensus.cc:385] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.169265 31284 raft_consensus.cc:740] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.169870 31284 consensus_queue.cc:260] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.171564 31282 raft_consensus.cc:359] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.172086 31282 raft_consensus.cc:385] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.172289 31282 raft_consensus.cc:740] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.172748 31282 consensus_queue.cc:260] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.176296 31282 ts_tablet_manager.cc:1434] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:11:08.175634 31234 raft_consensus.cc:3060] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.177790 31282 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:08.195001 31409 raft_consensus.cc:493] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.184932 31321 consensus_queue.cc:1048] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:08.195852 31409 raft_consensus.cc:515] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.204007 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3f639e54a041fdb1c2d051bed72073" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.206116 31384 consensus_queue.cc:1048] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.207311 31281 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:08.207799 31282 tablet_bootstrap.cc:654] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.207962 31281 ts_tablet_manager.cc:1403] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.009s
I20260709 13:11:08.213884 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3f639e54a041fdb1c2d051bed72073" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.215762 31284 ts_tablet_manager.cc:1434] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.186s	user 0.008s	sys 0.000s
I20260709 13:11:08.223037 31284 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:08.238217 31281 raft_consensus.cc:359] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.239427 31281 raft_consensus.cc:385] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.239804 31281 raft_consensus.cc:740] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.214831 31331 consensus_queue.cc:1048] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:11:08.241490 31283 tablet_bootstrap.cc:654] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.244894 31281 consensus_queue.cc:260] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.222172 31235 raft_consensus.cc:2468] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:08.209615 31343 raft_consensus.cc:515] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.224089 31409 leader_election.cc:290] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.259837 31281 ts_tablet_manager.cc:1434] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.005s
I20260709 13:11:08.261420 31284 tablet_bootstrap.cc:654] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.261514 31281 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:08.247195 31331 raft_consensus.cc:493] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.270174 30979 leader_election.cc:304] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.265777 31403 raft_consensus.cc:493] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.272302 31403 raft_consensus.cc:515] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.274736 31403 leader_election.cc:290] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.275309 31403 raft_consensus.cc:2804] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.275780 31403 raft_consensus.cc:697] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:08.270260 31331 raft_consensus.cc:515] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.278359 31331 leader_election.cc:290] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:08.280526 31289 consensus_queue.cc:1048] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.280817 31343 leader_election.cc:290] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:08.300910 31281 tablet_bootstrap.cc:654] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:08.303869 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 65271us
I20260709 13:11:08.307358 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:08.309203 30978 leader_election.cc:343] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.312268 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d463c852ffa846c0a6cabd5e29c4c32d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:08.276615 31403 consensus_queue.cc:237] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.306347 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:08.293011 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 58248.7us
I20260709 13:11:08.321698 31368 consensus_queue.cc:1048] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.313805 31161 raft_consensus.cc:3060] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:08.329895 31053 leader_election.cc:343] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.330368 31356 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.330694 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.331210 31365 consensus_queue.cc:1048] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.332635 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.331568 31234 raft_consensus.cc:2393] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 1: Already voted for candidate 116e6baff6234eadbc262b5fb70cfd5b in this term.
I20260709 13:11:08.334251 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
W20260709 13:11:08.336493 30979 leader_election.cc:343] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.337050 30979 leader_election.cc:304] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.338380 31321 raft_consensus.cc:493] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.338903 31321 raft_consensus.cc:515] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.341460 31289 raft_consensus.cc:2749] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.334897 31162 raft_consensus.cc:3060] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.342219 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.345745 31384 consensus_queue.cc:1048] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.352439 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d463c852ffa846c0a6cabd5e29c4c32d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:08.353511 31012 raft_consensus.cc:3060] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.359915 31384 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.360986 31384 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.362629 31283 tablet_bootstrap.cc:492] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:08.363267 31283 ts_tablet_manager.cc:1403] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.238s	user 0.018s	sys 0.003s
I20260709 13:11:08.363866 31384 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:08.360143 31282 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:08.366065 31282 ts_tablet_manager.cc:1403] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.188s	user 0.006s	sys 0.017s
I20260709 13:11:08.367466 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:08.366739 31054 leader_election.cc:343] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.390906 31283 raft_consensus.cc:359] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.392258 31283 raft_consensus.cc:385] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.392728 31283 raft_consensus.cc:740] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.382323 31356 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.399890 31013 raft_consensus.cc:2393] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dec8ae7db1414dbea5acc7be7ffc9dfb in current term 1: Already voted for candidate 116e6baff6234eadbc262b5fb70cfd5b in this term.
I20260709 13:11:08.383126 31128 leader_election.cc:304] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
W20260709 13:11:08.402037 30979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 65595.8us
I20260709 13:11:08.406761 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.413496 31284 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:08.408974 31414 raft_consensus.cc:493] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.414083 31284 ts_tablet_manager.cc:1403] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.197s	user 0.019s	sys 0.010s
I20260709 13:11:08.414052 31414 raft_consensus.cc:515] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.417788 31161 raft_consensus.cc:2468] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
W20260709 13:11:08.418076 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 45262.9us
I20260709 13:11:08.419206 31053 leader_election.cc:304] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.419852 31282 raft_consensus.cc:359] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.420267 31408 raft_consensus.cc:2804] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.420828 31408 raft_consensus.cc:697] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:08.421838 31408 consensus_queue.cc:237] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.416785 31284 raft_consensus.cc:359] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.423185 31284 raft_consensus.cc:385] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.419289 31365 raft_consensus.cc:3060] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.425310 31282 raft_consensus.cc:385] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.394243 31054 leader_election.cc:304] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.425174 31284 raft_consensus.cc:740] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.426100 31282 raft_consensus.cc:740] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.433233 31282 consensus_queue.cc:260] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.435015 31282 ts_tablet_manager.cc:1434] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:11:08.435892 31414 leader_election.cc:290] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.437721 31284 consensus_queue.cc:260] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.444000 31321 leader_election.cc:290] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:08.466576 31414 raft_consensus.cc:2749] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:08.467038 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 106976us
W20260709 13:11:08.452656 31415 log.cc:927] Time spent T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:11:08.437929 31162 raft_consensus.cc:2468] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:08.486472 30978 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.487583 31403 raft_consensus.cc:2804] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.487645 31284 ts_tablet_manager.cc:1434] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.073s	user 0.015s	sys 0.023s
I20260709 13:11:08.488204 31403 raft_consensus.cc:697] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:08.489424 31284 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:08.489199 31403 consensus_queue.cc:237] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.492040 31012 raft_consensus.cc:2468] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:08.494717 31281 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:08.495306 31281 ts_tablet_manager.cc:1403] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.234s	user 0.024s	sys 0.005s
W20260709 13:11:08.501681 31419 log.cc:927] Time spent T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:08.501484 31281 raft_consensus.cc:359] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.502322 31281 raft_consensus.cc:385] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.502707 31284 tablet_bootstrap.cc:654] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.504537 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b038abfe774f34a24e07139da4520b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:08.506431 31013 raft_consensus.cc:3060] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.497006 31201 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.502668 31281 raft_consensus.cc:740] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.507999 31384 raft_consensus.cc:3060] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.507954 31281 consensus_queue.cc:260] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.512447 31281 ts_tablet_manager.cc:1434] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:08.513553 31281 tablet_bootstrap.cc:492] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:08.502332 31283 consensus_queue.cc:260] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.523430 31283 ts_tablet_manager.cc:1434] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.160s	user 0.008s	sys 0.004s
I20260709 13:11:08.527918 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.539108 31331 raft_consensus.cc:493] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.539700 31331 raft_consensus.cc:515] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.541913 31331 leader_election.cc:290] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:08.547890 31384 raft_consensus.cc:2749] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.548269 31365 raft_consensus.cc:2749] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.555442 31282 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:08.556919 31284 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:08.557544 31284 ts_tablet_manager.cc:1403] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.018s
I20260709 13:11:08.564610 31281 tablet_bootstrap.cc:654] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.564123 30910 catalog_manager.cc:5697] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.568600 31284 raft_consensus.cc:359] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.569669 31284 raft_consensus.cc:385] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.570011 31284 raft_consensus.cc:740] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.570993 31284 consensus_queue.cc:260] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
W20260709 13:11:08.526695 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 84764.9us
I20260709 13:11:08.525473 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a348c59d23d847cd8e01296e609f0e8c" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.536517 30979 leader_election.cc:304] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.573711 31284 ts_tablet_manager.cc:1434] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
W20260709 13:11:08.574541 30979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 48254.9us
I20260709 13:11:08.575552 31284 tablet_bootstrap.cc:492] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:08.576807 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.578548 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:08.579509 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:08.580302 31011 raft_consensus.cc:2468] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:08.584093 31128 leader_election.cc:304] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.585289 31053 leader_election.cc:304] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.586650 31408 raft_consensus.cc:2749] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.587535 31365 raft_consensus.cc:2804] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.587970 31365 raft_consensus.cc:493] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.588403 31365 raft_consensus.cc:3060] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.592063 31284 tablet_bootstrap.cc:654] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.594254 31281 tablet_bootstrap.cc:492] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:08.594839 31281 ts_tablet_manager.cc:1403] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.001s
I20260709 13:11:08.597523 31281 raft_consensus.cc:359] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.597574 31365 raft_consensus.cc:515] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.598258 31281 raft_consensus.cc:385] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.601073 31281 raft_consensus.cc:740] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.603333 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:08.603367 31281 consensus_queue.cc:260] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.604492 31011 raft_consensus.cc:3060] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.607321 31281 ts_tablet_manager.cc:1434] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:11:08.608616 31281 tablet_bootstrap.cc:492] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:08.609418 31422 raft_consensus.cc:2749] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.613612 31282 tablet_bootstrap.cc:654] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.615561 31281 tablet_bootstrap.cc:654] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.624488 31365 leader_election.cc:290] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:08.625793 31284 tablet_bootstrap.cc:492] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:08.626507 31284 ts_tablet_manager.cc:1403] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.004s
I20260709 13:11:08.628357 31011 raft_consensus.cc:2468] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:08.629770 31284 raft_consensus.cc:359] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.632115 31284 raft_consensus.cc:385] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.632431 31284 raft_consensus.cc:740] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.632822 31128 leader_election.cc:304] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.633298 31284 consensus_queue.cc:260] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.633774 31365 raft_consensus.cc:2804] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.635754 31284 ts_tablet_manager.cc:1434] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:08.638134 31284 tablet_bootstrap.cc:492] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:08.635000 31365 raft_consensus.cc:697] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
W20260709 13:11:08.640790 31128 leader_election.cc:343] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.639880 31365 consensus_queue.cc:237] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.646420 31281 tablet_bootstrap.cc:492] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:08.647125 31281 ts_tablet_manager.cc:1403] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 13:11:08.648510 31422 consensus_queue.cc:1048] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:08.653406 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:08.653604 31282 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:08.654112 31282 ts_tablet_manager.cc:1403] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.000s
I20260709 13:11:08.657001 31283 tablet_bootstrap.cc:492] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:08.661918 31233 raft_consensus.cc:2468] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:08.670550 31284 tablet_bootstrap.cc:654] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.651008 31281 raft_consensus.cc:359] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.672096 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:08.675298 31281 raft_consensus.cc:385] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.675653 31281 raft_consensus.cc:740] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.676420 31281 consensus_queue.cc:260] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.681830 31284 tablet_bootstrap.cc:492] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:08.682305 31284 ts_tablet_manager.cc:1403] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 13:11:08.683444 31283 tablet_bootstrap.cc:654] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.683516 31289 consensus_queue.cc:1048] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.685161 31289 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.685463 31284 raft_consensus.cc:359] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.685639 31289 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.686213 31284 raft_consensus.cc:385] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.686504 31284 raft_consensus.cc:740] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.687194 31284 consensus_queue.cc:260] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.687734 31289 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:08.689306 31284 ts_tablet_manager.cc:1434] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:08.690398 31284 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:08.693384 31085 raft_consensus.cc:3060] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.696555 31284 tablet_bootstrap.cc:654] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.697891 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:08.698632 31086 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:08.704382 30979 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:08.706507 31281 ts_tablet_manager.cc:1434] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:11:08.707039 31422 raft_consensus.cc:2804] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.707633 31281 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:08.707643 31422 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.717020 31422 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.727331 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.727715 31281 tablet_bootstrap.cc:654] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.728121 31233 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
W20260709 13:11:08.730875 31128 leader_election.cc:343] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.735296 31281 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:08.737447 31284 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:08.737982 31284 ts_tablet_manager.cc:1403] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.005s
I20260709 13:11:08.741019 31284 raft_consensus.cc:359] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.741761 31284 raft_consensus.cc:385] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.742041 31284 raft_consensus.cc:740] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.742797 31284 consensus_queue.cc:260] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.744804 31284 ts_tablet_manager.cc:1434] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:08.656816 31282 raft_consensus.cc:359] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.745625 31282 raft_consensus.cc:385] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.745915 31282 raft_consensus.cc:740] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.746024 31284 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:08.749064 31282 consensus_queue.cc:260] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.750262 31422 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.752816 31281 ts_tablet_manager.cc:1403] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.003s
I20260709 13:11:08.753072 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:08.753870 31235 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.755857 31281 raft_consensus.cc:359] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.756577 31281 raft_consensus.cc:385] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.756875 31281 raft_consensus.cc:740] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.757622 31281 consensus_queue.cc:260] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.759079 31422 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:08.760725 31282 ts_tablet_manager.cc:1434] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.000s
I20260709 13:11:08.760844 31321 raft_consensus.cc:493] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.761740 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:08.761886 31321 raft_consensus.cc:515] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.762388 31086 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.765650 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:08.766191 31408 raft_consensus.cc:493] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.766461 31321 leader_election.cc:290] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:08.761857 31281 ts_tablet_manager.cc:1434] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:08.766955 31408 raft_consensus.cc:515] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.768246 31281 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:08.771764 31235 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
W20260709 13:11:08.767745 30979 leader_election.cc:343] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.775563 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d927c6d703d46e2b498aab379411581" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.775846 31408 leader_election.cc:290] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.776297 31160 raft_consensus.cc:2468] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:08.777688 31053 leader_election.cc:304] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.778585 31408 raft_consensus.cc:2804] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.778447 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d927c6d703d46e2b498aab379411581" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.779146 31408 raft_consensus.cc:493] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.779588 31408 raft_consensus.cc:3060] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.779544 31233 raft_consensus.cc:2468] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:08.782675 31086 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:08.783123 31289 consensus_queue.cc:1048] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.772035 31284 tablet_bootstrap.cc:654] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.771524 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.785272 31162 raft_consensus.cc:2468] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:08.785899 30979 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:08.786744 31282 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:08.787626 31289 raft_consensus.cc:2804] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.787880 30978 leader_election.cc:304] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:08.788570 31289 raft_consensus.cc:697] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:08.789307 31321 raft_consensus.cc:2804] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.789767 31321 raft_consensus.cc:493] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.790258 31321 raft_consensus.cc:3060] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.789708 31289 consensus_queue.cc:237] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:08.796780 31408 raft_consensus.cc:515] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.798792 31283 tablet_bootstrap.cc:492] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:08.799427 31283 ts_tablet_manager.cc:1403] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.143s	user 0.037s	sys 0.058s
I20260709 13:11:08.799846 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d927c6d703d46e2b498aab379411581" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:08.800520 31162 raft_consensus.cc:3060] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.802574 31283 raft_consensus.cc:359] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.803293 31283 raft_consensus.cc:385] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.803558 31283 raft_consensus.cc:740] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.804262 31283 consensus_queue.cc:260] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.807468 30911 catalog_manager.cc:5697] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.809186 31162 raft_consensus.cc:2468] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:08.810365 31282 tablet_bootstrap.cc:654] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.810520 31053 leader_election.cc:304] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.811445 31414 raft_consensus.cc:2804] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.811951 31414 raft_consensus.cc:697] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:08.812800 31414 consensus_queue.cc:237] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.814128 31283 ts_tablet_manager.cc:1434] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:08.815191 31283 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:08.816255 31365 raft_consensus.cc:493] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.816805 31365 raft_consensus.cc:515] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.819348 31365 leader_election.cc:290] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:08.821346 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19e2ee8edef4c659be9276658c65913" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:08.822849 31128 leader_election.cc:343] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.823210 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19e2ee8edef4c659be9276658c65913" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:08.823078 31283 tablet_bootstrap.cc:654] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.824388 31086 raft_consensus.cc:2468] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:08.826282 31128 leader_election.cc:304] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:08.829135 31365 raft_consensus.cc:2804] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.829644 31365 raft_consensus.cc:493] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.830060 31365 raft_consensus.cc:3060] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.831446 31282 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:08.832001 31282 ts_tablet_manager.cc:1403] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:11:08.833550 31281 tablet_bootstrap.cc:654] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.835078 31282 raft_consensus.cc:359] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.836022 31282 raft_consensus.cc:385] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.836213 31292 raft_consensus.cc:493] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.836578 31282 raft_consensus.cc:740] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.836966 31292 raft_consensus.cc:515] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.837659 31282 consensus_queue.cc:260] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.839993 31292 leader_election.cc:290] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:08.841914 31284 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:08.841830 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3f639e54a041fdb1c2d051bed72073" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:08.841727 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3f639e54a041fdb1c2d051bed72073" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.842885 31086 raft_consensus.cc:2468] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:08.843793 31282 ts_tablet_manager.cc:1434] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:11:08.843000 31162 raft_consensus.cc:2468] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:08.844846 31282 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:08.845825 31201 leader_election.cc:304] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:08.847193 31292 raft_consensus.cc:2804] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.847597 31292 raft_consensus.cc:493] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.847941 31292 raft_consensus.cc:3060] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.850387 31408 leader_election.cc:290] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.850577 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d927c6d703d46e2b498aab379411581" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:08.852977 31235 raft_consensus.cc:3060] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.855707 31282 tablet_bootstrap.cc:654] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.862083 31235 raft_consensus.cc:2468] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:08.868166 31408 raft_consensus.cc:493] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.824942 30910 catalog_manager.cc:5697] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:08.869661 31408 raft_consensus.cc:515] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.870532 30910 catalog_manager.cc:5697] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:08.871999 31411 consensus_queue.cc:1048] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.873140 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e12bc43e64de9b904105f3a74f98e" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:08.874651 31053 leader_election.cc:343] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.804154 31321 raft_consensus.cc:515] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.878444 31408 leader_election.cc:290] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:08.879134 31282 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:08.878108 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e12bc43e64de9b904105f3a74f98e" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:08.866432 31283 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:08.881296 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:08.881986 31283 ts_tablet_manager.cc:1403] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.067s	user 0.034s	sys 0.015s
W20260709 13:11:08.882510 31054 leader_election.cc:343] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.883080 31054 leader_election.cc:304] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.884202 31414 raft_consensus.cc:2749] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.880575 31281 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:08.885411 31281 ts_tablet_manager.cc:1403] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.006s
I20260709 13:11:08.888459 31283 raft_consensus.cc:359] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.889571 31283 raft_consensus.cc:385] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.890050 31283 raft_consensus.cc:740] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
W20260709 13:11:08.889762 30979 leader_election.cc:343] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.890586 31281 raft_consensus.cc:359] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.891639 31281 raft_consensus.cc:385] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.891952 31281 raft_consensus.cc:740] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.892745 31281 consensus_queue.cc:260] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.894044 31282 ts_tablet_manager.cc:1403] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 13:11:08.894623 31283 consensus_queue.cc:260] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.897485 31282 raft_consensus.cc:359] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.898428 31282 raft_consensus.cc:385] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.898726 31282 raft_consensus.cc:740] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.899794 31282 consensus_queue.cc:260] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.901950 31282 ts_tablet_manager.cc:1434] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:08.902956 31282 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:08.903604 31414 consensus_queue.cc:1048] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.908267 31283 ts_tablet_manager.cc:1434] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:11:08.909408 31283 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:08.915364 31365 raft_consensus.cc:515] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.916208 31283 tablet_bootstrap.cc:654] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.917228 31281 ts_tablet_manager.cc:1434] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:11:08.927191 31281 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:08.931677 31356 consensus_queue.cc:1048] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.918162 31282 tablet_bootstrap.cc:654] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.851997 31284 ts_tablet_manager.cc:1403] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.001s
I20260709 13:11:08.941706 31365 leader_election.cc:290] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:08.921805 31321 leader_election.cc:290] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:08.923281 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:08.945178 31162 raft_consensus.cc:3060] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.953400 31282 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:08.953982 31282 ts_tablet_manager.cc:1403] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.004s
I20260709 13:11:08.956887 31414 raft_consensus.cc:493] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.943146 31284 raft_consensus.cc:359] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.958834 31284 raft_consensus.cc:385] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.957603 31414 raft_consensus.cc:515] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.959163 31284 raft_consensus.cc:740] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.959969 31284 consensus_queue.cc:260] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:08.960570 31283 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:08.961309 31283 ts_tablet_manager.cc:1403] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.011s
I20260709 13:11:08.962566 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:08.963805 31011 raft_consensus.cc:2393] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13bb23988f5940e5ba175699ca30e0d6 in current term 1: Already voted for candidate 116e6baff6234eadbc262b5fb70cfd5b in this term.
I20260709 13:11:08.967338 31282 raft_consensus.cc:359] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.968218 31282 raft_consensus.cc:385] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.968499 31282 raft_consensus.cc:740] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.968892 31289 consensus_queue.cc:1048] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.969900 31282 consensus_queue.cc:260] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.975271 31414 leader_election.cc:290] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:08.939886 31281 tablet_bootstrap.cc:654] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.943954 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19e2ee8edef4c659be9276658c65913" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:08.962503 31284 ts_tablet_manager.cc:1434] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:11:08.980334 31086 raft_consensus.cc:3060] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.981158 31284 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:08.981321 31283 raft_consensus.cc:359] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.982046 31283 raft_consensus.cc:385] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.982324 31283 raft_consensus.cc:740] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.944304 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19e2ee8edef4c659be9276658c65913" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:08.983203 31012 raft_consensus.cc:3060] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.983038 31283 consensus_queue.cc:260] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:08.922080 31292 raft_consensus.cc:515] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:08.977135 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:08.985678 31292 leader_election.cc:290] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:08.987181 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3f639e54a041fdb1c2d051bed72073" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:08.987988 31158 raft_consensus.cc:3060] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.989156 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3f639e54a041fdb1c2d051bed72073" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:08.989993 31085 raft_consensus.cc:3060] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.976753 31282 ts_tablet_manager.cc:1434] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:11:08.991117 31283 ts_tablet_manager.cc:1434] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:11:08.991351 31282 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:08.992136 31283 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:08.998466 31283 tablet_bootstrap.cc:654] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.999557 31321 raft_consensus.cc:493] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.000181 31321 raft_consensus.cc:515] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.000445 31053 leader_election.cc:304] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:08.979152 31289 consensus_queue.cc:1048] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.002399 31321 leader_election.cc:290] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:09.005689 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4024d7ca443348189e2bce2cafeca403" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:09.006639 31235 raft_consensus.cc:2468] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:09.008250 30979 leader_election.cc:304] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:09.008944 31281 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:09.011996 31281 ts_tablet_manager.cc:1403] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.004s
I20260709 13:11:09.012838 31289 raft_consensus.cc:2804] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.013461 31289 raft_consensus.cc:493] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.013955 31289 raft_consensus.cc:3060] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.015250 31281 raft_consensus.cc:359] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.016033 31281 raft_consensus.cc:385] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.016309 31281 raft_consensus.cc:740] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.017145 31281 consensus_queue.cc:260] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.019451 31284 tablet_bootstrap.cc:654] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.020967 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4024d7ca443348189e2bce2cafeca403" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:09.021906 31160 raft_consensus.cc:2468] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:09.024742 31282 tablet_bootstrap.cc:654] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.030125 31281 ts_tablet_manager.cc:1434] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:09.031324 31281 tablet_bootstrap.cc:492] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:09.036520 31284 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:09.037227 31284 ts_tablet_manager.cc:1403] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 13:11:09.037879 31408 raft_consensus.cc:3060] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.041105 31284 raft_consensus.cc:359] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.041913 31284 raft_consensus.cc:385] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.042284 31284 raft_consensus.cc:740] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.043179 31284 consensus_queue.cc:260] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
W20260709 13:11:09.045573 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 45216.3us
I20260709 13:11:08.962486 31162 raft_consensus.cc:2468] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:09.049518 30978 leader_election.cc:304] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:09.051025 31321 raft_consensus.cc:2804] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.051610 31321 raft_consensus.cc:697] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:09.052309 31282 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:09.052881 31282 ts_tablet_manager.cc:1403] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 13:11:09.052711 31321 consensus_queue.cc:237] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.058696 31284 ts_tablet_manager.cc:1434] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:11:09.060025 31284 tablet_bootstrap.cc:492] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:09.063835 31408 raft_consensus.cc:2749] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.065222 31012 raft_consensus.cc:2468] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:09.050040 31281 tablet_bootstrap.cc:654] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.056499 30911 catalog_manager.cc:5697] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.071986 31282 raft_consensus.cc:359] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.074453 31282 raft_consensus.cc:385] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.074776 31282 raft_consensus.cc:740] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.078087 31282 consensus_queue.cc:260] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.079953 31128 leader_election.cc:304] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.080950 31365 raft_consensus.cc:2804] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.081435 31365 raft_consensus.cc:697] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:09.082077 31158 raft_consensus.cc:2468] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:09.082232 31365 consensus_queue.cc:237] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.083704 31201 leader_election.cc:304] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.084645 31292 raft_consensus.cc:2804] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.085178 31292 raft_consensus.cc:697] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:09.086071 31292 consensus_queue.cc:237] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.087898 31409 raft_consensus.cc:493] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.088357 31284 tablet_bootstrap.cc:654] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.096153 31282 ts_tablet_manager.cc:1434] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:11:09.097595 31282 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:09.082724 31085 raft_consensus.cc:2468] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:09.088476 31409 raft_consensus.cc:515] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.124013 31283 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:09.124791 31283 ts_tablet_manager.cc:1403] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.133s	user 0.039s	sys 0.036s
I20260709 13:11:09.113085 31356 raft_consensus.cc:493] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.118382 31282 tablet_bootstrap.cc:654] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.134608 31356 raft_consensus.cc:515] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.130894 31086 raft_consensus.cc:2468] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:09.132009 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:09.159087 31382 raft_consensus.cc:493] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.159816 31382 raft_consensus.cc:515] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.162571 31382 leader_election.cc:290] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:09.163789 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86383b831804250835ad3b3d8f3f44c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:09.165536 31202 leader_election.cc:343] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.147915 31012 raft_consensus.cc:2468] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:09.173249 31054 leader_election.cc:304] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:09.174278 31414 raft_consensus.cc:2804] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.174686 31414 raft_consensus.cc:493] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.175037 31414 raft_consensus.cc:3060] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.175786 31284 tablet_bootstrap.cc:492] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:09.177047 31284 ts_tablet_manager.cc:1403] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.117s	user 0.030s	sys 0.026s
I20260709 13:11:09.176919 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:09.177459 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:09.177675 31159 raft_consensus.cc:2468] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:09.180557 31284 raft_consensus.cc:359] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.181725 31284 raft_consensus.cc:385] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.182099 31284 raft_consensus.cc:740] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.183383 31284 consensus_queue.cc:260] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.151422 31409 leader_election.cc:290] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:09.186591 31284 ts_tablet_manager.cc:1434] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:09.191331 31414 raft_consensus.cc:515] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.151667 31356 leader_election.cc:290] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:09.187891 31284 tablet_bootstrap.cc:492] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:09.153589 31292 raft_consensus.cc:493] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.193980 31292 raft_consensus.cc:515] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.194586 31289 raft_consensus.cc:515] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.192581 31283 raft_consensus.cc:359] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.196163 31283 raft_consensus.cc:385] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.196535 31283 raft_consensus.cc:740] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.197940 31289 leader_election.cc:290] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:09.197568 31283 consensus_queue.cc:260] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.202912 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:09.203617 31012 raft_consensus.cc:3060] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.198357 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:09.204799 31283 ts_tablet_manager.cc:1434] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:11:09.205190 31159 raft_consensus.cc:2468] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:09.198858 31086 raft_consensus.cc:2393] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 116e6baff6234eadbc262b5fb70cfd5b in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:09.207340 31284 tablet_bootstrap.cc:654] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.199726 31292 leader_election.cc:290] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:09.201485 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:09.208266 31235 raft_consensus.cc:3060] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.210215 31409 consensus_queue.cc:1048] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.214112 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4024d7ca443348189e2bce2cafeca403" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:09.214797 31158 raft_consensus.cc:3060] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.215656 31414 leader_election.cc:290] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:09.217286 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:09.218130 31159 raft_consensus.cc:3060] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.222107 30978 leader_election.cc:304] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.224974 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86383b831804250835ad3b3d8f3f44c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:09.225857 31011 raft_consensus.cc:2468] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:09.227562 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb04a7b75afd4166aee199de5f812c01" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:09.228597 31011 raft_consensus.cc:2393] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dec8ae7db1414dbea5acc7be7ffc9dfb in current term 1: Already voted for candidate e0094be1075d460cafd5160946c09aed in this term.
I20260709 13:11:09.230166 31202 leader_election.cc:304] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:09.231271 31292 raft_consensus.cc:2804] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.231666 31292 raft_consensus.cc:493] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.232028 31292 raft_consensus.cc:3060] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.232112 31202 leader_election.cc:304] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:09.240646 31292 raft_consensus.cc:515] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.245275 31414 consensus_queue.cc:1048] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.245548 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86383b831804250835ad3b3d8f3f44c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:09.246217 31086 raft_consensus.cc:3060] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.214821 31283 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:09.250288 31292 leader_election.cc:290] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:09.276122 31086 raft_consensus.cc:2468] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:09.290562 31282 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:09.291396 31282 ts_tablet_manager.cc:1403] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.014s
I20260709 13:11:09.283886 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86383b831804250835ad3b3d8f3f44c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:09.298153 31281 tablet_bootstrap.cc:492] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:09.299681 31011 raft_consensus.cc:3060] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.299976 31281 ts_tablet_manager.cc:1403] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.269s	user 0.038s	sys 0.031s
I20260709 13:11:09.240548 30907 catalog_manager.cc:5697] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.303889 31281 raft_consensus.cc:359] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.293237 31368 raft_consensus.cc:493] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.305218 31202 leader_election.cc:304] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:09.305668 31368 raft_consensus.cc:515] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.308315 31348 raft_consensus.cc:2804] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.309036 31348 raft_consensus.cc:697] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:09.310250 31348 consensus_queue.cc:237] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.313134 31284 tablet_bootstrap.cc:492] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:09.310772 31158 raft_consensus.cc:2468] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:09.313213 31281 raft_consensus.cc:385] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.316015 31281 raft_consensus.cc:740] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.313862 31284 ts_tablet_manager.cc:1403] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.126s	user 0.022s	sys 0.022s
I20260709 13:11:09.315115 31382 raft_consensus.cc:2749] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.321738 31086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e12bc43e64de9b904105f3a74f98e" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:09.322726 31086 raft_consensus.cc:2468] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:09.324374 31128 leader_election.cc:304] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.324472 31282 raft_consensus.cc:359] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.325362 31282 raft_consensus.cc:385] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.325675 31282 raft_consensus.cc:740] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.325541 31331 raft_consensus.cc:2804] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.333741 31331 raft_consensus.cc:493] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.334167 31331 raft_consensus.cc:3060] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.328752 31159 raft_consensus.cc:2468] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:09.326128 31368 leader_election.cc:290] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:09.339995 31283 tablet_bootstrap.cc:654] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.326936 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4024d7ca443348189e2bce2cafeca403" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:09.333799 31282 consensus_queue.cc:260] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.344416 31281 consensus_queue.cc:260] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.343976 31236 raft_consensus.cc:3060] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.349490 31282 ts_tablet_manager.cc:1434] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:11:09.350514 31012 raft_consensus.cc:2468] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:09.350776 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e12bc43e64de9b904105f3a74f98e" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:09.351117 31356 raft_consensus.cc:2764] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:09.351513 31231 raft_consensus.cc:2468] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:09.352100 31011 raft_consensus.cc:2468] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:09.353538 31054 leader_election.cc:304] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:09.354418 31411 raft_consensus.cc:2804] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.354889 31411 raft_consensus.cc:697] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:09.355680 31411 consensus_queue.cc:237] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.344604 31368 consensus_queue.cc:1048] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:11:09.361620 31365 consensus_queue.cc:1048] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:09.366437 31284 raft_consensus.cc:359] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.367341 31284 raft_consensus.cc:385] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.368597 31284 raft_consensus.cc:740] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.361248 31281 ts_tablet_manager.cc:1434] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 13:11:09.370112 31281 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:09.370631 31284 consensus_queue.cc:260] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.362424 30978 leader_election.cc:304] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.388609 31321 raft_consensus.cc:2804] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.389204 31321 raft_consensus.cc:697] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:09.390074 31321 consensus_queue.cc:237] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.398118 31282 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:09.409693 31236 raft_consensus.cc:2468] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:09.416340 31281 tablet_bootstrap.cc:654] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.417389 30910 catalog_manager.cc:5697] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.419214 31284 ts_tablet_manager.cc:1434] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.003s
I20260709 13:11:09.420706 31284 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:09.426956 31331 raft_consensus.cc:515] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.429342 31331 leader_election.cc:290] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:09.431152 31284 tablet_bootstrap.cc:654] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.431424 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e12bc43e64de9b904105f3a74f98e" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:09.432052 31088 raft_consensus.cc:3060] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.453267 31282 tablet_bootstrap.cc:654] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.455094 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03e12bc43e64de9b904105f3a74f98e" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:09.455822 31236 raft_consensus.cc:3060] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.463894 31236 raft_consensus.cc:2468] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:09.468242 31128 leader_election.cc:304] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.469789 31477 raft_consensus.cc:2804] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.470654 31477 raft_consensus.cc:697] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:09.471814 31477 consensus_queue.cc:237] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.477156 31356 consensus_queue.cc:1048] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.478500 31422 consensus_queue.cc:1048] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.484552 30911 catalog_manager.cc:5697] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.494165 31283 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:09.494755 31283 ts_tablet_manager.cc:1403] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.280s	user 0.015s	sys 0.010s
I20260709 13:11:09.495466 30911 catalog_manager.cc:5697] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.487913 31088 raft_consensus.cc:2468] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:09.489169 31321 raft_consensus.cc:493] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.510802 31281 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:09.511559 31281 ts_tablet_manager.cc:1403] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.004s
I20260709 13:11:09.510124 31321 raft_consensus.cc:515] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.536383 31282 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:09.536960 31282 ts_tablet_manager.cc:1403] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.009s
I20260709 13:11:09.538904 31283 raft_consensus.cc:359] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.540021 31283 raft_consensus.cc:385] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.540385 31283 raft_consensus.cc:740] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.544426 31282 raft_consensus.cc:359] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.545277 31282 raft_consensus.cc:385] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.545571 31282 raft_consensus.cc:740] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.545470 31356 consensus_queue.cc:1048] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.546458 31282 consensus_queue.cc:260] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.546938 30908 catalog_manager.cc:5697] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.550760 31321 leader_election.cc:290] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:09.550555 31479 consensus_queue.cc:1048] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.554273 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:09.554862 31282 ts_tablet_manager.cc:1434] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:09.555884 31282 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:09.555665 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:09.561318 31281 raft_consensus.cc:359] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.563867 31281 raft_consensus.cc:385] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.564291 31281 raft_consensus.cc:740] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
W20260709 13:11:09.562862 30979 leader_election.cc:343] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.568373 31348 consensus_queue.cc:1048] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.575603 31281 consensus_queue.cc:260] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.575521 31282 tablet_bootstrap.cc:654] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.576249 31283 consensus_queue.cc:260] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.588969 31281 ts_tablet_manager.cc:1434] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.000s
I20260709 13:11:09.579146 31087 raft_consensus.cc:2468] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:09.586946 31321 raft_consensus.cc:493] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.603168 31422 consensus_queue.cc:1048] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.597050 31321 raft_consensus.cc:515] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.605710 31292 consensus_queue.cc:1048] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.607856 31321 leader_election.cc:290] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:09.608711 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:09.610347 30978 leader_election.cc:343] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.608757 31283 ts_tablet_manager.cc:1434] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.114s	user 0.010s	sys 0.000s
I20260709 13:11:09.612095 31283 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:09.612829 31281 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:09.614666 31284 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:09.616933 31284 ts_tablet_manager.cc:1403] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.012s
I20260709 13:11:09.618302 31283 tablet_bootstrap.cc:654] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.619407 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:09.620750 30979 leader_election.cc:343] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.621258 30979 leader_election.cc:304] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:09.622017 31403 raft_consensus.cc:2749] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.644565 31281 tablet_bootstrap.cc:654] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.648692 30979 leader_election.cc:304] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:09.651207 31403 raft_consensus.cc:2804] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.651697 31403 raft_consensus.cc:493] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.652067 31403 raft_consensus.cc:3060] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.622411 31284 raft_consensus.cc:359] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.664625 31284 raft_consensus.cc:385] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.665274 31284 raft_consensus.cc:740] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.669260 31479 consensus_queue.cc:1048] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:09.677799 31284 consensus_queue.cc:260] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.685886 31284 ts_tablet_manager.cc:1434] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:11:09.686759 31284 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:09.668812 30907 catalog_manager.cc:5697] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.712248 31284 tablet_bootstrap.cc:654] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.714941 31282 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:09.715553 31282 ts_tablet_manager.cc:1403] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.011s
I20260709 13:11:09.718398 31282 raft_consensus.cc:359] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.719177 31282 raft_consensus.cc:385] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.719552 31282 raft_consensus.cc:740] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.722261 31403 raft_consensus.cc:515] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.723230 31283 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:09.723695 31281 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:09.723776 31283 ts_tablet_manager.cc:1403] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.004s
I20260709 13:11:09.724619 31403 leader_election.cc:290] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:09.726553 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:09.727480 31281 ts_tablet_manager.cc:1403] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.003s
I20260709 13:11:09.728039 31084 raft_consensus.cc:3060] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.728391 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:09.729244 31236 raft_consensus.cc:3060] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.729724 31382 consensus_queue.cc:1048] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.743983 31281 raft_consensus.cc:359] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.746652 31281 raft_consensus.cc:385] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.747069 31281 raft_consensus.cc:740] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.748428 31281 consensus_queue.cc:260] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.748736 31282 consensus_queue.cc:260] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.762395 31282 ts_tablet_manager.cc:1434] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:11:09.770957 31236 raft_consensus.cc:2468] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:09.772568 31283 raft_consensus.cc:359] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.781715 31283 raft_consensus.cc:385] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.781900 31283 raft_consensus.cc:740] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.782404 31283 consensus_queue.cc:260] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.775507 31282 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:09.777064 31281 ts_tablet_manager.cc:1434] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:11:09.784426 30979 leader_election.cc:304] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:09.786111 31281 tablet_bootstrap.cc:492] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:09.786010 31321 raft_consensus.cc:2804] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.787896 31321 raft_consensus.cc:697] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:09.790025 31283 ts_tablet_manager.cc:1434] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:11:09.791097 31283 tablet_bootstrap.cc:492] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:09.794029 31284 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:09.794852 31284 ts_tablet_manager.cc:1403] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.108s	user 0.036s	sys 0.026s
I20260709 13:11:09.789951 31321 consensus_queue.cc:237] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.775955 30908 catalog_manager.cc:5697] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.799456 31282 tablet_bootstrap.cc:654] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.822713 31281 tablet_bootstrap.cc:654] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.825588 31284 raft_consensus.cc:359] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.826452 31284 raft_consensus.cc:385] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.828828 31479 raft_consensus.cc:493] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.829360 31283 tablet_bootstrap.cc:654] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.829715 31479 raft_consensus.cc:515] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.813620 31084 raft_consensus.cc:2468] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:09.832108 31479 leader_election.cc:290] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
W20260709 13:11:09.832753 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:09.834527 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915f9be628344ac09e3d93a385ebbfdb" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:09.834619 31284 raft_consensus.cc:740] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
W20260709 13:11:09.836063 31128 leader_election.cc:343] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.836241 31348 consensus_queue.cc:1048] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.837955 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915f9be628344ac09e3d93a385ebbfdb" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:09.836228 31284 consensus_queue.cc:260] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:09.840204 31128 leader_election.cc:343] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.841149 31128 leader_election.cc:304] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:09.841802 31284 ts_tablet_manager.cc:1434] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.002s
I20260709 13:11:09.842357 31477 raft_consensus.cc:2749] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.843195 31284 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:09.844472 31411 consensus_queue.cc:1048] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.850131 31411 raft_consensus.cc:493] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.850868 31411 raft_consensus.cc:515] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.852643 31284 tablet_bootstrap.cc:654] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.852494 30910 catalog_manager.cc:5697] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.855002 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:09.855362 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:09.856844 31054 leader_election.cc:343] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:09.857448 31053 leader_election.cc:343] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.858116 31053 leader_election.cc:304] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:09.859247 31411 leader_election.cc:290] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:09.860064 31409 raft_consensus.cc:2749] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.865830 31321 consensus_queue.cc:1048] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.872921 31411 consensus_queue.cc:1048] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.875353 31348 raft_consensus.cc:493] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.875941 31348 raft_consensus.cc:515] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.878235 31348 leader_election.cc:290] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:09.879604 31281 tablet_bootstrap.cc:492] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:09.880211 31281 ts_tablet_manager.cc:1403] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.004s
I20260709 13:11:09.880513 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:09.881338 31162 raft_consensus.cc:2468] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:09.882128 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:09.882656 31201 leader_election.cc:304] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.883180 31012 raft_consensus.cc:2468] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:09.884202 31282 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:09.884426 31348 raft_consensus.cc:2804] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.884743 31282 ts_tablet_manager.cc:1403] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.009s
I20260709 13:11:09.884810 31348 raft_consensus.cc:493] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.885363 31348 raft_consensus.cc:3060] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.889024 31321 raft_consensus.cc:493] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.889715 31321 raft_consensus.cc:515] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:09.892735 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:09.894490 30979 leader_election.cc:343] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.896186 31284 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:09.896517 31321 leader_election.cc:290] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:09.897049 31284 ts_tablet_manager.cc:1403] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.008s
I20260709 13:11:09.880484 30907 catalog_manager.cc:5697] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.901278 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:09.903322 30979 leader_election.cc:343] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.903838 30979 leader_election.cc:304] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:09.904007 31284 raft_consensus.cc:359] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.904943 31284 raft_consensus.cc:385] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.905256 31321 raft_consensus.cc:2749] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.905287 31284 raft_consensus.cc:740] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.906323 31281 raft_consensus.cc:359] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.907828 31281 raft_consensus.cc:385] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.907073 31284 consensus_queue.cc:260] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.908209 31281 raft_consensus.cc:740] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.914525 31284 ts_tablet_manager.cc:1434] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:11:09.917021 31282 raft_consensus.cc:359] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.918015 31282 raft_consensus.cc:385] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.918347 31282 raft_consensus.cc:740] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.919281 31281 consensus_queue.cc:260] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.932085 31281 ts_tablet_manager.cc:1434] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:11:09.932621 31283 tablet_bootstrap.cc:492] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:09.933142 31281 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:09.933167 31283 ts_tablet_manager.cc:1403] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.142s	user 0.036s	sys 0.024s
I20260709 13:11:09.921291 31284 tablet_bootstrap.cc:492] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:09.927143 31348 raft_consensus.cc:515] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.942510 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:09.943215 31159 raft_consensus.cc:3060] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.944761 31284 tablet_bootstrap.cc:654] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.952099 31281 tablet_bootstrap.cc:654] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.953591 31403 consensus_queue.cc:1048] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.955128 31283 raft_consensus.cc:359] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.955889 31283 raft_consensus.cc:385] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.956157 31283 raft_consensus.cc:740] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.961279 31284 tablet_bootstrap.cc:492] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:09.961912 31284 ts_tablet_manager.cc:1403] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:11:09.929121 31282 consensus_queue.cc:260] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:09.968667 31284 raft_consensus.cc:359] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.969861 31284 raft_consensus.cc:385] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.970315 31284 raft_consensus.cc:740] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.970916 31282 ts_tablet_manager.cc:1434] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:11:09.961257 31159 raft_consensus.cc:2468] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:09.971881 31284 consensus_queue.cc:260] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.974375 31201 leader_election.cc:304] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:09.975921 31284 ts_tablet_manager.cc:1434] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:11:09.977249 31292 raft_consensus.cc:2804] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.977558 31284 tablet_bootstrap.cc:492] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:09.977816 31292 raft_consensus.cc:697] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:09.978808 31292 consensus_queue.cc:237] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:09.981585 31479 consensus_queue.cc:1048] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.986847 31284 tablet_bootstrap.cc:654] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.987735 31283 consensus_queue.cc:260] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:09.993357 31283 ts_tablet_manager.cc:1434] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.002s
I20260709 13:11:10.012005 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:10.029893 31012 raft_consensus.cc:3060] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.031792 31283 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:10.032913 31281 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:10.034548 31281 ts_tablet_manager.cc:1403] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.102s	user 0.034s	sys 0.035s
I20260709 13:11:10.016186 31284 tablet_bootstrap.cc:492] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:10.037485 31281 raft_consensus.cc:359] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.015828 30909 catalog_manager.cc:5697] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.038311 31281 raft_consensus.cc:385] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.038659 31281 raft_consensus.cc:740] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.039316 31281 consensus_queue.cc:260] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.038053 31284 ts_tablet_manager.cc:1403] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.012s
I20260709 13:11:10.041550 31281 ts_tablet_manager.cc:1434] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:10.042510 31281 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:10.043506 31284 raft_consensus.cc:359] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.044240 31284 raft_consensus.cc:385] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.044495 31284 raft_consensus.cc:740] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.045214 31284 consensus_queue.cc:260] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.047636 31284 ts_tablet_manager.cc:1434] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:10.048544 31284 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:10.049060 31281 tablet_bootstrap.cc:654] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.055902 31284 tablet_bootstrap.cc:654] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.061206 31283 tablet_bootstrap.cc:654] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.071902 31283 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:10.072526 31283 ts_tablet_manager.cc:1403] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 13:11:10.075860 31283 raft_consensus.cc:359] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.076704 31283 raft_consensus.cc:385] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.077297 31283 raft_consensus.cc:740] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.080622 31284 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:10.080510 31283 consensus_queue.cc:260] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.081318 31284 ts_tablet_manager.cc:1403] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 13:11:10.082726 31292 raft_consensus.cc:493] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.083294 31292 raft_consensus.cc:515] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.084851 31284 raft_consensus.cc:359] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.086498 31283 ts_tablet_manager.cc:1434] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:10.087668 31283 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:10.087841 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:10.088424 31292 leader_election.cc:290] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:10.088647 31011 raft_consensus.cc:2468] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:10.089095 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:10.089772 31084 raft_consensus.cc:2468] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:10.090296 31202 leader_election.cc:304] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:10.091914 31292 raft_consensus.cc:2804] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.092375 31292 raft_consensus.cc:493] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.092794 31292 raft_consensus.cc:3060] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.096971 31283 tablet_bootstrap.cc:654] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.085688 31284 raft_consensus.cc:385] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.097661 31284 raft_consensus.cc:740] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.099380 31284 consensus_queue.cc:260] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.101634 31284 ts_tablet_manager.cc:1434] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:11:10.102304 31292 raft_consensus.cc:515] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.105652 31479 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.106703 31479 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.108008 31284 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:10.108675 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:10.109695 31011 raft_consensus.cc:3060] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.112776 31012 raft_consensus.cc:2468] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:10.113996 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:10.115159 31284 tablet_bootstrap.cc:654] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:10.117213 31128 leader_election.cc:343] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.118865 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:10.120774 31128 leader_election.cc:343] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.121434 31128 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:10.122459 31477 raft_consensus.cc:2749] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.109328 31479 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:10.019402 31348 leader_election.cc:290] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:10.124166 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:10.125159 31084 raft_consensus.cc:3060] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.132548 31477 raft_consensus.cc:493] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.133484 31292 leader_election.cc:290] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:10.133354 31477 raft_consensus.cc:515] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.140961 31477 leader_election.cc:290] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:10.144770 31084 raft_consensus.cc:2468] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:10.149966 31202 leader_election.cc:304] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:10.150471 31479 consensus_queue.cc:1048] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.152056 31382 raft_consensus.cc:2804] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.166275 31382 raft_consensus.cc:697] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:10.167371 31382 consensus_queue.cc:237] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.115937 30910 catalog_manager.cc:5697] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.972008 31282 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:10.143129 31011 raft_consensus.cc:2468] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:10.146085 31284 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:10.195436 31284 ts_tablet_manager.cc:1403] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.004s
I20260709 13:11:10.197589 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:10.198648 31284 raft_consensus.cc:359] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.199448 31284 raft_consensus.cc:385] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.199898 31284 raft_consensus.cc:740] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.200795 31284 consensus_queue.cc:260] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.203676 31284 ts_tablet_manager.cc:1434] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:10.205000 31284 tablet_bootstrap.cc:492] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:10.217581 31284 tablet_bootstrap.cc:654] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.219377 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:10.231209 31292 raft_consensus.cc:493] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.232486 31292 raft_consensus.cc:515] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.236819 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915f9be628344ac09e3d93a385ebbfdb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:10.237835 31084 raft_consensus.cc:2468] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:10.240845 31202 leader_election.cc:304] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:10.241449 31403 raft_consensus.cc:493] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.241851 31526 raft_consensus.cc:2804] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.242352 31526 raft_consensus.cc:493] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.241994 31403 raft_consensus.cc:515] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.242691 31526 raft_consensus.cc:3060] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.246095 31403 leader_election.cc:290] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:10.246498 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:10.247674 31162 raft_consensus.cc:2468] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:10.249701 30978 leader_election.cc:304] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:10.252470 31403 raft_consensus.cc:2804] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.253098 31403 raft_consensus.cc:493] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.253582 31403 raft_consensus.cc:3060] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.254354 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:10.255131 31083 raft_consensus.cc:2468] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:10.265924 31403 raft_consensus.cc:515] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.266098 31473 consensus_queue.cc:1048] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.267912 31526 raft_consensus.cc:515] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.273159 31473 consensus_queue.cc:1048] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.273725 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915f9be628344ac09e3d93a385ebbfdb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:10.274466 31162 raft_consensus.cc:2468] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:10.281620 31403 leader_election.cc:290] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:10.283198 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:10.284140 31162 raft_consensus.cc:3060] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.289616 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
W20260709 13:11:10.290560 31128 leader_election.cc:343] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.290798 31084 raft_consensus.cc:3060] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:10.291628 31128 leader_election.cc:343] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.292230 31128 leader_election.cc:304] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:10.303772 31162 raft_consensus.cc:2468] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:10.349192 30978 leader_election.cc:304] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:10.350385 31321 raft_consensus.cc:2804] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.350936 31321 raft_consensus.cc:697] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:10.351827 31321 consensus_queue.cc:237] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.352941 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915f9be628344ac09e3d93a385ebbfdb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:10.353683 31088 raft_consensus.cc:3060] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.237064 31292 leader_election.cc:290] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:10.305922 31477 raft_consensus.cc:2749] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.309360 31281 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:10.311196 31282 tablet_bootstrap.cc:654] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.311394 31283 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:10.357262 31281 ts_tablet_manager.cc:1403] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.315s	user 0.074s	sys 0.087s
I20260709 13:11:10.357393 31283 ts_tablet_manager.cc:1403] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.270s	user 0.026s	sys 0.079s
I20260709 13:11:10.314429 31284 tablet_bootstrap.cc:492] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:10.358448 31284 ts_tablet_manager.cc:1403] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.154s	user 0.036s	sys 0.028s
I20260709 13:11:10.360618 31283 raft_consensus.cc:359] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.361450 31283 raft_consensus.cc:385] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.360379 31281 raft_consensus.cc:359] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.361802 31284 raft_consensus.cc:359] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.362850 31284 raft_consensus.cc:385] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.363170 31284 raft_consensus.cc:740] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.316776 31479 raft_consensus.cc:493] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.341957 31526 leader_election.cc:290] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:10.344956 31084 raft_consensus.cc:2468] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:10.364014 31479 raft_consensus.cc:515] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.346256 30911 catalog_manager.cc:5697] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.366559 31479 leader_election.cc:290] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:10.367475 31284 consensus_queue.cc:260] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.361847 31283 raft_consensus.cc:740] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.369741 31283 consensus_queue.cc:260] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.371870 31283 ts_tablet_manager.cc:1434] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:10.374996 31284 ts_tablet_manager.cc:1434] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:11:10.375941 31283 tablet_bootstrap.cc:492] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:10.362193 31281 raft_consensus.cc:385] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.385601 31281 raft_consensus.cc:740] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.388141 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:10.389008 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:10.386598 31281 consensus_queue.cc:260] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:10.390853 31128 leader_election.cc:343] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.391649 31281 ts_tablet_manager.cc:1434] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
W20260709 13:11:10.392006 31128 leader_election.cc:343] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.392709 31128 leader_election.cc:304] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:10.397785 31283 tablet_bootstrap.cc:654] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.399539 31088 raft_consensus.cc:2468] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:10.401075 31202 leader_election.cc:304] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:10.401109 31479 raft_consensus.cc:2749] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.404037 31282 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:10.404593 31282 ts_tablet_manager.cc:1403] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.433s	user 0.018s	sys 0.016s
I20260709 13:11:10.406747 31526 raft_consensus.cc:2804] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.407389 31526 raft_consensus.cc:697] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:10.408406 31526 consensus_queue.cc:237] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.408581 31282 raft_consensus.cc:359] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.409718 31282 raft_consensus.cc:385] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.410128 31282 raft_consensus.cc:740] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.417898 31479 raft_consensus.cc:493] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.418583 31479 raft_consensus.cc:515] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.421977 31479 leader_election.cc:290] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:10.421705 31282 consensus_queue.cc:260] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.424533 31282 ts_tablet_manager.cc:1434] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:11:10.425906 31282 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:10.425819 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:10.427513 31128 leader_election.cc:343] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.428293 31477 raft_consensus.cc:493] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.428822 31477 raft_consensus.cc:515] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.418190 31284 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:10.431206 31477 leader_election.cc:290] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:10.429343 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915f9be628344ac09e3d93a385ebbfdb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:10.433990 31282 tablet_bootstrap.cc:654] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.432673 31159 raft_consensus.cc:3060] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.437201 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:10.438520 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:10.440647 31128 leader_election.cc:343] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.445608 31281 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
W20260709 13:11:10.445768 31128 leader_election.cc:343] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.446446 31128 leader_election.cc:304] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:10.447254 31283 tablet_bootstrap.cc:492] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:10.448343 31283 ts_tablet_manager.cc:1403] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.000s
I20260709 13:11:10.449189 31479 raft_consensus.cc:2749] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.451957 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:10.453807 31283 raft_consensus.cc:359] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.454917 31283 raft_consensus.cc:385] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.455262 31283 raft_consensus.cc:740] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.455942 31283 consensus_queue.cc:260] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.458591 31283 ts_tablet_manager.cc:1434] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:10.459756 31283 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:10.467187 31283 tablet_bootstrap.cc:654] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.469759 31292 consensus_queue.cc:1048] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.488832 31284 tablet_bootstrap.cc:654] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.496138 31159 raft_consensus.cc:2468] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:10.501405 31284 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:10.502291 31284 ts_tablet_manager.cc:1403] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.001s
I20260709 13:11:10.505621 31284 raft_consensus.cc:359] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.501405 31283 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:10.507012 31283 ts_tablet_manager.cc:1403] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.003s
I20260709 13:11:10.510246 31283 raft_consensus.cc:359] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.512197 31283 raft_consensus.cc:385] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.512293 31284 raft_consensus.cc:385] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.513077 31284 raft_consensus.cc:740] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.513635 31282 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:10.512645 31283 raft_consensus.cc:740] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.514178 31282 ts_tablet_manager.cc:1403] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.000s
I20260709 13:11:10.514647 31283 consensus_queue.cc:260] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.515836 31284 consensus_queue.cc:260] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.519727 31284 ts_tablet_manager.cc:1434] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:11:10.519809 31282 raft_consensus.cc:359] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.522318 31282 raft_consensus.cc:385] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.522974 31282 raft_consensus.cc:740] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.520892 31283 ts_tablet_manager.cc:1434] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:10.523592 31281 tablet_bootstrap.cc:654] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.524390 31283 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:10.527107 30909 catalog_manager.cc:5697] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.529338 31282 consensus_queue.cc:260] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.530473 31284 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:10.541474 31283 tablet_bootstrap.cc:654] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.542804 31282 ts_tablet_manager.cc:1434] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:11:10.548640 31282 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:10.543558 31284 tablet_bootstrap.cc:654] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.563674 31282 tablet_bootstrap.cc:654] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.565721 31284 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:10.567018 31284 ts_tablet_manager.cc:1403] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.001s
I20260709 13:11:10.570152 31284 raft_consensus.cc:359] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.570955 31284 raft_consensus.cc:385] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.571332 31284 raft_consensus.cc:740] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.572113 31284 consensus_queue.cc:260] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.574709 31284 ts_tablet_manager.cc:1434] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:10.575942 31284 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:10.579375 31536 raft_consensus.cc:493] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.580166 31536 raft_consensus.cc:515] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.582479 31284 tablet_bootstrap.cc:654] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.582618 31536 leader_election.cc:290] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:10.585139 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e351de7e26472fa16a05408cd1bef6" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:10.588729 31054 leader_election.cc:343] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.590338 31526 consensus_queue.cc:1048] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.655880 31284 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:10.656648 31284 ts_tablet_manager.cc:1403] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.008s
I20260709 13:11:10.660125 31284 raft_consensus.cc:359] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.660997 31284 raft_consensus.cc:385] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.661330 31284 raft_consensus.cc:740] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.662118 31284 consensus_queue.cc:260] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.664542 31284 ts_tablet_manager.cc:1434] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:11:10.746011 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e351de7e26472fa16a05408cd1bef6" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:10.757653 31536 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.758348 31536 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.761353 31536 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:10.809680 31548 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.810335 31548 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.813536 31548 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:10.816613 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:10.817713 31233 raft_consensus.cc:2468] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:10.819905 30979 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:10.820976 31473 raft_consensus.cc:2804] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.821379 31473 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.821691 31473 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.823936 31282 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:10.824489 31282 ts_tablet_manager.cc:1403] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.276s	user 0.011s	sys 0.006s
I20260709 13:11:10.827704 31282 raft_consensus.cc:359] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.828321 31282 raft_consensus.cc:385] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.828500 31282 raft_consensus.cc:740] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.829319 31282 consensus_queue.cc:260] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.831676 31282 ts_tablet_manager.cc:1434] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:11:10.831517 31473 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.832962 31282 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:10.833726 31473 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:10.835072 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:10.837885 31233 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.840968 31282 tablet_bootstrap.cc:654] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.847973 31233 raft_consensus.cc:2468] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:10.849946 31281 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:10.850574 30979 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:10.851711 31356 raft_consensus.cc:2804] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.852329 31356 raft_consensus.cc:697] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:10.853027 31282 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:10.853583 31282 ts_tablet_manager.cc:1403] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:11:10.853215 31356 consensus_queue.cc:237] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.850615 31281 ts_tablet_manager.cc:1403] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.405s	user 0.009s	sys 0.049s
I20260709 13:11:10.859455 31282 raft_consensus.cc:359] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.860337 31282 raft_consensus.cc:385] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.860687 31282 raft_consensus.cc:740] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.861491 31282 consensus_queue.cc:260] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.862571 31283 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:10.863348 31283 ts_tablet_manager.cc:1403] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.339s	user 0.023s	sys 0.000s
I20260709 13:11:10.864271 31282 ts_tablet_manager.cc:1434] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:10.865407 31282 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:10.866861 31281 raft_consensus.cc:359] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.868114 31281 raft_consensus.cc:385] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.868498 31281 raft_consensus.cc:740] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.869408 31281 consensus_queue.cc:260] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:10.866739 31283 raft_consensus.cc:359] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.871721 31283 raft_consensus.cc:385] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.872041 31283 raft_consensus.cc:740] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.873083 31282 tablet_bootstrap.cc:654] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.872761 31283 consensus_queue.cc:260] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.875217 31281 ts_tablet_manager.cc:1434] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:11:10.875267 31283 ts_tablet_manager.cc:1434] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:11:10.877815 31283 tablet_bootstrap.cc:492] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:10.878276 31281 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:10.885540 31530 raft_consensus.cc:493] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.890383 31283 tablet_bootstrap.cc:654] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.890733 31530 raft_consensus.cc:515] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.889174 31282 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:10.885716 31479 raft_consensus.cc:493] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.894706 31282 ts_tablet_manager.cc:1403] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.009s
I20260709 13:11:10.895119 31479 raft_consensus.cc:515] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:10.896485 31283 tablet_bootstrap.cc:492] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:10.897122 31283 ts_tablet_manager.cc:1403] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 13:11:10.899056 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:10.899461 31282 raft_consensus.cc:359] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.900352 31282 raft_consensus.cc:385] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.900746 31282 raft_consensus.cc:740] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.900378 31283 raft_consensus.cc:359] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
W20260709 13:11:10.871083 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 421679us
I20260709 13:11:10.901928 31283 raft_consensus.cc:385] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.901737 31282 consensus_queue.cc:260] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:10.902420 31283 raft_consensus.cc:740] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.903139 31283 consensus_queue.cc:260] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:10.904841 31282 ts_tablet_manager.cc:1434] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:11:10.905469 31283 ts_tablet_manager.cc:1434] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:10.906139 31282 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:10.906415 31283 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:10.910296 31526 consensus_queue.cc:1048] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.913877 31284 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:10.914873 31282 tablet_bootstrap.cc:654] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.915233 31283 tablet_bootstrap.cc:654] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:10.905021 31128 leader_election.cc:343] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:10.918236 31128 leader_election.cc:343] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.918716 31128 leader_election.cc:304] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:10.921031 31477 raft_consensus.cc:2749] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.937294 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:10.900223 31054 leader_election.cc:343] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.959188 31054 leader_election.cc:304] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:10.959533 31479 leader_election.cc:290] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:10.960372 31479 raft_consensus.cc:493] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.985513 31382 consensus_queue.cc:1048] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.963640 31530 leader_election.cc:290] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:10.960604 31541 raft_consensus.cc:2749] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:10.963690 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 63495.7us
I20260709 13:11:11.024089 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.041426 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:11.042594 31155 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.032330 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:11.031721 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:11.031450 31054 leader_election.cc:343] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.985904 31479 raft_consensus.cc:515] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.057060 31281 tablet_bootstrap.cc:700] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent opening tablet: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:11:11.058209 31281 tablet_bootstrap.cc:654] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.057740 31292 consensus_queue.cc:1048] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:11.059808 31382 raft_consensus.cc:493] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.060560 31382 raft_consensus.cc:515] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:11.063124 31479 leader_election.cc:290] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:11.063717 31382 leader_election.cc:290] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:10.984562 31284 tablet_bootstrap.cc:654] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:11.072052 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 45273us
I20260709 13:11:11.076617 31530 raft_consensus.cc:493] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.077448 31530 raft_consensus.cc:515] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.080605 31530 leader_election.cc:290] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:11.090154 31128 leader_election.cc:343] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.169044 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:11.169726 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 80900.5us
I20260709 13:11:11.101507 31282 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:11.180423 31282 ts_tablet_manager.cc:1403] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.274s	user 0.072s	sys 0.079s
I20260709 13:11:11.188060 31411 raft_consensus.cc:493] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.192377 31356 raft_consensus.cc:493] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.101507 31284 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:11.193665 31283 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:11.197196 31283 ts_tablet_manager.cc:1403] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.291s	user 0.027s	sys 0.088s
W20260709 13:11:11.196081 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 99633.7us
I20260709 13:11:11.199268 31356 raft_consensus.cc:515] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.201069 31411 raft_consensus.cc:515] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.204902 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:11.205935 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e351de7e26472fa16a05408cd1bef6" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:11.207135 31088 raft_consensus.cc:2468] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:11.207731 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:11.205392 31411 leader_election.cc:290] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:11.209041 31010 raft_consensus.cc:2468] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:11.217908 31284 ts_tablet_manager.cc:1403] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.304s	user 0.012s	sys 0.004s
I20260709 13:11:11.219828 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:11.222692 31161 raft_consensus.cc:2468] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:11.225355 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:11.229038 31202 leader_election.cc:304] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:11.229537 31541 raft_consensus.cc:493] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.232470 31526 raft_consensus.cc:2804] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.230612 31541 raft_consensus.cc:515] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:11.233173 31526 raft_consensus.cc:493] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.233704 31526 raft_consensus.cc:3060] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.235386 31541 leader_election.cc:290] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:11.235283 31284 raft_consensus.cc:359] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.236327 31284 raft_consensus.cc:385] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.243304 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:11.246387 31281 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:11.224277 31282 raft_consensus.cc:359] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:11.247622 31281 ts_tablet_manager.cc:1403] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.370s	user 0.018s	sys 0.001s
I20260709 13:11:11.247988 31282 raft_consensus.cc:385] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.248512 31282 raft_consensus.cc:740] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:11.249557 31282 consensus_queue.cc:260] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:11.253211 31281 raft_consensus.cc:359] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.247779 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:11.257665 31281 raft_consensus.cc:385] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.260478 31281 raft_consensus.cc:740] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:11.236709 31284 raft_consensus.cc:740] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
W20260709 13:11:11.266904 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 88087.4us
I20260709 13:11:11.269364 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:11.270128 31013 raft_consensus.cc:2468] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
W20260709 13:11:11.269456 30979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 54679.8us
I20260709 13:11:11.272734 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:11.273600 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:11.273774 31159 raft_consensus.cc:2468] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:11.277781 31473 consensus_queue.cc:1048] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:11.283524 31548 raft_consensus.cc:493] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.284376 31054 leader_election.cc:343] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.285097 31356 leader_election.cc:290] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:11.286397 31282 ts_tablet_manager.cc:1434] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.004s
I20260709 13:11:11.288514 31282 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:11.282980 31283 raft_consensus.cc:359] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.298592 31283 raft_consensus.cc:385] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.298944 31283 raft_consensus.cc:740] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:11.299853 31283 consensus_queue.cc:260] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.284472 31548 raft_consensus.cc:515] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.303792 31548 leader_election.cc:290] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:11.280370 30978 leader_election.cc:304] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:11.300252 31526 raft_consensus.cc:515] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:11.297495 31284 consensus_queue.cc:260] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.306963 31281 consensus_queue.cc:260] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.309223 31548 raft_consensus.cc:2804] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.311723 31548 raft_consensus.cc:493] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.312135 31548 raft_consensus.cc:3060] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:11.308344 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 135560us
I20260709 13:11:11.320087 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:11.285079 31054 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:11.321445 31281 ts_tablet_manager.cc:1434] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260709 13:11:11.328958 30909 catalog_manager.cc:5697] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:11.330539 31128 leader_election.cc:343] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.331327 31128 leader_election.cc:304] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:11.331451 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e351de7e26472fa16a05408cd1bef6" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:11.332571 31010 raft_consensus.cc:2468] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:11.336215 31563 raft_consensus.cc:493] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.337261 31128 leader_election.cc:343] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.337440 31563 raft_consensus.cc:515] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:11.341164 31477 raft_consensus.cc:2749] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:11.345629 31536 raft_consensus.cc:2749] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:11.346055 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 61891.9us
I20260709 13:11:11.347009 31284 ts_tablet_manager.cc:1434] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.006s
I20260709 13:11:11.356002 31526 leader_election.cc:290] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:11.353015 31563 leader_election.cc:290] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:11.334197 31159 raft_consensus.cc:2468] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:11.348781 31054 leader_election.cc:304] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:11.384157 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:11.374009 31536 raft_consensus.cc:2804] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.387101 31536 raft_consensus.cc:493] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.387745 31536 raft_consensus.cc:3060] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.385908 31053 leader_election.cc:304] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
W20260709 13:11:11.366899 31128 leader_election.cc:343] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.395219 31128 leader_election.cc:304] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:11.399432 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e351de7e26472fa16a05408cd1bef6" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:11.399979 31156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:11.400254 31084 raft_consensus.cc:3060] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.400844 31156 raft_consensus.cc:2468] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:11.397642 31411 raft_consensus.cc:2804] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.407301 31411 raft_consensus.cc:493] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.407727 31411 raft_consensus.cc:3060] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.408252 31526 consensus_queue.cc:1048] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:11.411027 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:11.416168 31156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:11.417325 31565 raft_consensus.cc:2749] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:11.419785 31156 raft_consensus.cc:2468] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
W20260709 13:11:11.416501 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 64836.4us
W20260709 13:11:11.421777 31128 leader_election.cc:343] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.428830 31128 leader_election.cc:304] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:11.430712 31565 raft_consensus.cc:2804] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.422003 30978 leader_election.cc:304] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:11.431185 31565 raft_consensus.cc:493] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.425526 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:11.431654 31565 raft_consensus.cc:3060] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.432214 31053 leader_election.cc:304] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:11.432422 31356 raft_consensus.cc:2804] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.433086 31356 raft_consensus.cc:493] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.433559 31356 raft_consensus.cc:3060] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.433945 31541 raft_consensus.cc:2804] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.434549 31541 raft_consensus.cc:493] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.436337 31541 raft_consensus.cc:3060] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.447237 31281 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:11.449752 31284 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
W20260709 13:11:11.404423 31054 leader_election.cc:343] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:11.455173 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 57490.7us
W20260709 13:11:11.456004 31054 leader_election.cc:343] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.463390 31541 raft_consensus.cc:515] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:11.467139 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e351de7e26472fa16a05408cd1bef6" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:11.483525 31565 raft_consensus.cc:515] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.481024 31010 raft_consensus.cc:3060] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.486195 31565 leader_election.cc:290] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:11.403102 31155 raft_consensus.cc:2468] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:11.493008 31282 tablet_bootstrap.cc:654] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.493458 31283 ts_tablet_manager.cc:1434] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.238s	user 0.012s	sys 0.001s
I20260709 13:11:11.496557 31541 leader_election.cc:290] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:11.498922 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.499745 31161 raft_consensus.cc:3060] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.499513 31473 consensus_queue.cc:1048] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:11.506489 31411 raft_consensus.cc:515] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:11.509093 31536 raft_consensus.cc:515] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.511124 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:11.513669 31088 raft_consensus.cc:2393] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 116e6baff6234eadbc262b5fb70cfd5b in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:11.514617 31536 leader_election.cc:290] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:11.515029 31473 consensus_queue.cc:1048] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.511201 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.516561 31158 raft_consensus.cc:3060] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.511271 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
W20260709 13:11:11.523711 30979 leader_election.cc:343] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.531780 31084 raft_consensus.cc:2468] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:11.541431 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
W20260709 13:11:11.534487 31054 leader_election.cc:343] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:11.545738 31054 leader_election.cc:343] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.549420 31541 raft_consensus.cc:493] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.549999 31541 raft_consensus.cc:515] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.551015 31158 raft_consensus.cc:2468] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:11.551424 31284 tablet_bootstrap.cc:654] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.552793 31548 raft_consensus.cc:515] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.553879 31283 tablet_bootstrap.cc:492] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:11.554049 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.554344 31011 raft_consensus.cc:2393] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 13bb23988f5940e5ba175699ca30e0d6 in current term 1: Already voted for candidate 116e6baff6234eadbc262b5fb70cfd5b in this term.
I20260709 13:11:11.554713 31155 raft_consensus.cc:3060] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.553064 31053 leader_election.cc:304] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:11.557124 31281 tablet_bootstrap.cc:654] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.557617 31536 raft_consensus.cc:2804] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:11.558233 31536 raft_consensus.cc:697] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:11.508812 31411 leader_election.cc:290] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:11.571553 31202 leader_election.cc:304] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:11.572995 31382 raft_consensus.cc:2804] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:11.573549 31382 raft_consensus.cc:697] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:11.574709 31382 consensus_queue.cc:237] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:11.576895 31548 leader_election.cc:290] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:11.559347 31536 consensus_queue.cc:237] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:11.584846 31541 leader_election.cc:290] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:11.588552 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:11.589643 31083 raft_consensus.cc:2393] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 116e6baff6234eadbc262b5fb70cfd5b in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:11.589550 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:11.590461 31009 raft_consensus.cc:2468] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:11.578896 31010 raft_consensus.cc:2468] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:11.592797 31526 raft_consensus.cc:493] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.593433 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:11.593367 31526 raft_consensus.cc:515] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.595847 31526 leader_election.cc:290] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:11.559214 31128 leader_election.cc:343] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.599128 31054 leader_election.cc:304] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:11.602250 31161 raft_consensus.cc:2468] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:11.603701 31053 leader_election.cc:304] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:11.603924 31411 raft_consensus.cc:2804] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.604454 31411 raft_consensus.cc:493] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.604990 31411 raft_consensus.cc:3060] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.605389 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:11.606288 31159 raft_consensus.cc:2393] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13bb23988f5940e5ba175699ca30e0d6 in current term 1: Already voted for candidate e0094be1075d460cafd5160946c09aed in this term.
I20260709 13:11:11.604676 31321 consensus_queue.cc:1048] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:11.604506 31156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1fdd08f91a438a9f88c5a2bc59326b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.616369 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:11.618320 31159 raft_consensus.cc:2468] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:11.618441 30978 leader_election.cc:304] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:11.619789 31321 raft_consensus.cc:2749] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:11.611791 31541 raft_consensus.cc:2804] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:11.601275 31356 raft_consensus.cc:515] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.603940 31128 leader_election.cc:304] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
W20260709 13:11:11.649665 21395 debug-util.cc:398] Leaking SignalData structure 0x7b0800200380 after lost signal to thread 31053
I20260709 13:11:11.629942 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:11.662827 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 103721us
I20260709 13:11:11.663813 31356 leader_election.cc:290] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:11.664929 31479 raft_consensus.cc:2749] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:11.668308 31411 raft_consensus.cc:515] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.671303 31411 leader_election.cc:290] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:11.678589 30942 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3320 after lost signal to thread 21393
I20260709 13:11:11.678699 30907 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48376 (request call id 45) took 1217 ms. Trace:
I20260709 13:11:11.679605 30907 rpcz_store.cc:276] 0709 13:11:10.461281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.148276 (+686995us) service_pool.cc:224] Handling call
0709 13:11:11.678473 (+530197us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":150656}
I20260709 13:11:11.633490 31541 raft_consensus.cc:697] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
W20260709 13:11:11.680629 30942 debug-util.cc:398] Leaking SignalData structure 0x7b08001bca80 after lost signal to thread 30945
I20260709 13:11:11.688905 31473 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.692610 31473 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:11.694489 30942 debug-util.cc:398] Leaking SignalData structure 0x7b08002230c0 after lost signal to thread 31037
I20260709 13:11:11.704232 31281 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:11.705084 31281 ts_tablet_manager.cc:1403] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.308s	user 0.009s	sys 0.010s
W20260709 13:11:11.704114 31202 leader_election.cc:343] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.719120 31156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.719940 31479 raft_consensus.cc:493] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.720288 31156 raft_consensus.cc:3060] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.720605 31479 raft_consensus.cc:515] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.721422 31541 consensus_queue.cc:237] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
W20260709 13:11:11.715238 30942 debug-util.cc:398] Leaking SignalData structure 0x7b08001f61c0 after lost signal to thread 31112
I20260709 13:11:11.728227 31283 tablet_bootstrap.cc:654] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.735877 31201 leader_election.cc:304] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:11.738121 31473 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:11.730382 31281 raft_consensus.cc:359] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.750320 31281 raft_consensus.cc:385] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.750804 31281 raft_consensus.cc:740] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
W20260709 13:11:11.688753 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 77458.6us
W20260709 13:11:11.752897 30942 debug-util.cc:398] Leaking SignalData structure 0x7b0800260ce0 after lost signal to thread 31186
I20260709 13:11:11.753041 31292 raft_consensus.cc:2804] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:11.753834 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 62385.2us
W20260709 13:11:11.758327 30942 debug-util.cc:398] Leaking SignalData structure 0x7b08002054e0 after lost signal to thread 31260
I20260709 13:11:11.757268 31292 raft_consensus.cc:493] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.788739 31281 consensus_queue.cc:260] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.762948 31479 leader_election.cc:290] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:11.801146 31581 log.cc:927] Time spent T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:11:11.756141 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 67603.2us
I20260709 13:11:11.758195 30911 catalog_manager.cc:5697] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:11.793392 31292 raft_consensus.cc:3060] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.814320 31281 ts_tablet_manager.cc:1434] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.003s
I20260709 13:11:11.817852 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b31ab53d447b3ab5bd993b7c992bf" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:11.819370 31284 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:11.819944 31284 ts_tablet_manager.cc:1403] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.371s	user 0.030s	sys 0.030s
I20260709 13:11:11.818091 31281 tablet_bootstrap.cc:492] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
W20260709 13:11:11.787245 30979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 153488us
I20260709 13:11:11.821528 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:11.822332 31013 raft_consensus.cc:3060] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.829327 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:11.830057 31234 raft_consensus.cc:3060] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.832759 31292 raft_consensus.cc:515] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:11.825382 31128 leader_election.cc:343] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.839002 31155 raft_consensus.cc:2468] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:11.842993 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:11.858814 31084 raft_consensus.cc:2393] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:11.848496 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.851794 31013 raft_consensus.cc:2468] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:11.863663 31054 leader_election.cc:304] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:11.864154 31283 tablet_bootstrap.cc:492] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:11.864773 31283 ts_tablet_manager.cc:1403] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.311s	user 0.010s	sys 0.006s
I20260709 13:11:11.868706 31161 raft_consensus.cc:2393] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 13bb23988f5940e5ba175699ca30e0d6 in current term 1: Already voted for candidate e0094be1075d460cafd5160946c09aed in this term.
I20260709 13:11:11.869220 31568 raft_consensus.cc:2804] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:11.869874 31568 raft_consensus.cc:697] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:11.870880 31568 consensus_queue.cc:237] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.868386 31283 raft_consensus.cc:359] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:11.876642 31283 raft_consensus.cc:385] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.845105 31156 raft_consensus.cc:2468] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:11.878418 30978 leader_election.cc:304] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:11.877717 30910 catalog_manager.cc:5697] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.879585 31234 raft_consensus.cc:2468] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:11.879597 31562 raft_consensus.cc:2804] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:11.885289 31562 raft_consensus.cc:697] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:11.886412 31562 consensus_queue.cc:237] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.887387 31053 leader_election.cc:304] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:11.892330 31580 raft_consensus.cc:2804] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:11.892931 31580 raft_consensus.cc:697] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:11.893136 31282 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:11.893955 31282 ts_tablet_manager.cc:1403] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.606s	user 0.015s	sys 0.009s
I20260709 13:11:11.893973 31580 consensus_queue.cc:237] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:11.903380 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:11.904098 31155 raft_consensus.cc:3060] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.877060 31283 raft_consensus.cc:740] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:11.910043 31281 tablet_bootstrap.cc:654] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.912583 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:11.913513 31011 raft_consensus.cc:2393] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:11.914484 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b31ab53d447b3ab5bd993b7c992bf" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:11.916816 31284 raft_consensus.cc:359] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.919340 31284 raft_consensus.cc:385] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.908629 31282 raft_consensus.cc:359] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.919682 31284 raft_consensus.cc:740] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:11.922078 31282 raft_consensus.cc:385] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.922407 31282 raft_consensus.cc:740] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:11.922967 31283 consensus_queue.cc:260] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:11.930284 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:11.931380 31283 ts_tablet_manager.cc:1434] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:11:11.916126 31128 leader_election.cc:304] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:11.932677 31283 tablet_bootstrap.cc:492] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:11.933126 31479 raft_consensus.cc:2749] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:11.931278 31084 raft_consensus.cc:2468] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:11.916038 31292 leader_election.cc:290] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:11.938287 31282 consensus_queue.cc:260] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.939371 31011 raft_consensus.cc:2468] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:11.924719 30907 catalog_manager.cc:5697] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.943137 31155 raft_consensus.cc:2468] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:11.950641 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:11.951932 31128 leader_election.cc:304] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:11.952960 31565 raft_consensus.cc:2804] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.953358 31565 raft_consensus.cc:493] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.953831 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:11.953848 31565 raft_consensus.cc:3060] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:11.955602 31202 leader_election.cc:343] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:11.953848 31284 consensus_queue.cc:260] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.958392 31284 ts_tablet_manager.cc:1434] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.138s	user 0.006s	sys 0.001s
I20260709 13:11:11.959894 31284 tablet_bootstrap.cc:492] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:11.955032 30979 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:11.962630 31562 raft_consensus.cc:2804] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:11.963088 30911 catalog_manager.cc:5697] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:11.971050 31283 tablet_bootstrap.cc:654] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.974092 31284 tablet_bootstrap.cc:654] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.949890 31282 ts_tablet_manager.cc:1434] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.001s
I20260709 13:11:11.986404 31565 raft_consensus.cc:515] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:11.989816 31282 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:11.990048 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b31ab53d447b3ab5bd993b7c992bf" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:11.990741 31013 raft_consensus.cc:3060] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.963092 31562 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.993254 31562 raft_consensus.cc:3060] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.988708 31565 leader_election.cc:290] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:12.001473 30979 leader_election.cc:343] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:12.010914 31054 consensus_peers.cc:597] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:12.010545 31281 tablet_bootstrap.cc:492] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:12.011694 31281 ts_tablet_manager.cc:1403] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.011s
I20260709 13:11:11.986457 30907 catalog_manager.cc:5697] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.010988 31282 tablet_bootstrap.cc:654] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.011083 31562 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:12.014746 31281 raft_consensus.cc:359] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.015493 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b31ab53d447b3ab5bd993b7c992bf" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:12.016943 31201 leader_election.cc:304] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:12.015548 31281 raft_consensus.cc:385] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.018777 31562 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:12.018978 31281 raft_consensus.cc:740] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.020174 31281 consensus_queue.cc:260] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.021340 31013 raft_consensus.cc:2468] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:12.022776 31292 raft_consensus.cc:2804] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.023348 31292 raft_consensus.cc:697] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:12.024200 31292 consensus_queue.cc:237] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.032968 31283 tablet_bootstrap.cc:492] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:12.033596 31283 ts_tablet_manager.cc:1403] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.007s
I20260709 13:11:12.042659 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
W20260709 13:11:12.043347 31128 leader_election.cc:343] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.043503 31084 raft_consensus.cc:3060] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.048151 31281 ts_tablet_manager.cc:1434] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:11:12.049940 31541 consensus_queue.cc:1048] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.052098 31281 tablet_bootstrap.cc:492] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:12.052608 31525 consensus_queue.cc:1048] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.055677 31283 raft_consensus.cc:359] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.057260 31128 leader_election.cc:304] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:12.068776 31565 raft_consensus.cc:2804] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.069382 31565 raft_consensus.cc:697] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:12.070238 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:12.070338 31565 consensus_queue.cc:237] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:12.073923 30979 leader_election.cc:343] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.075838 31283 raft_consensus.cc:385] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.076242 31283 raft_consensus.cc:740] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.077168 31284 tablet_bootstrap.cc:492] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:12.077791 31284 ts_tablet_manager.cc:1403] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.003s
I20260709 13:11:12.081419 31281 tablet_bootstrap.cc:654] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.083812 31284 raft_consensus.cc:359] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.072232 30911 catalog_manager.cc:5697] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.090711 31283 consensus_queue.cc:260] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.094098 31283 ts_tablet_manager.cc:1434] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.002s
I20260709 13:11:12.098515 30909 catalog_manager.cc:5697] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.102823 31283 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:12.107134 31292 consensus_queue.cc:1048] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.084791 31284 raft_consensus.cc:385] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.108258 31284 raft_consensus.cc:740] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.109084 31284 consensus_queue.cc:260] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.124938 31284 ts_tablet_manager.cc:1434] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:11:12.088027 30910 catalog_manager.cc:5697] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.127741 31284 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:12.128129 30910 catalog_manager.cc:5697] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.137106 31283 tablet_bootstrap.cc:654] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.152253 31084 raft_consensus.cc:2468] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:12.157542 30979 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:12.158767 31403 raft_consensus.cc:2804] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.159312 31403 raft_consensus.cc:697] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:12.160444 31403 consensus_queue.cc:237] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:12.177877 31541 raft_consensus.cc:493] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.178495 31541 raft_consensus.cc:515] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.180131 31284 tablet_bootstrap.cc:654] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.191398 31281 tablet_bootstrap.cc:492] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:12.182606 31282 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:12.194789 31281 ts_tablet_manager.cc:1403] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.011s
I20260709 13:11:12.195147 31282 ts_tablet_manager.cc:1403] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.206s	user 0.009s	sys 0.026s
I20260709 13:11:12.183390 31541 leader_election.cc:290] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:12.183058 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:12.192884 31054 consensus_peers.cc:597] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:12.192232 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:12.215968 31054 leader_election.cc:343] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.214231 31155 raft_consensus.cc:2468] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:12.237739 31053 leader_election.cc:304] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:12.239275 31580 raft_consensus.cc:2804] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.239774 31580 raft_consensus.cc:493] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.240204 31580 raft_consensus.cc:3060] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.248594 31282 raft_consensus.cc:359] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.249472 31282 raft_consensus.cc:385] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.249758 31282 raft_consensus.cc:740] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.252946 31565 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.253494 31565 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.257287 31282 consensus_queue.cc:260] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.260268 31281 raft_consensus.cc:359] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.262334 31281 raft_consensus.cc:385] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.262719 31281 raft_consensus.cc:740] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.266284 31282 ts_tablet_manager.cc:1434] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.001s
I20260709 13:11:12.266543 31283 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:12.266902 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:12.268625 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:12.269731 31128 leader_election.cc:343] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:12.270597 31128 leader_election.cc:343] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.271005 31128 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:12.267120 31283 ts_tablet_manager.cc:1403] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.165s	user 0.007s	sys 0.009s
I20260709 13:11:12.272294 31479 raft_consensus.cc:2749] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:12.271484 30910 catalog_manager.cc:5697] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.255981 31580 raft_consensus.cc:515] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.258607 31565 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:12.277179 31281 consensus_queue.cc:260] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.283931 31282 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:12.285696 31284 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:12.286412 31284 ts_tablet_manager.cc:1403] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.002s
I20260709 13:11:12.286304 31283 raft_consensus.cc:359] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.287147 31283 raft_consensus.cc:385] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.287432 31283 raft_consensus.cc:740] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.288161 31283 consensus_queue.cc:260] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.294112 31281 ts_tablet_manager.cc:1434] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 13:11:12.301501 31283 ts_tablet_manager.cc:1434] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:11:12.302491 31541 consensus_queue.cc:1048] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:12.303117 31283 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:12.304657 31586 consensus_queue.cc:1048] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:12.311790 31589 consensus_queue.cc:1048] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.314968 31580 leader_election.cc:290] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:12.316814 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:12.296933 31284 raft_consensus.cc:359] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.320799 31284 raft_consensus.cc:385] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.321206 31284 raft_consensus.cc:740] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.323211 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:12.323899 31158 raft_consensus.cc:3060] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:12.324999 31054 leader_election.cc:343] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.332098 31283 tablet_bootstrap.cc:654] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.341324 31284 consensus_queue.cc:260] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.353968 31589 consensus_queue.cc:1048] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.332708 31158 raft_consensus.cc:2468] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:12.359426 31281 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:12.360527 31053 leader_election.cc:304] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:12.376047 31589 raft_consensus.cc:2804] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.376595 31589 raft_consensus.cc:697] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:12.389571 31589 consensus_queue.cc:237] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.391185 31568 raft_consensus.cc:493] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.391788 31568 raft_consensus.cc:515] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.388953 31284 ts_tablet_manager.cc:1434] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.102s	user 0.004s	sys 0.008s
I20260709 13:11:12.394058 31568 leader_election.cc:290] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:12.394762 31284 tablet_bootstrap.cc:492] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:12.401678 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078186d5ab1e4886903ffb8cd15f46d9" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:12.405097 31054 leader_election.cc:343] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.407261 31282 tablet_bootstrap.cc:654] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.409677 30907 catalog_manager.cc:5697] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.418175 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078186d5ab1e4886903ffb8cd15f46d9" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:12.430848 31292 consensus_queue.cc:1048] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.436568 31525 raft_consensus.cc:493] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.437893 31525 raft_consensus.cc:515] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.440624 31525 leader_election.cc:290] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:12.428371 31155 raft_consensus.cc:2468] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:12.442629 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:12.444170 31284 tablet_bootstrap.cc:654] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.445055 31283 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:12.445574 31283 ts_tablet_manager.cc:1403] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.143s	user 0.021s	sys 0.023s
I20260709 13:11:12.451787 31283 raft_consensus.cc:359] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:12.462920 31283 raft_consensus.cc:385] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.463263 31283 raft_consensus.cc:740] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.464052 31283 consensus_queue.cc:260] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:12.468849 31053 leader_election.cc:304] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:12.471017 31541 raft_consensus.cc:2804] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.471578 31541 raft_consensus.cc:493] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.472261 31541 raft_consensus.cc:3060] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.481458 31282 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:12.481936 31283 ts_tablet_manager.cc:1434] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:11:12.470367 31403 consensus_queue.cc:1048] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.482067 31282 ts_tablet_manager.cc:1403] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.198s	user 0.027s	sys 0.006s
I20260709 13:11:12.482613 31281 tablet_bootstrap.cc:654] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.490608 31282 raft_consensus.cc:359] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.471961 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5428cc42d4f7281ae35788233dee8" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:12.491426 31282 raft_consensus.cc:385] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.491765 31282 raft_consensus.cc:740] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.483772 31589 consensus_queue.cc:1048] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.492620 31282 consensus_queue.cc:260] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.495229 31201 leader_election.cc:304] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:12.494275 31283 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:12.496769 31292 raft_consensus.cc:2749] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:12.505926 31282 ts_tablet_manager.cc:1434] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:11:12.512187 31282 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:12.518584 31284 tablet_bootstrap.cc:492] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:12.522935 31284 ts_tablet_manager.cc:1403] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.130s	user 0.005s	sys 0.008s
I20260709 13:11:12.526436 31541 raft_consensus.cc:515] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.528504 31589 consensus_queue.cc:1048] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.532343 31282 tablet_bootstrap.cc:654] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.538529 31281 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:12.539170 31281 ts_tablet_manager.cc:1403] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.180s	user 0.006s	sys 0.007s
I20260709 13:11:12.550249 31292 raft_consensus.cc:493] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.550895 31292 raft_consensus.cc:515] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.561955 31283 tablet_bootstrap.cc:654] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.567516 31010 raft_consensus.cc:3060] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.569806 31292 leader_election.cc:290] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:12.570609 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:12.570765 31284 raft_consensus.cc:359] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.571599 31284 raft_consensus.cc:385] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.571889 31284 raft_consensus.cc:740] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.584421 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078186d5ab1e4886903ffb8cd15f46d9" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:12.585273 31158 raft_consensus.cc:3060] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.595453 31235 raft_consensus.cc:3060] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.598436 31284 consensus_queue.cc:260] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.604998 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078186d5ab1e4886903ffb8cd15f46d9" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:12.609335 31284 ts_tablet_manager.cc:1434] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
W20260709 13:11:12.610004 31054 leader_election.cc:343] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.610572 31284 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:12.617237 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ff9b94c054250a66182155d62b0fc" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:12.618847 31565 raft_consensus.cc:493] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.619680 31565 raft_consensus.cc:515] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.620826 31292 consensus_queue.cc:1048] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:12.622351 31565 leader_election.cc:290] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:12.622426 31284 tablet_bootstrap.cc:654] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.625345 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:12.625866 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:12.626962 31009 raft_consensus.cc:2468] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:12.628552 31128 leader_election.cc:304] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:12.617372 31586 raft_consensus.cc:493] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.629565 31586 raft_consensus.cc:515] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.631779 31610 raft_consensus.cc:2804] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.632433 31158 raft_consensus.cc:2468] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:12.576220 31541 leader_election.cc:290] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
W20260709 13:11:12.633987 31128 leader_election.cc:343] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.640051 31201 leader_election.cc:304] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:12.632464 31610 raft_consensus.cc:493] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.655211 31292 raft_consensus.cc:2749] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:12.657907 31281 raft_consensus.cc:359] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.660440 31281 raft_consensus.cc:385] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.661034 31281 raft_consensus.cc:740] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.673729 31282 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:12.674259 31586 leader_election.cc:290] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:12.674384 31282 ts_tablet_manager.cc:1403] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.019s
I20260709 13:11:12.658557 31610 raft_consensus.cc:3060] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.681668 31053 leader_election.cc:304] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
W20260709 13:11:12.691771 30979 consensus_peers.cc:597] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:12.688930 31281 consensus_queue.cc:260] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.697378 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:12.689453 31541 raft_consensus.cc:2804] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:12.717327 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199428020b7342f1b3d816182baa55e4" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:12.728216 31541 raft_consensus.cc:697] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:12.729339 31541 consensus_queue.cc:237] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:12.730675 31234 raft_consensus.cc:3060] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.740835 31473 consensus_queue.cc:1048] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:12.747503 31284 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:12.748154 31284 ts_tablet_manager.cc:1403] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.031s
I20260709 13:11:12.751168 31284 raft_consensus.cc:359] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.751904 31284 raft_consensus.cc:385] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.752189 31284 raft_consensus.cc:740] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.752908 31284 consensus_queue.cc:260] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.755009 31284 ts_tablet_manager.cc:1434] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:12.756755 31284 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:12.747674 31610 raft_consensus.cc:515] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.762884 31284 tablet_bootstrap.cc:654] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.773651 31282 raft_consensus.cc:359] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:12.774423 31589 raft_consensus.cc:493] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.774598 31282 raft_consensus.cc:385] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.762928 31281 ts_tablet_manager.cc:1434] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.223s	user 0.011s	sys 0.000s
I20260709 13:11:12.774973 31282 raft_consensus.cc:740] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.774261 31610 leader_election.cc:290] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:12.789785 31282 consensus_queue.cc:260] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:12.795463 31624 raft_consensus.cc:493] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.796108 31624 raft_consensus.cc:515] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:12.798516 31624 leader_election.cc:290] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:12.775020 31589 raft_consensus.cc:515] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.801043 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5496455d6ea451dadd260868b97d356" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:12.801329 31589 leader_election.cc:290] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:12.801533 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:12.801903 31589 consensus_queue.cc:1048] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:12.802150 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5496455d6ea451dadd260868b97d356" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:12.802274 31155 raft_consensus.cc:2468] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:12.802918 31009 raft_consensus.cc:2468] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:12.804720 31053 leader_election.cc:304] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:12.804786 31054 leader_election.cc:304] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:12.805202 31281 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
W20260709 13:11:12.806386 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 114375us
I20260709 13:11:12.796103 31283 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:12.809597 31283 ts_tablet_manager.cc:1403] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.316s	user 0.025s	sys 0.030s
I20260709 13:11:12.805996 31580 raft_consensus.cc:2804] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:12.808336 31568 raft_consensus.cc:2804] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:12.829370 31054 leader_election.cc:343] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.846267 31281 tablet_bootstrap.cc:654] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:12.848452 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 66082.3us
I20260709 13:11:12.849596 31282 ts_tablet_manager.cc:1434] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.175s	user 0.008s	sys 0.001s
I20260709 13:11:12.851464 31236 raft_consensus.cc:3060] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.815609 31580 raft_consensus.cc:493] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.833365 31568 raft_consensus.cc:493] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.856688 31580 raft_consensus.cc:3060] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.870147 30909 catalog_manager.cc:5697] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.876941 30978 leader_election.cc:304] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:12.878250 31284 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:12.878873 31284 ts_tablet_manager.cc:1403] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.012s
I20260709 13:11:12.861374 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:12.864027 31610 consensus_queue.cc:1048] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:11:12.885620 31631 raft_consensus.cc:2749] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:12.853901 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:12.887187 31013 raft_consensus.cc:3060] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.887429 31284 raft_consensus.cc:359] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:12.888394 31284 raft_consensus.cc:385] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.888676 31284 raft_consensus.cc:740] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.889333 31284 consensus_queue.cc:260] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:12.892094 31054 consensus_peers.cc:597] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:12.892398 31284 ts_tablet_manager.cc:1434] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:12.895450 31284 tablet_bootstrap.cc:492] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:12.895264 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:12.899394 31282 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:12.863682 31283 raft_consensus.cc:359] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.905632 31283 raft_consensus.cc:385] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:12.906041 31283 raft_consensus.cc:740] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:12.908562 31284 tablet_bootstrap.cc:654] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:12.913359 31054 leader_election.cc:343] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.859717 31568 raft_consensus.cc:3060] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:12.917140 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 60203.5us
I20260709 13:11:12.915868 31479 raft_consensus.cc:493] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.937033 31479 raft_consensus.cc:515] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.939141 31479 leader_election.cc:290] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:12.935292 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:12.945776 31283 consensus_queue.cc:260] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:12.935986 31282 tablet_bootstrap.cc:654] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:12.949873 31083 raft_consensus.cc:3060] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.953366 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f666ffe90c44600a3394d80de817540" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:12.955310 31128 leader_election.cc:343] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.961655 31479 consensus_queue.cc:1048] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:12.991202 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f666ffe90c44600a3394d80de817540" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:12.993568 31283 ts_tablet_manager.cc:1434] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.183s	user 0.005s	sys 0.003s
W20260709 13:11:12.998924 31128 leader_election.cc:343] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:12.999490 31128 leader_election.cc:304] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:13.000622 31610 raft_consensus.cc:2749] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.019526 31283 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:13.049463 31568 raft_consensus.cc:515] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.053557 31013 raft_consensus.cc:2468] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:13.054415 31479 raft_consensus.cc:493] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.055096 31479 raft_consensus.cc:515] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.055616 31128 leader_election.cc:304] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:13.056843 31639 raft_consensus.cc:2804] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.057551 31639 raft_consensus.cc:697] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:13.058763 31639 consensus_queue.cc:237] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.064285 31479 leader_election.cc:290] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:13.066749 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:13.068457 31128 leader_election.cc:343] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.069535 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:13.071710 31128 leader_election.cc:343] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.072340 31128 leader_election.cc:304] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:13.073341 31479 raft_consensus.cc:2749] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.081080 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5496455d6ea451dadd260868b97d356" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:13.137826 31083 raft_consensus.cc:2468] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:13.140830 31479 raft_consensus.cc:493] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.159381 31479 raft_consensus.cc:515] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.163437 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d313b1f24abb861e4028d92c4bcb" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:13.165446 31128 leader_election.cc:343] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.166841 31479 leader_election.cc:290] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:13.146620 31580 raft_consensus.cc:515] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
W20260709 13:11:13.149041 31054 leader_election.cc:343] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.158198 31568 leader_election.cc:290] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:13.214145 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d313b1f24abb861e4028d92c4bcb" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:13.223906 31281 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:13.224545 31281 ts_tablet_manager.cc:1403] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.437s	user 0.024s	sys 0.053s
W20260709 13:11:13.236505 31128 leader_election.cc:343] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.237138 31128 leader_election.cc:304] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:13.241026 31639 raft_consensus.cc:2749] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.243227 31283 tablet_bootstrap.cc:654] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.246583 31284 tablet_bootstrap.cc:492] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:13.246982 31580 leader_election.cc:290] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:13.247195 31284 ts_tablet_manager.cc:1403] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.354s	user 0.081s	sys 0.097s
W20260709 13:11:13.257956 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 137298us
W20260709 13:11:13.336273 30978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 82568us
I20260709 13:11:13.342046 31284 raft_consensus.cc:359] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.343129 31284 raft_consensus.cc:385] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.351735 31284 raft_consensus.cc:740] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.356573 31284 consensus_queue.cc:260] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.358827 31284 ts_tablet_manager.cc:1434] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.111s	user 0.010s	sys 0.005s
I20260709 13:11:13.359982 31284 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:13.361253 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:13.349970 31281 raft_consensus.cc:359] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.363672 31281 raft_consensus.cc:385] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:13.350540 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 93715.6us
I20260709 13:11:13.350714 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5496455d6ea451dadd260868b97d356" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
W20260709 13:11:13.363998 31054 leader_election.cc:343] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.364603 31013 raft_consensus.cc:3060] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.372048 30907 catalog_manager.cc:5697] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.383649 31541 consensus_queue.cc:1048] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.392222 31013 raft_consensus.cc:2468] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
W20260709 13:11:13.353142 31646 log.cc:927] Time spent T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Append to log took a long time: real 0.107s	user 0.004s	sys 0.000s
I20260709 13:11:13.353189 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:13.398614 31158 raft_consensus.cc:3060] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.355813 31283 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:13.408452 31283 ts_tablet_manager.cc:1403] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.389s	user 0.016s	sys 0.003s
I20260709 13:11:13.411403 31283 raft_consensus.cc:359] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.412190 31283 raft_consensus.cc:385] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.412489 31283 raft_consensus.cc:740] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.363997 31281 raft_consensus.cc:740] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.392652 31284 tablet_bootstrap.cc:654] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.348201 31282 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
W20260709 13:11:13.395349 31054 consensus_peers.cc:597] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:13.413439 31281 consensus_queue.cc:260] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.413801 31054 leader_election.cc:304] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:13.415904 31282 ts_tablet_manager.cc:1403] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.517s	user 0.053s	sys 0.095s
I20260709 13:11:13.416930 31158 raft_consensus.cc:2468] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:13.416424 31541 raft_consensus.cc:2804] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.421092 31541 raft_consensus.cc:697] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:13.422065 31541 consensus_queue.cc:237] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.428085 31282 raft_consensus.cc:359] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.428306 31283 consensus_queue.cc:260] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.431756 31525 raft_consensus.cc:493] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.440935 31525 raft_consensus.cc:515] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.440587 31282 raft_consensus.cc:385] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.442203 31282 raft_consensus.cc:740] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.442245 31283 ts_tablet_manager.cc:1434] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:11:13.443255 31525 leader_election.cc:290] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:13.443562 31282 consensus_queue.cc:260] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.444140 31283 tablet_bootstrap.cc:492] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:13.454429 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5496455d6ea451dadd260868b97d356" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:13.436080 31284 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:13.457800 31284 ts_tablet_manager.cc:1403] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.008s
I20260709 13:11:13.465188 31053 leader_election.cc:304] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:13.473723 31282 ts_tablet_manager.cc:1434] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 13:11:13.480332 31283 tablet_bootstrap.cc:654] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.470538 31589 raft_consensus.cc:2804] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.481320 31281 ts_tablet_manager.cc:1434] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.256s	user 0.008s	sys 0.008s
I20260709 13:11:13.481622 31589 raft_consensus.cc:697] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:13.482486 31281 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:13.482656 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5496455d6ea451dadd260868b97d356" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:13.483731 31013 raft_consensus.cc:2393] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dec8ae7db1414dbea5acc7be7ffc9dfb in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:13.488722 30907 catalog_manager.cc:5697] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.492437 31282 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:13.482667 31589 consensus_queue.cc:237] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.513450 31284 raft_consensus.cc:359] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.514261 31284 raft_consensus.cc:385] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.514570 31284 raft_consensus.cc:740] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.517073 31281 tablet_bootstrap.cc:654] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.518610 31284 consensus_queue.cc:260] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.525220 31284 ts_tablet_manager.cc:1434] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 13:11:13.525769 31630 consensus_queue.cc:1048] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.530792 31284 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:13.534034 31282 tablet_bootstrap.cc:654] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.540393 31283 tablet_bootstrap.cc:492] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:13.540951 31283 ts_tablet_manager.cc:1403] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.001s
I20260709 13:11:13.554101 31630 consensus_queue.cc:1048] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:13.554271 30909 catalog_manager.cc:5697] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.565178 31283 raft_consensus.cc:359] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.566093 31283 raft_consensus.cc:385] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.566507 31283 raft_consensus.cc:740] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.567404 31283 consensus_queue.cc:260] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.569005 31631 raft_consensus.cc:493] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.569646 31631 raft_consensus.cc:515] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.570437 31283 ts_tablet_manager.cc:1434] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:11:13.571646 31283 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:13.546247 31202 leader_election.cc:304] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:13.572739 31656 raft_consensus.cc:3060] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.573647 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:13.574518 31160 raft_consensus.cc:2393] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 116e6baff6234eadbc262b5fb70cfd5b in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:13.577589 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32fc226fc7844c9096a579b3a8c05060" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:13.579088 31631 leader_election.cc:290] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:13.581311 30979 leader_election.cc:304] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:13.582158 31403 raft_consensus.cc:3060] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.607895 31284 tablet_bootstrap.cc:654] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.609231 31281 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:13.614530 31403 raft_consensus.cc:2749] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.616163 31281 ts_tablet_manager.cc:1403] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.134s	user 0.007s	sys 0.007s
I20260709 13:11:13.623886 31281 raft_consensus.cc:359] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.624631 31281 raft_consensus.cc:385] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.625252 31656 raft_consensus.cc:2749] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.627704 31282 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:13.628271 31282 ts_tablet_manager.cc:1403] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.136s	user 0.039s	sys 0.039s
I20260709 13:11:13.625174 31281 raft_consensus.cc:740] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.629436 31281 consensus_queue.cc:260] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.632452 31282 raft_consensus.cc:359] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.633955 31282 raft_consensus.cc:385] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.634394 31282 raft_consensus.cc:740] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.635231 31281 ts_tablet_manager.cc:1434] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.003s
I20260709 13:11:13.635172 31282 consensus_queue.cc:260] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.641875 31282 ts_tablet_manager.cc:1434] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:11:13.643494 31281 tablet_bootstrap.cc:492] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:13.657447 31639 raft_consensus.cc:493] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.658027 31639 raft_consensus.cc:515] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.660441 31639 leader_election.cc:290] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:13.662465 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b140d661f41949f9b1fd260999e50999" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:13.664151 31128 leader_election.cc:343] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.665130 31282 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:13.681975 31233 raft_consensus.cc:3060] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.670713 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b140d661f41949f9b1fd260999e50999" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:13.691431 31639 raft_consensus.cc:493] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.691963 31639 raft_consensus.cc:515] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.695917 31580 raft_consensus.cc:493] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.696489 31580 raft_consensus.cc:515] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.699047 31580 leader_election.cc:290] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
W20260709 13:11:13.698673 31128 leader_election.cc:343] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.699980 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:13.700088 31128 leader_election.cc:304] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
W20260709 13:11:13.701301 31054 leader_election.cc:343] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.701967 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c1509877e94c6a94893dd51dba1748" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:13.702028 31630 raft_consensus.cc:2749] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.704345 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:13.705065 31160 raft_consensus.cc:2468] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:13.705576 31284 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:13.694622 31639 leader_election.cc:290] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:13.706097 31284 ts_tablet_manager.cc:1403] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.176s	user 0.009s	sys 0.026s
I20260709 13:11:13.708107 31053 leader_election.cc:304] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:13.708932 31284 raft_consensus.cc:359] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.709651 31284 raft_consensus.cc:385] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.709930 31284 raft_consensus.cc:740] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
W20260709 13:11:13.710049 31128 leader_election.cc:343] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.710572 31284 consensus_queue.cc:260] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.720381 31541 raft_consensus.cc:2804] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.720938 31541 raft_consensus.cc:493] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.721374 31541 raft_consensus.cc:3060] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.722605 31284 ts_tablet_manager.cc:1434] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:11:13.723999 31284 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:13.724288 31630 raft_consensus.cc:493] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.725067 31630 raft_consensus.cc:515] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.726836 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c1509877e94c6a94893dd51dba1748" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:13.736387 31281 tablet_bootstrap.cc:654] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:13.738600 31128 leader_election.cc:343] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.739159 31128 leader_election.cc:304] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:13.745041 31639 raft_consensus.cc:2749] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.747135 31283 tablet_bootstrap.cc:654] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.749094 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccfbc32da67458799cc341fb3277d37" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:13.753918 31128 leader_election.cc:343] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.755002 31630 leader_election.cc:290] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:13.763988 31541 raft_consensus.cc:515] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.765370 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccfbc32da67458799cc341fb3277d37" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:13.771536 31128 leader_election.cc:343] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.772295 31128 leader_election.cc:304] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:13.780061 31281 tablet_bootstrap.cc:492] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:13.780886 31281 ts_tablet_manager.cc:1403] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.004s
I20260709 13:11:13.782836 31639 raft_consensus.cc:2749] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:13.784001 31281 raft_consensus.cc:359] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.784960 31281 raft_consensus.cc:385] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.785509 31281 raft_consensus.cc:740] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.786556 31281 consensus_queue.cc:260] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.767307 31282 tablet_bootstrap.cc:654] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.789526 31281 ts_tablet_manager.cc:1434] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:13.789969 31284 tablet_bootstrap.cc:654] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.793406 31281 tablet_bootstrap.cc:492] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:13.797201 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:13.798015 31160 raft_consensus.cc:3060] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.803208 31283 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:13.803794 31283 ts_tablet_manager.cc:1403] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.003s
I20260709 13:11:13.807850 31283 raft_consensus.cc:359] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.808773 31283 raft_consensus.cc:385] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.817351 31283 raft_consensus.cc:740] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.818279 31281 tablet_bootstrap.cc:654] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.818212 31283 consensus_queue.cc:260] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.816777 31282 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:13.813251 31160 raft_consensus.cc:2468] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:13.821882 31053 leader_election.cc:304] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:13.812076 31541 leader_election.cc:290] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:13.820322 31282 ts_tablet_manager.cc:1403] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.001s
I20260709 13:11:13.810388 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
W20260709 13:11:13.823818 31054 leader_election.cc:343] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.826210 31644 raft_consensus.cc:2804] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:13.826869 31644 raft_consensus.cc:697] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:13.828300 31284 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:13.829125 31284 ts_tablet_manager.cc:1403] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.007s
I20260709 13:11:13.827845 31644 consensus_queue.cc:237] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.832880 31284 raft_consensus.cc:359] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.833617 31284 raft_consensus.cc:385] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.833886 31284 raft_consensus.cc:740] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.834549 31284 consensus_queue.cc:260] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.846663 31284 ts_tablet_manager.cc:1434] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:13.848152 31284 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:13.853994 31283 ts_tablet_manager.cc:1434] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.004s
I20260709 13:11:13.855494 31283 tablet_bootstrap.cc:492] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:13.862510 31580 consensus_queue.cc:1048] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:13.863688 31281 tablet_bootstrap.cc:492] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:13.864207 31281 ts_tablet_manager.cc:1403] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.017s
I20260709 13:11:13.864753 31284 tablet_bootstrap.cc:654] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.866217 31282 raft_consensus.cc:359] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.866959 31282 raft_consensus.cc:385] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.867333 31282 raft_consensus.cc:740] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.879634 31580 consensus_queue.cc:1048] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:13.867041 31281 raft_consensus.cc:359] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.869004 31283 tablet_bootstrap.cc:654] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.881240 31281 raft_consensus.cc:385] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.882323 31281 raft_consensus.cc:740] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.883460 31281 consensus_queue.cc:260] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.879398 31282 consensus_queue.cc:260] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:13.887562 31282 ts_tablet_manager.cc:1434] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.000s
I20260709 13:11:13.893769 31281 ts_tablet_manager.cc:1434] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:11:13.894927 31580 raft_consensus.cc:493] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.895705 31580 raft_consensus.cc:515] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:13.901496 31233 raft_consensus.cc:3060] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.903594 31283 tablet_bootstrap.cc:492] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:13.904191 31283 ts_tablet_manager.cc:1403] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.008s
I20260709 13:11:13.908387 31580 leader_election.cc:290] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:13.910351 31283 raft_consensus.cc:359] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.911218 31283 raft_consensus.cc:385] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.911501 31283 raft_consensus.cc:740] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.912252 31283 consensus_queue.cc:260] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:13.917520 31283 ts_tablet_manager.cc:1434] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:11:13.918650 31283 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:13.925408 30909 catalog_manager.cc:5697] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.929090 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:13.924741 31283 tablet_bootstrap.cc:654] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.936275 31281 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:13.936565 31282 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:13.953403 31282 tablet_bootstrap.cc:654] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.954226 31281 tablet_bootstrap.cc:654] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:13.968580 31284 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:13.969259 31284 ts_tablet_manager.cc:1403] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.121s	user 0.028s	sys 0.011s
I20260709 13:11:13.971311 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:13.972594 31013 raft_consensus.cc:2468] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:13.973408 31284 raft_consensus.cc:359] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.974231 31284 raft_consensus.cc:385] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:13.974511 31284 raft_consensus.cc:740] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:13.975203 31284 consensus_queue.cc:260] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:13.978540 31284 ts_tablet_manager.cc:1434] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 13:11:13.981880 31054 leader_election.cc:343] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:13.983420 31054 leader_election.cc:304] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:13.993875 31589 raft_consensus.cc:2804] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:13.994374 31589 raft_consensus.cc:493] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.994818 31589 raft_consensus.cc:3060] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:13.996632 31284 tablet_bootstrap.cc:492] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed: Bootstrap starting.
I20260709 13:11:14.004082 31283 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:14.004701 31283 ts_tablet_manager.cc:1403] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.004s
I20260709 13:11:14.007037 31541 consensus_queue.cc:1048] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.008267 31283 raft_consensus.cc:359] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.009241 31283 raft_consensus.cc:385] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.009552 31283 raft_consensus.cc:740] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.009765 31624 consensus_queue.cc:1048] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.010288 31283 consensus_queue.cc:260] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.014096 31284 tablet_bootstrap.cc:654] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.018356 31283 ts_tablet_manager.cc:1434] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:14.019445 31283 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:14.026955 31283 tablet_bootstrap.cc:654] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.030053 31624 raft_consensus.cc:493] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.030699 31624 raft_consensus.cc:515] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.035753 31624 leader_election.cc:290] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:14.040886 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f666ffe90c44600a3394d80de817540" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:14.042903 31283 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:14.043637 31283 ts_tablet_manager.cc:1403] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 13:11:14.046967 31284 tablet_bootstrap.cc:492] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed: No bootstrap required, opened a new log
I20260709 13:11:14.047688 31284 ts_tablet_manager.cc:1403] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 13:11:14.051051 31284 raft_consensus.cc:359] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.054388 31284 raft_consensus.cc:385] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.054793 31284 raft_consensus.cc:740] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.055673 31284 consensus_queue.cc:260] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.053606 31283 raft_consensus.cc:359] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.057300 31283 raft_consensus.cc:385] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:14.057665 31054 leader_election.cc:343] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.057665 31283 raft_consensus.cc:740] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.059454 31284 ts_tablet_manager.cc:1434] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:11:14.061539 31624 raft_consensus.cc:493] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.062551 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f666ffe90c44600a3394d80de817540" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.063225 31155 raft_consensus.cc:2468] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:14.062125 31624 raft_consensus.cc:515] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.067996 31283 consensus_queue.cc:260] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.069068 31656 raft_consensus.cc:493] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.069669 31656 raft_consensus.cc:515] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.071063 31589 raft_consensus.cc:515] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.072955 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078186d5ab1e4886903ffb8cd15f46d9" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:14.076193 31624 leader_election.cc:290] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:14.082029 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078186d5ab1e4886903ffb8cd15f46d9" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.084077 31201 leader_election.cc:304] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:14.085688 31283 ts_tablet_manager.cc:1434] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:11:14.087555 31656 leader_election.cc:290] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:14.088613 31656 raft_consensus.cc:2749] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.097537 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b140d661f41949f9b1fd260999e50999" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.098949 31160 raft_consensus.cc:2468] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:14.103055 31283 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:14.114002 31282 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:14.125029 31282 ts_tablet_manager.cc:1403] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.002s
I20260709 13:11:14.124141 31053 leader_election.cc:304] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:14.130076 31568 raft_consensus.cc:2804] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.130832 31568 raft_consensus.cc:493] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.131213 31568 raft_consensus.cc:3060] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.146695 31589 leader_election.cc:290] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:14.148293 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b140d661f41949f9b1fd260999e50999" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:14.157289 31282 raft_consensus.cc:359] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.151926 31281 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:14.161585 31281 ts_tablet_manager.cc:1403] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.001s
I20260709 13:11:14.161418 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:14.162389 31013 raft_consensus.cc:3060] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.168074 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:14.152856 31053 leader_election.cc:304] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:14.173321 31283 tablet_bootstrap.cc:654] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.173414 31589 raft_consensus.cc:2804] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.173714 31630 raft_consensus.cc:493] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.174036 31589 raft_consensus.cc:493] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.174455 31589 raft_consensus.cc:3060] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.174258 31630 raft_consensus.cc:515] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
W20260709 13:11:14.177681 31054 leader_election.cc:343] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.158463 31282 raft_consensus.cc:385] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.178607 31282 raft_consensus.cc:740] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.179343 31282 consensus_queue.cc:260] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.179979 31013 raft_consensus.cc:2468] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:14.181766 31282 ts_tablet_manager.cc:1434] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:11:14.183424 31281 raft_consensus.cc:359] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.176553 31630 leader_election.cc:290] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:14.184234 31281 raft_consensus.cc:385] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.184064 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1997fc1c544e87afea39d3052e547a" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:14.184595 31281 raft_consensus.cc:740] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.185328 31281 consensus_queue.cc:260] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.185598 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1997fc1c544e87afea39d3052e547a" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:14.187196 31128 leader_election.cc:343] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:14.191131 31128 leader_election.cc:343] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.191671 31128 leader_election.cc:304] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:14.192799 31630 raft_consensus.cc:2749] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.193209 31282 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:14.200732 31589 raft_consensus.cc:515] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.206022 31283 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:14.206629 31283 ts_tablet_manager.cc:1403] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.001s
I20260709 13:11:14.208159 31054 leader_election.cc:304] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:14.209322 31281 ts_tablet_manager.cc:1434] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:11:14.210477 31281 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:14.168367 31568 raft_consensus.cc:515] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.212479 31283 raft_consensus.cc:359] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.213243 31283 raft_consensus.cc:385] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.213541 31283 raft_consensus.cc:740] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.213965 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b140d661f41949f9b1fd260999e50999" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:14.214591 31158 raft_consensus.cc:3060] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.216153 31282 tablet_bootstrap.cc:654] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.220139 31589 leader_election.cc:290] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:14.223335 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f666ffe90c44600a3394d80de817540" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:14.224037 31155 raft_consensus.cc:3060] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.214229 31283 consensus_queue.cc:260] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.212811 31568 leader_election.cc:290] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:14.233103 31155 raft_consensus.cc:2468] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:14.234642 31053 leader_election.cc:304] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:14.235397 31624 raft_consensus.cc:2804] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.240449 31624 raft_consensus.cc:697] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:14.241780 31624 consensus_queue.cc:237] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:14.242894 31054 leader_election.cc:343] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.236186 31158 raft_consensus.cc:2468] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:14.237299 31283 ts_tablet_manager.cc:1434] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:11:14.238468 31644 raft_consensus.cc:2804] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.246775 31644 raft_consensus.cc:697] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:14.247225 31053 leader_election.cc:304] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:14.247685 31644 consensus_queue.cc:237] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.249327 31580 raft_consensus.cc:2804] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.249905 31580 raft_consensus.cc:697] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:14.250594 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b140d661f41949f9b1fd260999e50999" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:14.250811 31580 consensus_queue.cc:237] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
W20260709 13:11:14.252364 31054 leader_election.cc:343] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.249331 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f666ffe90c44600a3394d80de817540" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:14.253188 31013 raft_consensus.cc:3060] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.261819 31283 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
W20260709 13:11:14.263842 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:14.266314 31281 tablet_bootstrap.cc:654] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.271835 31479 raft_consensus.cc:493] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.272450 31479 raft_consensus.cc:515] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.275336 31479 leader_election.cc:290] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:14.276257 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:14.276389 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:14.280491 31085 raft_consensus.cc:2468] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:14.278501 31282 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:14.281751 31128 leader_election.cc:304] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:14.282595 31479 raft_consensus.cc:2804] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:14.282771 31128 leader_election.cc:343] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.283057 31479 raft_consensus.cc:493] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.283445 31479 raft_consensus.cc:3060] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.278849 31013 raft_consensus.cc:2468] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:14.286132 31283 tablet_bootstrap.cc:654] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.282342 31282 ts_tablet_manager.cc:1403] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.036s
I20260709 13:11:14.299823 31281 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:14.300354 31281 ts_tablet_manager.cc:1403] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.000s
I20260709 13:11:14.310367 31281 raft_consensus.cc:359] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.311131 31281 raft_consensus.cc:385] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.311489 31233 raft_consensus.cc:3060] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.315323 30907 catalog_manager.cc:5697] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.311518 31281 raft_consensus.cc:740] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.317612 30907 catalog_manager.cc:5697] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.318987 31281 consensus_queue.cc:260] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.321408 31281 ts_tablet_manager.cc:1434] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:11:14.325660 31479 raft_consensus.cc:515] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.330852 31282 raft_consensus.cc:359] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.334259 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:14.334929 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:14.335994 31085 raft_consensus.cc:3060] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.329097 31630 raft_consensus.cc:493] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.337653 31630 raft_consensus.cc:515] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.339910 31630 leader_election.cc:290] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:14.336055 31128 leader_election.cc:343] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.349109 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:14.350852 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
W20260709 13:11:14.354725 31128 leader_election.cc:343] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:14.355433 31128 leader_election.cc:343] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.355926 31128 leader_election.cc:304] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:14.356637 31630 raft_consensus.cc:2749] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.350886 31281 tablet_bootstrap.cc:492] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:14.333974 31282 raft_consensus.cc:385] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.358992 31282 raft_consensus.cc:740] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.361390 31282 consensus_queue.cc:260] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.371254 31282 ts_tablet_manager.cc:1434] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 13:11:14.377022 31282 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:14.372080 31281 tablet_bootstrap.cc:654] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:14.372926 31054 consensus_peers.cc:597] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:14.364013 31562 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.380827 31562 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.384130 31630 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.384513 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.384987 31630 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.387591 31630 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:14.388264 31155 raft_consensus.cc:2468] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:14.388978 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:14.389794 31236 raft_consensus.cc:2468] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:14.391376 30979 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:14.392375 31586 raft_consensus.cc:2804] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.392771 31586 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.393409 31562 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:14.393014 31580 consensus_queue.cc:1048] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.393150 31586 raft_consensus.cc:3060] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.394251 31085 raft_consensus.cc:2468] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:14.398898 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:14.401034 31236 raft_consensus.cc:2468] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 0.
I20260709 13:11:14.402312 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:14.407303 31580 raft_consensus.cc:493] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.407958 31580 raft_consensus.cc:515] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.410282 31580 leader_election.cc:290] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:14.409960 31281 tablet_bootstrap.cc:492] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:14.407232 31128 leader_election.cc:304] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:14.411623 31281 ts_tablet_manager.cc:1403] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.003s
I20260709 13:11:14.412002 31630 raft_consensus.cc:2804] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.412235 31128 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:14.412606 31630 raft_consensus.cc:697] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:14.413628 31630 consensus_queue.cc:237] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.414968 31639 raft_consensus.cc:2804] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.418850 31639 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.419222 31639 raft_consensus.cc:3060] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.420017 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09ce39cf2764cd2b2f8457b146e657d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:14.420811 31009 raft_consensus.cc:2468] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:14.424090 31282 tablet_bootstrap.cc:654] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.426318 31054 leader_election.cc:304] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:14.427343 31580 raft_consensus.cc:2804] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.427752 31580 raft_consensus.cc:493] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.428092 31580 raft_consensus.cc:3060] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.428537 31688 raft_consensus.cc:493] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.428339 31639 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.429036 31688 raft_consensus.cc:515] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.430457 31639 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:14.431113 31688 leader_election.cc:290] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:14.414788 31281 raft_consensus.cc:359] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.432536 31281 raft_consensus.cc:385] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.432809 31281 raft_consensus.cc:740] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.433589 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09ce39cf2764cd2b2f8457b146e657d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:14.415349 30907 catalog_manager.cc:5697] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.434185 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:14.434976 31009 raft_consensus.cc:2393] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dec8ae7db1414dbea5acc7be7ffc9dfb in current term 1: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:14.435405 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:14.436559 31281 consensus_queue.cc:260] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
W20260709 13:11:14.437134 31054 leader_election.cc:343] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.437911 31580 raft_consensus.cc:515] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.438858 31202 leader_election.cc:304] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:14.440769 31656 raft_consensus.cc:3060] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.439651 31281 ts_tablet_manager.cc:1434] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:11:14.446202 31281 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:14.360659 31283 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:14.333220 31479 leader_election.cc:290] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:14.456236 31644 raft_consensus.cc:493] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.456893 31644 raft_consensus.cc:515] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.456516 31283 ts_tablet_manager.cc:1403] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.195s	user 0.020s	sys 0.002s
I20260709 13:11:14.460122 31281 tablet_bootstrap.cc:654] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.462706 31586 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.466039 31656 raft_consensus.cc:2749] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:14.466728 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 54574.7us
I20260709 13:11:14.463955 31283 raft_consensus.cc:359] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.509076 31283 raft_consensus.cc:385] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.509456 31283 raft_consensus.cc:740] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.510494 31283 consensus_queue.cc:260] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.470504 31012 raft_consensus.cc:2393] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 1: Already voted for candidate 116e6baff6234eadbc262b5fb70cfd5b in this term.
I20260709 13:11:14.470809 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c1509877e94c6a94893dd51dba1748" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:14.472119 31580 leader_election.cc:290] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:14.517571 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:14.518595 31012 raft_consensus.cc:2393] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 1: Already voted for candidate 116e6baff6234eadbc262b5fb70cfd5b in this term.
I20260709 13:11:14.517980 31283 ts_tablet_manager.cc:1434] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.002s
I20260709 13:11:14.519764 31283 tablet_bootstrap.cc:492] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:14.472806 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09ce39cf2764cd2b2f8457b146e657d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:14.473914 31586 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:14.477489 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09ce39cf2764cd2b2f8457b146e657d" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:14.528503 31013 raft_consensus.cc:3060] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.479471 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:14.481432 31644 leader_election.cc:290] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:14.482704 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c1509877e94c6a94893dd51dba1748" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.533295 31234 raft_consensus.cc:3060] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.533576 31155 raft_consensus.cc:2468] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:14.498823 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:14.535110 31160 raft_consensus.cc:2393] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 116e6baff6234eadbc262b5fb70cfd5b in current term 1: Already voted for candidate e0094be1075d460cafd5160946c09aed in this term.
I20260709 13:11:14.516002 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
W20260709 13:11:14.520346 31054 leader_election.cc:343] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:14.538885 31054 leader_election.cc:343] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.539749 31053 leader_election.cc:304] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:14.542130 31624 raft_consensus.cc:2804] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.542583 31624 raft_consensus.cc:493] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.542945 31624 raft_consensus.cc:3060] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.549824 31013 raft_consensus.cc:2468] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:14.551497 31054 leader_election.cc:304] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:14.546932 31128 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:14.557044 31580 raft_consensus.cc:2804] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.568267 31580 raft_consensus.cc:697] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:14.569312 31580 consensus_queue.cc:237] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.570690 31283 tablet_bootstrap.cc:654] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.555150 31479 raft_consensus.cc:2749] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.573931 31234 raft_consensus.cc:2468] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:14.575174 30979 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: e0094be1075d460cafd5160946c09aed
I20260709 13:11:14.576184 31562 raft_consensus.cc:2804] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.576702 31562 raft_consensus.cc:697] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:14.577595 31562 consensus_queue.cc:237] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.598137 31525 raft_consensus.cc:493] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.598851 31525 raft_consensus.cc:515] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.602499 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:14.603061 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa32971139947f1a694bda08ee6848d" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.604319 31624 raft_consensus.cc:515] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.605394 31201 leader_election.cc:304] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:14.608197 31624 leader_election.cc:290] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:14.608033 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c1509877e94c6a94893dd51dba1748" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:14.608906 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c1509877e94c6a94893dd51dba1748" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:14.609239 31160 raft_consensus.cc:3060] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.621654 31281 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:14.622380 31281 ts_tablet_manager.cc:1403] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.176s	user 0.024s	sys 0.021s
I20260709 13:11:14.609741 31525 leader_election.cc:290] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:14.610368 31688 raft_consensus.cc:2749] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.644225 31541 consensus_queue.cc:1048] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.647169 30907 catalog_manager.cc:5697] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.647253 30910 catalog_manager.cc:5697] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 0 to 1, leader changed from <none> to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 1 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:14.650797 31054 leader_election.cc:343] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.654040 31282 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:14.654640 31282 ts_tablet_manager.cc:1403] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.278s	user 0.039s	sys 0.028s
I20260709 13:11:14.662207 31283 tablet_bootstrap.cc:492] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:14.662835 31283 ts_tablet_manager.cc:1403] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.002s
I20260709 13:11:14.664312 31541 consensus_queue.cc:1048] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.666682 31160 raft_consensus.cc:2468] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:14.668179 31282 raft_consensus.cc:359] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.673688 31282 raft_consensus.cc:385] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.674312 31053 leader_election.cc:304] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:14.675575 31624 raft_consensus.cc:2804] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.674033 31282 raft_consensus.cc:740] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.680665 31541 consensus_queue.cc:1048] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.681910 31281 raft_consensus.cc:359] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.682683 31281 raft_consensus.cc:385] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.682983 31281 raft_consensus.cc:740] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.671301 31283 raft_consensus.cc:359] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.683717 31281 consensus_queue.cc:260] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.689599 31281 ts_tablet_manager.cc:1434] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.003s
I20260709 13:11:14.684386 31283 raft_consensus.cc:385] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.690084 31283 raft_consensus.cc:740] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.690747 31281 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:14.691665 31283 consensus_queue.cc:260] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.693883 31283 ts_tablet_manager.cc:1434] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:11:14.694916 31283 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6: Bootstrap starting.
I20260709 13:11:14.682300 31624 raft_consensus.cc:697] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:14.697826 31624 consensus_queue.cc:237] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:14.701627 30907 catalog_manager.cc:5697] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.705682 31282 consensus_queue.cc:260] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.709115 31282 ts_tablet_manager.cc:1434] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 13:11:14.710366 31282 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:14.713011 31281 tablet_bootstrap.cc:654] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.718335 31283 tablet_bootstrap.cc:654] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.747002 31282 tablet_bootstrap.cc:654] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.791272 31281 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:14.792120 31281 ts_tablet_manager.cc:1403] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.011s
I20260709 13:11:14.794462 31568 consensus_queue.cc:1048] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:14.810644 30979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 57124.4us
I20260709 13:11:14.803740 31568 raft_consensus.cc:493] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.820582 31562 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.821795 31562 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.824488 31562 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:14.827970 31580 consensus_queue.cc:1048] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.828068 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:14.820139 31568 raft_consensus.cc:515] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.841207 31282 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:14.841993 31282 ts_tablet_manager.cc:1403] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.132s	user 0.028s	sys 0.012s
W20260709 13:11:14.849238 31054 consensus_peers.cc:597] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Couldn't send request to peer dec8ae7db1414dbea5acc7be7ffc9dfb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:14.851357 30979 leader_election.cc:343] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.853483 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:14.854245 31083 raft_consensus.cc:2468] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
W20260709 13:11:14.858999 31703 log.cc:927] Time spent T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:14.858237 30979 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:14.862232 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1997fc1c544e87afea39d3052e547a" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.863852 31153 raft_consensus.cc:2468] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 0.
I20260709 13:11:14.865293 31053 leader_election.cc:304] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:14.865518 31281 raft_consensus.cc:359] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.866333 31281 raft_consensus.cc:385] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.866468 31644 raft_consensus.cc:2804] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.866691 31281 raft_consensus.cc:740] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.867003 31644 raft_consensus.cc:493] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.867471 31644 raft_consensus.cc:3060] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.870301 31281 consensus_queue.cc:260] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.883028 31281 ts_tablet_manager.cc:1434] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 13:11:14.869583 31568 leader_election.cc:290] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:14.892560 31281 tablet_bootstrap.cc:492] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:14.893733 31283 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6: No bootstrap required, opened a new log
I20260709 13:11:14.894794 31283 ts_tablet_manager.cc:1403] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6: Time spent bootstrapping tablet: real 0.200s	user 0.019s	sys 0.004s
I20260709 13:11:14.897450 31282 raft_consensus.cc:359] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.898155 31282 raft_consensus.cc:385] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.898406 31282 raft_consensus.cc:740] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.899039 31282 consensus_queue.cc:260] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.892582 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1997fc1c544e87afea39d3052e547a" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:14.903396 31283 raft_consensus.cc:359] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.904175 31283 raft_consensus.cc:385] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.904456 31283 raft_consensus.cc:740] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.889528 31709 raft_consensus.cc:2804] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.909520 31709 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.909946 31709 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:14.913516 31054 leader_election.cc:343] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.916438 31282 ts_tablet_manager.cc:1434] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.003s
I20260709 13:11:14.917656 31282 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:14.921002 31283 consensus_queue.cc:260] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.922735 31234 raft_consensus.cc:3060] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.923988 31283 ts_tablet_manager.cc:1434] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
W20260709 13:11:14.929469 31128 consensus_peers.cc:597] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:14.908281 30908 catalog_manager.cc:5697] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.930460 31282 tablet_bootstrap.cc:654] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.933411 31709 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:14.950831 31709 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:14.955502 31233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:14.956079 31281 tablet_bootstrap.cc:654] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:14.962790 30979 leader_election.cc:343] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.979270 31711 consensus_queue.cc:1048] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.970325 31700 raft_consensus.cc:493] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.980278 31700 raft_consensus.cc:515] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:14.982926 31700 leader_election.cc:290] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:14.994321 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:15.001521 31083 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.995306 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d313b1f24abb861e4028d92c4bcb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:14.992936 31710 raft_consensus.cc:493] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.003161 31710 raft_consensus.cc:515] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.003180 31153 raft_consensus.cc:2468] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:15.010227 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f63569bde3451593d530f6be062a16" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:15.010439 31201 leader_election.cc:304] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:15.012307 31715 consensus_queue.cc:1048] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.013546 31688 raft_consensus.cc:2804] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:15.014170 31688 raft_consensus.cc:493] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.014622 31688 raft_consensus.cc:3060] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:15.015412 31054 leader_election.cc:343] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.999512 31644 raft_consensus.cc:515] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:14.994766 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d313b1f24abb861e4028d92c4bcb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:15.019585 31012 raft_consensus.cc:2468] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:15.022614 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1997fc1c544e87afea39d3052e547a" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:15.023377 31153 raft_consensus.cc:3060] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.030627 31231 raft_consensus.cc:3060] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.030421 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f63569bde3451593d530f6be062a16" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:15.035260 31644 leader_election.cc:290] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
W20260709 13:11:15.043105 31054 leader_election.cc:343] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:15.043614 31054 leader_election.cc:304] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:15.044885 31568 raft_consensus.cc:2749] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:15.048269 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1997fc1c544e87afea39d3052e547a" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:15.021534 31710 leader_election.cc:290] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:15.082830 31282 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:15.058878 31630 consensus_queue.cc:1048] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:11:15.084393 31282 ts_tablet_manager.cc:1403] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.167s	user 0.016s	sys 0.006s
I20260709 13:11:15.093444 31282 raft_consensus.cc:359] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:15.099373 31282 raft_consensus.cc:385] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.103063 31282 raft_consensus.cc:740] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.104655 31282 consensus_queue.cc:260] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
W20260709 13:11:15.064146 31054 leader_election.cc:343] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:15.110417 31707 consensus_queue.cc:1048] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.115206 31153 raft_consensus.cc:2468] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:15.116487 31053 leader_election.cc:304] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:15.116418 31282 ts_tablet_manager.cc:1434] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:11:15.133029 31282 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:15.122062 31644 raft_consensus.cc:2804] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:15.151440 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 95740.3us
I20260709 13:11:15.138113 31688 raft_consensus.cc:515] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.150563 31644 raft_consensus.cc:697] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:15.173579 31688 leader_election.cc:290] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:15.173938 31644 consensus_queue.cc:237] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:15.178776 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d313b1f24abb861e4028d92c4bcb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:15.179476 31009 raft_consensus.cc:3060] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.182893 31281 tablet_bootstrap.cc:492] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:15.183477 31281 ts_tablet_manager.cc:1403] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.291s	user 0.020s	sys 0.014s
I20260709 13:11:15.188746 31708 consensus_queue.cc:1048] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:15.191921 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d313b1f24abb861e4028d92c4bcb" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:15.192539 31009 raft_consensus.cc:2468] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:15.195269 31202 leader_election.cc:304] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:15.192689 31155 raft_consensus.cc:3060] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.199559 31688 raft_consensus.cc:2804] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:15.200099 31688 raft_consensus.cc:697] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:15.200938 31688 consensus_queue.cc:237] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.202461 31281 raft_consensus.cc:359] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:15.203639 31281 raft_consensus.cc:385] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.203933 31281 raft_consensus.cc:740] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.163031 31083 raft_consensus.cc:2468] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:15.204710 31281 consensus_queue.cc:260] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:15.212011 30979 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:15.213020 31709 raft_consensus.cc:2804] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:15.213685 31709 raft_consensus.cc:697] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:15.214629 31709 consensus_queue.cc:237] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.218755 31013 raft_consensus.cc:3060] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.224440 31155 raft_consensus.cc:2468] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:15.235684 31711 consensus_queue.cc:1048] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.233155 31282 tablet_bootstrap.cc:654] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.235427 31236 raft_consensus.cc:3060] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.246773 31568 consensus_queue.cc:1048] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.236810 31281 ts_tablet_manager.cc:1434] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:11:15.252341 31281 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:15.281298 31281 tablet_bootstrap.cc:654] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.308632 31281 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:15.309343 31281 ts_tablet_manager.cc:1403] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.000s
I20260709 13:11:15.312888 31281 raft_consensus.cc:359] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.313669 31281 raft_consensus.cc:385] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.313956 31281 raft_consensus.cc:740] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.314632 31281 consensus_queue.cc:260] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.314301 30908 catalog_manager.cc:5697] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.316783 31281 ts_tablet_manager.cc:1434] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:15.318120 31281 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:15.325579 31281 tablet_bootstrap.cc:654] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.350761 31282 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:15.351284 31282 ts_tablet_manager.cc:1403] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.222s	user 0.008s	sys 0.013s
I20260709 13:11:15.354269 31282 raft_consensus.cc:359] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.355042 31282 raft_consensus.cc:385] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.357595 31282 raft_consensus.cc:740] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.359061 31282 consensus_queue.cc:260] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.361305 31281 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:15.361922 31281 ts_tablet_manager.cc:1403] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.012s
I20260709 13:11:15.363474 31282 ts_tablet_manager.cc:1434] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:11:15.364682 31282 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:15.365070 31281 raft_consensus.cc:359] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.365869 31281 raft_consensus.cc:385] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.366154 31281 raft_consensus.cc:740] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.371048 31281 consensus_queue.cc:260] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.373261 31281 ts_tablet_manager.cc:1434] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:11:15.374351 31281 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:15.376737 31688 raft_consensus.cc:493] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.377417 31688 raft_consensus.cc:515] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.379820 31688 leader_election.cc:290] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:15.382053 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccfbc32da67458799cc341fb3277d37" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:15.382771 31013 raft_consensus.cc:2468] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:15.383908 31202 leader_election.cc:304] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:15.387634 31688 raft_consensus.cc:2804] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:15.388114 31688 raft_consensus.cc:493] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.388489 31688 raft_consensus.cc:3060] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.390106 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccfbc32da67458799cc341fb3277d37" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:15.390872 31153 raft_consensus.cc:2468] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:15.392958 31282 tablet_bootstrap.cc:654] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.399515 31281 tablet_bootstrap.cc:654] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.400950 30908 catalog_manager.cc:5697] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.418431 31282 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:15.419205 31282 ts_tablet_manager.cc:1403] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.005s
I20260709 13:11:15.422408 31282 raft_consensus.cc:359] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:15.423192 31282 raft_consensus.cc:385] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.423497 31282 raft_consensus.cc:740] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.424296 31282 consensus_queue.cc:260] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:15.432893 31282 ts_tablet_manager.cc:1434] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:15.434051 31282 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:15.440145 31281 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:15.436777 31688 raft_consensus.cc:515] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.440846 31281 ts_tablet_manager.cc:1403] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.013s
I20260709 13:11:15.443241 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccfbc32da67458799cc341fb3277d37" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:15.443843 31153 raft_consensus.cc:3060] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.445363 31281 raft_consensus.cc:359] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.446141 31281 raft_consensus.cc:385] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.446414 31281 raft_consensus.cc:740] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.447098 31281 consensus_queue.cc:260] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.450259 31281 ts_tablet_manager.cc:1434] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:11:15.451551 31281 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:15.455186 31153 raft_consensus.cc:2468] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:15.456637 31201 leader_election.cc:304] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:15.457432 31656 raft_consensus.cc:2804] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:15.457947 31656 raft_consensus.cc:697] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:15.458346 31281 tablet_bootstrap.cc:654] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.458767 31656 consensus_queue.cc:237] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.466065 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccfbc32da67458799cc341fb3277d37" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:15.466722 31013 raft_consensus.cc:3060] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:15.471859 30959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:15.473552 30909 catalog_manager.cc:5697] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.440420 31282 tablet_bootstrap.cc:654] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.487615 31282 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:15.488027 31281 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:15.488129 31282 ts_tablet_manager.cc:1403] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.003s
I20260709 13:11:15.488677 31281 ts_tablet_manager.cc:1403] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.008s
I20260709 13:11:15.491312 31282 raft_consensus.cc:359] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.492055 31282 raft_consensus.cc:385] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.492329 31282 raft_consensus.cc:740] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.493171 31281 raft_consensus.cc:359] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.493194 31282 consensus_queue.cc:260] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.493954 31281 raft_consensus.cc:385] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.494303 31281 raft_consensus.cc:740] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.494980 31281 consensus_queue.cc:260] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.498391 31282 ts_tablet_manager.cc:1434] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:11:15.498543 31688 leader_election.cc:290] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:15.499146 31013 raft_consensus.cc:2468] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:15.499593 31282 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:15.502264 31281 ts_tablet_manager.cc:1434] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:11:15.503314 31281 tablet_bootstrap.cc:492] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb: Bootstrap starting.
I20260709 13:11:15.507009 31282 tablet_bootstrap.cc:654] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.509646 31281 tablet_bootstrap.cc:654] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.521113 31282 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: No bootstrap required, opened a new log
I20260709 13:11:15.521870 31282 ts_tablet_manager.cc:1403] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:11:15.528446 30910 catalog_manager.cc:5697] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.559404 31282 raft_consensus.cc:359] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.560163 31282 raft_consensus.cc:385] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.560405 31282 raft_consensus.cc:740] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.562752 31281 tablet_bootstrap.cc:492] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb: No bootstrap required, opened a new log
I20260709 13:11:15.563910 31282 consensus_queue.cc:260] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.566085 31282 ts_tablet_manager.cc:1434] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:11:15.563285 31281 ts_tablet_manager.cc:1403] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.034s
I20260709 13:11:15.566929 31709 raft_consensus.cc:493] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.567478 31709 raft_consensus.cc:515] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.569927 31281 raft_consensus.cc:359] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:15.570744 31281 raft_consensus.cc:385] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.571002 31281 raft_consensus.cc:740] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.571722 31281 consensus_queue.cc:260] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:15.573520 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:15.574316 31234 raft_consensus.cc:2468] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:15.574414 31711 consensus_queue.cc:1048] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.575942 30979 leader_election.cc:304] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:15.576727 31715 raft_consensus.cc:2804] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:15.577237 31715 raft_consensus.cc:493] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.577606 31715 raft_consensus.cc:3060] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.578516 31281 ts_tablet_manager.cc:1434] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:11:15.576617 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:15.581984 31155 raft_consensus.cc:2468] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 0.
I20260709 13:11:15.599223 31715 raft_consensus.cc:515] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.603014 31709 leader_election.cc:290] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:15.610605 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:15.611399 31160 raft_consensus.cc:3060] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.613598 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:15.614359 31234 raft_consensus.cc:3060] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.621420 31562 consensus_queue.cc:1048] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:15.634275 31234 raft_consensus.cc:2468] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:15.635548 31688 consensus_queue.cc:1048] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:15.638243 30979 leader_election.cc:304] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:15.635886 31715 leader_election.cc:290] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 1 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:15.644181 31688 consensus_queue.cc:1048] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:15.643906 31709 raft_consensus.cc:2804] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:15.654564 31722 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.664737 31722 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.665509 31709 raft_consensus.cc:697] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:15.666715 31709 consensus_queue.cc:237] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:15.667515 31722 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:15.673697 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:15.664281 31160 raft_consensus.cc:2468] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 1.
I20260709 13:11:15.677409 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:15.677230 31234 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.682675 31202 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:15.704449 31236 raft_consensus.cc:3060] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.724938 31656 raft_consensus.cc:2749] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:15.735219 31562 consensus_queue.cc:1048] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:15.735325 31707 consensus_queue.cc:1048] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:15.772114 30907 catalog_manager.cc:5697] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 1 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.802599 31688 raft_consensus.cc:493] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.803320 31688 raft_consensus.cc:515] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.808532 31688 leader_election.cc:290] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:15.802552 31009 raft_consensus.cc:3060] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.814427 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f63569bde3451593d530f6be062a16" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:15.815498 31083 raft_consensus.cc:2468] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:15.814411 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f63569bde3451593d530f6be062a16" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:15.817881 31013 raft_consensus.cc:2468] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 0.
I20260709 13:11:15.820307 31202 leader_election.cc:304] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:15.821909 31656 raft_consensus.cc:2804] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:15.822301 31656 raft_consensus.cc:493] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.822659 31656 raft_consensus.cc:3060] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.870967 31656 raft_consensus.cc:515] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:15.883849 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f63569bde3451593d530f6be062a16" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
I20260709 13:11:15.884698 31013 raft_consensus.cc:3060] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.939157 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f63569bde3451593d530f6be062a16" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:15.940021 31083 raft_consensus.cc:3060] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:15.964346 31656 leader_election.cc:290] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:15.968684 31083 raft_consensus.cc:2468] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:15.967929 31013 raft_consensus.cc:2468] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:15.970225 31709 raft_consensus.cc:493] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:15.970868 31709 raft_consensus.cc:515] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:15.970259 31202 leader_election.cc:304] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:15.974362 31656 raft_consensus.cc:2804] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:15.975133 31656 raft_consensus.cc:697] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:15.973855 31709 leader_election.cc:290] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:15.978751 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:15.980247 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:15.983202 30978 leader_election.cc:304] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:15.984222 31709 raft_consensus.cc:2749] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:15.976050 31656 consensus_queue.cc:237] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:16.011881 31722 consensus_queue.cc:1048] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:16.033169 30910 catalog_manager.cc:5697] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 1 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.042131 31722 consensus_queue.cc:1048] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:16.061815 31709 consensus_queue.cc:1048] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:16.098963 31709 consensus_queue.cc:1048] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:16.502476 31722 consensus_queue.cc:1048] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:16.504037 31722 consensus_queue.cc:1048] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:17.350428 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
W20260709 13:11:17.363880 31202 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 357 similar messages]
W20260709 13:11:17.409114 31128 consensus_peers.cc:597] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.409205 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 45405.6us
W20260709 13:11:17.415185 31202 consensus_peers.cc:597] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.420538 31054 consensus_peers.cc:597] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.427790 31054 consensus_peers.cc:597] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.443446 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.448022 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:11:17.448360 31202 consensus_peers.cc:597] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.450692 21390 tablet_replica.cc:333] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.451581 21390 raft_consensus.cc:2243] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.452543 21390 raft_consensus.cc:2272] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.454919 31054 consensus_peers.cc:597] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.455070 21390 tablet_replica.cc:333] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
W20260709 13:11:17.455968 31128 consensus_peers.cc:597] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.456171 21390 raft_consensus.cc:2243] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.456750 21390 raft_consensus.cc:2272] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.458748 21390 tablet_replica.cc:333] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.459466 21390 raft_consensus.cc:2243] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.459906 21390 raft_consensus.cc:2272] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.462172 21390 tablet_replica.cc:333] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.463011 21390 raft_consensus.cc:2243] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.463518 21390 raft_consensus.cc:2272] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.466534 21390 tablet_replica.cc:333] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.467248 21390 raft_consensus.cc:2243] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.467813 21390 raft_consensus.cc:2272] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.470402 21390 tablet_replica.cc:333] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.471259 21390 raft_consensus.cc:2243] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.472273 21390 raft_consensus.cc:2272] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.474777 21390 tablet_replica.cc:333] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.475533 21390 raft_consensus.cc:2243] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.476042 21390 raft_consensus.cc:2272] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.477895 21390 tablet_replica.cc:333] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.478586 21390 raft_consensus.cc:2243] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.479019 21390 raft_consensus.cc:2272] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.480803 21390 tablet_replica.cc:333] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.481477 21390 raft_consensus.cc:2243] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.481905 21390 raft_consensus.cc:2272] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.483659 21390 tablet_replica.cc:333] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.484288 21390 raft_consensus.cc:2243] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.484701 21390 raft_consensus.cc:2272] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.486876 21390 tablet_replica.cc:333] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.487449 21390 raft_consensus.cc:2243] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.487884 21390 raft_consensus.cc:2272] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.490427 21390 tablet_replica.cc:333] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.491218 21390 raft_consensus.cc:2243] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.492086 21390 raft_consensus.cc:2272] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.495005 21390 tablet_replica.cc:333] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.495805 21390 raft_consensus.cc:2243] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.496722 21390 raft_consensus.cc:2272] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.499446 21390 tablet_replica.cc:333] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
W20260709 13:11:17.500238 31128 consensus_peers.cc:597] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.500267 21390 raft_consensus.cc:2243] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.501446 21390 raft_consensus.cc:2272] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.504007 21390 tablet_replica.cc:333] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.504916 21390 raft_consensus.cc:2243] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.505970 21390 raft_consensus.cc:2272] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.509323 21390 tablet_replica.cc:333] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.510495 21390 raft_consensus.cc:2243] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.511126 21390 raft_consensus.cc:2272] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.514297 21390 tablet_replica.cc:333] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.515152 21390 raft_consensus.cc:2243] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.515780 21390 raft_consensus.cc:2272] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.518656 21390 tablet_replica.cc:333] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.519532 21390 raft_consensus.cc:2243] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.520632 21390 raft_consensus.cc:2272] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.523556 21390 tablet_replica.cc:333] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.524439 21390 raft_consensus.cc:2243] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.525051 21390 raft_consensus.cc:2272] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.527756 21390 tablet_replica.cc:333] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.528568 21390 raft_consensus.cc:2243] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.529708 21390 raft_consensus.cc:2272] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.531152 31128 consensus_peers.cc:597] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.532316 21390 tablet_replica.cc:333] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.533630 21390 raft_consensus.cc:2243] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.535018 21390 raft_consensus.cc:2272] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.538561 21390 tablet_replica.cc:333] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.539458 21390 raft_consensus.cc:2243] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.540216 21390 raft_consensus.cc:2272] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.542598 21390 tablet_replica.cc:333] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.543358 21390 raft_consensus.cc:2243] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.543875 21390 raft_consensus.cc:2272] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.546959 21390 tablet_replica.cc:333] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.548163 21390 raft_consensus.cc:2243] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.549376 21390 raft_consensus.cc:2272] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.552201 21390 tablet_replica.cc:333] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
W20260709 13:11:17.553041 31054 consensus_peers.cc:597] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.553889 31054 consensus_peers.cc:597] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.553980 21390 raft_consensus.cc:2243] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.554653 21390 raft_consensus.cc:2272] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.556915 21390 tablet_replica.cc:333] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.557529 21390 raft_consensus.cc:2243] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.558617 21390 raft_consensus.cc:2272] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.561721 21390 tablet_replica.cc:333] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.562618 21390 raft_consensus.cc:2243] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.563978 21390 raft_consensus.cc:2272] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.567816 21390 tablet_replica.cc:333] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.568667 21390 raft_consensus.cc:2243] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.569381 21390 raft_consensus.cc:2272] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.572753 21390 tablet_replica.cc:333] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.573727 21390 raft_consensus.cc:2243] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.574349 21390 raft_consensus.cc:2272] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.578068 21390 tablet_replica.cc:333] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.579023 21390 raft_consensus.cc:2243] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.579694 21390 raft_consensus.cc:2272] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.580386 31202 consensus_peers.cc:597] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.583077 21390 tablet_replica.cc:333] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.584146 21390 raft_consensus.cc:2243] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.584767 21390 raft_consensus.cc:2272] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.586773 31054 consensus_peers.cc:597] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.587750 21390 tablet_replica.cc:333] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.588697 21390 raft_consensus.cc:2243] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.589361 21390 raft_consensus.cc:2272] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.590767 31202 consensus_peers.cc:597] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.592144 31054 consensus_peers.cc:597] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.592248 21390 tablet_replica.cc:333] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
W20260709 13:11:17.592839 31054 consensus_peers.cc:597] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.593348 21390 raft_consensus.cc:2243] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.593986 21390 raft_consensus.cc:2272] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.596819 21390 tablet_replica.cc:333] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.598541 21390 raft_consensus.cc:2243] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.599609 21390 raft_consensus.cc:2272] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.602432 21390 tablet_replica.cc:333] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.603379 21390 raft_consensus.cc:2243] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.603993 21390 raft_consensus.cc:2272] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.606937 21390 tablet_replica.cc:333] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.607797 21390 raft_consensus.cc:2243] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.609093 21390 raft_consensus.cc:2272] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.612149 21390 tablet_replica.cc:333] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.613153 21390 raft_consensus.cc:2243] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:17.613329 31054 consensus_peers.cc:597] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.613862 21390 raft_consensus.cc:2272] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.616964 21390 tablet_replica.cc:333] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.617959 21390 raft_consensus.cc:2243] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.618593 21390 raft_consensus.cc:2272] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.620826 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.621510 21390 tablet_replica.cc:333] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.622390 21390 raft_consensus.cc:2243] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.623428 21390 raft_consensus.cc:2272] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.626425 21390 tablet_replica.cc:333] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.627229 21390 raft_consensus.cc:2243] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.628535 21390 raft_consensus.cc:2272] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.631609 21390 tablet_replica.cc:333] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.632458 21390 raft_consensus.cc:2243] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.633562 21390 raft_consensus.cc:2272] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.635257 31054 consensus_peers.cc:597] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.639096 21390 tablet_replica.cc:333] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.642207 21390 raft_consensus.cc:2243] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.642863 21390 raft_consensus.cc:2272] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.646531 21390 tablet_replica.cc:333] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.647308 21390 raft_consensus.cc:2243] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.647909 21390 raft_consensus.cc:2272] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.650851 31202 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.653110 31128 consensus_peers.cc:597] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.655043 21390 tablet_replica.cc:333] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.655874 21390 raft_consensus.cc:2243] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:17.656440 31054 consensus_peers.cc:597] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.657049 21390 raft_consensus.cc:2272] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:17.658514 31202 consensus_peers.cc:597] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.663379 21390 tablet_replica.cc:333] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: stopping tablet replica
I20260709 13:11:17.665544 21390 raft_consensus.cc:2243] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.666590 21390 raft_consensus.cc:2272] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.756742 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
W20260709 13:11:17.900156 31202 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.907231 31128 consensus_peers.cc:597] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.914204 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.931555 31128 consensus_peers.cc:597] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.958292 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:17.967430 31773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.970587 31774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:17.981760 31776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:17.987747 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:17.989786 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:17.990224 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:17.990489 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602677990467 us; error 0 us; skew 500 ppm
I20260709 13:11:17.991286 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:17.995391 21390 webserver.cc:533] Webserver started at http://127.20.227.129:43111/ using document root <none> and password file <none>
I20260709 13:11:17.996042 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:17.996294 21390 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:18.017088 21390 fs_manager.cc:714] Time spent opening directory manager: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:11:18.039448 31782 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.043053 21390 fs_manager.cc:730] Time spent opening block manager: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:11:18.043589 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "116e6baff6234eadbc262b5fb70cfd5b"
format_stamp: "Formatted at 2026-07-09 13:11:04 on dist-test-slave-078m"
I20260709 13:11:18.044759 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.130406 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.132504 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.141331 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.160616 31789 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:11:18.508504 31771 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.509188 31771 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.511529 31771 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.513942 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:18.517233 31202 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.517721 31202 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:18.518392 31771 raft_consensus.cc:2749] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.551608 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:11:18.552054 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.399s	user 0.014s	sys 0.001s
I20260709 13:11:18.552448 21390 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:11:18.560189 31789 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:18.566277 31762 raft_consensus.cc:493] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.566921 31762 raft_consensus.cc:515] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.570495 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:18.574826 31762 leader_election.cc:290] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:18.577215 31777 raft_consensus.cc:493] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.577785 31777 raft_consensus.cc:515] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.580003 31777 leader_election.cc:290] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.597357 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:18.598292 31789 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.599390 31789 tablet_bootstrap.cc:492] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:18.600097 31789 ts_tablet_manager.cc:1403] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.018s
I20260709 13:11:18.603070 31789 raft_consensus.cc:359] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.603852 31789 raft_consensus.cc:740] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.604665 31789 consensus_queue.cc:260] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:18.605865 31054 leader_election.cc:336] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.608300 31758 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.609905 31758 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.609460 31054 leader_election.cc:304] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:18.612550 31758 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.613178 31766 raft_consensus.cc:2749] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.622289 31789 ts_tablet_manager.cc:1434] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:11:18.623553 31789 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:18.624066 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:18.626613 31128 leader_election.cc:336] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.627105 31128 leader_election.cc:304] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:18.627758 31758 raft_consensus.cc:2749] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.634085 31770 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.634759 31770 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.638281 31771 raft_consensus.cc:493] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
W20260709 13:11:18.638998 31128 leader_election.cc:336] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.639142 31771 raft_consensus.cc:515] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.639981 31766 raft_consensus.cc:493] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.640533 31766 raft_consensus.cc:515] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.641912 31771 leader_election.cc:290] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.642899 31766 leader_election.cc:290] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.643435 31766 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.643676 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4024d7ca443348189e2bce2cafeca403" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:18.644161 31766 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.649755 31757 raft_consensus.cc:493] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.650418 31757 raft_consensus.cc:515] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.655951 31757 leader_election.cc:290] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:18.657545 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:18.662734 31770 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.653159 31766 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.670322 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:18.668817 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:18.672411 31202 leader_election.cc:336] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.673032 31202 leader_election.cc:304] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:18.673877 31770 raft_consensus.cc:2749] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:18.675221 31202 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.677104 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:18.677982 31202 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:18.678872 31770 raft_consensus.cc:2749] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.679322 31128 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:18.680018 31770 raft_consensus.cc:493] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.680917 31770 raft_consensus.cc:515] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.681365 31758 raft_consensus.cc:2749] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.683947 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:18.684688 31155 raft_consensus.cc:2468] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:18.686023 31201 leader_election.cc:304] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:18.686930 31771 raft_consensus.cc:2804] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:18.687402 31771 raft_consensus.cc:493] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.688799 31771 raft_consensus.cc:3060] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.689796 31750 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.690430 31750 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.688321 31770 leader_election.cc:290] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.693517 31750 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.704511 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
W20260709 13:11:18.726725 31054 leader_election.cc:336] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.727260 31054 leader_election.cc:304] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:18.728015 31758 raft_consensus.cc:493] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.728693 31758 raft_consensus.cc:515] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.732753 31758 leader_election.cc:290] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.737638 31762 raft_consensus.cc:2749] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.739746 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4024d7ca443348189e2bce2cafeca403" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:18.740197 31054 leader_election.cc:336] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.740679 31229 raft_consensus.cc:2468] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
W20260709 13:11:18.745815 31128 leader_election.cc:336] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.740681 31054 leader_election.cc:304] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:18.749626 31762 raft_consensus.cc:2749] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:18.749838 31054 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.750476 31054 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:18.751410 31762 raft_consensus.cc:2749] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.754094 31128 leader_election.cc:304] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:18.755228 31750 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.755834 31750 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.758430 31750 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.760064 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:18.762025 31758 raft_consensus.cc:2804] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:18.762509 31758 raft_consensus.cc:493] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.762851 31758 raft_consensus.cc:3060] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.764835 31777 raft_consensus.cc:493] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.765431 31777 raft_consensus.cc:515] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.767597 31777 leader_election.cc:290] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.764465 31750 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.768625 31750 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.770159 31762 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.770474 31758 raft_consensus.cc:515] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.771034 31762 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.773221 31762 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.776969 31789 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.777933 31789 tablet_bootstrap.cc:492] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:18.778578 31789 ts_tablet_manager.cc:1403] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.155s	user 0.062s	sys 0.040s
I20260709 13:11:18.774470 31750 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:18.781976 31202 leader_election.cc:336] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:18.782774 31202 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.783119 31750 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.783735 31750 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.785797 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:18.786471 31085 raft_consensus.cc:2468] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:18.787278 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:18.772694 31758 leader_election.cc:290] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.790508 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4024d7ca443348189e2bce2cafeca403" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:18.791489 31229 raft_consensus.cc:3060] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.792994 31771 raft_consensus.cc:515] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.795538 31771 leader_election.cc:290] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.790176 31128 leader_election.cc:304] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:18.797485 31758 raft_consensus.cc:2804] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:18.797878 31758 raft_consensus.cc:493] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.798259 31758 raft_consensus.cc:3060] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.800040 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda26a7c7224e67bdad8915bf964ca0" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:18.800736 31155 raft_consensus.cc:3060] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:18.802603 31128 leader_election.cc:336] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:18.803381 31128 leader_election.cc:336] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.805337 31789 raft_consensus.cc:359] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.806257 31789 raft_consensus.cc:740] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.807057 31789 consensus_queue.cc:260] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.809432 31777 raft_consensus.cc:493] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.810081 31777 raft_consensus.cc:515] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.812601 31777 leader_election.cc:290] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.815927 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:18.816584 31085 raft_consensus.cc:2468] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:18.821131 31128 leader_election.cc:304] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:18.821417 31771 raft_consensus.cc:493] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
W20260709 13:11:18.822016 31128 leader_election.cc:336] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.822156 31771 raft_consensus.cc:515] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:18.823203 31777 raft_consensus.cc:2804] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:18.823614 31777 raft_consensus.cc:493] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.824010 31777 raft_consensus.cc:3060] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.824764 31771 leader_election.cc:290] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.826203 31789 ts_tablet_manager.cc:1434] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:11:18.827390 31789 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:18.786016 31750 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.839648 31479 raft_consensus.cc:493] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.840404 31479 raft_consensus.cc:515] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.843611 31479 leader_election.cc:290] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.846421 31155 raft_consensus.cc:2468] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
I20260709 13:11:18.783178 31202 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
W20260709 13:11:18.850322 31128 leader_election.cc:336] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:18.860896 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 78118.7us
I20260709 13:11:18.852609 31758 raft_consensus.cc:515] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.863979 31762 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.864389 31758 leader_election.cc:290] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.864621 31762 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.867086 31762 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.858542 31777 raft_consensus.cc:515] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.870499 31777 leader_election.cc:290] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:18.861420 31750 raft_consensus.cc:2749] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.852285 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:18.862027 31201 leader_election.cc:304] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:18.885375 31794 raft_consensus.cc:2804] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.887177 31794 raft_consensus.cc:697] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:18.888732 31794 consensus_queue.cc:237] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.892418 31789 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.897019 31789 tablet_bootstrap.cc:492] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:18.897763 31789 ts_tablet_manager.cc:1403] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.005s
I20260709 13:11:18.899202 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:18.899931 31234 raft_consensus.cc:2468] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:18.900460 31789 raft_consensus.cc:359] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.901209 31789 raft_consensus.cc:740] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.907616 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411f721c7ce43a8be90b329495cf898" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:18.908318 31085 raft_consensus.cc:3060] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.915532 31085 raft_consensus.cc:2468] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:18.917207 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9171d33cb114ba2850a02216ed350a1" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:18.917789 31085 raft_consensus.cc:3060] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.916639 31128 leader_election.cc:304] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:18.925588 31777 raft_consensus.cc:2749] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:18.926174 31128 leader_election.cc:336] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.927577 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:18.928275 31083 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:18.930619 31128 leader_election.cc:304] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:18.931409 31777 raft_consensus.cc:2804] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:11:18.931898 31128 leader_election.cc:336] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:18.930980 31771 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.933558 31771 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.931929 31777 raft_consensus.cc:697] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:18.936549 31777 consensus_queue.cc:237] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.934724 31789 consensus_queue.cc:260] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.943498 31771 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.954849 31789 ts_tablet_manager.cc:1434] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:11:18.956228 31789 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:18.962283 30907 catalog_manager.cc:5697] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.924611 31085 raft_consensus.cc:2468] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:18.893450 31229 raft_consensus.cc:2468] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:18.977072 31128 leader_election.cc:304] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:18.977368 31795 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.978371 31777 raft_consensus.cc:2804] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.986287 31777 raft_consensus.cc:697] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:18.987285 31777 consensus_queue.cc:237] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:18.993389 31758 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.994089 21390 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:11:18.993992 31758 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.995569 31770 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:18.996372 31758 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.996156 31770 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.984078 31128 leader_election.cc:304] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:18.998651 31770 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:18.998610 31758 raft_consensus.cc:2804] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:18.985148 31771 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.000739 31758 raft_consensus.cc:697] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:18.994558 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.442s	user 0.311s	sys 0.015s
I20260709 13:11:19.001832 31758 consensus_queue.cc:237] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:18.978826 31202 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:19.008459 31770 raft_consensus.cc:2804] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.008929 31770 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.009290 31770 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.000679 31771 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.014837 31771 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.018726 31770 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:19.007575 31128 leader_election.cc:336] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.025242 31770 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:19.022125 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:19.026278 31085 raft_consensus.cc:2468] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:19.044756 31766 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.045527 31766 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.048543 31766 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.048792 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:19.049798 31085 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:19.063613 31770 raft_consensus.cc:493] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.060654 31795 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.064576 31770 raft_consensus.cc:515] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.067058 31795 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.067492 31770 leader_election.cc:290] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:19.068254 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 96829.6us
I20260709 13:11:19.071175 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:19.078506 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:19.088557 31762 raft_consensus.cc:493] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.095356 31155 raft_consensus.cc:2468] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:19.095392 31160 raft_consensus.cc:2468] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:19.099371 31762 raft_consensus.cc:515] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.110436 31479 raft_consensus.cc:493] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.111250 31479 raft_consensus.cc:515] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.123696 31201 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:19.124794 31770 raft_consensus.cc:2804] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.125226 31770 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.125627 31770 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.127089 31762 leader_election.cc:290] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.125252 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:19.130312 31159 raft_consensus.cc:2468] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:19.107690 31777 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.121397 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:19.133061 31777 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.132411 31479 leader_election.cc:290] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.135439 31229 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:19.137267 31777 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.141579 31201 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:19.149647 31201 leader_election.cc:304] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:19.150550 31771 raft_consensus.cc:2804] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.150998 31771 raft_consensus.cc:493] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.158169 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:19.159058 31236 raft_consensus.cc:2468] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:19.151443 31771 raft_consensus.cc:3060] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.151273 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:19.164935 31202 leader_election.cc:336] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.166241 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:19.166016 31202 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:19.166852 31085 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.157346 31794 raft_consensus.cc:2804] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.170261 31794 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
W20260709 13:11:19.172353 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.173225 31202 leader_election.cc:336] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.173708 31202 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:19.164461 31750 raft_consensus.cc:493] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.180449 31085 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
I20260709 13:11:19.174044 31794 raft_consensus.cc:3060] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.185463 31770 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.187378 31128 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:19.188460 31770 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.189209 31789 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:19.190647 31750 raft_consensus.cc:515] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.192288 31789 tablet_bootstrap.cc:492] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:19.193038 31777 raft_consensus.cc:2804] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.193506 31777 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.193884 31777 raft_consensus.cc:3060] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.195533 31808 raft_consensus.cc:2749] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.171236 31229 raft_consensus.cc:2468] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 1.
I20260709 13:11:19.193506 31750 leader_election.cc:290] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.194707 31794 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.199252 31794 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.197438 31770 raft_consensus.cc:2749] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.193030 31789 ts_tablet_manager.cc:1403] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.237s	user 0.084s	sys 0.073s
W20260709 13:11:19.200314 31128 leader_election.cc:336] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.203198 31789 raft_consensus.cc:359] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.203501 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:19.204102 31155 raft_consensus.cc:3060] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.203843 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:19.203943 31789 raft_consensus.cc:740] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.205340 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:19.205925 31160 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.209684 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:19.210489 31236 raft_consensus.cc:2393] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 2: Already voted for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in this term.
I20260709 13:11:19.205899 31789 consensus_queue.cc:260] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:19.212669 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 109797us
W20260709 13:11:19.213078 31202 leader_election.cc:336] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.213434 31054 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
W20260709 13:11:19.213920 31202 leader_election.cc:336] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.210613 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:19.216054 31159 raft_consensus.cc:2468] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:19.216694 31766 raft_consensus.cc:2804] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.217173 31766 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.215375 31155 raft_consensus.cc:2468] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
I20260709 13:11:19.217694 31766 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.216275 31160 raft_consensus.cc:2468] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
W20260709 13:11:19.219619 31128 leader_election.cc:336] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.220407 31128 leader_election.cc:336] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.222607 31201 leader_election.cc:304] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:19.222870 31128 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.224313 31789 ts_tablet_manager.cc:1434] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:11:19.224586 31128 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:19.225301 31789 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:19.226600 31201 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:19.228053 31479 raft_consensus.cc:2749] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.229439 31054 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:19.231318 31201 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:19.234265 30911 catalog_manager.cc:5697] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.236016 31202 leader_election.cc:304] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.228685 31795 raft_consensus.cc:2804] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.238042 31795 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.238325 31794 raft_consensus.cc:493] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.239022 31794 raft_consensus.cc:515] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.239511 31711 raft_consensus.cc:2804] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.241474 31711 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.241937 31711 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.232280 31770 raft_consensus.cc:2804] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.243124 31770 raft_consensus.cc:493] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.238476 31795 raft_consensus.cc:3060] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.243634 31770 raft_consensus.cc:3060] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.243139 31814 raft_consensus.cc:2804] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.252341 31801 raft_consensus.cc:2804] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.253015 31801 raft_consensus.cc:697] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:19.254246 31801 consensus_queue.cc:237] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.251773 31814 raft_consensus.cc:697] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:19.275166 31814 consensus_queue.cc:237] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.281581 31813 raft_consensus.cc:2804] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.282045 31813 raft_consensus.cc:493] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.282392 31813 raft_consensus.cc:3060] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.301031 31794 leader_election.cc:290] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:19.302932 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 67010.8us
I20260709 13:11:19.310217 31202 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:19.314122 31813 raft_consensus.cc:515] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.314915 31808 raft_consensus.cc:2804] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.315359 31808 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
W20260709 13:11:19.315421 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 86058.6us
I20260709 13:11:19.315975 31808 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.316567 31813 leader_election.cc:290] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:19.359622 30910 catalog_manager.cc:5697] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.363816 30910 catalog_manager.cc:5697] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.331691 31202 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:19.321529 31771 raft_consensus.cc:515] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.366938 31229 raft_consensus.cc:2393] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0094be1075d460cafd5160946c09aed in current term 2: Already voted for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in this term.
W20260709 13:11:19.368654 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.369560 31202 leader_election.cc:336] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.370604 31771 leader_election.cc:290] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.345394 31766 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.371223 31771 raft_consensus.cc:2804] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.371917 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c2897f341b4f1c8c3d2a7956814756" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:19.342326 31795 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:19.320339 31054 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.370193 31128 leader_election.cc:304] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:19.372593 31766 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.334340 31770 raft_consensus.cc:515] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.351781 31711 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.376654 31770 leader_election.cc:290] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.377564 31711 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:19.370271 31202 leader_election.cc:336] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.378348 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b094ad0db83444268d00301854825ce5" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed"
W20260709 13:11:19.378791 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.378919 31155 raft_consensus.cc:3060] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.327338 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:19.386708 31235 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:19.324159 31808 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.389395 31808 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.390585 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d55d9d82c1b4132bc6b1dfa24082de4" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:19.391393 31229 raft_consensus.cc:3060] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.374270 31795 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.320673 31777 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.372536 31160 raft_consensus.cc:3060] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.395871 31777 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:19.403776 31202 leader_election.cc:336] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.406620 31202 leader_election.cc:336] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.407426 31202 leader_election.cc:336] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.405529 31771 raft_consensus.cc:697] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:19.408465 31771 consensus_queue.cc:237] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:19.414045 31202 leader_election.cc:336] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.418244 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.374109 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 53899.7us
I20260709 13:11:19.421355 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ac6de9f3474deaa670077135f894f7" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:19.422351 31085 raft_consensus.cc:2468] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 1.
I20260709 13:11:19.423928 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ac6de9f3474deaa670077135f894f7" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:19.424657 31235 raft_consensus.cc:2468] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
I20260709 13:11:19.424996 31789 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:19.424798 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a281d1ba3bb943d39ecfbb7aa5310350" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:19.425894 31236 raft_consensus.cc:3060] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:19.430261 31202 leader_election.cc:336] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.430944 31202 leader_election.cc:336] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.431166 31229 raft_consensus.cc:2468] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:19.426251 31789 tablet_bootstrap.cc:492] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:19.414956 30911 catalog_manager.cc:5697] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.485316 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:19.480300 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:19.504793 31085 raft_consensus.cc:3060] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.505494 31084 raft_consensus.cc:2393] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dec8ae7db1414dbea5acc7be7ffc9dfb in current term 2: Already voted for candidate 13bb23988f5940e5ba175699ca30e0d6 in this term.
I20260709 13:11:19.468577 31711 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.473625 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
W20260709 13:11:19.464938 31202 leader_election.cc:336] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.488788 31159 raft_consensus.cc:1275] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:19.507174 31202 leader_election.cc:336] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.507368 31235 raft_consensus.cc:2393] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 13bb23988f5940e5ba175699ca30e0d6 in current term 2: Already voted for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in this term.
I20260709 13:11:19.471596 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:19.508533 31229 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:19.492729 31054 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.513612 31085 raft_consensus.cc:2468] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
W20260709 13:11:19.513948 31054 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.514878 31202 leader_election.cc:304] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.516214 31813 raft_consensus.cc:2804] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.516685 31813 raft_consensus.cc:493] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.517084 31813 raft_consensus.cc:3060] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.522522 31711 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.528846 31711 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.501578 31160 raft_consensus.cc:2468] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
I20260709 13:11:19.535171 31479 raft_consensus.cc:2749] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.474994 31236 raft_consensus.cc:2468] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:19.472561 31789 ts_tablet_manager.cc:1403] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.247s	user 0.017s	sys 0.014s
W20260709 13:11:19.468109 31128 leader_election.cc:336] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.540620 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 72533.5us
I20260709 13:11:19.544698 31128 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.535713 31202 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:19.550469 31771 raft_consensus.cc:2749] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.550094 31789 raft_consensus.cc:359] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:19.551365 31789 raft_consensus.cc:740] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.552306 31789 consensus_queue.cc:260] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:19.529992 31808 consensus_queue.cc:1048] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:19.554749 31813 raft_consensus.cc:515] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.557744 31789 ts_tablet_manager.cc:1434] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:11:19.580446 31789 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:19.465269 31155 raft_consensus.cc:2468] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
I20260709 13:11:19.553462 31479 raft_consensus.cc:2804] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.558094 31202 leader_election.cc:304] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.600522 31479 raft_consensus.cc:697] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
W20260709 13:11:19.600991 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 48044.1us
I20260709 13:11:19.601804 31479 consensus_queue.cc:237] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.605126 31808 raft_consensus.cc:2804] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.607733 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ac6de9f3474deaa670077135f894f7" candidate_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:19.608513 31085 raft_consensus.cc:3060] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.607060 31808 raft_consensus.cc:697] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:19.621330 31808 consensus_queue.cc:237] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.562875 31054 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.624909 31711 raft_consensus.cc:2804] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:19.624998 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 62190.2us
I20260709 13:11:19.524111 30911 catalog_manager.cc:5697] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.626343 31054 leader_election.cc:304] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:19.564257 31813 leader_election.cc:290] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Requested vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:19.533033 31229 raft_consensus.cc:2468] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 2.
I20260709 13:11:19.625370 31711 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.633229 31711 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.638372 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:19.639218 31236 raft_consensus.cc:2468] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 1.
W20260709 13:11:19.623262 31202 consensus_peers.cc:597] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.651840 31201 leader_election.cc:304] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
W20260709 13:11:19.562258 31128 leader_election.cc:336] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.653836 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 91615.7us
W20260709 13:11:19.654382 31128 consensus_peers.cc:597] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.662712 31085 raft_consensus.cc:2468] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ae7db1414dbea5acc7be7ffc9dfb in term 2.
W20260709 13:11:19.666069 31054 leader_election.cc:336] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.660073 31711 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.669633 31201 leader_election.cc:304] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.675155 31128 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.678102 31817 raft_consensus.cc:2764] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:11:19.680204 31128 consensus_peers.cc:597] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:19.675501 31054 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.682569 31054 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.683172 31054 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:19.684149 31817 raft_consensus.cc:2749] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.686609 31236 raft_consensus.cc:1275] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.691213 31054 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:19.697577 31084 raft_consensus.cc:1275] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.682044 31758 raft_consensus.cc:2804] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.699172 31758 raft_consensus.cc:697] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
W20260709 13:11:19.700088 31128 consensus_peers.cc:597] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.674819 31771 raft_consensus.cc:2804] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.705423 31054 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:19.682251 31813 raft_consensus.cc:2804] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.711046 31806 raft_consensus.cc:2804] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:19.711470 31806 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:19.711855 31806 raft_consensus.cc:3060] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.722862 31711 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:19.723999 31771 raft_consensus.cc:697] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:19.725445 31771 consensus_queue.cc:237] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.701414 31817 raft_consensus.cc:2804] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.727228 31813 raft_consensus.cc:697] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:19.727062 31817 raft_consensus.cc:697] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:19.728274 31813 consensus_queue.cc:237] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.728268 30911 catalog_manager.cc:5697] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.731878 30911 catalog_manager.cc:5697] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.727070 30910 catalog_manager.cc:5697] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.700548 31159 raft_consensus.cc:1275] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.746485 31084 raft_consensus.cc:1275] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.747141 31770 consensus_queue.cc:1048] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.700181 31758 consensus_queue.cc:237] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:19.752557 31789 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:19.730337 31817 consensus_queue.cc:237] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.758481 31479 consensus_queue.cc:1048] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:19.775393 31789 tablet_bootstrap.cc:492] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:19.776542 31789 ts_tablet_manager.cc:1403] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.014s
W20260709 13:11:19.781932 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 128345us
I20260709 13:11:19.783782 31202 leader_election.cc:304] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:19.798000 31789 raft_consensus.cc:359] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:19.799170 31789 raft_consensus.cc:740] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.792304 31750 raft_consensus.cc:2804] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.800199 31789 consensus_queue.cc:260] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:19.803721 31750 raft_consensus.cc:697] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Leader. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:19.804708 31750 consensus_queue.cc:237] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.805243 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:19.805897 31229 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:19.813558 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.130:37997, user_credentials={real_user=slave}} blocked reactor thread for 105324us
I20260709 13:11:19.815521 31789 ts_tablet_manager.cc:1434] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
W20260709 13:11:19.823218 31054 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.840301 31807 consensus_queue.cc:1048] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:11:19.813124 31806 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:19.868914 31054 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:19.908053 31128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 73316.2us
I20260709 13:11:19.929719 31789 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:19.934320 31229 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 2.
I20260709 13:11:19.941191 31792 raft_consensus.cc:493] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.941857 31792 raft_consensus.cc:515] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:19.942920 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 50451.7us
I20260709 13:11:19.943008 31054 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
W20260709 13:11:19.944010 31202 leader_election.cc:336] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:19.965405 31856 raft_consensus.cc:2804] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:19.966054 31856 raft_consensus.cc:697] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:19.966992 31856 consensus_queue.cc:237] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:19.968026 31153 raft_consensus.cc:1275] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:19.970310 31770 consensus_queue.cc:1048] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.960911 31852 consensus_queue.cc:1048] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.151s
I20260709 13:11:19.988409 31792 leader_election.cc:290] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
W20260709 13:11:20.008786 31202 consensus_peers.cc:597] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.009477 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.009979 31202 consensus_peers.cc:597] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.010432 31202 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.010789 31202 consensus_peers.cc:597] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:20.019855 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbb400d6df043169f05f3dac26057e0" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:20.051422 31084 raft_consensus.cc:1275] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.055810 31771 consensus_queue.cc:1048] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:20.045617 31806 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:20.068413 30910 catalog_manager.cc:5697] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.062595 31229 raft_consensus.cc:3060] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:20.088342 31128 consensus_peers.cc:597] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.105325 31202 consensus_peers.cc:597] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.123672 31202 consensus_peers.cc:597] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:20.135962 30911 catalog_manager.cc:5697] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:20.143508 31128 consensus_peers.cc:597] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.145149 31202 consensus_peers.cc:597] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.145704 31202 consensus_peers.cc:597] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.141079 30911 catalog_manager.cc:5697] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.150081 31229 raft_consensus.cc:2468] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 2.
I20260709 13:11:20.155771 31233 raft_consensus.cc:1275] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:20.163689 31128 consensus_peers.cc:597] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.163916 31202 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.151717 30911 catalog_manager.cc:5697] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132). New cstate: current_term: 2 leader_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.171999 31807 consensus_queue.cc:1048] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:20.172853 31084 raft_consensus.cc:1275] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.179858 31750 consensus_queue.cc:1048] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:20.168543 31054 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
W20260709 13:11:20.185402 31054 consensus_peers.cc:597] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.185905 31054 consensus_peers.cc:597] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.187875 31757 raft_consensus.cc:2804] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:20.188776 31757 raft_consensus.cc:697] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:20.189762 31757 consensus_queue.cc:237] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:20.191236 31054 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:20.192934 31054 consensus_peers.cc:597] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.192775 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:20.230064 31054 consensus_peers.cc:597] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.237694 30907 catalog_manager.cc:5697] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.240815 30907 catalog_manager.cc:5697] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:20.289008 31880 log.cc:927] Time spent T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:11:20.295009 31128 consensus_peers.cc:597] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.308534 31202 consensus_peers.cc:597] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:20.323765 31155 raft_consensus.cc:1275] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.326512 31771 consensus_queue.cc:1048] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:20.325941 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.333731 31202 consensus_peers.cc:597] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.334227 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.342229 31082 raft_consensus.cc:1275] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:20.356622 31128 consensus_peers.cc:597] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.357273 31128 consensus_peers.cc:597] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:20.357712 31128 consensus_peers.cc:597] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.365160 31236 raft_consensus.cc:1275] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.373320 31792 raft_consensus.cc:493] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.374161 31792 raft_consensus.cc:515] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:20.386974 31789 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:20.388123 31789 tablet_bootstrap.cc:492] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:20.388835 31789 ts_tablet_manager.cc:1403] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.481s	user 0.042s	sys 0.020s
I20260709 13:11:20.391449 31789 raft_consensus.cc:359] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:20.392182 31789 raft_consensus.cc:740] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.392940 31789 consensus_queue.cc:260] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:20.393150 31801 consensus_queue.cc:1048] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:20.402467 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb456ded01cd478bb026e7177d35b17c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:20.396204 31777 consensus_queue.cc:1048] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:11:20.420084 31054 consensus_peers.cc:597] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.423442 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:20.423955 31233 raft_consensus.cc:1275] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 13bb23988f5940e5ba175699ca30e0d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.425539 31792 leader_election.cc:290] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:20.425755 31856 consensus_queue.cc:1048] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:20.426589 31792 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.427160 31792 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:20.437217 31792 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:20.453320 31789 ts_tablet_manager.cc:1434] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.003s
I20260709 13:11:20.454406 31789 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:20.455550 31054 consensus_peers.cc:597] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.458513 31786 leader_election.cc:304] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:20.464802 31236 raft_consensus.cc:1275] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 13bb23988f5940e5ba175699ca30e0d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.466324 31229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:20.470580 31202 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:20.475392 31896 raft_consensus.cc:2749] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:20.500566 31155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
W20260709 13:11:20.506088 31054 consensus_peers.cc:597] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.506721 31054 consensus_peers.cc:597] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:20.476078 31869 consensus_queue.cc:1048] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:11:20.518359 31785 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed
I20260709 13:11:20.546249 30910 catalog_manager.cc:5697] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 1 to 2, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.531241 31896 raft_consensus.cc:2749] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:20.553730 31201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 57894.9us
I20260709 13:11:20.567075 31155 raft_consensus.cc:1275] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer dec8ae7db1414dbea5acc7be7ffc9dfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:20.597824 31888 log.cc:927] Time spent T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: Append to log took a long time: real 0.109s	user 0.004s	sys 0.000s
I20260709 13:11:20.650888 31896 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.651599 31896 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:20.614300 31813 consensus_queue.cc:1048] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:11:20.654045 31896 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:20.657299 31054 consensus_peers.cc:597] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.674948 31234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:20.751183 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 65336us
W20260709 13:11:20.754851 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 67220.1us
I20260709 13:11:20.785519 31789 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:20.791433 31789 tablet_bootstrap.cc:492] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:20.793399 31789 ts_tablet_manager.cc:1403] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.339s	user 0.034s	sys 0.015s
W20260709 13:11:20.813553 31128 consensus_peers.cc:597] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.821914 31202 consensus_peers.cc:597] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.831569 31128 consensus_peers.cc:597] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:20.843196 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 52659us
W20260709 13:11:20.862212 31202 consensus_peers.cc:597] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:20.896471 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca5c8e4b4b9485a8be8282fb6372669" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:20.902351 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:20.915630 31789 raft_consensus.cc:359] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:20.917652 31789 raft_consensus.cc:740] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.918634 31786 leader_election.cc:304] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:20.921082 31896 raft_consensus.cc:2749] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:20.920745 31786 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:20.923403 31789 consensus_queue.cc:260] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:20.923765 31896 raft_consensus.cc:2749] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:20.926370 31789 ts_tablet_manager.cc:1434] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.132s	user 0.006s	sys 0.001s
I20260709 13:11:20.927284 31789 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:20.944218 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 152745us
I20260709 13:11:20.970799 31789 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:20.978012 31789 tablet_bootstrap.cc:492] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:20.979214 31789 ts_tablet_manager.cc:1403] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.013s
I20260709 13:11:20.982820 31789 raft_consensus.cc:359] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:20.983556 31789 raft_consensus.cc:740] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.984336 31789 consensus_queue.cc:260] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:20.985707 31233 raft_consensus.cc:1275] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 13bb23988f5940e5ba175699ca30e0d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:20.986537 31789 ts_tablet_manager.cc:1434] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:20.987421 31789 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:21.000625 31054 consensus_peers.cc:597] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.005967 31054 consensus_peers.cc:597] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:21.018298 31919 consensus_queue.cc:1048] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:21.038237 31054 consensus_peers.cc:597] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.069785 31789 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:21.071389 31789 tablet_bootstrap.cc:492] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:21.072943 31789 ts_tablet_manager.cc:1403] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.012s
W20260709 13:11:21.075838 31054 consensus_peers.cc:597] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:21.076308 31789 raft_consensus.cc:359] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:21.077951 31789 raft_consensus.cc:740] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.078724 31789 consensus_queue.cc:260] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:21.080744 31789 ts_tablet_manager.cc:1434] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:21.081549 31789 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:21.116101 31789 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:21.119079 31789 tablet_bootstrap.cc:492] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:21.120321 31789 ts_tablet_manager.cc:1403] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.012s
I20260709 13:11:21.123515 31789 raft_consensus.cc:359] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:21.124291 31789 raft_consensus.cc:740] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.125211 31789 consensus_queue.cc:260] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:21.127635 31789 ts_tablet_manager.cc:1434] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:11:21.128473 31789 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:21.223526 31944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:36611 every 8 connection(s)
I20260709 13:11:21.233103 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:36611
I20260709 13:11:21.249692 31789 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:21.251432 31789 tablet_bootstrap.cc:492] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:21.253765 31789 ts_tablet_manager.cc:1403] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.059s
I20260709 13:11:21.258292 31789 raft_consensus.cc:359] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:21.259155 31789 raft_consensus.cc:740] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.260092 31789 consensus_queue.cc:260] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:21.274148 31789 ts_tablet_manager.cc:1434] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:11:21.275344 31789 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:21.278529 31893 raft_consensus.cc:3060] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.314329 31789 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:21.315454 31789 tablet_bootstrap.cc:492] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:21.520843 31789 ts_tablet_manager.cc:1403] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.246s	user 0.013s	sys 0.020s
I20260709 13:11:21.530714 31897 raft_consensus.cc:493] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.531898 31897 raft_consensus.cc:515] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:21.554553 31897 leader_election.cc:290] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:21.556600 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:21.569403 31789 raft_consensus.cc:359] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:21.570163 31789 raft_consensus.cc:740] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.570868 31789 consensus_queue.cc:260] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:21.597333 31861 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.598582 31861 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
W20260709 13:11:21.643594 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 46738.5us
W20260709 13:11:21.670184 31054 consensus_peers.cc:597] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:21.673173 31868 raft_consensus.cc:3060] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.679265 31789 ts_tablet_manager.cc:1434] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.158s	user 0.007s	sys 0.004s
I20260709 13:11:21.684264 31861 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:21.691952 31789 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:21.695228 31232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:21.698069 31949 heartbeater.cc:344] Connected to a master server at 127.20.227.190:43499
I20260709 13:11:21.698701 31949 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:21.700038 31949 heartbeater.cc:507] Master 127.20.227.190:43499 requested a full tablet report, sending...
I20260709 13:11:21.701802 31232 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 2.
I20260709 13:11:21.708209 31855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b" is_pre_election: true
I20260709 13:11:21.709492 31961 raft_consensus.cc:493] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.711232 31961 raft_consensus.cc:515] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
W20260709 13:11:21.715679 31054 leader_election.cc:343] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.731587 31054 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:21.748116 31082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b9a38986234993ab664c4bc0812651" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:21.764987 31961 leader_election.cc:290] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:21.746585 31861 raft_consensus.cc:2804] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:21.766171 31861 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.766544 31861 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.764497 31786 leader_election.cc:304] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:21.768173 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0094be1075d460cafd5160946c09aed" is_pre_election: true
I20260709 13:11:21.779534 31961 raft_consensus.cc:2749] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:21.794939 31082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13bb23988f5940e5ba175699ca30e0d6" is_pre_election: true
I20260709 13:11:21.828136 31875 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.837271 31884 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.862599 31786 leader_election.cc:304] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:21.863518 31961 raft_consensus.cc:2749] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:21.871610 31861 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:21.874636 31861 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 3 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:21.875533 31789 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:21.876686 31789 tablet_bootstrap.cc:492] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:21.877440 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:21.878203 31231 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.879504 31881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "13bb23988f5940e5ba175699ca30e0d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
W20260709 13:11:21.883383 31054 leader_election.cc:343] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.877453 31789 ts_tablet_manager.cc:1403] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.006s
I20260709 13:11:21.888319 31789 raft_consensus.cc:359] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:21.889086 31789 raft_consensus.cc:740] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.890022 31789 consensus_queue.cc:260] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:21.892516 31789 ts_tablet_manager.cc:1434] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:11:21.893515 31789 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:21.904598 31231 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13bb23988f5940e5ba175699ca30e0d6 in term 3.
I20260709 13:11:21.906376 31054 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:21.915205 31922 raft_consensus.cc:2804] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:21.915817 31922 raft_consensus.cc:697] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 LEADER]: Becoming Leader. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:21.917198 31922 consensus_queue.cc:237] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:22.074389 30911 catalog_manager.cc:5697] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 reported cstate change: term changed from 1 to 3, leader changed from 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129) to 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "13bb23988f5940e5ba175699ca30e0d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.078259 31789 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.079442 31789 tablet_bootstrap.cc:492] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.080173 31789 ts_tablet_manager.cc:1403] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.187s	user 0.033s	sys 0.021s
I20260709 13:11:22.110581 31789 raft_consensus.cc:359] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.111305 31789 raft_consensus.cc:740] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.112174 31789 consensus_queue.cc:260] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:22.116190 31128 consensus_peers.cc:597] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:22.121423 31789 ts_tablet_manager.cc:1434] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.005s
W20260709 13:11:22.135921 31128 consensus_peers.cc:597] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:22.149176 31789 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.150486 30907 ts_manager.cc:194] Re-registered known tserver with Master: 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:22.202378 31884 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:22.273571 31053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:45509, user_credentials={real_user=slave}} blocked reactor thread for 100688us
W20260709 13:11:22.289207 31202 consensus_peers.cc:597] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:22.311023 31202 consensus_peers.cc:597] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:22.332960 31128 consensus_peers.cc:597] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:22.340170 31789 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.341815 31789 tablet_bootstrap.cc:492] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.342486 31789 ts_tablet_manager.cc:1403] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.194s	user 0.030s	sys 0.008s
I20260709 13:11:22.344779 31789 raft_consensus.cc:359] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.345438 31789 raft_consensus.cc:740] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.346128 31789 consensus_queue.cc:260] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.347887 31789 ts_tablet_manager.cc:1434] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:22.348691 31789 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.403882 31789 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.404819 31789 tablet_bootstrap.cc:492] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.405622 31789 ts_tablet_manager.cc:1403] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.027s
I20260709 13:11:22.410109 31789 raft_consensus.cc:359] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.410930 31789 raft_consensus.cc:740] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.411698 31789 consensus_queue.cc:260] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.414327 31789 ts_tablet_manager.cc:1434] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:22.415212 31789 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:22.418370 31054 consensus_peers.cc:597] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.443334 30907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43870
I20260709 13:11:22.450151 31949 heartbeater.cc:499] Master 127.20.227.190:43499 was elected leader, sending a full tablet report...
I20260709 13:11:22.451979 31789 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.454253 31789 tablet_bootstrap.cc:492] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.455036 31789 ts_tablet_manager.cc:1403] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.011s
I20260709 13:11:22.458328 31789 raft_consensus.cc:359] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.460372 31789 raft_consensus.cc:740] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.461185 31789 consensus_queue.cc:260] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.469331 31789 ts_tablet_manager.cc:1434] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:11:22.470737 31789 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.495265 31789 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.496379 31789 tablet_bootstrap.cc:492] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.497189 31789 ts_tablet_manager.cc:1403] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 13:11:22.498867 31231 raft_consensus.cc:1275] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Refusing update from remote peer 13bb23988f5940e5ba175699ca30e0d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:22.500828 31973 consensus_queue.cc:1048] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:22.505380 31789 raft_consensus.cc:359] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:22.506248 31789 raft_consensus.cc:740] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.507105 31789 consensus_queue.cc:260] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:22.509550 31789 ts_tablet_manager.cc:1434] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:22.510496 31789 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.532599 31789 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.534180 31789 tablet_bootstrap.cc:492] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.534878 31789 ts_tablet_manager.cc:1403] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 13:11:22.537750 31789 raft_consensus.cc:359] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.538417 31789 raft_consensus.cc:740] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.539104 31789 consensus_queue.cc:260] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.541329 31789 ts_tablet_manager.cc:1434] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:22.542234 31789 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.566092 31789 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.567094 31789 tablet_bootstrap.cc:492] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.567795 31789 ts_tablet_manager.cc:1403] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.006s
I20260709 13:11:22.570426 31789 raft_consensus.cc:359] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.571058 31789 raft_consensus.cc:740] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.571781 31789 consensus_queue.cc:260] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.574028 31789 ts_tablet_manager.cc:1434] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.002s
I20260709 13:11:22.574849 31789 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.595847 31789 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.596647 31789 tablet_bootstrap.cc:492] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.597237 31789 ts_tablet_manager.cc:1403] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.001s
I20260709 13:11:22.599459 31789 raft_consensus.cc:359] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:22.599992 31789 raft_consensus.cc:740] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.600555 31789 consensus_queue.cc:260] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:22.602572 31789 ts_tablet_manager.cc:1434] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:22.603832 31789 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:22.619050 31128 consensus_peers.cc:597] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:22.634464 31789 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.636163 31789 tablet_bootstrap.cc:492] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.637115 31789 ts_tablet_manager.cc:1403] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.033s	user 0.030s	sys 0.000s
W20260709 13:11:22.640774 31128 consensus_peers.cc:597] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:22.640650 31789 raft_consensus.cc:359] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.641427 31789 raft_consensus.cc:740] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.642189 31789 consensus_queue.cc:260] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.644685 31789 ts_tablet_manager.cc:1434] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:22.645670 31789 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.650724 31889 raft_consensus.cc:3060] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.682374 31789 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.683631 31789 tablet_bootstrap.cc:492] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.684408 31789 ts_tablet_manager.cc:1403] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.006s
I20260709 13:11:22.690301 31789 raft_consensus.cc:359] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.691049 31789 raft_consensus.cc:740] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.702096 31789 consensus_queue.cc:260] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.705088 31789 ts_tablet_manager.cc:1434] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:11:22.706054 31789 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:22.713763 31128 consensus_peers.cc:597] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:22.732950 31202 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:22.744851 31789 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.746449 31789 tablet_bootstrap.cc:492] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.747344 31789 ts_tablet_manager.cc:1403] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.005s
I20260709 13:11:22.750411 31789 raft_consensus.cc:359] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.751256 31789 raft_consensus.cc:740] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.752269 31789 consensus_queue.cc:260] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.754721 31789 ts_tablet_manager.cc:1434] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:22.760309 31789 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:22.762619 31054 consensus_peers.cc:597] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:22.804004 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:22.821357 31889 raft_consensus.cc:3060] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.830837 31789 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.832039 31789 tablet_bootstrap.cc:492] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.832846 31789 ts_tablet_manager.cc:1403] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.013s
I20260709 13:11:22.837630 31789 raft_consensus.cc:359] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:22.838551 31789 raft_consensus.cc:740] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.839500 31789 consensus_queue.cc:260] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
W20260709 13:11:22.840764 31054 consensus_peers.cc:597] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:22.841955 31789 ts_tablet_manager.cc:1434] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:22.844466 31789 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:22.911590 31789 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.912675 31789 tablet_bootstrap.cc:492] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.913471 31789 ts_tablet_manager.cc:1403] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.003s
I20260709 13:11:22.916538 31789 raft_consensus.cc:359] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.917547 31789 raft_consensus.cc:740] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.918372 31789 consensus_queue.cc:260] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:22.920922 31789 ts_tablet_manager.cc:1434] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:22.921921 31789 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:22.934837 31128 consensus_peers.cc:597] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:22.937326 31054 consensus_peers.cc:597] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:22.942907 31889 raft_consensus.cc:3060] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.970005 31789 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.971154 31789 tablet_bootstrap.cc:492] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:22.972031 31789 ts_tablet_manager.cc:1403] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.012s
I20260709 13:11:22.975485 31789 raft_consensus.cc:359] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:22.976321 31789 raft_consensus.cc:740] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.977151 31789 consensus_queue.cc:260] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:22.979645 31789 ts_tablet_manager.cc:1434] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:11:22.980532 31789 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.004760 31789 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:11:23.005524 31128 consensus_peers.cc:597] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:23.005865 31789 tablet_bootstrap.cc:492] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.006922 31789 ts_tablet_manager.cc:1403] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 13:11:23.010033 31789 raft_consensus.cc:359] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.010885 31789 raft_consensus.cc:740] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
W20260709 13:11:23.011674 31202 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:23.011804 31789 consensus_queue.cc:260] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.014010 31789 ts_tablet_manager.cc:1434] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:23.017031 31789 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.026608 31889 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:11:23.071527 31202 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:23.114084 31789 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.115247 31789 tablet_bootstrap.cc:492] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.116024 31789 ts_tablet_manager.cc:1403] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.099s	user 0.036s	sys 0.056s
I20260709 13:11:23.120198 31789 raft_consensus.cc:359] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.121444 31789 raft_consensus.cc:740] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
W20260709 13:11:23.116629 31054 consensus_peers.cc:597] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:23.122903 31789 consensus_queue.cc:260] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.126699 31789 ts_tablet_manager.cc:1434] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:23.127877 31789 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.171941 31789 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.173206 31789 tablet_bootstrap.cc:492] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.174299 31789 ts_tablet_manager.cc:1403] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.047s	user 0.031s	sys 0.007s
I20260709 13:11:23.178375 31789 raft_consensus.cc:359] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.179232 31789 raft_consensus.cc:740] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.180199 31789 consensus_queue.cc:260] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.182533 31789 ts_tablet_manager.cc:1434] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:11:23.183548 31789 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
W20260709 13:11:23.205437 31202 consensus_peers.cc:597] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:23.237138 31789 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.238205 31789 tablet_bootstrap.cc:492] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.238973 31789 ts_tablet_manager.cc:1403] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.008s
I20260709 13:11:23.241518 31789 raft_consensus.cc:359] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.242049 31789 raft_consensus.cc:740] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.242784 31789 consensus_queue.cc:260] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.245005 31789 ts_tablet_manager.cc:1434] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:23.248795 31789 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.291213 31789 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.293027 31789 tablet_bootstrap.cc:492] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.293738 31789 ts_tablet_manager.cc:1403] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.012s
I20260709 13:11:23.296394 31789 raft_consensus.cc:359] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.297205 31789 raft_consensus.cc:740] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.297884 31789 consensus_queue.cc:260] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.300347 31789 ts_tablet_manager.cc:1434] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:23.301290 31789 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.323657 31789 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.324715 31789 tablet_bootstrap.cc:492] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.325500 31789 ts_tablet_manager.cc:1403] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.001s
I20260709 13:11:23.328276 31789 raft_consensus.cc:359] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.329056 31789 raft_consensus.cc:740] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.330274 31789 consensus_queue.cc:260] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.332667 31789 ts_tablet_manager.cc:1434] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:11:23.333799 31054 consensus_peers.cc:597] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:23.339510 31789 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.355619 31789 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.356519 31789 tablet_bootstrap.cc:492] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.357179 31789 ts_tablet_manager.cc:1403] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:11:23.359936 31789 raft_consensus.cc:359] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.360606 31789 raft_consensus.cc:740] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.361333 31789 consensus_queue.cc:260] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.363493 31789 ts_tablet_manager.cc:1434] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:23.365677 31789 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.414644 31789 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.416182 31789 tablet_bootstrap.cc:492] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.416908 31789 ts_tablet_manager.cc:1403] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.015s
I20260709 13:11:23.419618 31789 raft_consensus.cc:359] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.426761 31789 raft_consensus.cc:740] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.427722 31789 consensus_queue.cc:260] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.430689 31789 ts_tablet_manager.cc:1434] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:11:23.431737 31789 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.451745 31789 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.452768 31789 tablet_bootstrap.cc:492] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.453459 31789 ts_tablet_manager.cc:1403] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 13:11:23.456074 31789 raft_consensus.cc:359] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.456760 31789 raft_consensus.cc:740] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.457588 31789 consensus_queue.cc:260] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.461735 31789 ts_tablet_manager.cc:1434] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:23.494671 31889 raft_consensus.cc:3060] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.498234 31789 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.603996 31789 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.605156 31789 tablet_bootstrap.cc:492] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.606055 31789 ts_tablet_manager.cc:1403] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.015s
I20260709 13:11:23.608836 31789 raft_consensus.cc:359] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.609551 31789 raft_consensus.cc:740] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.611299 31789 consensus_queue.cc:260] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:23.613734 31789 ts_tablet_manager.cc:1434] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
W20260709 13:11:23.614214 31202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:36611, user_credentials={real_user=slave}} blocked reactor thread for 58279.9us
W20260709 13:11:23.621237 31054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.132:45991, user_credentials={real_user=slave}} blocked reactor thread for 65295.1us
I20260709 13:11:23.643591 31789 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.679939 31789 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.680936 31789 tablet_bootstrap.cc:492] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.681648 31789 ts_tablet_manager.cc:1403] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.014s
I20260709 13:11:23.684343 31789 raft_consensus.cc:359] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.685055 31789 raft_consensus.cc:740] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.685788 31789 consensus_queue.cc:260] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.687892 31789 ts_tablet_manager.cc:1434] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:23.689091 31789 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.716928 31789 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.717944 31789 tablet_bootstrap.cc:492] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.718676 31789 ts_tablet_manager.cc:1403] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.004s
I20260709 13:11:23.721529 31789 raft_consensus.cc:359] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.722295 31789 raft_consensus.cc:740] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.723021 31789 consensus_queue.cc:260] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.725826 31789 ts_tablet_manager.cc:1434] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:23.727965 31789 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.756585 31789 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.757841 31789 tablet_bootstrap.cc:492] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.758682 31789 ts_tablet_manager.cc:1403] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.012s
I20260709 13:11:23.761688 31789 raft_consensus.cc:359] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.762457 31789 raft_consensus.cc:740] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.763206 31789 consensus_queue.cc:260] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.765533 31789 ts_tablet_manager.cc:1434] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:23.766367 31789 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.803081 31789 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.804200 31789 tablet_bootstrap.cc:492] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.805037 31789 ts_tablet_manager.cc:1403] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.007s
I20260709 13:11:23.808271 31789 raft_consensus.cc:359] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.811079 31789 raft_consensus.cc:740] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.811775 31789 consensus_queue.cc:260] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.813778 31868 raft_consensus.cc:3060] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.819494 31875 raft_consensus.cc:3060] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.826161 31884 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.829936 31789 ts_tablet_manager.cc:1434] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:11:23.831023 31789 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.881141 31789 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.882164 31789 tablet_bootstrap.cc:492] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.882921 31789 ts_tablet_manager.cc:1403] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.007s
I20260709 13:11:23.885931 31789 raft_consensus.cc:359] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.886703 31789 raft_consensus.cc:740] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.887568 31789 consensus_queue.cc:260] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.890003 31789 ts_tablet_manager.cc:1434] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:23.890918 31789 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.922465 31789 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.923688 31789 tablet_bootstrap.cc:492] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.924489 31789 ts_tablet_manager.cc:1403] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.005s
I20260709 13:11:23.927521 31789 raft_consensus.cc:359] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.928423 31789 raft_consensus.cc:740] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.929348 31789 consensus_queue.cc:260] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:23.932017 31789 ts_tablet_manager.cc:1434] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:23.933398 31789 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap starting.
I20260709 13:11:23.937186 31884 raft_consensus.cc:3060] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.966907 31889 raft_consensus.cc:3060] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.974622 31789 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:23.975749 31789 tablet_bootstrap.cc:492] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Bootstrap complete.
I20260709 13:11:23.977964 31789 ts_tablet_manager.cc:1403] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.003s
I20260709 13:11:23.982923 31884 raft_consensus.cc:3060] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.987756 31789 raft_consensus.cc:359] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.988590 31789 raft_consensus.cc:740] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.992631 31789 consensus_queue.cc:260] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:23.995096 31789 ts_tablet_manager.cc:1434] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:11:24.038378 31884 raft_consensus.cc:3060] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.374599 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:31.428138 31088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:31.428906 31088 raft_consensus.cc:606] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:31.432132 31088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:31.433756 31088 raft_consensus.cc:606] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:31.447180 31232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77215be4400643a880f8163084e38aee"
dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:11:31.447674 31232 raft_consensus.cc:606] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:31.451675 31088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:31.452294 31088 raft_consensus.cc:606] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:31.455498 31088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aab6881f32b9471485c79ae279c00120"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "e0094be1075d460cafd5160946c09aed"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:31.456161 31088 raft_consensus.cc:606] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Received request to transfer leadership to TS e0094be1075d460cafd5160946c09aed
I20260709 13:11:31.458957 31088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:31.459460 31088 raft_consensus.cc:606] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:31.460495 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:31.461753 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:31.523938 32044 raft_consensus.cc:993] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.524698 32039 raft_consensus.cc:1081] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.526171 31889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39916
I20260709 13:11:31.526693 31889 raft_consensus.cc:493] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.526984 31889 raft_consensus.cc:3060] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.532569 31889 raft_consensus.cc:515] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:31.534332 31889 leader_election.cc:290] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:31.535470 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:31.535465 31232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f82c954e654c919b31a5619dae274b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:31.536374 31088 raft_consensus.cc:3055] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:31.536428 31232 raft_consensus.cc:3060] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.536984 31088 raft_consensus.cc:740] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:31.537863 31088 consensus_queue.cc:260] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:31.539477 31088 raft_consensus.cc:3060] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.545027 31232 raft_consensus.cc:2468] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:31.546578 31786 leader_election.cc:304] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:31.546886 31088 raft_consensus.cc:2468] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:31.548712 32052 raft_consensus.cc:2804] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.549986 32052 raft_consensus.cc:697] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:31.550869 32052 consensus_queue.cc:237] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:31.651074 30908 catalog_manager.cc:5697] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.682739 32044 raft_consensus.cc:993] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.683792 32044 raft_consensus.cc:1081] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.686700 31889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39916
I20260709 13:11:31.687693 31889 raft_consensus.cc:493] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.688591 31889 raft_consensus.cc:3060] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.704006 31889 raft_consensus.cc:515] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:31.710160 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:31.711513 31088 raft_consensus.cc:3055] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:31.712009 31088 raft_consensus.cc:740] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:31.713418 31088 consensus_queue.cc:260] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:31.721278 31088 raft_consensus.cc:3060] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.727608 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c808b493dc45a290985c48d06f1dcb" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:31.728556 31153 raft_consensus.cc:3060] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.737021 31889 leader_election.cc:290] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:31.743736 31088 raft_consensus.cc:2468] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:31.746470 31786 leader_election.cc:304] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:31.747891 31153 raft_consensus.cc:2468] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:31.748051 32052 raft_consensus.cc:2804] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.760510 32052 raft_consensus.cc:697] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:31.764128 32056 raft_consensus.cc:993] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.762612 32052 consensus_queue.cc:237] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:31.782341 32038 raft_consensus.cc:1081] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.798334 31868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39916
I20260709 13:11:31.799257 31868 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.799801 31868 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.851397 31868 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:31.861431 31868 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 4 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:31.865247 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:31.866268 31235 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.867681 32065 raft_consensus.cc:993] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.869760 32056 raft_consensus.cc:1081] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.872346 31868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39916
I20260709 13:11:31.873433 31868 raft_consensus.cc:493] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.873955 31868 raft_consensus.cc:3060] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.888830 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591d8edfc1be4d78be4cab40b1e156cd" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:31.889875 31088 raft_consensus.cc:3055] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:31.890280 31088 raft_consensus.cc:740] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:31.891659 31088 consensus_queue.cc:260] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:31.896154 31088 raft_consensus.cc:3060] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.900058 31235 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 4.
I20260709 13:11:31.901873 32065 raft_consensus.cc:993] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower e0094be1075d460cafd5160946c09aed to start an election
I20260709 13:11:31.904148 31786 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:31.905980 32052 raft_consensus.cc:2804] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:31.906641 32052 raft_consensus.cc:697] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 4 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:31.907282 32065 raft_consensus.cc:1081] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Signalling peer e0094be1075d460cafd5160946c09aed to start an election
I20260709 13:11:31.908041 32052 consensus_queue.cc:237] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:31.914279 31160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aab6881f32b9471485c79ae279c00120"
dest_uuid: "e0094be1075d460cafd5160946c09aed"
 from {username='slave'} at 127.0.0.1:55334
I20260709 13:11:31.915153 31160 raft_consensus.cc:493] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.915623 31160 raft_consensus.cc:3060] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.921572 31868 raft_consensus.cc:515] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:31.922289 31088 raft_consensus.cc:2468] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 4.
I20260709 13:11:31.924017 31868 leader_election.cc:290] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:31.925153 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:31.925853 31153 raft_consensus.cc:3060] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.926095 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e9c5f498864f4a9ef1dcf9e952e10c" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:31.926817 31083 raft_consensus.cc:3055] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:31.927352 31083 raft_consensus.cc:740] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:31.928689 31083 consensus_queue.cc:260] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:31.930609 31083 raft_consensus.cc:3060] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.934427 31160 raft_consensus.cc:515] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:31.942121 32032 raft_consensus.cc:993] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.942730 32032 raft_consensus.cc:1081] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:31.944589 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77215be4400643a880f8163084e38aee"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39906
I20260709 13:11:31.945281 31884 raft_consensus.cc:493] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.945928 31884 raft_consensus.cc:3060] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.952286 31153 raft_consensus.cc:2468] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:31.953099 31088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:31.953745 31088 raft_consensus.cc:3055] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:31.954092 31088 raft_consensus.cc:740] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:31.955338 31088 consensus_queue.cc:260] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:31.956634 31088 raft_consensus.cc:3060] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.957643 31785 leader_election.cc:304] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:31.958848 31160 leader_election.cc:290] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:31.962689 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab6881f32b9471485c79ae279c00120" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:31.965353 31231 raft_consensus.cc:3060] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.968163 31082 raft_consensus.cc:1275] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:31.963660 32052 raft_consensus.cc:2804] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.973014 32053 consensus_queue.cc:1048] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:11:31.979669 31884 raft_consensus.cc:515] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:31.996251 31232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:31.980798 31088 raft_consensus.cc:2468] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:32.008544 31232 raft_consensus.cc:3055] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.009027 31232 raft_consensus.cc:740] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:32.009593 31128 leader_election.cc:304] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:32.009985 31232 consensus_queue.cc:260] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:32.010836 32034 raft_consensus.cc:2804] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.011559 31232 raft_consensus.cc:3060] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.011667 32034 raft_consensus.cc:697] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:31.999491 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77215be4400643a880f8163084e38aee" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:32.013602 31084 raft_consensus.cc:3060] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.013504 32034 consensus_queue.cc:237] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:32.019426 32052 raft_consensus.cc:697] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:32.025275 32052 consensus_queue.cc:237] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:31.992831 31083 raft_consensus.cc:2468] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:32.003125 31235 raft_consensus.cc:1275] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.000000 31884 leader_election.cc:290] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:32.034706 31084 raft_consensus.cc:2468] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:31.999820 31231 raft_consensus.cc:2468] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:32.041930 32069 consensus_queue.cc:1048] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.042383 31786 leader_election.cc:304] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:32.057174 32052 raft_consensus.cc:2804] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.056084 30908 catalog_manager.cc:5697] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 1 to 2, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.061949 32052 raft_consensus.cc:697] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:32.062853 31232 raft_consensus.cc:2468] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:32.062098 30910 catalog_manager.cc:5697] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.064818 30910 catalog_manager.cc:5697] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 3 to 4, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 4 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.066740 30910 catalog_manager.cc:5697] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.067240 32052 consensus_queue.cc:237] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
W20260709 13:11:32.094174 32074 log.cc:927] Time spent T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:11:32.118018 30910 catalog_manager.cc:5697] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.164398 31160 raft_consensus.cc:1275] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.166136 32052 consensus_queue.cc:1048] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.185738 31082 raft_consensus.cc:1275] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.192581 32053 consensus_queue.cc:1048] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:32.349572 31231 raft_consensus.cc:1275] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:32.351524 32075 consensus_queue.cc:1048] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:32.361408 31082 raft_consensus.cc:1275] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 4 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:32.368319 32076 consensus_queue.cc:1048] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:32.422430 31082 raft_consensus.cc:1275] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.423882 32076 consensus_queue.cc:1048] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.434365 31160 raft_consensus.cc:1275] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.441592 32052 consensus_queue.cc:1048] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.462957 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.480722 31231 raft_consensus.cc:1275] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.482390 32052 consensus_queue.cc:1048] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.493407 31082 raft_consensus.cc:1275] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.495033 32075 consensus_queue.cc:1048] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.513262 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.558004 31082 raft_consensus.cc:1275] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.559252 32057 consensus_queue.cc:1048] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.559537 31082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d927c6d703d46e2b498aab379411581"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "e0094be1075d460cafd5160946c09aed"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:32.560221 31082 raft_consensus.cc:606] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Received request to transfer leadership to TS e0094be1075d460cafd5160946c09aed
I20260709 13:11:32.565555 31082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:32.566202 31082 raft_consensus.cc:606] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:32.569851 32056 raft_consensus.cc:993] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower e0094be1075d460cafd5160946c09aed to start an election
I20260709 13:11:32.570469 32056 raft_consensus.cc:1081] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Signalling peer e0094be1075d460cafd5160946c09aed to start an election
I20260709 13:11:32.571988 31153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d927c6d703d46e2b498aab379411581"
dest_uuid: "e0094be1075d460cafd5160946c09aed"
 from {username='slave'} at 127.0.0.1:55334
I20260709 13:11:32.572546 31153 raft_consensus.cc:493] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.572914 31153 raft_consensus.cc:3060] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.572993 31231 raft_consensus.cc:1275] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.575464 32034 consensus_queue.cc:1048] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.583398 31153 raft_consensus.cc:515] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:32.587538 31153 leader_election.cc:290] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:32.588096 31082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:32.589025 31082 raft_consensus.cc:606] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:32.591869 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d927c6d703d46e2b498aab379411581" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:32.592579 31231 raft_consensus.cc:3060] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.594221 31082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d927c6d703d46e2b498aab379411581" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:32.594847 31082 raft_consensus.cc:3055] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.595145 31082 raft_consensus.cc:740] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:32.603051 31231 raft_consensus.cc:2468] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:32.596827 31082 consensus_queue.cc:260] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:32.604992 31082 raft_consensus.cc:3060] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.607147 31083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47"
dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:59658
I20260709 13:11:32.607826 31083 raft_consensus.cc:606] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:32.610163 31128 leader_election.cc:304] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:32.611439 32034 raft_consensus.cc:2804] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.615222 31231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40"
dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:11:32.616097 31231 raft_consensus.cc:606] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:32.629196 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:32.631851 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:32.636772 32032 raft_consensus.cc:993] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:32.637704 32045 raft_consensus.cc:1081] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:32.652457 31082 raft_consensus.cc:2468] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0094be1075d460cafd5160946c09aed in term 2.
I20260709 13:11:32.662729 31868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39906
I20260709 13:11:32.663558 31868 raft_consensus.cc:493] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.664181 31868 raft_consensus.cc:3060] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.664562 32034 raft_consensus.cc:697] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Becoming Leader. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:32.665570 32034 consensus_queue.cc:237] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:32.678112 31868 raft_consensus.cc:515] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:32.681522 31231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:32.682211 31231 raft_consensus.cc:3055] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.682528 31231 raft_consensus.cc:740] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:32.683467 31231 consensus_queue.cc:260] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:32.684608 31231 raft_consensus.cc:3060] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.691509 31868 leader_election.cc:290] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:32.693372 31231 raft_consensus.cc:2468] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:32.694780 31786 leader_election.cc:304] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:32.694872 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:32.695652 31153 raft_consensus.cc:3060] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.696075 32053 raft_consensus.cc:2804] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.696645 32053 raft_consensus.cc:697] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:32.697659 32053 consensus_queue.cc:237] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:32.705542 30908 catalog_manager.cc:5697] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed reported cstate change: term changed from 1 to 2, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to e0094be1075d460cafd5160946c09aed (127.20.227.131). New cstate: current_term: 2 leader_uuid: "e0094be1075d460cafd5160946c09aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.710580 31153 raft_consensus.cc:2468] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:32.722673 30911 catalog_manager.cc:5697] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.997754 32065 raft_consensus.cc:993] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:32.998318 32056 raft_consensus.cc:1081] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:32.999938 31868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39916
I20260709 13:11:33.000484 31868 raft_consensus.cc:493] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.000814 31868 raft_consensus.cc:3060] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.005990 31868 raft_consensus.cc:515] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:33.007755 31868 leader_election.cc:290] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:33.008415 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:33.008822 31160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907cbf2380f64d5fb28bc0d5b47a0505" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:33.009105 31083 raft_consensus.cc:3055] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.009407 31160 raft_consensus.cc:3060] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.009541 31083 raft_consensus.cc:740] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:33.010360 31083 consensus_queue.cc:260] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:33.011471 31083 raft_consensus.cc:3060] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.018420 31083 raft_consensus.cc:2468] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:33.018108 31160 raft_consensus.cc:2468] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:33.019734 31785 leader_election.cc:304] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:33.020524 32053 raft_consensus.cc:2804] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.021040 32053 raft_consensus.cc:697] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:33.021891 32053 consensus_queue.cc:237] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:33.031888 30911 catalog_manager.cc:5697] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.041419 32065 raft_consensus.cc:993] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:33.041939 32066 raft_consensus.cc:1081] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:33.043576 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39916
I20260709 13:11:33.044142 31884 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.044512 31884 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.051925 31884 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.053586 31884 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:33.054318 31232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:33.054607 31083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be55665ac28642f4b97c7716efcb8e47" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:33.054986 31232 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.055101 31083 raft_consensus.cc:3055] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:33.055598 31083 raft_consensus.cc:740] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:33.056397 31083 consensus_queue.cc:260] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.058391 31083 raft_consensus.cc:3060] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.062601 31232 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:33.064141 31786 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:33.065037 32053 raft_consensus.cc:2804] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:33.065496 32053 raft_consensus.cc:697] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:33.066179 31083 raft_consensus.cc:2468] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:33.066396 32053 consensus_queue.cc:237] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.079618 30911 catalog_manager.cc:5697] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 2 to 3, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 3 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.084816 31082 raft_consensus.cc:1275] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.086408 32095 consensus_queue.cc:1048] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.097836 31231 raft_consensus.cc:1275] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer e0094be1075d460cafd5160946c09aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.099537 32090 consensus_queue.cc:1048] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:33.120471 32056 raft_consensus.cc:993] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:33.121023 32056 raft_consensus.cc:1081] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:33.122759 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39916
I20260709 13:11:33.123310 31884 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.123641 31884 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.131560 31884 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.133345 31884 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:33.134123 31232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:33.134385 31082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76022e8458f3433295d3ed60bf4abb60" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:33.134868 31232 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.135414 31082 raft_consensus.cc:3055] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:33.135736 31082 raft_consensus.cc:740] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13bb23988f5940e5ba175699ca30e0d6, State: Running, Role: LEADER
I20260709 13:11:33.136575 31082 consensus_queue.cc:260] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.137789 31082 raft_consensus.cc:3060] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.143020 31232 raft_consensus.cc:2468] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:33.144443 31082 raft_consensus.cc:2468] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:33.144737 31786 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 
I20260709 13:11:33.145771 32053 raft_consensus.cc:2804] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:33.146179 32053 raft_consensus.cc:697] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:33.147050 32053 consensus_queue.cc:237] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.157462 30910 catalog_manager.cc:5697] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 2 to 3, leader changed from 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 3 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.239486 31160 raft_consensus.cc:1275] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.244356 32053 consensus_queue.cc:1048] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.261214 31232 raft_consensus.cc:1275] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.262777 32076 consensus_queue.cc:1048] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.420262 31160 raft_consensus.cc:1275] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.421499 32076 consensus_queue.cc:1048] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.441542 31083 raft_consensus.cc:1275] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.446360 32076 consensus_queue.cc:1048] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:33.499397 31231 raft_consensus.cc:1275] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:33.501152 32076 consensus_queue.cc:1048] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.517685 31084 raft_consensus.cc:1275] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:33.519064 32053 consensus_queue.cc:1048] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.633776 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:33.677429 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:33.727447 31235 raft_consensus.cc:1275] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:33.728806 32053 consensus_queue.cc:1048] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.740852 31153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312"
dest_uuid: "e0094be1075d460cafd5160946c09aed"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:52884
I20260709 13:11:33.741487 31153 raft_consensus.cc:606] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:33.741487 31084 raft_consensus.cc:1275] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:33.745960 32076 consensus_queue.cc:1048] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.748695 31235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b"
dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:11:33.756474 31235 raft_consensus.cc:606] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:33.763280 31235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79"
dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:11:33.763881 31235 raft_consensus.cc:606] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:33.782994 31235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b"
dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:11:33.784572 31235 raft_consensus.cc:606] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:33.788065 31235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1064b7411424cda96d26036597d7585"
dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
mode: GRACEFUL
new_leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:50236
I20260709 13:11:33.788554 31235 raft_consensus.cc:606] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Received request to transfer leadership to TS 116e6baff6234eadbc262b5fb70cfd5b
I20260709 13:11:33.789862 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:33.791356 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:33.914023 32109 raft_consensus.cc:993] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:33.914588 32109 raft_consensus.cc:1081] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:33.916076 31889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39906
I20260709 13:11:33.916545 31889 raft_consensus.cc:493] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.916890 31889 raft_consensus.cc:3060] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.923588 31889 raft_consensus.cc:515] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.925190 31889 leader_election.cc:290] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:33.925951 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:33.926314 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc60351fa2144dda7548a307178a27b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:33.926616 31235 raft_consensus.cc:3055] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.926854 31084 raft_consensus.cc:3060] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.926952 31235 raft_consensus.cc:740] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:33.927780 31235 consensus_queue.cc:260] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.929117 31235 raft_consensus.cc:3060] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.934337 31084 raft_consensus.cc:2468] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:33.936110 31786 leader_election.cc:304] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:33.936514 31235 raft_consensus.cc:2468] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:33.938656 32075 raft_consensus.cc:2804] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.939278 32075 raft_consensus.cc:697] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:33.940070 32075 consensus_queue.cc:237] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:33.953383 30910 catalog_manager.cc:5697] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.059111 32094 raft_consensus.cc:993] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.059638 32109 raft_consensus.cc:1081] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.061255 31889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39906
I20260709 13:11:34.061801 31889 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.062119 31889 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.066932 31889 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:34.068562 31889 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Requested vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:34.069811 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:34.070359 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76957cc6f9014c59b535bb48b9ff4b79" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:34.071038 31084 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.071134 31235 raft_consensus.cc:3055] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:34.071561 31235 raft_consensus.cc:740] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:34.072260 31235 consensus_queue.cc:260] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:34.073412 31235 raft_consensus.cc:3060] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.076804 31084 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:34.077963 31786 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:34.078678 32053 raft_consensus.cc:2804] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:34.079164 32053 raft_consensus.cc:697] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:34.079770 31235 raft_consensus.cc:2468] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:34.080144 32053 consensus_queue.cc:237] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:34.090801 30910 catalog_manager.cc:5697] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 2 to 3, leader changed from dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 3 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.102429 32109 raft_consensus.cc:993] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.102970 32045 raft_consensus.cc:1081] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.104396 31868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39906
I20260709 13:11:34.105038 31868 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.105307 31868 raft_consensus.cc:3060] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.110554 31868 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:34.112244 31868 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:34.112957 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:34.113313 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:34.113585 31153 raft_consensus.cc:3060] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.113893 31235 raft_consensus.cc:3055] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:34.114179 31235 raft_consensus.cc:740] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:34.114866 31235 consensus_queue.cc:260] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:34.115818 31235 raft_consensus.cc:3060] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.118597 31153 raft_consensus.cc:2468] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:34.119828 31785 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:34.120635 31235 raft_consensus.cc:2468] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:34.120813 32053 raft_consensus.cc:2804] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:34.121543 32053 raft_consensus.cc:697] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:34.122330 32053 consensus_queue.cc:237] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:34.126153 32045 raft_consensus.cc:993] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.126724 32045 raft_consensus.cc:1081] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.129550 31868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1064b7411424cda96d26036597d7585"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39906
I20260709 13:11:34.130131 31868 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.130514 31868 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.136976 30910 catalog_manager.cc:5697] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.138152 31868 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:34.141043 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb"
I20260709 13:11:34.141119 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1064b7411424cda96d26036597d7585" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:34.141700 31235 raft_consensus.cc:3055] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:34.141952 31153 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.142078 31235 raft_consensus.cc:740] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dec8ae7db1414dbea5acc7be7ffc9dfb, State: Running, Role: LEADER
I20260709 13:11:34.143393 31235 consensus_queue.cc:260] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:34.144630 31235 raft_consensus.cc:3060] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.151041 31153 raft_consensus.cc:2468] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:34.140522 31868 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Requested vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991)
I20260709 13:11:34.151811 31235 raft_consensus.cc:2468] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 3.
I20260709 13:11:34.153062 31785 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed; no voters: 
I20260709 13:11:34.153901 32053 raft_consensus.cc:2804] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:34.154321 32053 raft_consensus.cc:697] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:34.155134 32053 consensus_queue.cc:237] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:34.165428 30910 catalog_manager.cc:5697] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 2 to 3, leader changed from dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 3 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.192405 32034 raft_consensus.cc:993] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed: : Instructing follower 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.193145 32057 raft_consensus.cc:1081] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Signalling peer 116e6baff6234eadbc262b5fb70cfd5b to start an election
I20260709 13:11:34.194628 31868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312"
dest_uuid: "116e6baff6234eadbc262b5fb70cfd5b"
 from {username='slave'} at 127.0.0.1:39892
I20260709 13:11:34.195204 31868 raft_consensus.cc:493] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.195544 31868 raft_consensus.cc:3060] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.201746 31868 raft_consensus.cc:515] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:34.203495 31868 leader_election.cc:290] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Requested vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:34.204101 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13bb23988f5940e5ba175699ca30e0d6"
I20260709 13:11:34.204439 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137325b94b3480bbf698a17ddd2e312" candidate_uuid: "116e6baff6234eadbc262b5fb70cfd5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0094be1075d460cafd5160946c09aed"
I20260709 13:11:34.205070 31153 raft_consensus.cc:3055] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:34.205382 31153 raft_consensus.cc:740] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0094be1075d460cafd5160946c09aed, State: Running, Role: LEADER
I20260709 13:11:34.205435 31084 raft_consensus.cc:3060] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.206365 31153 consensus_queue.cc:260] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:34.207684 31153 raft_consensus.cc:3060] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.212546 31084 raft_consensus.cc:2468] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:34.213671 31786 leader_election.cc:304] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6; no voters: 
I20260709 13:11:34.214097 31153 raft_consensus.cc:2468] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116e6baff6234eadbc262b5fb70cfd5b in term 2.
I20260709 13:11:34.214504 32053 raft_consensus.cc:2804] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:34.215001 32053 raft_consensus.cc:697] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Becoming Leader. State: Replica: 116e6baff6234eadbc262b5fb70cfd5b, State: Running, Role: LEADER
I20260709 13:11:34.215876 32053 consensus_queue.cc:237] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:34.224429 30910 catalog_manager.cc:5697] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b reported cstate change: term changed from 1 to 2, leader changed from e0094be1075d460cafd5160946c09aed (127.20.227.131) to 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129). New cstate: current_term: 2 leader_uuid: "116e6baff6234eadbc262b5fb70cfd5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.388015 31084 raft_consensus.cc:1275] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:34.389586 32053 consensus_queue.cc:1048] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:34.402524 31232 raft_consensus.cc:1275] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:34.404109 32076 consensus_queue.cc:1048] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.557618 31082 raft_consensus.cc:1275] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.559185 32076 consensus_queue.cc:1048] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.575456 31232 raft_consensus.cc:1275] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.575628 31235 raft_consensus.cc:1275] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.579886 32053 consensus_queue.cc:1048] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.581926 32053 consensus_queue.cc:1048] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.605978 31153 raft_consensus.cc:1275] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 3 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:34.607969 32053 consensus_queue.cc:1048] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:34.618815 31160 raft_consensus.cc:1275] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:34.625062 32053 consensus_queue.cc:1048] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:34.642400 31232 raft_consensus.cc:1275] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:34.643661 32053 consensus_queue.cc:1048] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.676905 31161 raft_consensus.cc:1275] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:34.678896 32141 consensus_queue.cc:1048] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.690092 31082 raft_consensus.cc:1275] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Refusing update from remote peer 116e6baff6234eadbc262b5fb70cfd5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:34.691622 32141 consensus_queue.cc:1048] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.792409 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:34.831995 21390 tablet_server.cc:179] TabletServer@127.20.227.129:36611 shutting down...
W20260709 13:11:34.848229 31054 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 299 similar messages]
W20260709 13:11:34.863612 31054 consensus_peers.cc:597] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:34.866585 31054 consensus_peers.cc:597] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.888705 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:34.894197 21390 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:34.894850 31054 consensus_peers.cc:597] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.895546 21390 raft_consensus.cc:2243] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.896759 21390 raft_consensus.cc:2272] T 72c808b493dc45a290985c48d06f1dcb P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:34.898358 31054 consensus_peers.cc:597] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.899770 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.900594 21390 raft_consensus.cc:2243] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.901115 21390 raft_consensus.cc:2272] T a281d1ba3bb943d39ecfbb7aa5310350 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.903376 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.904354 21390 raft_consensus.cc:2243] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.904954 21390 raft_consensus.cc:2272] T 4024d7ca443348189e2bce2cafeca403 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.907976 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.908722 21390 raft_consensus.cc:2243] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.909241 21390 raft_consensus.cc:2272] T 9411f721c7ce43a8be90b329495cf898 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.911381 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.912204 21390 raft_consensus.cc:2243] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.912665 21390 raft_consensus.cc:2272] T ecda26a7c7224e67bdad8915bf964ca0 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.915665 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.916419 21390 raft_consensus.cc:2243] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.916921 21390 raft_consensus.cc:2272] T 199428020b7342f1b3d816182baa55e4 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:34.918502 31202 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.920169 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.921304 21390 raft_consensus.cc:2243] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.921864 21390 raft_consensus.cc:2272] T 7f1fdd08f91a438a9f88c5a2bc59326b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:34.923388 31128 consensus_peers.cc:597] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.925240 21390 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:34.926159 31128 consensus_peers.cc:597] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.926203 21390 raft_consensus.cc:2243] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.926920 21390 raft_consensus.cc:2272] T 1785d313b1f24abb861e4028d92c4bcb P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.930195 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.931176 21390 raft_consensus.cc:2243] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:11:34.931788 31202 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.932221 21390 raft_consensus.cc:2272] T 77215be4400643a880f8163084e38aee P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.935323 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.935904 21390 raft_consensus.cc:2243] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.936380 21390 raft_consensus.cc:2272] T 6fbb400d6df043169f05f3dac26057e0 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.939045 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.939703 21390 raft_consensus.cc:2243] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.940176 21390 raft_consensus.cc:2272] T 73c1509877e94c6a94893dd51dba1748 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.942981 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.943621 21390 raft_consensus.cc:2243] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.944542 21390 raft_consensus.cc:2272] T 591d8edfc1be4d78be4cab40b1e156cd P 116e6baff6234eadbc262b5fb70cfd5b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.947947 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.948904 21390 raft_consensus.cc:2243] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.950016 21390 raft_consensus.cc:2272] T 83e9c5f498864f4a9ef1dcf9e952e10c P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.953140 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.953876 21390 raft_consensus.cc:2243] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.954299 21390 raft_consensus.cc:2272] T e9171d33cb114ba2850a02216ed350a1 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.956411 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.957052 21390 raft_consensus.cc:2243] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.957825 21390 raft_consensus.cc:2272] T f2f82c954e654c919b31a5619dae274b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.960228 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.961040 21390 raft_consensus.cc:2243] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.961582 21390 raft_consensus.cc:2272] T e6ac6de9f3474deaa670077135f894f7 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.964677 21390 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:34.965253 31128 consensus_peers.cc:597] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.965560 21390 raft_consensus.cc:2243] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.966116 21390 raft_consensus.cc:2272] T 0ca5c8e4b4b9485a8be8282fb6372669 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.968403 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.969316 21390 raft_consensus.cc:2243] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.969901 21390 raft_consensus.cc:2272] T c5496455d6ea451dadd260868b97d356 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.972951 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.973699 21390 raft_consensus.cc:2243] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:11:34.974431 31202 consensus_peers.cc:597] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.974757 21390 raft_consensus.cc:2272] T 76957cc6f9014c59b535bb48b9ff4b79 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.978289 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.979096 21390 raft_consensus.cc:2243] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.979621 21390 raft_consensus.cc:2272] T ba4b31ab53d447b3ab5bd993b7c992bf P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.982635 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.983428 21390 raft_consensus.cc:2243] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.983970 21390 raft_consensus.cc:2272] T a09ce39cf2764cd2b2f8457b146e657d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.986986 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.987778 21390 raft_consensus.cc:2243] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.988729 21390 raft_consensus.cc:2272] T ec1733f1f71041d8a04cc61010a93c40 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.994493 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.995117 21390 raft_consensus.cc:2243] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:34.995136 31128 consensus_peers.cc:597] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.995801 21390 raft_consensus.cc:2272] T 8d55d9d82c1b4132bc6b1dfa24082de4 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.998536 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:34.999177 21390 raft_consensus.cc:2243] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.999652 21390 raft_consensus.cc:2272] T 32fc226fc7844c9096a579b3a8c05060 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.002812 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.003703 21390 raft_consensus.cc:2243] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:11:35.003762 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.005118 21390 raft_consensus.cc:2272] T 76022e8458f3433295d3ed60bf4abb60 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.007361 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.007961 21390 raft_consensus.cc:2243] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.008420 21390 raft_consensus.cc:2272] T b86383b831804250835ad3b3d8f3f44c P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.010985 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.011829 21390 raft_consensus.cc:2243] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.012455 21390 raft_consensus.cc:2272] T 79f63569bde3451593d530f6be062a16 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.015718 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.016466 21390 raft_consensus.cc:2243] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.017061 21390 raft_consensus.cc:2272] T cb456ded01cd478bb026e7177d35b17c P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.020186 31054 consensus_peers.cc:597] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.020442 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.021471 21390 raft_consensus.cc:2243] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.022125 21390 raft_consensus.cc:2272] T 35e351de7e26472fa16a05408cd1bef6 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.024776 31202 consensus_peers.cc:597] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.025460 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.026073 21390 raft_consensus.cc:2243] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.026453 21390 raft_consensus.cc:2272] T 6ccfbc32da67458799cc341fb3277d37 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.028548 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.029206 21390 raft_consensus.cc:2243] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.029615 21390 raft_consensus.cc:2272] T 61b038abfe774f34a24e07139da4520b P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.031762 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.032388 21390 raft_consensus.cc:2243] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.032922 21390 raft_consensus.cc:2272] T 15ad993bfbea46e0a43ffcb149c68de7 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.035945 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.036700 21390 raft_consensus.cc:2243] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.037801 21390 raft_consensus.cc:2272] T 2137325b94b3480bbf698a17ddd2e312 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.038133 31202 consensus_peers.cc:597] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.040614 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.041361 21390 raft_consensus.cc:2243] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.042158 21390 raft_consensus.cc:2272] T 907cbf2380f64d5fb28bc0d5b47a0505 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.044955 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.045676 21390 raft_consensus.cc:2243] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.046484 21390 raft_consensus.cc:2272] T cfc60351fa2144dda7548a307178a27b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.049922 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.050645 21390 raft_consensus.cc:2243] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.051146 21390 raft_consensus.cc:2272] T d463c852ffa846c0a6cabd5e29c4c32d P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.053354 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.053968 21390 raft_consensus.cc:2243] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.054327 21390 raft_consensus.cc:2272] T 4f666ffe90c44600a3394d80de817540 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.056366 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.056912 21390 raft_consensus.cc:2243] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.057329 21390 raft_consensus.cc:2272] T e3b9a38986234993ab664c4bc0812651 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.059520 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.060107 21390 raft_consensus.cc:2243] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.060495 21390 raft_consensus.cc:2272] T 05c2897f341b4f1c8c3d2a7956814756 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.062595 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.063047 21390 raft_consensus.cc:2243] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.063797 21390 raft_consensus.cc:2272] T 6c75c9a447d34afbadebde99ab3d010b P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.066388 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.066995 21390 raft_consensus.cc:2243] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.067804 21390 raft_consensus.cc:2272] T e1064b7411424cda96d26036597d7585 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.070762 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.071491 21390 raft_consensus.cc:2243] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.072000 21390 raft_consensus.cc:2272] T bb04a7b75afd4166aee199de5f812c01 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.072190 31054 consensus_peers.cc:597] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.075081 21390 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:35.075489 31128 consensus_peers.cc:597] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.075748 21390 raft_consensus.cc:2243] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.076798 21390 raft_consensus.cc:2272] T be55665ac28642f4b97c7716efcb8e47 P 116e6baff6234eadbc262b5fb70cfd5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.079656 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.080289 21390 raft_consensus.cc:2243] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.080924 21390 raft_consensus.cc:2272] T d19e2ee8edef4c659be9276658c65913 P 116e6baff6234eadbc262b5fb70cfd5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.083890 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:35.084563 21390 raft_consensus.cc:2243] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.085110 21390 raft_consensus.cc:2272] T b094ad0db83444268d00301854825ce5 P 116e6baff6234eadbc262b5fb70cfd5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.163960 21390 tablet_server.cc:196] TabletServer@127.20.227.129:36611 shutdown complete.
W20260709 13:11:35.167270 31128 consensus_peers.cc:597] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.174971 31202 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.218581 31202 consensus_peers.cc:597] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.241577 31128 consensus_peers.cc:597] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.257359 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.258109 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.264469 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
W20260709 13:11:35.282920 31202 consensus_peers.cc:597] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.285905 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.286904 31128 consensus_peers.cc:597] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.287786 31128 consensus_peers.cc:597] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.312595 31128 consensus_peers.cc:597] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.317215 31054 consensus_peers.cc:597] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.322983 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:35.325138 21390 tablet_replica.cc:333] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.325996 21390 raft_consensus.cc:2243] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.326576 21390 raft_consensus.cc:2272] T e3b9a38986234993ab664c4bc0812651 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.328675 31128 consensus_peers.cc:597] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.329744 21390 tablet_replica.cc:333] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.330781 21390 raft_consensus.cc:2243] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:35.329434 31128 consensus_peers.cc:597] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.332252 21390 raft_consensus.cc:2272] T 4f666ffe90c44600a3394d80de817540 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.335937 21390 tablet_replica.cc:333] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.336819 21390 raft_consensus.cc:2243] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.338276 21390 raft_consensus.cc:2272] T f2f82c954e654c919b31a5619dae274b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.341251 21390 tablet_replica.cc:333] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.342185 21390 raft_consensus.cc:2243] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.342756 21390 raft_consensus.cc:2272] T 2137325b94b3480bbf698a17ddd2e312 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.344841 31202 consensus_peers.cc:597] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.348409 21390 tablet_replica.cc:333] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.349519 21390 raft_consensus.cc:2243] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.350075 21390 raft_consensus.cc:2272] T 76022e8458f3433295d3ed60bf4abb60 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.350549 31128 consensus_peers.cc:597] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.350710 31054 consensus_peers.cc:597] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.359190 21390 tablet_replica.cc:333] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.360203 21390 raft_consensus.cc:2243] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.361342 21390 raft_consensus.cc:2272] T 32fc226fc7844c9096a579b3a8c05060 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.365419 21390 tablet_replica.cc:333] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.366657 21390 raft_consensus.cc:2243] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.367726 21390 raft_consensus.cc:2272] T 078186d5ab1e4886903ffb8cd15f46d9 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.372228 21390 tablet_replica.cc:333] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.374598 21390 raft_consensus.cc:2243] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.375793 21390 raft_consensus.cc:2272] T 4ff5428cc42d4f7281ae35788233dee8 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.379036 21390 tablet_replica.cc:333] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.379974 21390 raft_consensus.cc:2243] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:35.383025 31128 consensus_peers.cc:597] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.386516 21390 raft_consensus.cc:2272] T b140d661f41949f9b1fd260999e50999 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.393020 21390 tablet_replica.cc:333] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.394088 21390 raft_consensus.cc:2243] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:35.397560 31202 consensus_peers.cc:597] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.405048 21390 raft_consensus.cc:2272] T 7f1fdd08f91a438a9f88c5a2bc59326b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.407477 21390 tablet_replica.cc:333] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.408205 21390 raft_consensus.cc:2243] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.409374 21390 raft_consensus.cc:2272] T fa0ff9b94c054250a66182155d62b0fc P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.411971 21390 tablet_replica.cc:333] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.412588 21390 raft_consensus.cc:2243] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.413056 21390 raft_consensus.cc:2272] T 915f9be628344ac09e3d93a385ebbfdb P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.415148 21390 tablet_replica.cc:333] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.415776 21390 raft_consensus.cc:2243] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.416213 21390 raft_consensus.cc:2272] T 9411f721c7ce43a8be90b329495cf898 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.418356 21390 tablet_replica.cc:333] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.418972 21390 raft_consensus.cc:2243] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.419806 21390 raft_consensus.cc:2272] T 7aa32971139947f1a694bda08ee6848d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.422677 21390 tablet_replica.cc:333] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.423378 21390 raft_consensus.cc:2243] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.424348 21390 raft_consensus.cc:2272] T c5496455d6ea451dadd260868b97d356 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.426963 21390 tablet_replica.cc:333] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.427659 21390 raft_consensus.cc:2243] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.428158 21390 raft_consensus.cc:2272] T 0ca5c8e4b4b9485a8be8282fb6372669 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.431082 21390 tablet_replica.cc:333] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.431845 21390 raft_consensus.cc:2243] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.432328 21390 raft_consensus.cc:2272] T 83e9c5f498864f4a9ef1dcf9e952e10c P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.434353 21390 tablet_replica.cc:333] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.434955 21390 raft_consensus.cc:2243] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.435426 21390 raft_consensus.cc:2272] T a348c59d23d847cd8e01296e609f0e8c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.437556 21390 tablet_replica.cc:333] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.438103 21390 raft_consensus.cc:2243] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.438535 21390 raft_consensus.cc:2272] T e03e12bc43e64de9b904105f3a74f98e P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.440385 21390 tablet_replica.cc:333] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.440981 21390 raft_consensus.cc:2243] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.441419 21390 raft_consensus.cc:2272] T e9171d33cb114ba2850a02216ed350a1 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.443310 21390 tablet_replica.cc:333] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.443895 21390 raft_consensus.cc:2243] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.444344 21390 raft_consensus.cc:2272] T d19e2ee8edef4c659be9276658c65913 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.446547 21390 tablet_replica.cc:333] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.447224 21390 raft_consensus.cc:2243] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.447680 21390 raft_consensus.cc:2272] T aab6881f32b9471485c79ae279c00120 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.450239 21390 tablet_replica.cc:333] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.451210 21390 raft_consensus.cc:2243] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.451764 21390 raft_consensus.cc:2272] T 8f3f639e54a041fdb1c2d051bed72073 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.454185 21390 tablet_replica.cc:333] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.454835 21390 raft_consensus.cc:2243] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.455976 21390 raft_consensus.cc:2272] T a09ce39cf2764cd2b2f8457b146e657d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.458976 21390 tablet_replica.cc:333] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.459757 21390 raft_consensus.cc:2243] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.460291 21390 raft_consensus.cc:2272] T 76957cc6f9014c59b535bb48b9ff4b79 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.463821 21390 tablet_replica.cc:333] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.464377 21390 raft_consensus.cc:2243] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.464777 21390 raft_consensus.cc:2272] T be55665ac28642f4b97c7716efcb8e47 P 13bb23988f5940e5ba175699ca30e0d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.467410 21390 tablet_replica.cc:333] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.468041 21390 raft_consensus.cc:2243] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.468559 21390 raft_consensus.cc:2272] T 79f63569bde3451593d530f6be062a16 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.471233 21390 tablet_replica.cc:333] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
W20260709 13:11:35.471784 31202 consensus_peers.cc:597] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.471953 21390 raft_consensus.cc:2243] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.472548 21390 raft_consensus.cc:2272] T b86383b831804250835ad3b3d8f3f44c P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.474573 21390 tablet_replica.cc:333] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.475272 21390 raft_consensus.cc:2243] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.475683 21390 raft_consensus.cc:2272] T 35e351de7e26472fa16a05408cd1bef6 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.477802 21390 tablet_replica.cc:333] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.478302 21390 raft_consensus.cc:2243] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.478696 21390 raft_consensus.cc:2272] T 36995fac4a8745f1ae1c292c94f4f813 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.480806 21390 tablet_replica.cc:333] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.481395 21390 raft_consensus.cc:2243] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.482285 21390 raft_consensus.cc:2272] T d463c852ffa846c0a6cabd5e29c4c32d P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.484922 21390 tablet_replica.cc:333] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.485529 21390 raft_consensus.cc:2243] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.485966 21390 raft_consensus.cc:2272] T 907cbf2380f64d5fb28bc0d5b47a0505 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.487228 31128 consensus_peers.cc:597] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.488071 21390 tablet_replica.cc:333] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.488685 21390 raft_consensus.cc:2243] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.489169 21390 raft_consensus.cc:2272] T cfc60351fa2144dda7548a307178a27b P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.491887 21390 tablet_replica.cc:333] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.492597 21390 raft_consensus.cc:2243] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.493165 21390 raft_consensus.cc:2272] T 2d927c6d703d46e2b498aab379411581 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.495918 21390 tablet_replica.cc:333] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.496451 21390 raft_consensus.cc:2243] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.496970 21390 raft_consensus.cc:2272] T 15ad993bfbea46e0a43ffcb149c68de7 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.499769 21390 tablet_replica.cc:333] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.500480 21390 raft_consensus.cc:2243] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.501075 21390 raft_consensus.cc:2272] T 61b038abfe774f34a24e07139da4520b P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.501173 31128 consensus_peers.cc:597] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.503346 21390 tablet_replica.cc:333] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.503913 21390 raft_consensus.cc:2243] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.504345 21390 raft_consensus.cc:2272] T e6ac6de9f3474deaa670077135f894f7 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.506493 21390 tablet_replica.cc:333] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.507114 21390 raft_consensus.cc:2243] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.507884 21390 raft_consensus.cc:2272] T 3f1997fc1c544e87afea39d3052e547a P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.510346 21390 tablet_replica.cc:333] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.510975 21390 raft_consensus.cc:2243] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.511803 21390 raft_consensus.cc:2272] T 10a49c820fa64c7bbd18b86ed3d16bb3 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.514000 21390 tablet_replica.cc:333] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.514499 21390 raft_consensus.cc:2243] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.514942 21390 raft_consensus.cc:2272] T 77215be4400643a880f8163084e38aee P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.516983 21390 tablet_replica.cc:333] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.517681 21390 raft_consensus.cc:2243] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.518705 21390 raft_consensus.cc:2272] T 73c1509877e94c6a94893dd51dba1748 P 13bb23988f5940e5ba175699ca30e0d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.521659 21390 tablet_replica.cc:333] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.522522 21390 raft_consensus.cc:2243] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:35.523625 21390 raft_consensus.cc:2272] T 6fbb400d6df043169f05f3dac26057e0 P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.527153 21390 tablet_replica.cc:333] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.527845 21390 raft_consensus.cc:2243] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.528398 21390 raft_consensus.cc:2272] T 591d8edfc1be4d78be4cab40b1e156cd P 13bb23988f5940e5ba175699ca30e0d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.531348 21390 tablet_replica.cc:333] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6: stopping tablet replica
I20260709 13:11:35.531946 21390 raft_consensus.cc:2243] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.532444 21390 raft_consensus.cc:2272] T 72c808b493dc45a290985c48d06f1dcb P 13bb23988f5940e5ba175699ca30e0d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:35.547529 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.552268 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.610426 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
W20260709 13:11:35.619051 31202 consensus_peers.cc:597] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.662196 31202 consensus_peers.cc:597] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.671656 31128 consensus_peers.cc:597] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.674835 31202 consensus_peers.cc:597] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.707501 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
W20260709 13:11:35.810511 31128 consensus_peers.cc:597] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.814429 31128 consensus_peers.cc:597] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.818980 31128 consensus_peers.cc:597] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.013698 31128 consensus_peers.cc:597] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.038511 31201 consensus_peers.cc:597] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.045083 31201 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.045796 31201 consensus_peers.cc:597] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.047387 31201 consensus_peers.cc:597] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.048003 31201 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.048655 31201 consensus_peers.cc:597] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.049373 31201 consensus_peers.cc:597] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.049909 31201 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.050463 31201 consensus_peers.cc:597] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.070700 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:36.071574 21390 tablet_replica.cc:333] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.072265 21390 raft_consensus.cc:2243] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.072790 21390 raft_consensus.cc:2272] T ecda26a7c7224e67bdad8915bf964ca0 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.075457 21390 tablet_replica.cc:333] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.076318 21390 raft_consensus.cc:2243] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.076710 21390 raft_consensus.cc:2272] T 6ccfbc32da67458799cc341fb3277d37 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.079211 31201 consensus_peers.cc:597] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.079706 32163 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.080260 32163 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.082269 32163 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:36.083666 21390 tablet_replica.cc:333] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.086349 21390 raft_consensus.cc:2243] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:36.086863 31202 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.087023 21390 raft_consensus.cc:2272] T 73c1509877e94c6a94893dd51dba1748 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.087996 31202 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.087963 32163 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.088575 31202 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.088739 32163 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.089388 32162 raft_consensus.cc:2749] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.090939 21390 tablet_replica.cc:333] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.091218 32163 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:36.091925 21390 raft_consensus.cc:2243] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.094323 21390 raft_consensus.cc:2272] T 1785d313b1f24abb861e4028d92c4bcb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.097575 21390 tablet_replica.cc:333] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.098363 21390 raft_consensus.cc:2243] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:36.098620 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.099248 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.099364 21390 raft_consensus.cc:2272] T e3b9a38986234993ab664c4bc0812651 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.099485 31202 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.100986 32163 raft_consensus.cc:2749] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.102670 21390 tablet_replica.cc:333] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.103516 21390 raft_consensus.cc:2243] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.104023 21390 raft_consensus.cc:2272] T 4f666ffe90c44600a3394d80de817540 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.106400 21390 tablet_replica.cc:333] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.106982 21390 raft_consensus.cc:2243] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.107419 21390 raft_consensus.cc:2272] T 7aa32971139947f1a694bda08ee6848d P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.109653 21390 tablet_replica.cc:333] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.110255 21390 raft_consensus.cc:2243] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.110710 21390 raft_consensus.cc:2272] T 2137325b94b3480bbf698a17ddd2e312 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.112661 21390 tablet_replica.cc:333] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.113313 21390 raft_consensus.cc:2243] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.113739 21390 raft_consensus.cc:2272] T 078186d5ab1e4886903ffb8cd15f46d9 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.115876 21390 tablet_replica.cc:333] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.116519 21390 raft_consensus.cc:2243] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.117497 21390 raft_consensus.cc:2272] T a281d1ba3bb943d39ecfbb7aa5310350 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.119596 21390 tablet_replica.cc:333] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.120201 21390 raft_consensus.cc:2243] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.121085 21390 raft_consensus.cc:2272] T ba4b31ab53d447b3ab5bd993b7c992bf P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.123067 21390 tablet_replica.cc:333] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.123972 21390 raft_consensus.cc:2243] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.124496 21390 raft_consensus.cc:2272] T 199428020b7342f1b3d816182baa55e4 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.127633 21390 tablet_replica.cc:333] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.128315 21390 raft_consensus.cc:2243] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.128773 21390 raft_consensus.cc:2272] T b140d661f41949f9b1fd260999e50999 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.130833 21390 tablet_replica.cc:333] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.131408 21390 raft_consensus.cc:2243] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.131871 21390 raft_consensus.cc:2272] T 7f1fdd08f91a438a9f88c5a2bc59326b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.133863 21390 tablet_replica.cc:333] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.134469 21390 raft_consensus.cc:2243] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.134902 21390 raft_consensus.cc:2272] T e1064b7411424cda96d26036597d7585 P e0094be1075d460cafd5160946c09aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.136945 21390 tablet_replica.cc:333] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.137519 21390 raft_consensus.cc:2243] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.137957 21390 raft_consensus.cc:2272] T fa0ff9b94c054250a66182155d62b0fc P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.139829 21390 tablet_replica.cc:333] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.140372 21390 raft_consensus.cc:2243] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.141042 21390 raft_consensus.cc:2272] T 4ff5428cc42d4f7281ae35788233dee8 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.140962 32159 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.141675 32159 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:36.141942 32160 raft_consensus.cc:493] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.142601 32160 raft_consensus.cc:515] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:36.143990 32159 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:36.144173 21390 tablet_replica.cc:333] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.144762 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c75c9a447d34afbadebde99ab3d010b" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
I20260709 13:11:36.145064 21390 raft_consensus.cc:2243] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.146157 21390 raft_consensus.cc:2272] T 9411f721c7ce43a8be90b329495cf898 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.146659 32160 leader_election.cc:290] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:36.147595 32163 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.149204 21390 tablet_replica.cc:333] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.148193 32163 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:36.150010 21390 raft_consensus.cc:2243] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:36.150338 31128 leader_election.cc:336] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.150703 21390 raft_consensus.cc:2272] T 915f9be628344ac09e3d93a385ebbfdb P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.150909 31128 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:36.151777 32160 raft_consensus.cc:2749] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:36.152133 31128 leader_election.cc:336] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.153847 32163 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:36.154452 21390 tablet_replica.cc:333] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.155431 21390 raft_consensus.cc:2243] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:11:36.155694 31201 leader_election.cc:336] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.156420 21390 raft_consensus.cc:2272] T e9171d33cb114ba2850a02216ed350a1 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.158967 31128 leader_election.cc:336] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.159422 21390 tablet_replica.cc:333] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.159446 31128 leader_election.cc:304] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.160327 21390 raft_consensus.cc:2243] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.160660 32160 raft_consensus.cc:2749] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.161556 21390 raft_consensus.cc:2272] T e03e12bc43e64de9b904105f3a74f98e P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.161731 31202 leader_election.cc:336] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.162190 31202 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.162956 32162 raft_consensus.cc:2749] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.163677 32162 raft_consensus.cc:493] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.164397 21390 tablet_replica.cc:333] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.164093 32162 raft_consensus.cc:515] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.165308 21390 raft_consensus.cc:2243] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.164439 32160 raft_consensus.cc:493] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.166324 32162 leader_election.cc:290] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:36.166623 21390 raft_consensus.cc:2272] T aab6881f32b9471485c79ae279c00120 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.166206 32160 raft_consensus.cc:515] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } }
I20260709 13:11:36.168780 32160 leader_election.cc:290] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:36.170991 32159 raft_consensus.cc:493] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.169579 21390 tablet_replica.cc:333] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.171983 32159 raft_consensus.cc:515] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:36.173180 21390 raft_consensus.cc:2243] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.173758 21390 raft_consensus.cc:2272] T 6c75c9a447d34afbadebde99ab3d010b P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.174096 32159 leader_election.cc:290] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dec8ae7db1414dbea5acc7be7ffc9dfb (127.20.227.132:45991), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:36.175915 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1733f1f71041d8a04cc61010a93c40" candidate_uuid: "e0094be1075d460cafd5160946c09aed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" is_pre_election: true
W20260709 13:11:36.176159 31202 leader_election.cc:336] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:36.176945 31202 leader_election.cc:336] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.176699 31128 leader_election.cc:336] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.177399 31202 leader_election.cc:304] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.177870 21390 tablet_replica.cc:333] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.178167 32163 raft_consensus.cc:2749] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.178733 21390 raft_consensus.cc:2243] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:36.178925 31128 leader_election.cc:336] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.179371 21390 raft_consensus.cc:2272] T 8f3f639e54a041fdb1c2d051bed72073 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.179471 31128 leader_election.cc:304] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.180222 32159 raft_consensus.cc:2749] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.181690 32163 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.182149 21390 tablet_replica.cc:333] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
W20260709 13:11:36.182322 31128 leader_election.cc:336] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.182250 32163 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.182857 31128 leader_election.cc:304] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0094be1075d460cafd5160946c09aed; no voters: 116e6baff6234eadbc262b5fb70cfd5b, dec8ae7db1414dbea5acc7be7ffc9dfb
I20260709 13:11:36.183084 21390 raft_consensus.cc:2243] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.183519 32159 raft_consensus.cc:2749] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.183900 21390 raft_consensus.cc:2272] T 05c2897f341b4f1c8c3d2a7956814756 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.184481 32163 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:36.187294 21390 tablet_replica.cc:333] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.188143 21390 raft_consensus.cc:2243] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.188746 21390 raft_consensus.cc:2272] T b094ad0db83444268d00301854825ce5 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.191767 21390 tablet_replica.cc:333] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.192544 21390 raft_consensus.cc:2243] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.193526 21390 raft_consensus.cc:2272] T d19e2ee8edef4c659be9276658c65913 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.194265 31202 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:36.195021 31202 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.196188 21390 tablet_replica.cc:333] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.195410 31202 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.197203 21390 raft_consensus.cc:2243] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.197237 32165 raft_consensus.cc:2749] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.198474 21390 raft_consensus.cc:2272] T 4024d7ca443348189e2bce2cafeca403 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.201363 21390 tablet_replica.cc:333] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.202107 21390 raft_consensus.cc:2243] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.203080 21390 raft_consensus.cc:2272] T bb04a7b75afd4166aee199de5f812c01 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.205875 21390 tablet_replica.cc:333] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.206516 21390 raft_consensus.cc:2243] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.207087 21390 raft_consensus.cc:2272] T cb456ded01cd478bb026e7177d35b17c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.209003 21390 tablet_replica.cc:333] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.209537 21390 raft_consensus.cc:2243] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.209949 21390 raft_consensus.cc:2272] T 36995fac4a8745f1ae1c292c94f4f813 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.211838 21390 tablet_replica.cc:333] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.212432 32163 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.212466 21390 raft_consensus.cc:2243] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.213320 21390 raft_consensus.cc:2272] T 83e9c5f498864f4a9ef1dcf9e952e10c P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.213173 32163 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:36.215094 32163 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:36.215729 21390 tablet_replica.cc:333] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.216892 21390 raft_consensus.cc:2243] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.217834 21390 raft_consensus.cc:2272] T a348c59d23d847cd8e01296e609f0e8c P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.220575 21390 tablet_replica.cc:333] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.221343 21390 raft_consensus.cc:2243] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:36.221571 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.221894 21390 raft_consensus.cc:2272] T d463c852ffa846c0a6cabd5e29c4c32d P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.222632 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.223083 31202 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.223800 32163 raft_consensus.cc:2749] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:36.224680 21390 tablet_replica.cc:333] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.225386 21390 raft_consensus.cc:2243] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.225880 21390 raft_consensus.cc:2272] T 907cbf2380f64d5fb28bc0d5b47a0505 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.227772 21390 tablet_replica.cc:333] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.228329 21390 raft_consensus.cc:2243] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.228806 21390 raft_consensus.cc:2272] T 3f1997fc1c544e87afea39d3052e547a P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.231128 21390 tablet_replica.cc:333] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.231685 21390 raft_consensus.cc:2243] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.232131 21390 raft_consensus.cc:2272] T 10a49c820fa64c7bbd18b86ed3d16bb3 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.234287 21390 tablet_replica.cc:333] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.234810 21390 raft_consensus.cc:2243] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.235544 21390 raft_consensus.cc:2272] T 61b038abfe774f34a24e07139da4520b P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.237529 21390 tablet_replica.cc:333] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.238027 21390 raft_consensus.cc:2243] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.238780 21390 raft_consensus.cc:2272] T 15ad993bfbea46e0a43ffcb149c68de7 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.240687 21390 tablet_replica.cc:333] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.241268 21390 raft_consensus.cc:2243] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.241999 21390 raft_consensus.cc:2272] T 2d927c6d703d46e2b498aab379411581 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.243778 21390 tablet_replica.cc:333] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.244342 21390 raft_consensus.cc:2243] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.244769 21390 raft_consensus.cc:2272] T ec1733f1f71041d8a04cc61010a93c40 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.247051 21390 tablet_replica.cc:333] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.247570 21390 raft_consensus.cc:2243] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.247991 21390 raft_consensus.cc:2272] T 72c808b493dc45a290985c48d06f1dcb P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.250145 21390 tablet_replica.cc:333] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.250803 21390 raft_consensus.cc:2243] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.251241 21390 raft_consensus.cc:2272] T 32fc226fc7844c9096a579b3a8c05060 P e0094be1075d460cafd5160946c09aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.253697 21390 tablet_replica.cc:333] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed: stopping tablet replica
I20260709 13:11:36.254256 21390 raft_consensus.cc:2243] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:36.254997 21390 raft_consensus.cc:2272] T 8d55d9d82c1b4132bc6b1dfa24082de4 P e0094be1075d460cafd5160946c09aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.308977 32163 raft_consensus.cc:493] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.309616 32163 raft_consensus.cc:515] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:36.312969 32163 leader_election.cc:290] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:36.316104 31201 connection.cc:573] client connection to 127.20.227.131:45509 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:11:36.316649 31201 leader_election.cc:336] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:11:36.317776 31202 leader_election.cc:336] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.318290 31202 leader_election.cc:304] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.319666 32163 raft_consensus.cc:2749] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.366463 32162 raft_consensus.cc:493] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.367219 32162 raft_consensus.cc:515] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:36.370321 32162 leader_election.cc:290] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:36.373742 32162 raft_consensus.cc:493] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.374501 32162 raft_consensus.cc:515] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.376631 32162 leader_election.cc:290] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:36.377844 31201 leader_election.cc:336] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:36.378832 31202 leader_election.cc:336] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.379199 31202 leader_election.cc:304] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.379827 32162 raft_consensus.cc:2749] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:36.384070 31202 leader_election.cc:336] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:36.384961 31202 leader_election.cc:336] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.385389 31202 leader_election.cc:304] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.386031 32162 raft_consensus.cc:2749] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.429395 32162 raft_consensus.cc:493] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.429868 32162 raft_consensus.cc:515] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.431841 32162 leader_election.cc:290] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:36.436311 31202 leader_election.cc:336] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:36.437050 31202 leader_election.cc:336] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.437398 31202 leader_election.cc:304] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.438185 32162 raft_consensus.cc:2749] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.448058 32162 raft_consensus.cc:493] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.448665 32162 raft_consensus.cc:515] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.451099 32162 leader_election.cc:290] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:36.455045 31202 leader_election.cc:336] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.455768 31202 leader_election.cc:336] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.456228 31202 leader_election.cc:304] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.456979 32162 raft_consensus.cc:2749] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.488776 32162 raft_consensus.cc:493] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.489516 32162 raft_consensus.cc:515] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.491258 32162 leader_election.cc:290] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:36.495442 31202 leader_election.cc:336] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:36.496331 31202 leader_election.cc:336] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.496716 31202 leader_election.cc:304] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.497422 32162 raft_consensus.cc:2749] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.514403 32163 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:36.514925 32163 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:36.517005 32163 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:36.520910 31201 leader_election.cc:336] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:36.522379 31202 leader_election.cc:336] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.522790 31202 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.523391 32163 raft_consensus.cc:2749] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.614993 32162 raft_consensus.cc:493] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.615618 32162 raft_consensus.cc:515] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:36.617911 32162 leader_election.cc:290] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:36.621505 31202 leader_election.cc:336] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.622820 31201 leader_election.cc:336] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:36.623353 31201 leader_election.cc:304] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.624068 32162 raft_consensus.cc:2749] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.630057 32162 raft_consensus.cc:493] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.630511 32162 raft_consensus.cc:515] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:36.632298 32162 leader_election.cc:290] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:36.636011 31202 leader_election.cc:336] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.636680 31201 leader_election.cc:336] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:36.637228 31201 leader_election.cc:304] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.637789 32162 raft_consensus.cc:2749] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.705029 32162 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.705577 32162 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:36.707273 32163 raft_consensus.cc:493] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.707571 32162 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:36.707883 32163 raft_consensus.cc:515] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:36.710078 32163 leader_election.cc:290] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:36.711786 31202 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.713008 31202 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:36.713413 31202 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:36.714026 32163 raft_consensus.cc:2749] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:36.714224 31201 leader_election.cc:336] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:36.715512 31202 leader_election.cc:336] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.715833 31202 leader_election.cc:304] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.716377 32163 raft_consensus.cc:2749] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.839520 32162 raft_consensus.cc:493] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.840137 32162 raft_consensus.cc:515] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:36.842000 32162 leader_election.cc:290] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:36.845672 31202 leader_election.cc:336] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.846235 31201 leader_election.cc:336] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:36.846402 31183 debug-util.cc:398] Leaking SignalData structure 0x7b08001de920 after lost signal to thread 21393
I20260709 13:11:36.846691 31201 leader_election.cc:304] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.847396 32162 raft_consensus.cc:2749] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:36.847558 31183 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9160 after lost signal to thread 30945
W20260709 13:11:36.849551 31183 debug-util.cc:398] Leaking SignalData structure 0x7b08000150c0 after lost signal to thread 31260
I20260709 13:11:36.871058 32162 raft_consensus.cc:493] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.871655 32162 raft_consensus.cc:515] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:36.873715 32162 leader_election.cc:290] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:36.877761 31202 leader_election.cc:336] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:36.878322 31201 leader_election.cc:336] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:36.878754 31201 leader_election.cc:304] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.879436 32163 raft_consensus.cc:2749] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.895721 32163 raft_consensus.cc:493] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:36.896334 32163 raft_consensus.cc:515] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:36.898825 32163 leader_election.cc:290] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:36.902752 31201 leader_election.cc:336] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:36.903967 31202 leader_election.cc:336] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:36.904348 31202 leader_election.cc:304] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:36.905216 32163 raft_consensus.cc:2749] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:37.130836 32162 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.131492 32162 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:37.134528 32163 raft_consensus.cc:493] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.135116 32163 raft_consensus.cc:515] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:37.137916 32163 leader_election.cc:290] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
I20260709 13:11:37.134061 32162 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:37.138330 31201 leader_election.cc:336] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:37.139984 31202 leader_election.cc:336] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:37.140390 31202 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
W20260709 13:11:37.140674 31201 leader_election.cc:336] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:37.141187 32162 raft_consensus.cc:2749] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:37.142813 31202 leader_election.cc:336] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:37.143170 31202 leader_election.cc:304] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.143738 32162 raft_consensus.cc:2749] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:37.279129 31202 consensus_peers.cc:597] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:37.308459 32162 raft_consensus.cc:493] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.309136 32162 raft_consensus.cc:515] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:37.311712 32163 raft_consensus.cc:493] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.312259 32163 raft_consensus.cc:515] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:37.314383 32163 leader_election.cc:290] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:37.316998 32162 leader_election.cc:290] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:37.318604 31202 leader_election.cc:336] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:37.323482 31201 leader_election.cc:336] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:37.324146 31202 leader_election.cc:336] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:37.324304 31201 leader_election.cc:336] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:37.324576 31202 leader_election.cc:304] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.324981 31201 leader_election.cc:304] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.325562 32162 raft_consensus.cc:2749] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:37.325906 32170 raft_consensus.cc:2749] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:37.333025 21390 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 31183)
W20260709 13:11:37.346392 31202 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.502876 31202 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.506623 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:37.533368 32162 raft_consensus.cc:493] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.533903 32162 raft_consensus.cc:515] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:37.535022 32170 raft_consensus.cc:493] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.535614 32170 raft_consensus.cc:515] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:37.536233 32162 leader_election.cc:290] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
I20260709 13:11:37.537820 32170 leader_election.cc:290] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:37.541009 31202 leader_election.cc:336] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:37.541584 31202 leader_election.cc:336] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:37.542495 31201 leader_election.cc:336] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:37.542888 31201 leader_election.cc:304] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.543574 32170 raft_consensus.cc:2749] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:37.543717 31201 leader_election.cc:336] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:37.544234 31201 leader_election.cc:304] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.544991 32170 raft_consensus.cc:2749] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:37.552336 32170 raft_consensus.cc:493] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.552836 32170 raft_consensus.cc:515] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:37.554806 32170 leader_election.cc:290] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:37.558862 31202 leader_election.cc:336] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:37.559762 31201 leader_election.cc:336] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:37.560138 31201 leader_election.cc:304] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.560721 32170 raft_consensus.cc:2749] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:37.587924 32170 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.588443 32170 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:37.590351 32170 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:37.595244 31202 leader_election.cc:336] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:37.597589 31201 leader_election.cc:336] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:37.598073 31201 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.598964 32170 raft_consensus.cc:2749] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:37.627106 32170 raft_consensus.cc:493] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:37.627594 32170 raft_consensus.cc:515] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:37.629681 32170 leader_election.cc:290] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:37.634261 31201 leader_election.cc:336] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:37.635800 31202 leader_election.cc:336] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:37.636180 31202 leader_election.cc:304] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.636750 32170 raft_consensus.cc:2749] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:37.733783 31202 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.761540 31202 consensus_peers.cc:597] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:37.766813 32162 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:37.767437 32162 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:37.769555 32162 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:37.772912 31202 consensus_peers.cc:597] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.773300 31202 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:37.775540 31202 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:37.776048 31202 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:37.776777 32162 raft_consensus.cc:2749] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:37.777236 31202 consensus_peers.cc:597] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:37.800035 32162 raft_consensus.cc:493] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:37.800683 32162 raft_consensus.cc:515] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:37.805593 32162 leader_election.cc:290] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:37.807286 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.807422 31201 leader_election.cc:336] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:37.810004 31202 leader_election.cc:336] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:37.810386 31202 leader_election.cc:304] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:37.810967 32162 raft_consensus.cc:2749] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:37.849670 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.860482 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.864180 31202 consensus_peers.cc:597] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.907867 31202 consensus_peers.cc:597] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.943111 31202 consensus_peers.cc:597] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.947039 31202 consensus_peers.cc:597] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.948774 31202 consensus_peers.cc:597] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.970697 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.022208 31202 consensus_peers.cc:597] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.054970 32170 raft_consensus.cc:493] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:38.055619 32170 raft_consensus.cc:515] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.057945 32170 leader_election.cc:290] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:38.062043 31202 leader_election.cc:336] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.062610 31202 leader_election.cc:336] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.062938 31202 leader_election.cc:304] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.063516 32170 raft_consensus.cc:2749] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:38.090291 32170 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:38.090978 32170 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.093549 32162 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:38.093662 32170 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
I20260709 13:11:38.094156 32162 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.096694 32162 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:38.100373 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.101409 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.101845 31202 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.102560 32170 raft_consensus.cc:2749] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:38.105223 31202 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:38.106494 31202 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:38.107030 31202 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.107795 32170 raft_consensus.cc:2749] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:38.111387 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.134063 31202 consensus_peers.cc:597] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.160384 32170 raft_consensus.cc:493] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.161093 32170 raft_consensus.cc:515] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:38.163475 32170 leader_election.cc:290] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:38.167436 31202 leader_election.cc:336] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:38.168323 31201 leader_election.cc:336] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:38.168833 31201 leader_election.cc:304] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.169642 32170 raft_consensus.cc:2749] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:38.175915 32170 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:38.176431 32170 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:38.178323 32170 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:38.181941 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:38.182626 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:38.183084 31202 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.183666 32170 raft_consensus.cc:2749] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:38.222278 32170 raft_consensus.cc:493] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.222849 32170 raft_consensus.cc:515] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:38.224779 32170 leader_election.cc:290] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:38.229029 31201 leader_election.cc:336] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:38.229569 32170 raft_consensus.cc:493] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
W20260709 13:11:38.229604 31202 leader_election.cc:336] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.230449 31202 leader_election.cc:304] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.230353 32170 raft_consensus.cc:515] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.231436 32162 raft_consensus.cc:2749] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:38.232928 32170 leader_election.cc:290] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:38.233632 31201 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.238358 31202 leader_election.cc:336] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.239250 31202 leader_election.cc:336] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.239658 31202 leader_election.cc:304] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.240388 32170 raft_consensus.cc:2749] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:38.246767 31201 consensus_peers.cc:597] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.273121 32170 raft_consensus.cc:493] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:38.273722 32170 raft_consensus.cc:515] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:38.275605 32170 leader_election.cc:290] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:38.279870 31202 leader_election.cc:336] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.280567 31201 leader_election.cc:336] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:38.280999 31201 leader_election.cc:304] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.281708 32170 raft_consensus.cc:2749] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:38.298795 31201 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.330046 32162 raft_consensus.cc:493] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:38.330541 32162 raft_consensus.cc:515] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:38.332581 32162 leader_election.cc:290] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:38.333608 21390 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 31183)
I20260709 13:11:38.333444 32162 raft_consensus.cc:493] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.335167 32162 raft_consensus.cc:515] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
W20260709 13:11:38.337270 31201 leader_election.cc:336] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:38.337850 32162 leader_election.cc:290] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:38.339902 31201 consensus_peers.cc:597] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.341543 31202 leader_election.cc:336] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.342011 31201 leader_election.cc:336] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:38.342110 31202 leader_election.cc:304] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.343031 32162 raft_consensus.cc:2749] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:38.344813 31202 leader_election.cc:336] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.345285 31202 leader_election.cc:304] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.346071 32170 raft_consensus.cc:2749] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:38.350265 31201 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.386513 31201 consensus_peers.cc:597] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.404973 32170 raft_consensus.cc:493] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:38.405624 32170 raft_consensus.cc:515] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.407429 32170 leader_election.cc:290] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:38.410696 31202 leader_election.cc:336] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.417872 31202 leader_election.cc:336] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.418274 31202 leader_election.cc:304] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.418916 32170 raft_consensus.cc:2749] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:38.420940 32162 raft_consensus.cc:493] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.421432 32162 raft_consensus.cc:515] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.423467 32162 leader_election.cc:290] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:38.426698 31201 consensus_peers.cc:597] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.428068 31202 leader_election.cc:336] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.428704 31202 leader_election.cc:336] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.429060 31202 leader_election.cc:304] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.429648 32162 raft_consensus.cc:2749] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:38.455863 31201 consensus_peers.cc:597] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.470701 32162 raft_consensus.cc:493] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.471328 32162 raft_consensus.cc:515] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.473426 32162 leader_election.cc:290] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:38.479342 31202 leader_election.cc:336] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:38.480268 31202 leader_election.cc:336] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:38.480612 31202 leader_election.cc:304] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.481273 32170 raft_consensus.cc:2749] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:38.499938 31201 consensus_peers.cc:597] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.526564 32170 raft_consensus.cc:493] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.527273 32170 raft_consensus.cc:515] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:38.529713 32170 leader_election.cc:290] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:38.534368 31201 leader_election.cc:336] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:38.534951 31202 leader_election.cc:336] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.535429 31202 leader_election.cc:304] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.536191 32170 raft_consensus.cc:2749] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:38.576448 32170 raft_consensus.cc:493] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.577009 32170 raft_consensus.cc:515] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:38.578943 32170 leader_election.cc:290] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:38.582566 31202 leader_election.cc:336] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:38.583348 31201 leader_election.cc:336] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:38.583712 31201 leader_election.cc:304] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.584267 32170 raft_consensus.cc:2749] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:38.628610 32162 raft_consensus.cc:493] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.629163 32162 raft_consensus.cc:515] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:38.631300 32162 leader_election.cc:290] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:38.635957 31202 leader_election.cc:336] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:38.636616 31201 leader_election.cc:336] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:38.637146 31201 leader_election.cc:304] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.637956 32162 raft_consensus.cc:2749] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:38.663642 32162 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:38.664225 32162 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:38.666172 32162 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:38.669874 31202 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:38.670619 31202 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:38.670933 31202 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:38.671494 32162 raft_consensus.cc:2749] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:38.712987 31201 consensus_peers.cc:597] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.802284 32170 raft_consensus.cc:493] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:38.802929 32170 raft_consensus.cc:515] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:38.805486 32170 leader_election.cc:290] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:38.809473 31201 leader_election.cc:336] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:38.810022 31202 leader_election.cc:336] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:38.810379 31202 leader_election.cc:304] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:38.810997 32170 raft_consensus.cc:2749] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:39.054809 32170 raft_consensus.cc:493] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:39.055335 32170 raft_consensus.cc:515] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:39.057197 32170 leader_election.cc:290] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:39.061048 31202 leader_election.cc:336] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:39.062779 31201 leader_election.cc:336] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:39.063161 31201 leader_election.cc:304] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.063781 32170 raft_consensus.cc:2749] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:39.158488 32170 raft_consensus.cc:493] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:39.159040 32170 raft_consensus.cc:515] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:39.160840 32170 leader_election.cc:290] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:39.164443 31202 leader_election.cc:336] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:39.165369 31201 leader_election.cc:336] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:39.165840 31201 leader_election.cc:304] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.166637 32170 raft_consensus.cc:2749] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:39.266669 32173 raft_consensus.cc:493] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:39.267310 32173 raft_consensus.cc:515] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:39.269124 32173 leader_election.cc:290] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:39.273205 31202 leader_election.cc:336] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:39.273732 31201 leader_election.cc:336] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:39.274204 31201 leader_election.cc:304] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.274838 32170 raft_consensus.cc:2749] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:39.302983 32170 raft_consensus.cc:493] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:39.303580 32170 raft_consensus.cc:515] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:39.305572 32170 leader_election.cc:290] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:39.310518 31201 leader_election.cc:336] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:39.311317 31202 leader_election.cc:336] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:39.311717 31202 leader_election.cc:304] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.312355 32170 raft_consensus.cc:2749] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:39.333912 32170 raft_consensus.cc:493] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
W20260709 13:11:39.334128 21390 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 31183)
I20260709 13:11:39.334614 32170 raft_consensus.cc:515] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:39.337108 32170 leader_election.cc:290] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:39.342545 31202 leader_election.cc:336] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:39.343024 31201 leader_election.cc:336] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
I20260709 13:11:39.343484 31201 leader_election.cc:304] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.344790 32170 raft_consensus.cc:2749] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:39.376032 32170 raft_consensus.cc:493] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:39.376657 32170 raft_consensus.cc:515] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:39.379117 32170 leader_election.cc:290] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:39.385234 31201 leader_election.cc:336] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:39.386758 31202 leader_election.cc:336] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:39.387233 31202 leader_election.cc:304] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.388592 32170 raft_consensus.cc:2749] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:39.479606 32170 raft_consensus.cc:493] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:39.480803 32170 raft_consensus.cc:515] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:39.485186 32170 leader_election.cc:290] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:39.488703 31202 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:39.489691 31202 leader_election.cc:336] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:39.490090 31202 leader_election.cc:304] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:39.490769 32170 raft_consensus.cc:2749] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:39.699036 32174 raft_consensus.cc:493] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:39.699538 32174 raft_consensus.cc:515] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:39.701297 32174 leader_election.cc:290] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:39.706169 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:39.707372 31202 leader_election.cc:336] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:39.707875 31202 leader_election.cc:304] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:39.708706 32174 raft_consensus.cc:2749] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:39.727589 32174 raft_consensus.cc:493] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:39.728247 32174 raft_consensus.cc:515] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:39.730856 32174 leader_election.cc:290] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:39.734447 31201 leader_election.cc:336] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:39.735699 31202 leader_election.cc:336] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:39.736321 31202 leader_election.cc:304] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.737192 32174 raft_consensus.cc:2749] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:39.767145 31202 consensus_peers.cc:597] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:39.780850 32170 raft_consensus.cc:493] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:39.781519 32170 raft_consensus.cc:515] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:39.783252 32170 leader_election.cc:290] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:39.787508 31201 leader_election.cc:336] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:39.788095 31202 leader_election.cc:336] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:39.788445 31202 leader_election.cc:304] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.789067 32170 raft_consensus.cc:2749] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:39.798146 32170 raft_consensus.cc:493] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:39.798797 32170 raft_consensus.cc:515] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:39.801620 32170 leader_election.cc:290] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:39.805708 31202 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:39.806619 31202 leader_election.cc:336] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:39.807044 31202 leader_election.cc:304] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:39.807739 32170 raft_consensus.cc:2749] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:39.826093 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:39.846887 31202 consensus_peers.cc:597] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:39.851408 31202 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111) [suppressed 454 similar messages]
I20260709 13:11:39.887014 32170 raft_consensus.cc:493] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0094be1075d460cafd5160946c09aed)
I20260709 13:11:39.887554 32170 raft_consensus.cc:515] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } }
I20260709 13:11:39.889704 32170 leader_election.cc:290] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0094be1075d460cafd5160946c09aed (127.20.227.131:45509), 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611)
W20260709 13:11:39.893389 31201 leader_election.cc:336] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:39.893965 31202 leader_election.cc:336] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:39.894299 31202 leader_election.cc:304] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, e0094be1075d460cafd5160946c09aed
I20260709 13:11:39.894908 32170 raft_consensus.cc:2749] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:39.926489 32170 raft_consensus.cc:493] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:39.927042 32170 raft_consensus.cc:515] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:39.928917 32170 leader_election.cc:290] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:39.934289 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
W20260709 13:11:39.935007 31202 leader_election.cc:336] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
I20260709 13:11:39.935474 31202 leader_election.cc:304] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:39.936309 32170 raft_consensus.cc:2749] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:39.986030 32170 raft_consensus.cc:493] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:39.987488 32170 raft_consensus.cc:515] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:39.989195 32170 leader_election.cc:290] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:39.993220 31202 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:39.993614 31202 leader_election.cc:336] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:39.994143 31202 leader_election.cc:336] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:39.994457 31202 leader_election.cc:304] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:39.995003 32170 raft_consensus.cc:2749] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:40.057724 32170 raft_consensus.cc:493] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:40.058223 32170 raft_consensus.cc:515] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:40.059942 32170 leader_election.cc:290] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:40.064276 31202 leader_election.cc:336] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:40.065120 31202 leader_election.cc:336] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.065562 31202 leader_election.cc:304] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:40.066305 32170 raft_consensus.cc:2749] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:40.158423 32170 raft_consensus.cc:493] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:40.158964 32170 raft_consensus.cc:515] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:40.160619 32170 leader_election.cc:290] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:40.164337 31202 leader_election.cc:336] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:40.165153 31202 leader_election.cc:336] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.165578 31202 leader_election.cc:304] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:40.166323 32170 raft_consensus.cc:2749] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:40.177197 32170 raft_consensus.cc:493] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:40.177729 32170 raft_consensus.cc:515] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:40.179687 32170 leader_election.cc:290] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:40.183408 31201 leader_election.cc:336] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:40.183938 31202 leader_election.cc:336] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.184384 31202 leader_election.cc:304] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:40.185263 32170 raft_consensus.cc:2749] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:40.210382 32170 raft_consensus.cc:493] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:40.210973 32170 raft_consensus.cc:515] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:40.212472 32170 leader_election.cc:290] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:40.217072 31202 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:40.217851 31202 leader_election.cc:336] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.218293 31202 leader_election.cc:304] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:40.219002 32170 raft_consensus.cc:2749] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:40.225816 31202 consensus_peers.cc:597] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.258787 32170 raft_consensus.cc:493] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116e6baff6234eadbc262b5fb70cfd5b)
I20260709 13:11:40.259266 32170 raft_consensus.cc:515] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } } peers { permanent_uuid: "116e6baff6234eadbc262b5fb70cfd5b" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 36611 } } peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } }
I20260709 13:11:40.260871 32170 leader_election.cc:290] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611), 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997)
W20260709 13:11:40.265075 31202 leader_election.cc:336] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111)
W20260709 13:11:40.267277 31202 leader_election.cc:336] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.267849 31202 leader_election.cc:304] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 116e6baff6234eadbc262b5fb70cfd5b, 13bb23988f5940e5ba175699ca30e0d6
I20260709 13:11:40.268673 32174 raft_consensus.cc:2749] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:40.271510 31202 consensus_peers.cc:597] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.273298 31202 consensus_peers.cc:597] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.286379 31202 consensus_peers.cc:597] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.306075 32174 raft_consensus.cc:493] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:40.306720 32174 raft_consensus.cc:515] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:40.309135 32174 leader_election.cc:290] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:40.313373 31201 leader_election.cc:336] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:40.313941 31202 leader_election.cc:336] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.314288 31202 leader_election.cc:304] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:40.314977 32174 raft_consensus.cc:2749] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:40.334810 21390 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 31183)
W20260709 13:11:40.355188 31202 consensus_peers.cc:597] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.371356 31202 consensus_peers.cc:597] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.404498 31202 consensus_peers.cc:597] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.419164 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.424531 31202 consensus_peers.cc:597] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.445678 32174 raft_consensus.cc:493] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:40.446195 32174 raft_consensus.cc:515] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:40.448063 32174 leader_election.cc:290] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:40.451762 31201 leader_election.cc:336] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:40.452423 31202 leader_election.cc:336] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.452935 31202 leader_election.cc:304] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:40.453531 32174 raft_consensus.cc:2749] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:40.454237 32170 raft_consensus.cc:493] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 13bb23988f5940e5ba175699ca30e0d6)
I20260709 13:11:40.454895 32170 raft_consensus.cc:515] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13bb23988f5940e5ba175699ca30e0d6" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37997 } } peers { permanent_uuid: "e0094be1075d460cafd5160946c09aed" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 45509 } } peers { permanent_uuid: "dec8ae7db1414dbea5acc7be7ffc9dfb" member_type: VOTER last_known_addr { host: "127.20.227.132" port: 45991 } }
I20260709 13:11:40.457080 32170 leader_election.cc:290] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997), e0094be1075d460cafd5160946c09aed (127.20.227.131:45509)
W20260709 13:11:40.461205 31201 leader_election.cc:336] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111)
W20260709 13:11:40.461886 31202 leader_election.cc:336] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111)
I20260709 13:11:40.462272 31202 leader_election.cc:304] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dec8ae7db1414dbea5acc7be7ffc9dfb; no voters: 13bb23988f5940e5ba175699ca30e0d6, e0094be1075d460cafd5160946c09aed
I20260709 13:11:40.462895 32170 raft_consensus.cc:2749] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:40.509403 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.545332 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
W20260709 13:11:40.569756 31202 consensus_peers.cc:597] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.590992 31202 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 116e6baff6234eadbc262b5fb70cfd5b (127.20.227.129:36611): Couldn't send request to peer 116e6baff6234eadbc262b5fb70cfd5b. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:36611: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.602147 31201 consensus_peers.cc:597] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.611744 31202 consensus_peers.cc:597] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.629995 21390 tablet_server.cc:179] TabletServer@127.20.227.132:0 shutting down...
W20260709 13:11:40.660347 31202 consensus_peers.cc:597] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.669081 31201 consensus_peers.cc:597] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.678685 31201 consensus_peers.cc:597] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer e0094be1075d460cafd5160946c09aed (127.20.227.131:45509): Couldn't send request to peer e0094be1075d460cafd5160946c09aed. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.131:45509: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.691524 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:40.692536 21390 tablet_replica.cc:333] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.693470 21390 raft_consensus.cc:2243] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.694525 21390 raft_consensus.cc:2272] T ecda26a7c7224e67bdad8915bf964ca0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.697468 21390 tablet_replica.cc:333] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.698302 21390 raft_consensus.cc:2243] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.699304 21390 raft_consensus.cc:2272] T 6ccfbc32da67458799cc341fb3277d37 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.702286 21390 tablet_replica.cc:333] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.703136 21390 raft_consensus.cc:2243] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.703723 21390 raft_consensus.cc:2272] T b140d661f41949f9b1fd260999e50999 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.706575 21390 tablet_replica.cc:333] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.707365 21390 raft_consensus.cc:2243] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.708353 21390 raft_consensus.cc:2272] T 1785d313b1f24abb861e4028d92c4bcb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.710954 21390 tablet_replica.cc:333] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.711467 21390 raft_consensus.cc:2243] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.712028 21390 raft_consensus.cc:2272] T a281d1ba3bb943d39ecfbb7aa5310350 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.714020 21390 tablet_replica.cc:333] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.714571 21390 raft_consensus.cc:2243] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.714943 21390 raft_consensus.cc:2272] T f2f82c954e654c919b31a5619dae274b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.716676 21390 tablet_replica.cc:333] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.717260 21390 raft_consensus.cc:2243] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.717629 21390 raft_consensus.cc:2272] T 078186d5ab1e4886903ffb8cd15f46d9 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.719404 21390 tablet_replica.cc:333] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.719919 21390 raft_consensus.cc:2243] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.720289 21390 raft_consensus.cc:2272] T fa0ff9b94c054250a66182155d62b0fc P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.722266 21390 tablet_replica.cc:333] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.722800 21390 raft_consensus.cc:2243] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.723161 21390 raft_consensus.cc:2272] T 4ff5428cc42d4f7281ae35788233dee8 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.725113 21390 tablet_replica.cc:333] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.725622 21390 raft_consensus.cc:2243] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.726390 21390 raft_consensus.cc:2272] T 199428020b7342f1b3d816182baa55e4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.728261 21390 tablet_replica.cc:333] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.728770 21390 raft_consensus.cc:2243] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.729573 21390 raft_consensus.cc:2272] T 915f9be628344ac09e3d93a385ebbfdb P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.731467 21390 tablet_replica.cc:333] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.731966 21390 raft_consensus.cc:2243] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.732344 21390 raft_consensus.cc:2272] T 7aa32971139947f1a694bda08ee6848d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.734344 21390 tablet_replica.cc:333] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.734930 21390 raft_consensus.cc:2243] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.735414 21390 raft_consensus.cc:2272] T c5496455d6ea451dadd260868b97d356 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.738101 21390 tablet_replica.cc:333] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.738852 21390 raft_consensus.cc:2243] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.739699 21390 raft_consensus.cc:2272] T 0ca5c8e4b4b9485a8be8282fb6372669 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.741808 21390 tablet_replica.cc:333] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.742375 21390 raft_consensus.cc:2243] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.742969 21390 raft_consensus.cc:2272] T aab6881f32b9471485c79ae279c00120 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.745095 21390 tablet_replica.cc:333] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.745647 21390 raft_consensus.cc:2243] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.746413 21390 raft_consensus.cc:2272] T 05c2897f341b4f1c8c3d2a7956814756 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.748981 21390 tablet_replica.cc:333] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.749701 21390 raft_consensus.cc:2243] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.750144 21390 raft_consensus.cc:2272] T 6c75c9a447d34afbadebde99ab3d010b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.751755 31202 consensus_peers.cc:597] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb -> Peer 13bb23988f5940e5ba175699ca30e0d6 (127.20.227.130:37997): Couldn't send request to peer 13bb23988f5940e5ba175699ca30e0d6. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.752719 21390 tablet_replica.cc:333] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.753608 21390 raft_consensus.cc:2243] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.754495 21390 raft_consensus.cc:2272] T 8f3f639e54a041fdb1c2d051bed72073 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.757078 21390 tablet_replica.cc:333] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.757681 21390 raft_consensus.cc:2243] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.758096 21390 raft_consensus.cc:2272] T e1064b7411424cda96d26036597d7585 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.759877 21390 tablet_replica.cc:333] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.760402 21390 raft_consensus.cc:2243] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.760800 21390 raft_consensus.cc:2272] T 4024d7ca443348189e2bce2cafeca403 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.762701 21390 tablet_replica.cc:333] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.763186 21390 raft_consensus.cc:2243] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.763540 21390 raft_consensus.cc:2272] T bb04a7b75afd4166aee199de5f812c01 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.765379 21390 tablet_replica.cc:333] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.765894 21390 raft_consensus.cc:2243] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.766266 21390 raft_consensus.cc:2272] T a09ce39cf2764cd2b2f8457b146e657d P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.768090 21390 tablet_replica.cc:333] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.768621 21390 raft_consensus.cc:2243] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.769073 21390 raft_consensus.cc:2272] T ba4b31ab53d447b3ab5bd993b7c992bf P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.770910 21390 tablet_replica.cc:333] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.771416 21390 raft_consensus.cc:2243] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.771778 21390 raft_consensus.cc:2272] T 76957cc6f9014c59b535bb48b9ff4b79 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.773499 21390 tablet_replica.cc:333] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.774240 21390 raft_consensus.cc:2243] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.774639 21390 raft_consensus.cc:2272] T cfc60351fa2144dda7548a307178a27b P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.776481 21390 tablet_replica.cc:333] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.777089 21390 raft_consensus.cc:2243] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.777951 21390 raft_consensus.cc:2272] T 35e351de7e26472fa16a05408cd1bef6 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.779848 21390 tablet_replica.cc:333] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.780414 21390 raft_consensus.cc:2243] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.781224 21390 raft_consensus.cc:2272] T 36995fac4a8745f1ae1c292c94f4f813 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.783018 21390 tablet_replica.cc:333] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.783563 21390 raft_consensus.cc:2243] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.784277 21390 raft_consensus.cc:2272] T cb456ded01cd478bb026e7177d35b17c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.786240 21390 tablet_replica.cc:333] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.786768 21390 raft_consensus.cc:2243] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.787509 21390 raft_consensus.cc:2272] T b094ad0db83444268d00301854825ce5 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.789418 21390 tablet_replica.cc:333] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.789968 21390 raft_consensus.cc:2243] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.790390 21390 raft_consensus.cc:2272] T 3f1997fc1c544e87afea39d3052e547a P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.792325 21390 tablet_replica.cc:333] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.793010 21390 raft_consensus.cc:2243] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.793426 21390 raft_consensus.cc:2272] T 77215be4400643a880f8163084e38aee P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.795254 21390 tablet_replica.cc:333] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.795833 21390 raft_consensus.cc:2243] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.796262 21390 raft_consensus.cc:2272] T 10a49c820fa64c7bbd18b86ed3d16bb3 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.798163 21390 tablet_replica.cc:333] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.798704 21390 raft_consensus.cc:2243] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.799489 21390 raft_consensus.cc:2272] T 79f63569bde3451593d530f6be062a16 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.801575 21390 tablet_replica.cc:333] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.802106 21390 raft_consensus.cc:2243] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.802871 21390 raft_consensus.cc:2272] T b86383b831804250835ad3b3d8f3f44c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.805040 21390 tablet_replica.cc:333] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.805572 21390 raft_consensus.cc:2243] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.805997 21390 raft_consensus.cc:2272] T ec1733f1f71041d8a04cc61010a93c40 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.808056 21390 tablet_replica.cc:333] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.808575 21390 raft_consensus.cc:2243] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.809042 21390 raft_consensus.cc:2272] T 76022e8458f3433295d3ed60bf4abb60 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.810928 21390 tablet_replica.cc:333] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.811450 21390 raft_consensus.cc:2243] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.811880 21390 raft_consensus.cc:2272] T 8d55d9d82c1b4132bc6b1dfa24082de4 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.813699 21390 tablet_replica.cc:333] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.814203 21390 raft_consensus.cc:2243] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.814608 21390 raft_consensus.cc:2272] T e03e12bc43e64de9b904105f3a74f98e P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.816414 21390 tablet_replica.cc:333] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.817068 21390 raft_consensus.cc:2243] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.817476 21390 raft_consensus.cc:2272] T 6fbb400d6df043169f05f3dac26057e0 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.819252 21390 tablet_replica.cc:333] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.819772 21390 raft_consensus.cc:2243] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.820207 21390 raft_consensus.cc:2272] T 591d8edfc1be4d78be4cab40b1e156cd P dec8ae7db1414dbea5acc7be7ffc9dfb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.822008 21390 tablet_replica.cc:333] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.822495 21390 raft_consensus.cc:2243] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.822906 21390 raft_consensus.cc:2272] T 2d927c6d703d46e2b498aab379411581 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.824699 21390 tablet_replica.cc:333] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.825210 21390 raft_consensus.cc:2243] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.825654 21390 raft_consensus.cc:2272] T be55665ac28642f4b97c7716efcb8e47 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.827509 21390 tablet_replica.cc:333] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.827979 21390 raft_consensus.cc:2243] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.828742 21390 raft_consensus.cc:2272] T e6ac6de9f3474deaa670077135f894f7 P dec8ae7db1414dbea5acc7be7ffc9dfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.830590 21390 tablet_replica.cc:333] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb: stopping tablet replica
I20260709 13:11:40.831089 21390 raft_consensus.cc:2243] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.831511 21390 raft_consensus.cc:2272] T a348c59d23d847cd8e01296e609f0e8c P dec8ae7db1414dbea5acc7be7ffc9dfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.898484 21390 tablet_server.cc:196] TabletServer@127.20.227.132:0 shutdown complete.
I20260709 13:11:40.964488 21390 master.cc:562] Master@127.20.227.190:43499 shutting down...
I20260709 13:11:40.994176 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.994781 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.995121 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0746e06264bc46e0b368986ee35b6398: stopping tablet replica
I20260709 13:11:41.043346 21390 master.cc:584] Master@127.20.227.190:43499 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36977 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:11:41.136826 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:35793
I20260709 13:11:41.138124 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:41.144709 32175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:41.145222 32176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:41.146311 32178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:41.146932 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:41.148020 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:41.148283 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:41.148428 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602701148413 us; error 0 us; skew 500 ppm
I20260709 13:11:41.149068 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:41.151820 21390 webserver.cc:533] Webserver started at http://127.20.227.190:40945/ using document root <none> and password file <none>
I20260709 13:11:41.152383 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:41.152567 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:41.152913 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:41.154129 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "f0edec0ffdb149258ebbac27d3f9478d"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.159238 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:41.163280 32183 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.164294 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:11:41.164624 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "f0edec0ffdb149258ebbac27d3f9478d"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.164950 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:41.177819 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:41.179061 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:41.220467 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:35793
I20260709 13:11:41.220568 32234 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:35793 every 8 connection(s)
I20260709 13:11:41.224896 32235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.236689 32235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d: Bootstrap starting.
I20260709 13:11:41.241978 32235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.246436 32235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d: No bootstrap required, opened a new log
I20260709 13:11:41.248876 32235 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0edec0ffdb149258ebbac27d3f9478d" member_type: VOTER }
I20260709 13:11:41.249282 32235 raft_consensus.cc:385] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:41.249545 32235 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0edec0ffdb149258ebbac27d3f9478d, State: Initialized, Role: FOLLOWER
I20260709 13:11:41.250211 32235 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0edec0ffdb149258ebbac27d3f9478d" member_type: VOTER }
I20260709 13:11:41.250684 32235 raft_consensus.cc:399] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:41.250891 32235 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:41.251137 32235 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:41.255995 32235 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0edec0ffdb149258ebbac27d3f9478d" member_type: VOTER }
I20260709 13:11:41.256613 32235 leader_election.cc:304] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0edec0ffdb149258ebbac27d3f9478d; no voters: 
I20260709 13:11:41.257897 32235 leader_election.cc:290] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:41.258463 32238 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:41.260048 32238 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 1 LEADER]: Becoming Leader. State: Replica: f0edec0ffdb149258ebbac27d3f9478d, State: Running, Role: LEADER
I20260709 13:11:41.260969 32235 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:41.260814 32238 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0edec0ffdb149258ebbac27d3f9478d" member_type: VOTER }
I20260709 13:11:41.265781 32240 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0edec0ffdb149258ebbac27d3f9478d. Latest consensus state: current_term: 1 leader_uuid: "f0edec0ffdb149258ebbac27d3f9478d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0edec0ffdb149258ebbac27d3f9478d" member_type: VOTER } }
I20260709 13:11:41.266501 32240 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:41.266968 32239 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0edec0ffdb149258ebbac27d3f9478d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0edec0ffdb149258ebbac27d3f9478d" member_type: VOTER } }
I20260709 13:11:41.267908 32239 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:41.271013 32247 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:41.279668 32247 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:41.280679 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:41.289806 32247 catalog_manager.cc:1383] Generated new cluster ID: 870875590c57482587007bf04e61eb9c
I20260709 13:11:41.290160 32247 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:41.324770 32247 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:41.326143 32247 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:41.342466 32247 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d: Generated new TSK 0
I20260709 13:11:41.343137 32247 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:41.347833 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:41.355002 32256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:41.356838 32257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:41.358891 21390 server_base.cc:1061] running on GCE node
W20260709 13:11:41.358857 32259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:41.360715 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:41.361002 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:41.361135 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602701361123 us; error 0 us; skew 500 ppm
I20260709 13:11:41.361632 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:41.364307 21390 webserver.cc:533] Webserver started at http://127.20.227.129:46771/ using document root <none> and password file <none>
I20260709 13:11:41.364794 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:41.365023 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:41.365262 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:41.366380 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "832164ed3f67429e9b6b55f10cab1e19"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.371480 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:41.375579 32264 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.376601 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:11:41.377202 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "832164ed3f67429e9b6b55f10cab1e19"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.377517 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:41.400703 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:41.402616 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:41.404201 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:41.406813 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:41.407054 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.407311 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:41.407536 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.452811 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:34247
I20260709 13:11:41.453037 32326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:34247 every 8 connection(s)
I20260709 13:11:41.458216 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:41.465950 32331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:41.466111 32332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:41.469561 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:41.470975 32327 heartbeater.cc:344] Connected to a master server at 127.20.227.190:35793
W20260709 13:11:41.470976 32335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:41.471494 32327 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:41.472271 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:41.472545 32327 heartbeater.cc:507] Master 127.20.227.190:35793 requested a full tablet report, sending...
W20260709 13:11:41.472587 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:41.473012 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602701472993 us; error 0 us; skew 500 ppm
I20260709 13:11:41.473855 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:41.475441 32200 ts_manager.cc:194] Registered new tserver with Master: 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247)
I20260709 13:11:41.477144 21390 webserver.cc:533] Webserver started at http://127.20.227.130:40193/ using document root <none> and password file <none>
I20260709 13:11:41.477648 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:41.477627 32200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43338
I20260709 13:11:41.478034 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:41.478331 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:41.479516 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "cc71c80513f5482cbdebb30e26a1b036"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.484160 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:41.487866 32339 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.488694 21390 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:41.489022 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "cc71c80513f5482cbdebb30e26a1b036"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.489315 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:41.521776 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:41.523049 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:41.524574 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:41.526997 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:41.527231 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.527477 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:41.527643 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.573745 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:37683
I20260709 13:11:41.574041 32401 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:37683 every 8 connection(s)
I20260709 13:11:41.578691 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:41.587064 32406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:41.587342 32405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:41.591958 21390 server_base.cc:1061] running on GCE node
W20260709 13:11:41.591913 32408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:41.593433 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:41.593700 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:41.593899 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602701593881 us; error 0 us; skew 500 ppm
I20260709 13:11:41.593920 32402 heartbeater.cc:344] Connected to a master server at 127.20.227.190:35793
I20260709 13:11:41.594442 32402 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:41.594584 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:41.595314 32402 heartbeater.cc:507] Master 127.20.227.190:35793 requested a full tablet report, sending...
I20260709 13:11:41.597575 21390 webserver.cc:533] Webserver started at http://127.20.227.131:34601/ using document root <none> and password file <none>
I20260709 13:11:41.597908 32200 ts_manager.cc:194] Registered new tserver with Master: cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:41.598207 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:41.598510 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:41.598781 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:41.599517 32200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43352
I20260709 13:11:41.600078 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "94a77032aa8a4a30b2990dee8acfaca3"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.605198 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:11:41.609262 32413 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.610289 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:41.610672 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "94a77032aa8a4a30b2990dee8acfaca3"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:41.611080 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:41.631870 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:41.633318 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:41.635228 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:41.637768 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:41.637971 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.638249 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:41.638463 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:41.735800 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:33985
I20260709 13:11:41.735916 32476 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:33985 every 8 connection(s)
I20260709 13:11:41.756610 32477 heartbeater.cc:344] Connected to a master server at 127.20.227.190:35793
I20260709 13:11:41.757063 32477 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:41.758071 32477 heartbeater.cc:507] Master 127.20.227.190:35793 requested a full tablet report, sending...
I20260709 13:11:41.761010 32200 ts_manager.cc:194] Registered new tserver with Master: 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:41.761354 21390 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020320036s
I20260709 13:11:41.763286 32200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43368
I20260709 13:11:41.793777 32200 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43382:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:41.797480 32200 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:41.884073 32367 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffb3af1bd274ab8a6cda32a41ecced3 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:41.885453 32364 tablet_service.cc:1511] Processing CreateTablet for tablet ffa187132503479db4b2c3e326e75550 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:41.886148 32367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffb3af1bd274ab8a6cda32a41ecced3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.887188 32364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa187132503479db4b2c3e326e75550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.887745 32365 tablet_service.cc:1511] Processing CreateTablet for tablet 95aa329ca8824a98ad9b655cc38d6f32 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:41.889424 32365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95aa329ca8824a98ad9b655cc38d6f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.889051 32366 tablet_service.cc:1511] Processing CreateTablet for tablet 8f575d45c8cf493da4bd68e56b8fb765 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:41.890623 32366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f575d45c8cf493da4bd68e56b8fb765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.891517 32363 tablet_service.cc:1511] Processing CreateTablet for tablet 1a20f668b5454d68b790e14540ed7286 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:41.893107 32363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a20f668b5454d68b790e14540ed7286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.899590 32362 tablet_service.cc:1511] Processing CreateTablet for tablet 509f9202219c4863a5ab7d2db1a31400 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:41.901538 32362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f9202219c4863a5ab7d2db1a31400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.914885 32361 tablet_service.cc:1511] Processing CreateTablet for tablet 729640c1a04e414f80ba63e6e185718d (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:41.919445 32361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729640c1a04e414f80ba63e6e185718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.934319 32360 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca5cf4a68f349019aabcf63baf5f72e (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:41.935972 32360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca5cf4a68f349019aabcf63baf5f72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.943600 32292 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffb3af1bd274ab8a6cda32a41ecced3 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:41.945264 32492 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:41.946341 32291 tablet_service.cc:1511] Processing CreateTablet for tablet 8f575d45c8cf493da4bd68e56b8fb765 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:41.948087 32291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f575d45c8cf493da4bd68e56b8fb765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.950105 32442 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffb3af1bd274ab8a6cda32a41ecced3 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:41.950796 32359 tablet_service.cc:1511] Processing CreateTablet for tablet d2ec8e9c59a94bc999b69215e72dd3e5 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:41.951426 32289 tablet_service.cc:1511] Processing CreateTablet for tablet ffa187132503479db4b2c3e326e75550 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:41.952318 32359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ec8e9c59a94bc999b69215e72dd3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.950133 32290 tablet_service.cc:1511] Processing CreateTablet for tablet 95aa329ca8824a98ad9b655cc38d6f32 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:41.954247 32288 tablet_service.cc:1511] Processing CreateTablet for tablet 1a20f668b5454d68b790e14540ed7286 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:41.957382 32287 tablet_service.cc:1511] Processing CreateTablet for tablet 509f9202219c4863a5ab7d2db1a31400 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:41.960310 32286 tablet_service.cc:1511] Processing CreateTablet for tablet 729640c1a04e414f80ba63e6e185718d (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:41.963099 32492 tablet_bootstrap.cc:654] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:41.964035 32285 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca5cf4a68f349019aabcf63baf5f72e (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:41.966302 32284 tablet_service.cc:1511] Processing CreateTablet for tablet d2ec8e9c59a94bc999b69215e72dd3e5 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:41.951875 32442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffb3af1bd274ab8a6cda32a41ecced3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.967880 32441 tablet_service.cc:1511] Processing CreateTablet for tablet 8f575d45c8cf493da4bd68e56b8fb765 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:41.984335 32441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f575d45c8cf493da4bd68e56b8fb765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.969612 32440 tablet_service.cc:1511] Processing CreateTablet for tablet 95aa329ca8824a98ad9b655cc38d6f32 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:41.989068 32440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95aa329ca8824a98ad9b655cc38d6f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.971401 32439 tablet_service.cc:1511] Processing CreateTablet for tablet ffa187132503479db4b2c3e326e75550 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:41.992646 32439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa187132503479db4b2c3e326e75550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.972507 32283 tablet_service.cc:1511] Processing CreateTablet for tablet a0b1118f0289484c9b711321d835a5b6 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:41.973748 32438 tablet_service.cc:1511] Processing CreateTablet for tablet 1a20f668b5454d68b790e14540ed7286 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:41.999931 32438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a20f668b5454d68b790e14540ed7286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.975155 32437 tablet_service.cc:1511] Processing CreateTablet for tablet 509f9202219c4863a5ab7d2db1a31400 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:42.002897 32437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f9202219c4863a5ab7d2db1a31400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.977100 32366 tablet_service.cc:1511] Processing CreateTablet for tablet a0b1118f0289484c9b711321d835a5b6 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:42.010766 32366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b1118f0289484c9b711321d835a5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.980785 32492 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:41.977851 32435 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca5cf4a68f349019aabcf63baf5f72e (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:42.012423 32492 ts_tablet_manager.cc:1403] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.014s
I20260709 13:11:42.013484 32435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca5cf4a68f349019aabcf63baf5f72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.980850 32433 tablet_service.cc:1511] Processing CreateTablet for tablet a0b1118f0289484c9b711321d835a5b6 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:42.018776 32433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b1118f0289484c9b711321d835a5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.981299 32289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa187132503479db4b2c3e326e75550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.025281 32288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a20f668b5454d68b790e14540ed7286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.026566 32292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffb3af1bd274ab8a6cda32a41ecced3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.027768 32285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca5cf4a68f349019aabcf63baf5f72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.976498 32436 tablet_service.cc:1511] Processing CreateTablet for tablet 729640c1a04e414f80ba63e6e185718d (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:42.029481 32436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729640c1a04e414f80ba63e6e185718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.979198 32434 tablet_service.cc:1511] Processing CreateTablet for tablet d2ec8e9c59a94bc999b69215e72dd3e5 (DEFAULT_TABLE table=test-workload [id=8bbc968a0fcf4b019d2a1e1ca000607e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:42.032712 32434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ec8e9c59a94bc999b69215e72dd3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.034905 32287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f9202219c4863a5ab7d2db1a31400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.037159 32283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b1118f0289484c9b711321d835a5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.039337 32284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ec8e9c59a94bc999b69215e72dd3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.040993 32290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95aa329ca8824a98ad9b655cc38d6f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.042575 32286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729640c1a04e414f80ba63e6e185718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.016480 32492 raft_consensus.cc:359] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.048534 32492 raft_consensus.cc:385] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.055981 32492 raft_consensus.cc:740] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.063284 32492 consensus_queue.cc:260] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.092954 32492 ts_tablet_manager.cc:1434] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.004s
I20260709 13:11:42.094278 32402 heartbeater.cc:499] Master 127.20.227.190:35793 was elected leader, sending a full tablet report...
I20260709 13:11:42.140286 32495 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.149223 32492 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.152745 32495 tablet_bootstrap.cc:654] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.178170 32497 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.198912 32495 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.199563 32495 ts_tablet_manager.cc:1403] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.024s
I20260709 13:11:42.202696 32495 raft_consensus.cc:359] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.203459 32495 raft_consensus.cc:385] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.203763 32495 raft_consensus.cc:740] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.204701 32495 consensus_queue.cc:260] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.214567 32492 tablet_bootstrap.cc:654] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.217901 32497 tablet_bootstrap.cc:654] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.224005 32477 heartbeater.cc:499] Master 127.20.227.190:35793 was elected leader, sending a full tablet report...
I20260709 13:11:42.225740 32495 ts_tablet_manager.cc:1434] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:11:42.226492 32492 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.227029 32495 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.227100 32492 ts_tablet_manager.cc:1403] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.002s
I20260709 13:11:42.229506 32497 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.230048 32497 ts_tablet_manager.cc:1403] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.000s
I20260709 13:11:42.230773 32492 raft_consensus.cc:359] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.231581 32492 raft_consensus.cc:385] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.231892 32492 raft_consensus.cc:740] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.232965 32492 consensus_queue.cc:260] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.233384 32497 raft_consensus.cc:359] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.234176 32497 raft_consensus.cc:385] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.234511 32497 raft_consensus.cc:740] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.235544 32495 tablet_bootstrap.cc:654] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.235466 32497 consensus_queue.cc:260] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.240512 32492 ts_tablet_manager.cc:1434] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
W20260709 13:11:42.242293 32478 tablet.cc:2406] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:42.245394 32497 ts_tablet_manager.cc:1434] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.009s
I20260709 13:11:42.246428 32327 heartbeater.cc:499] Master 127.20.227.190:35793 was elected leader, sending a full tablet report...
I20260709 13:11:42.248080 32492 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.258749 32492 tablet_bootstrap.cc:654] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.262305 32497 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.265918 32495 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.266633 32495 ts_tablet_manager.cc:1403] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.023s
I20260709 13:11:42.270081 32495 raft_consensus.cc:359] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.270977 32495 raft_consensus.cc:385] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.271368 32495 raft_consensus.cc:740] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.272154 32492 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.272835 32492 ts_tablet_manager.cc:1403] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:11:42.272539 32495 consensus_queue.cc:260] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
W20260709 13:11:42.274547 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:42.274117 32497 tablet_bootstrap.cc:654] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.276345 32492 raft_consensus.cc:359] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.277172 32492 raft_consensus.cc:385] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.277463 32492 raft_consensus.cc:740] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.278887 32495 ts_tablet_manager.cc:1434] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:42.280423 32495 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.289333 32495 tablet_bootstrap.cc:654] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.294593 32492 consensus_queue.cc:260] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.304908 32495 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.305651 32495 ts_tablet_manager.cc:1403] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.003s
I20260709 13:11:42.307130 32492 ts_tablet_manager.cc:1434] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.034s	user 0.013s	sys 0.001s
I20260709 13:11:42.309046 32495 raft_consensus.cc:359] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.309988 32495 raft_consensus.cc:385] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.310356 32495 raft_consensus.cc:740] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.311656 32492 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.311372 32495 consensus_queue.cc:260] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.315423 32497 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.316064 32497 ts_tablet_manager.cc:1403] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.005s
I20260709 13:11:42.316097 32495 ts_tablet_manager.cc:1434] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:11:42.317560 32495 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.319639 32497 raft_consensus.cc:359] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.320410 32497 raft_consensus.cc:385] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.320822 32492 tablet_bootstrap.cc:654] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.320760 32497 raft_consensus.cc:740] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.321899 32497 consensus_queue.cc:260] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.325747 32495 tablet_bootstrap.cc:654] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.332643 32497 ts_tablet_manager.cc:1434] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.005s
I20260709 13:11:42.334343 32497 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.337742 32494 raft_consensus.cc:493] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.338455 32494 raft_consensus.cc:515] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.337832 32495 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.341557 32495 ts_tablet_manager.cc:1403] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 13:11:42.341427 32494 leader_election.cc:290] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.342161 32497 tablet_bootstrap.cc:654] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.345106 32492 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.345774 32492 ts_tablet_manager.cc:1403] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.014s
I20260709 13:11:42.345353 32495 raft_consensus.cc:359] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.346413 32495 raft_consensus.cc:385] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.346829 32495 raft_consensus.cc:740] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.348050 32495 consensus_queue.cc:260] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.352365 32492 raft_consensus.cc:359] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.353523 32492 raft_consensus.cc:385] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.353935 32492 raft_consensus.cc:740] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.355206 32492 consensus_queue.cc:260] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.359441 32495 ts_tablet_manager.cc:1434] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:42.362684 32492 ts_tablet_manager.cc:1434] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:11:42.363989 32492 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.368680 32495 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.374665 32497 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.375252 32497 ts_tablet_manager.cc:1403] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.008s
I20260709 13:11:42.376513 32495 tablet_bootstrap.cc:654] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.377602 32492 tablet_bootstrap.cc:654] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.378508 32497 raft_consensus.cc:359] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.381672 32497 raft_consensus.cc:385] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.381995 32497 raft_consensus.cc:740] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.382944 32497 consensus_queue.cc:260] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.389694 32302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.390923 32302 raft_consensus.cc:2468] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 0.
I20260709 13:11:42.393066 32497 ts_tablet_manager.cc:1434] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 13:11:42.393503 32343 leader_election.cc:304] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.394236 32497 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.395684 32494 raft_consensus.cc:2804] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.396085 32494 raft_consensus.cc:493] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.396472 32494 raft_consensus.cc:3060] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.401540 32495 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.402175 32495 ts_tablet_manager.cc:1403] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.008s
I20260709 13:11:42.402693 32497 tablet_bootstrap.cc:654] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.406111 32495 raft_consensus.cc:359] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.406773 32495 raft_consensus.cc:385] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.407016 32495 raft_consensus.cc:740] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.407740 32495 consensus_queue.cc:260] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.410681 32495 ts_tablet_manager.cc:1434] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:11:42.410753 32497 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.411875 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.412202 32495 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.412212 32497 ts_tablet_manager.cc:1403] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:11:42.412606 32452 raft_consensus.cc:2468] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 0.
I20260709 13:11:42.405313 32494 raft_consensus.cc:515] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.417199 32497 raft_consensus.cc:359] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.417989 32497 raft_consensus.cc:385] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.418305 32497 raft_consensus.cc:740] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.418255 32302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.419052 32302 raft_consensus.cc:3060] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.420030 32495 tablet_bootstrap.cc:654] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.420902 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:42.421540 32452 raft_consensus.cc:3060] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.427508 32302 raft_consensus.cc:2468] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 1.
I20260709 13:11:42.426306 32497 consensus_queue.cc:260] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.428287 32495 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.428920 32495 ts_tablet_manager.cc:1403] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:11:42.428963 32343 leader_election.cc:304] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.430121 32452 raft_consensus.cc:2468] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 1.
I20260709 13:11:42.431615 32494 leader_election.cc:290] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.432433 32494 raft_consensus.cc:2804] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.432452 32495 raft_consensus.cc:359] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.433255 32494 raft_consensus.cc:697] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:42.433619 32495 raft_consensus.cc:385] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.434149 32495 raft_consensus.cc:740] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.434978 32495 consensus_queue.cc:260] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.436830 32498 raft_consensus.cc:493] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.437593 32495 ts_tablet_manager.cc:1434] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:42.437853 32492 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.438511 32492 ts_tablet_manager.cc:1403] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.004s
I20260709 13:11:42.438934 32495 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.437364 32498 raft_consensus.cc:515] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.434557 32494 consensus_queue.cc:237] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.449045 32492 raft_consensus.cc:359] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.454250 32492 raft_consensus.cc:385] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.455176 32492 raft_consensus.cc:740] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.445063 32498 leader_election.cc:290] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.464010 32492 consensus_queue.cc:260] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.460304 32495 tablet_bootstrap.cc:654] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.470233 32492 ts_tablet_manager.cc:1434] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:11:42.471899 32492 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.475728 32497 ts_tablet_manager.cc:1434] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.002s
I20260709 13:11:42.479180 32501 raft_consensus.cc:493] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.479826 32501 raft_consensus.cc:515] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.483708 32497 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.490830 32501 leader_election.cc:290] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.498723 32498 raft_consensus.cc:493] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.501468 32498 raft_consensus.cc:515] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.519202 32498 leader_election.cc:290] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.526621 32501 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.527534 32501 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.531141 32494 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.531766 32494 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.535080 32501 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.535359 32492 tablet_bootstrap.cc:654] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.538971 32515 raft_consensus.cc:493] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.539595 32515 raft_consensus.cc:515] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.540215 32497 tablet_bootstrap.cc:654] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.542044 32515 leader_election.cc:290] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.546216 32494 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.546389 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.550231 32516 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.550491 32377 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.550546 32302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.550817 32516 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.551434 32302 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 0.
I20260709 13:11:42.552232 32415 leader_election.cc:304] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.547067 32498 raft_consensus.cc:493] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.553544 32498 raft_consensus.cc:515] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.554708 32302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.547564 32376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.547955 32197 catalog_manager.cc:5697] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.559986 32498 leader_election.cc:290] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.562047 32498 raft_consensus.cc:2804] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.562412 32498 raft_consensus.cc:493] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.562743 32498 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.565181 32516 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.565698 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.566668 32452 raft_consensus.cc:2468] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 0.
I20260709 13:11:42.569223 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.569684 32451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.571318 32451 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832164ed3f67429e9b6b55f10cab1e19 in term 0.
I20260709 13:11:42.571952 32376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.572695 32376 raft_consensus.cc:2468] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.572973 32268 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:42.574169 32501 raft_consensus.cc:2804] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.574666 32501 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.575007 32376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.575664 32376 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.575073 32501 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.577502 32495 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.578058 32495 ts_tablet_manager.cc:1403] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.007s
W20260709 13:11:42.579093 32415 leader_election.cc:343] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.579921 32415 leader_election.cc:304] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.581976 32451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.582859 32451 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 0.
I20260709 13:11:42.583120 32302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.583715 32516 raft_consensus.cc:2804] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.583887 32302 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.584213 32516 raft_consensus.cc:493] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.582103 32301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.584473 32343 leader_election.cc:304] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.583618 32300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.584637 32516 raft_consensus.cc:3060] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.584687 32299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.586264 32343 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.587072 32494 raft_consensus.cc:2804] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:42.586967 32417 leader_election.cc:343] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.587589 32494 raft_consensus.cc:493] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.587695 32343 leader_election.cc:343] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.588004 32494 raft_consensus.cc:3060] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.587891 32417 leader_election.cc:304] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3; no voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:42.589474 32525 raft_consensus.cc:2749] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:42.589653 32417 leader_election.cc:343] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.590827 32495 raft_consensus.cc:359] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.591922 32495 raft_consensus.cc:385] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.593693 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.594558 32495 raft_consensus.cc:740] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.592195 32492 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.596136 32492 ts_tablet_manager.cc:1403] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.008s
I20260709 13:11:42.576807 32498 raft_consensus.cc:515] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.597121 32452 raft_consensus.cc:2393] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 832164ed3f67429e9b6b55f10cab1e19 in current term 1: Already voted for candidate 94a77032aa8a4a30b2990dee8acfaca3 in this term.
I20260709 13:11:42.597349 32376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.597209 32495 consensus_queue.cc:260] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.598171 32376 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832164ed3f67429e9b6b55f10cab1e19 in term 0.
I20260709 13:11:42.590940 32515 raft_consensus.cc:2804] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.599593 32377 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832164ed3f67429e9b6b55f10cab1e19 in term 0.
I20260709 13:11:42.601326 32515 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.601742 32515 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.602732 32299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.603444 32299 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.606002 32492 raft_consensus.cc:359] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.606549 32498 leader_election.cc:290] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.606877 32492 raft_consensus.cc:385] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.606447 32494 raft_consensus.cc:515] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.607218 32492 raft_consensus.cc:740] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.607447 32498 raft_consensus.cc:493] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.608266 32498 raft_consensus.cc:515] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.609036 32492 consensus_queue.cc:260] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.596235 32501 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.609541 32415 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.612335 32516 raft_consensus.cc:515] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.613617 32300 raft_consensus.cc:2393] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94a77032aa8a4a30b2990dee8acfaca3 in current term 1: Already voted for candidate 832164ed3f67429e9b6b55f10cab1e19 in this term.
I20260709 13:11:42.619369 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:42.619700 32529 raft_consensus.cc:2804] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.620088 32451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:42.620760 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:42.612980 32498 leader_election.cc:290] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.622242 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:42.623134 32374 raft_consensus.cc:3060] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.623664 32515 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.625396 32376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.626375 32376 raft_consensus.cc:2468] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.615396 32302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.608745 32494 leader_election.cc:290] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
W20260709 13:11:42.629060 32417 leader_election.cc:343] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.620266 32529 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.629725 32302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.630018 32529 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.630685 32302 raft_consensus.cc:2393] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc71c80513f5482cbdebb30e26a1b036 in current term 1: Already voted for candidate 832164ed3f67429e9b6b55f10cab1e19 in this term.
I20260709 13:11:42.630761 32375 raft_consensus.cc:2393] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 832164ed3f67429e9b6b55f10cab1e19 in current term 1: Already voted for candidate cc71c80513f5482cbdebb30e26a1b036 in this term.
I20260709 13:11:42.632071 32415 leader_election.cc:304] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.634261 32498 raft_consensus.cc:2804] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.634915 32498 raft_consensus.cc:493] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.635296 32498 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.635414 32495 ts_tablet_manager.cc:1434] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:11:42.642275 32495 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.643025 32498 raft_consensus.cc:515] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.645301 32299 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:42.615556 32516 leader_election.cc:290] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.616206 32266 leader_election.cc:304] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:42.613770 32301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.650491 32417 leader_election.cc:304] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
W20260709 13:11:42.651925 32417 leader_election.cc:343] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.652504 32450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:42.617626 32298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.662777 32529 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.618434 32501 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 election: Requested vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.664186 32451 raft_consensus.cc:2393] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 832164ed3f67429e9b6b55f10cab1e19 in current term 1: Already voted for candidate 94a77032aa8a4a30b2990dee8acfaca3 in this term.
I20260709 13:11:42.664724 32501 raft_consensus.cc:2764] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:42.617945 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
W20260709 13:11:42.665078 32343 leader_election.cc:343] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.665802 32452 raft_consensus.cc:3060] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.620107 32377 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.668848 32298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.669749 32298 raft_consensus.cc:2393] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 94a77032aa8a4a30b2990dee8acfaca3 in current term 1: Already voted for candidate 832164ed3f67429e9b6b55f10cab1e19 in this term.
I20260709 13:11:42.672842 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:42.673693 32375 raft_consensus.cc:2393] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 94a77032aa8a4a30b2990dee8acfaca3 in current term 1: Already voted for candidate cc71c80513f5482cbdebb30e26a1b036 in this term.
I20260709 13:11:42.674971 32415 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3; no voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:42.675894 32525 raft_consensus.cc:2749] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.676625 32529 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.661456 32516 raft_consensus.cc:2804] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.677862 32516 raft_consensus.cc:697] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:42.678088 32501 raft_consensus.cc:493] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.678171 32343 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:42.678656 32501 raft_consensus.cc:515] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.678784 32516 consensus_queue.cc:237] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.679474 32494 raft_consensus.cc:2749] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.682143 32498 leader_election.cc:290] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.682786 32450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.683470 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:42.684298 32375 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.684967 32501 leader_election.cc:290] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.686232 32374 raft_consensus.cc:2468] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:42.687904 32415 leader_election.cc:304] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19
W20260709 13:11:42.684346 32268 leader_election.cc:343] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.690722 32298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.649142 32515 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
W20260709 13:11:42.692961 32417 leader_election.cc:343] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.696476 32529 raft_consensus.cc:2804] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.702677 32495 tablet_bootstrap.cc:654] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.696746 32452 raft_consensus.cc:2468] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 1.
I20260709 13:11:42.704691 32497 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.706246 32497 ts_tablet_manager.cc:1403] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.021s
I20260709 13:11:42.706343 32375 raft_consensus.cc:2468] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
W20260709 13:11:42.699115 32266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.130:37683, user_credentials={real_user=slave}} blocked reactor thread for 82784.4us
I20260709 13:11:42.707118 32343 leader_election.cc:304] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19
I20260709 13:11:42.707569 32415 leader_election.cc:304] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19
I20260709 13:11:42.708946 32498 raft_consensus.cc:2804] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.709187 32530 raft_consensus.cc:2804] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.709503 32498 raft_consensus.cc:697] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:42.709992 32530 raft_consensus.cc:697] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:42.710776 32498 consensus_queue.cc:237] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.711760 32266 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19; no voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:42.711274 32530 consensus_queue.cc:237] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.710207 32492 ts_tablet_manager.cc:1434] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.114s	user 0.027s	sys 0.022s
I20260709 13:11:42.714013 32492 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.715969 32532 raft_consensus.cc:2749] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.718971 32529 raft_consensus.cc:697] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:42.729666 32529 consensus_queue.cc:237] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.726259 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.732403 32497 raft_consensus.cc:359] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.733881 32377 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:42.735942 32497 raft_consensus.cc:385] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:42.741605 32266 leader_election.cc:343] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.741824 32495 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.742290 32266 leader_election.cc:304] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19; no voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:42.742601 32495 ts_tablet_manager.cc:1403] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.002s
I20260709 13:11:42.743993 32532 raft_consensus.cc:2749] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.740140 32497 raft_consensus.cc:740] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.745237 32497 consensus_queue.cc:260] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.746100 32495 raft_consensus.cc:359] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.746955 32495 raft_consensus.cc:385] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.747299 32495 raft_consensus.cc:740] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.747757 32497 ts_tablet_manager.cc:1434] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:11:42.748298 32495 consensus_queue.cc:260] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.742762 32198 catalog_manager.cc:5697] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.751906 32497 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.752202 32492 tablet_bootstrap.cc:654] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.755403 32495 ts_tablet_manager.cc:1434] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:42.763409 32495 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.789397 32495 tablet_bootstrap.cc:654] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.795063 32497 tablet_bootstrap.cc:654] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.796049 32492 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.798345 32197 catalog_manager.cc:5697] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.803596 32492 ts_tablet_manager.cc:1403] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.005s
I20260709 13:11:42.808187 32492 raft_consensus.cc:359] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.809291 32492 raft_consensus.cc:385] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.809773 32492 raft_consensus.cc:740] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.810873 32492 consensus_queue.cc:260] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.813663 32492 ts_tablet_manager.cc:1434] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:11:42.814599 32492 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.815260 32495 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.816061 32495 ts_tablet_manager.cc:1403] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.016s
I20260709 13:11:42.820109 32495 raft_consensus.cc:359] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.821188 32495 raft_consensus.cc:385] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.821568 32495 raft_consensus.cc:740] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.821743 32492 tablet_bootstrap.cc:654] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.822719 32495 consensus_queue.cc:260] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.827014 32495 ts_tablet_manager.cc:1434] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:11:42.827762 32497 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.828114 32495 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3: Bootstrap starting.
I20260709 13:11:42.828375 32497 ts_tablet_manager.cc:1403] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.015s
I20260709 13:11:42.832211 32497 raft_consensus.cc:359] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.833146 32497 raft_consensus.cc:385] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.833506 32497 raft_consensus.cc:740] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.832737 32198 catalog_manager.cc:5697] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.834482 32497 consensus_queue.cc:260] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.835547 32495 tablet_bootstrap.cc:654] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.834779 32198 catalog_manager.cc:5697] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.840263 32497 ts_tablet_manager.cc:1434] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:11:42.841585 32497 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.849649 32492 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.850242 32492 ts_tablet_manager.cc:1403] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.009s
I20260709 13:11:42.852380 32492 raft_consensus.cc:359] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.852933 32492 raft_consensus.cc:385] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.853200 32492 raft_consensus.cc:740] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.853993 32492 consensus_queue.cc:260] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.862031 32530 raft_consensus.cc:493] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.862299 32497 tablet_bootstrap.cc:654] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.862644 32530 raft_consensus.cc:515] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.865221 32495 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3: No bootstrap required, opened a new log
I20260709 13:11:42.865796 32495 ts_tablet_manager.cc:1403] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.015s
I20260709 13:11:42.866278 32530 leader_election.cc:290] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.868163 32298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.868636 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.869390 32452 raft_consensus.cc:2468] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 0.
W20260709 13:11:42.869997 32343 leader_election.cc:343] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.870298 32492 ts_tablet_manager.cc:1434] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:11:42.870914 32343 leader_election.cc:304] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19
I20260709 13:11:42.870970 32495 raft_consensus.cc:359] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.871860 32495 raft_consensus.cc:385] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.872180 32495 raft_consensus.cc:740] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.872328 32530 raft_consensus.cc:2804] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.872804 32530 raft_consensus.cc:493] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.873224 32530 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.873165 32495 consensus_queue.cc:260] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.878509 32495 ts_tablet_manager.cc:1434] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:42.880709 32492 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.882097 32497 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.882678 32497 ts_tablet_manager.cc:1403] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.011s
I20260709 13:11:42.885852 32497 raft_consensus.cc:359] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.886610 32497 raft_consensus.cc:385] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.886900 32497 raft_consensus.cc:740] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.887419 32492 tablet_bootstrap.cc:654] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.887355 32530 raft_consensus.cc:515] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.887889 32497 consensus_queue.cc:260] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.890904 32497 ts_tablet_manager.cc:1434] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:11:42.891467 32298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.891997 32497 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
W20260709 13:11:42.893095 32343 leader_election.cc:343] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:42.893705 32492 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.894346 32492 ts_tablet_manager.cc:1403] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:11:42.897756 32492 raft_consensus.cc:359] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.898617 32492 raft_consensus.cc:385] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.898984 32492 raft_consensus.cc:740] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.899953 32492 consensus_queue.cc:260] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.902508 32492 ts_tablet_manager.cc:1434] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:42.903693 32492 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036: Bootstrap starting.
I20260709 13:11:42.903745 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:42.904479 32452 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.904647 32532 raft_consensus.cc:493] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.905267 32532 raft_consensus.cc:515] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.907469 32532 leader_election.cc:290] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.908440 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.910892 32492 tablet_bootstrap.cc:654] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.900962 32497 tablet_bootstrap.cc:654] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.912402 32450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:42.913306 32530 leader_election.cc:290] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:42.914276 32452 raft_consensus.cc:2468] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 1.
I20260709 13:11:42.916016 32343 leader_election.cc:304] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19
I20260709 13:11:42.913381 32450 raft_consensus.cc:2393] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 832164ed3f67429e9b6b55f10cab1e19 in current term 1: Already voted for candidate cc71c80513f5482cbdebb30e26a1b036 in this term.
I20260709 13:11:42.918143 32530 raft_consensus.cc:2804] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.918746 32530 raft_consensus.cc:697] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:42.919221 32268 leader_election.cc:304] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19; no voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:42.920536 32532 raft_consensus.cc:3060] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.919898 32530 consensus_queue.cc:237] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.932484 32532 raft_consensus.cc:2749] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:42.934016 32492 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036: No bootstrap required, opened a new log
I20260709 13:11:42.934649 32492 ts_tablet_manager.cc:1403] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.013s
I20260709 13:11:42.935074 32497 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.935626 32497 ts_tablet_manager.cc:1403] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.014s
I20260709 13:11:42.937589 32492 raft_consensus.cc:359] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.937939 32197 catalog_manager.cc:5697] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.938472 32492 raft_consensus.cc:385] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.938524 32497 raft_consensus.cc:359] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.939003 32492 raft_consensus.cc:740] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.939390 32497 raft_consensus.cc:385] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.939733 32497 raft_consensus.cc:740] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.940084 32492 consensus_queue.cc:260] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.940491 32497 consensus_queue.cc:260] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.942461 32492 ts_tablet_manager.cc:1434] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:42.945088 32497 ts_tablet_manager.cc:1434] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:11:42.946022 32497 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.950114 32529 raft_consensus.cc:493] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.950753 32529 raft_consensus.cc:515] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.951679 32497 tablet_bootstrap.cc:654] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.955653 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.956465 32375 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.957806 32529 leader_election.cc:290] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.958091 32415 leader_election.cc:304] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.958580 32298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.959380 32529 raft_consensus.cc:2804] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.959323 32298 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.959867 32529 raft_consensus.cc:493] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.960299 32529 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.964254 32497 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:42.964738 32497 ts_tablet_manager.cc:1403] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:11:42.966003 32498 raft_consensus.cc:493] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.966598 32498 raft_consensus.cc:515] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:42.967082 32497 raft_consensus.cc:359] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.967154 32529 raft_consensus.cc:515] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.967986 32497 raft_consensus.cc:385] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:42.968369 32497 raft_consensus.cc:740] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:42.969038 32497 consensus_queue.cc:260] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.969815 32529 leader_election.cc:290] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:42.969939 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:42.970924 32375 raft_consensus.cc:2468] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.973428 32415 leader_election.cc:304] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.974586 32497 ts_tablet_manager.cc:1434] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:11:42.974419 32301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:42.975149 32301 raft_consensus.cc:2468] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 0.
I20260709 13:11:42.975608 32497 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:42.975503 32298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:42.976373 32298 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.977102 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:42.977684 32375 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.982476 32497 tablet_bootstrap.cc:654] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:42.985126 32529 raft_consensus.cc:2804] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:42.985706 32529 raft_consensus.cc:493] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.985977 32375 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:42.987823 32415 leader_election.cc:304] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:42.989085 32516 raft_consensus.cc:2804] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:42.989751 32516 raft_consensus.cc:697] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:42.969720 32498 leader_election.cc:290] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247)
I20260709 13:11:42.990952 32516 consensus_queue.cc:237] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.986208 32529 raft_consensus.cc:3060] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:42.996465 32532 raft_consensus.cc:493] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.997109 32532 raft_consensus.cc:515] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:42.997735 32298 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:42.999397 32532 leader_election.cc:290] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:43.002264 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:43.002480 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:43.002938 32452 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832164ed3f67429e9b6b55f10cab1e19 in term 0.
I20260709 13:11:43.003008 32530 consensus_queue.cc:1048] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.003276 32375 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832164ed3f67429e9b6b55f10cab1e19 in term 0.
I20260709 13:11:43.004410 32268 leader_election.cc:304] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:43.005276 32532 raft_consensus.cc:2804] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:43.005192 32529 raft_consensus.cc:515] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:43.005892 32532 raft_consensus.cc:493] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.007623 32532 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.008949 32497 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: No bootstrap required, opened a new log
I20260709 13:11:43.009533 32497 ts_tablet_manager.cc:1403] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.012s
I20260709 13:11:43.012609 32497 raft_consensus.cc:359] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:43.013393 32497 raft_consensus.cc:385] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:43.013706 32497 raft_consensus.cc:740] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:43.014446 32497 consensus_queue.cc:260] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:43.017182 32497 ts_tablet_manager.cc:1434] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:43.017707 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:43.018316 32375 raft_consensus.cc:3060] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.018594 32200 catalog_manager.cc:5697] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.026978 32375 raft_consensus.cc:2468] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:43.028385 32415 leader_election.cc:304] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:43.029333 32516 raft_consensus.cc:2804] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.030169 32532 raft_consensus.cc:515] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:43.030184 32516 raft_consensus.cc:697] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:43.031725 32516 consensus_queue.cc:237] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:43.033264 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:43.033998 32377 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.034031 32529 leader_election.cc:290] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 1 election: Requested vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247)
I20260709 13:11:43.036535 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:43.037235 32452 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.037636 32301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:43.038257 32301 raft_consensus.cc:3060] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.045352 32494 consensus_queue.cc:1048] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.046087 32452 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 832164ed3f67429e9b6b55f10cab1e19 in term 1.
I20260709 13:11:43.045841 32377 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 832164ed3f67429e9b6b55f10cab1e19 in term 1.
I20260709 13:11:43.047529 32268 leader_election.cc:304] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:43.048460 32501 raft_consensus.cc:2804] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:43.049933 32501 raft_consensus.cc:697] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 LEADER]: Becoming Leader. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Running, Role: LEADER
I20260709 13:11:43.050876 32501 consensus_queue.cc:237] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:43.054553 32532 leader_election.cc:290] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 election: Requested vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:43.062530 32197 catalog_manager.cc:5697] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "832164ed3f67429e9b6b55f10cab1e19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.067625 32301 raft_consensus.cc:2468] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:43.081918 32200 catalog_manager.cc:5697] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.088445 32516 consensus_queue.cc:1048] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.103504 32525 consensus_queue.cc:1048] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.138358 32501 raft_consensus.cc:493] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.139210 32501 raft_consensus.cc:515] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:43.141296 32501 leader_election.cc:290] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:43.142151 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:43.142541 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:43.142851 32530 consensus_queue.cc:1048] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.143734 32377 raft_consensus.cc:2393] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 832164ed3f67429e9b6b55f10cab1e19 in current term 1: Already voted for candidate 94a77032aa8a4a30b2990dee8acfaca3 in this term.
I20260709 13:11:43.144886 32266 leader_election.cc:304] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19; no voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:43.145780 32501 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.156224 32494 consensus_queue.cc:1048] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.158547 32501 raft_consensus.cc:2749] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.165094 32525 consensus_queue.cc:1048] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.176642 32532 raft_consensus.cc:493] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.177222 32532 raft_consensus.cc:515] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:43.177561 32498 consensus_queue.cc:1048] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:43.179288 32532 leader_election.cc:290] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:43.180819 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:43.182140 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:43.183010 32377 raft_consensus.cc:2393] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 832164ed3f67429e9b6b55f10cab1e19 in current term 1: Already voted for candidate 94a77032aa8a4a30b2990dee8acfaca3 in this term.
I20260709 13:11:43.184147 32266 leader_election.cc:304] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19; no voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:43.185341 32532 raft_consensus.cc:3060] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.192500 32532 raft_consensus.cc:2749] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:43.281776 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:43.286895 32498 consensus_queue.cc:1048] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.298533 32516 consensus_queue.cc:1048] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.310655 32532 raft_consensus.cc:493] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.311251 32532 raft_consensus.cc:515] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:43.313185 32532 leader_election.cc:290] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:43.314327 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:43.315227 32452 raft_consensus.cc:2393] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 832164ed3f67429e9b6b55f10cab1e19 in current term 1: Already voted for candidate cc71c80513f5482cbdebb30e26a1b036 in this term.
I20260709 13:11:43.314531 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "832164ed3f67429e9b6b55f10cab1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:43.316702 32266 leader_election.cc:304] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19; no voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:43.317540 32532 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:43.323246 32532 raft_consensus.cc:2749] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:43.363366 32494 consensus_queue.cc:1048] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.375252 32515 consensus_queue.cc:1048] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.433079 32516 consensus_queue.cc:1048] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.441617 32516 consensus_queue.cc:1048] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.448118 32516 consensus_queue.cc:1048] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.460539 32532 consensus_queue.cc:1048] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.465117 32525 consensus_queue.cc:1048] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:43.480494 32501 consensus_queue.cc:1048] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:44.288165 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:44.306350 32570 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.306967 32570 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:44.308909 32570 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:44.309980 32301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19" is_pre_election: true
I20260709 13:11:44.310292 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
I20260709 13:11:44.310591 32301 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 1.
I20260709 13:11:44.310907 32452 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 1.
I20260709 13:11:44.311834 32343 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:44.312554 32570 raft_consensus.cc:2804] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:44.312945 32570 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.313237 32570 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.318519 32570 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:44.320168 32570 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:44.321185 32301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:44.321424 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:44.321770 32301 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.322160 32452 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.327132 32301 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:44.327978 32452 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:44.328408 32343 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:44.329442 32570 raft_consensus.cc:2804] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.329924 32570 raft_consensus.cc:697] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:44.330727 32570 consensus_queue.cc:237] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:44.338537 32197 catalog_manager.cc:5697] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 0 to 2, leader changed from <none> to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.595460 21390 ts_manager.cc:295] Set tserver state for 832164ed3f67429e9b6b55f10cab1e19 to MAINTENANCE_MODE
I20260709 13:11:44.596302 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
I20260709 13:11:44.623025 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:44.623843 21390 tablet_replica.cc:333] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.624464 21390 raft_consensus.cc:2243] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.624975 21390 raft_consensus.cc:2272] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.626906 21390 tablet_replica.cc:333] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.627494 21390 raft_consensus.cc:2243] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.628093 21390 raft_consensus.cc:2272] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.630111 21390 tablet_replica.cc:333] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.630669 21390 raft_consensus.cc:2243] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.631088 21390 raft_consensus.cc:2272] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.633114 21390 tablet_replica.cc:333] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.633898 21390 raft_consensus.cc:2243] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.634393 21390 raft_consensus.cc:2272] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.636559 21390 tablet_replica.cc:333] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.637094 21390 raft_consensus.cc:2243] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.637440 21390 raft_consensus.cc:2272] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.639084 21390 tablet_replica.cc:333] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.639547 21390 raft_consensus.cc:2243] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.639886 21390 raft_consensus.cc:2272] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.641609 21390 tablet_replica.cc:333] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.642055 21390 raft_consensus.cc:2243] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.642398 21390 raft_consensus.cc:2272] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.643990 21390 tablet_replica.cc:333] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.644423 21390 raft_consensus.cc:2243] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.645222 21390 raft_consensus.cc:2272] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.647107 21390 tablet_replica.cc:333] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.647590 21390 raft_consensus.cc:2243] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.647922 21390 raft_consensus.cc:2272] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.649703 21390 tablet_replica.cc:333] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: stopping tablet replica
I20260709 13:11:44.650153 21390 raft_consensus.cc:2243] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.650529 21390 raft_consensus.cc:2272] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.683039 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
W20260709 13:11:44.734675 32343 consensus_peers.cc:597] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.752507 32417 consensus_peers.cc:597] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:44.757426 32452 raft_consensus.cc:1275] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:44.758847 32570 consensus_queue.cc:1048] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:44.776741 32343 consensus_peers.cc:597] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.801326 32417 consensus_peers.cc:597] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.826987 32417 consensus_peers.cc:597] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.840476 32343 consensus_peers.cc:597] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.850198 32417 consensus_peers.cc:597] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.959604 32417 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111) [suppressed 83 similar messages]
W20260709 13:11:44.962561 32417 consensus_peers.cc:597] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.048434 32343 consensus_peers.cc:597] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.289132 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:45.918023 32596 raft_consensus.cc:493] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 832164ed3f67429e9b6b55f10cab1e19)
I20260709 13:11:45.918624 32596 raft_consensus.cc:515] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:45.920578 32596 leader_election.cc:290] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:45.922147 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3" is_pre_election: true
W20260709 13:11:45.925025 32343 leader_election.cc:336] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111)
I20260709 13:11:45.925391 32343 leader_election.cc:304] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:45.925966 32596 raft_consensus.cc:2749] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:46.011169 32595 raft_consensus.cc:493] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 832164ed3f67429e9b6b55f10cab1e19)
I20260709 13:11:46.011885 32595 raft_consensus.cc:515] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:46.013937 32595 leader_election.cc:290] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:46.015198 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036" is_pre_election: true
I20260709 13:11:46.015925 32377 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 1.
I20260709 13:11:46.017042 32415 leader_election.cc:304] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:46.017882 32595 raft_consensus.cc:2804] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.018206 32595 raft_consensus.cc:493] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 832164ed3f67429e9b6b55f10cab1e19)
W20260709 13:11:46.018386 32417 leader_election.cc:336] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111)
I20260709 13:11:46.018505 32595 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.024313 32595 raft_consensus.cc:515] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:46.026371 32595 leader_election.cc:290] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:46.027536 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:46.028158 32374 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:46.030557 32417 leader_election.cc:336] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111)
I20260709 13:11:46.033625 32374 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 2.
I20260709 13:11:46.034799 32415 leader_election.cc:304] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 832164ed3f67429e9b6b55f10cab1e19
I20260709 13:11:46.035657 32595 raft_consensus.cc:2804] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:46.036223 32595 raft_consensus.cc:697] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:46.036985 32595 consensus_queue.cc:237] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:46.044731 32200 catalog_manager.cc:5697] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 1 to 2, leader changed from 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:46.290297 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:46.549738 32374 raft_consensus.cc:1275] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.551353 32598 consensus_queue.cc:1048] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:46.566848 32417 consensus_peers.cc:597] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:47.008632 32417 consensus_peers.cc:597] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.222297 32417 consensus_peers.cc:597] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.228014 32417 consensus_peers.cc:597] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.291313 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:47.379213 32343 consensus_peers.cc:597] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.417124 32343 consensus_peers.cc:597] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.429832 32343 consensus_peers.cc:597] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.437512 32343 consensus_peers.cc:597] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.438269 32417 consensus_peers.cc:597] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.453080 32417 consensus_peers.cc:597] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.292394 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:48.967870 32417 consensus_peers.cc:597] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:49.293412 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:49.437973 32417 consensus_peers.cc:597] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.603199 32417 consensus_peers.cc:597] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.703462 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:49.710726 32417 consensus_peers.cc:597] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.713356 32612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:49.719645 32611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:49.723954 21390 server_base.cc:1061] running on GCE node
W20260709 13:11:49.724452 32614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:49.725920 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:49.726212 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:49.726418 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602709726403 us; error 0 us; skew 500 ppm
I20260709 13:11:49.727041 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:49.730477 21390 webserver.cc:533] Webserver started at http://127.20.227.129:46771/ using document root <none> and password file <none>
I20260709 13:11:49.731022 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:49.731300 21390 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:49.735671 21390 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:11:49.739971 32620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:49.741174 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:49.741555 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "832164ed3f67429e9b6b55f10cab1e19"
format_stamp: "Formatted at 2026-07-09 13:11:41 on dist-test-slave-078m"
I20260709 13:11:49.741958 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:49.757057 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:49.758509 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:49.760319 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:49.765425 32627 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:11:49.803280 32417 consensus_peers.cc:597] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.811503 32343 consensus_peers.cc:597] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.823033 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:11:49.823526 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.059s	user 0.001s	sys 0.003s
I20260709 13:11:49.823936 21390 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:11:49.829932 32627 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:49.843905 32627 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:49.845090 32627 tablet_bootstrap.cc:492] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:49.845716 32627 ts_tablet_manager.cc:1403] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:11:49.847904 32627 raft_consensus.cc:359] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.848497 32627 raft_consensus.cc:740] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.849282 32627 consensus_queue.cc:260] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.851878 32627 ts_tablet_manager.cc:1434] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:49.852609 32627 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:49.866552 32627 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:49.866707 21390 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:11:49.867138 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.043s	user 0.042s	sys 0.000s
I20260709 13:11:49.867547 32627 tablet_bootstrap.cc:492] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:49.868367 32627 ts_tablet_manager.cc:1403] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:11:49.870883 32627 raft_consensus.cc:359] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.871495 32627 raft_consensus.cc:740] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.872233 32627 consensus_queue.cc:260] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.873934 32627 ts_tablet_manager.cc:1434] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:49.874691 32627 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:49.888381 32627 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:49.889632 32627 tablet_bootstrap.cc:492] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:49.890323 32627 ts_tablet_manager.cc:1403] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:11:49.893085 32627 raft_consensus.cc:359] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.893713 32627 raft_consensus.cc:740] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.894433 32627 consensus_queue.cc:260] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.896153 32627 ts_tablet_manager.cc:1434] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:49.897156 32627 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:49.912673 32627 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:49.913654 32627 tablet_bootstrap.cc:492] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:49.914280 32627 ts_tablet_manager.cc:1403] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
W20260709 13:11:49.914896 32343 consensus_peers.cc:597] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.916172 32627 raft_consensus.cc:359] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.916745 32627 raft_consensus.cc:740] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.917475 32627 consensus_queue.cc:260] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.919055 32627 ts_tablet_manager.cc:1434] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:49.919845 32627 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:49.932765 32627 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:49.933696 32627 tablet_bootstrap.cc:492] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:49.934427 32627 ts_tablet_manager.cc:1403] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:11:49.934772 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:34247
I20260709 13:11:49.934935 32689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:34247 every 8 connection(s)
I20260709 13:11:49.936547 32627 raft_consensus.cc:359] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.937234 32627 raft_consensus.cc:740] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.937948 32627 consensus_queue.cc:260] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.940070 32627 ts_tablet_manager.cc:1434] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:49.941008 32627 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:49.943012 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:49.970715 32690 heartbeater.cc:344] Connected to a master server at 127.20.227.190:35793
I20260709 13:11:49.971253 32690 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:49.972289 32690 heartbeater.cc:507] Master 127.20.227.190:35793 requested a full tablet report, sending...
I20260709 13:11:49.974632 32627 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:49.975793 32627 tablet_bootstrap.cc:492] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:49.976488 32627 ts_tablet_manager.cc:1403] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.008s
I20260709 13:11:49.978647 32200 ts_manager.cc:194] Re-registered known tserver with Master: 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247)
I20260709 13:11:49.978615 32627 raft_consensus.cc:359] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.979362 32627 raft_consensus.cc:740] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:49.980113 32627 consensus_queue.cc:260] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:49.982112 32374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
mode: GRACEFUL
new_leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:41040
I20260709 13:11:49.982544 32627 ts_tablet_manager.cc:1434] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:49.982909 32374 raft_consensus.cc:606] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Received request to transfer leadership to TS 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:49.983438 32627 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:49.990731 32200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55926
I20260709 13:11:49.995966 32690 heartbeater.cc:499] Master 127.20.227.190:35793 was elected leader, sending a full tablet report...
I20260709 13:11:49.998991 32627 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:50.000535 32627 tablet_bootstrap.cc:492] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:50.001356 32627 ts_tablet_manager.cc:1403] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:11:50.001554 32450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:50.002324 32450 raft_consensus.cc:606] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:50.004029 32627 raft_consensus.cc:359] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.004753 32627 raft_consensus.cc:740] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:50.005560 32627 consensus_queue.cc:260] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.005920 32450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:50.006700 32450 raft_consensus.cc:606] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:50.008397 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:50.007534 32627 ts_tablet_manager.cc:1434] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:11:50.009222 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:50.009654 32627 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:50.010078 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:50.030424 32616 raft_consensus.cc:993] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036: : Instructing follower 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:50.031010 32596 raft_consensus.cc:1081] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Signalling peer 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:50.031977 32627 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:50.033210 32627 tablet_bootstrap.cc:492] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:50.033077 32450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:51862
I20260709 13:11:50.033975 32450 raft_consensus.cc:493] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:50.034152 32627 ts_tablet_manager.cc:1403] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:11:50.034363 32450 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.036669 32627 raft_consensus.cc:359] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:50.037274 32627 raft_consensus.cc:740] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:50.037956 32627 consensus_queue.cc:260] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:50.039616 32627 ts_tablet_manager.cc:1434] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:50.040306 32627 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:50.043668 32450 raft_consensus.cc:515] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.046072 32450 leader_election.cc:290] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:50.047906 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:50.048686 32374 raft_consensus.cc:3055] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:50.049108 32374 raft_consensus.cc:740] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:50.050011 32374 consensus_queue.cc:260] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.051594 32374 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.055713 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca5cf4a68f349019aabcf63baf5f72e" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:50.056429 32662 raft_consensus.cc:3060] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.057526 32627 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:50.058688 32627 tablet_bootstrap.cc:492] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:50.059388 32627 ts_tablet_manager.cc:1403] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:11:50.059913 32374 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:50.061465 32415 leader_election.cc:304] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:50.062426 32606 raft_consensus.cc:2804] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.062397 32662 raft_consensus.cc:2468] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:50.062501 32627 raft_consensus.cc:359] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.063565 32627 raft_consensus.cc:740] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:50.064292 32627 consensus_queue.cc:260] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.064764 32606 raft_consensus.cc:697] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:50.065804 32606 consensus_queue.cc:237] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.066290 32627 ts_tablet_manager.cc:1434] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:50.067447 32627 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap starting.
I20260709 13:11:50.074990 32200 catalog_manager.cc:5697] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 2 to 3, leader changed from cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.083889 32627 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:50.084789 32627 tablet_bootstrap.cc:492] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Bootstrap complete.
I20260709 13:11:50.085546 32627 ts_tablet_manager.cc:1403] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:11:50.087877 32627 raft_consensus.cc:359] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.088619 32627 raft_consensus.cc:740] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832164ed3f67429e9b6b55f10cab1e19, State: Initialized, Role: FOLLOWER
I20260709 13:11:50.089265 32627 consensus_queue.cc:260] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.090839 32627 ts_tablet_manager.cc:1434] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:50.155242 32705 raft_consensus.cc:993] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:50.155830 32606 raft_consensus.cc:1081] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:50.157583 32374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:50.158049 32374 raft_consensus.cc:493] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:50.158314 32374 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.163915 32374 raft_consensus.cc:515] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.165998 32374 leader_election.cc:290] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:50.166731 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:50.167215 32450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:50.167471 32662 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.167869 32450 raft_consensus.cc:3055] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:50.168211 32450 raft_consensus.cc:740] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:50.169164 32450 consensus_queue.cc:260] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.170463 32450 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.175468 32662 raft_consensus.cc:2468] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:50.177001 32343 leader_election.cc:304] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:50.177773 32596 raft_consensus.cc:2804] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:50.178177 32450 raft_consensus.cc:2468] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:50.178330 32596 raft_consensus.cc:697] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:50.179319 32596 consensus_queue.cc:237] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.187155 32200 catalog_manager.cc:5697] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 1 to 2, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:50.260130 32705 raft_consensus.cc:993] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:50.260648 32606 raft_consensus.cc:1081] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:50.262387 32374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:50.263024 32374 raft_consensus.cc:493] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:50.263382 32374 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.269488 32374 raft_consensus.cc:515] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.271456 32374 leader_election.cc:290] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:50.272501 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:50.273059 32450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:50.273308 32662 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.273659 32450 raft_consensus.cc:3055] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:50.273988 32450 raft_consensus.cc:740] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:50.274654 32450 consensus_queue.cc:260] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.275660 32450 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.278913 32662 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:50.280102 32343 leader_election.cc:304] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:50.281019 32596 raft_consensus.cc:2804] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:50.281107 32450 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:50.281481 32596 raft_consensus.cc:697] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:50.282780 32596 consensus_queue.cc:237] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:50.290179 32200 catalog_manager.cc:5697] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 1 to 2, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:50.295002 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:50.441186 32662 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.473667 32374 raft_consensus.cc:1275] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:50.475737 32705 consensus_queue.cc:1048] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:50.504118 32662 raft_consensus.cc:1275] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:50.505653 32705 consensus_queue.cc:1048] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:50.675951 32450 raft_consensus.cc:1275] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:50.677601 32596 consensus_queue.cc:1048] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:50.687049 32662 raft_consensus.cc:1275] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:50.689534 32715 consensus_queue.cc:1048] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:50.723182 32450 raft_consensus.cc:1275] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:50.724766 32715 consensus_queue.cc:1048] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:50.735955 32662 raft_consensus.cc:1275] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:50.739048 32715 consensus_queue.cc:1048] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:51.022063 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:51.029379 32374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
mode: GRACEFUL
new_leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:41040
I20260709 13:11:51.029989 32374 raft_consensus.cc:606] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Received request to transfer leadership to TS 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:51.033126 32374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
mode: GRACEFUL
new_leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:41040
I20260709 13:11:51.033780 32374 raft_consensus.cc:606] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Received request to transfer leadership to TS 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:51.036795 32450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffa187132503479db4b2c3e326e75550"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:51.037460 32450 raft_consensus.cc:606] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:51.038779 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:51.039304 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:51.039947 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:51.296130 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:51.343257 32715 raft_consensus.cc:993] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036: : Instructing follower 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:51.343813 32596 raft_consensus.cc:1081] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Signalling peer 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:51.345633 32450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:51862
I20260709 13:11:51.346176 32450 raft_consensus.cc:493] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:51.346547 32450 raft_consensus.cc:3060] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.349419 32715 raft_consensus.cc:993] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036: : Instructing follower 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:51.349992 32596 raft_consensus.cc:1081] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Signalling peer 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:51.351761 32452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:51862
I20260709 13:11:51.352346 32452 raft_consensus.cc:493] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:51.352710 32452 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.353578 32450 raft_consensus.cc:515] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.355814 32450 leader_election.cc:290] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:51.356678 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:51.357136 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f575d45c8cf493da4bd68e56b8fb765" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:51.357383 32663 raft_consensus.cc:3060] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.357743 32374 raft_consensus.cc:3055] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.358085 32374 raft_consensus.cc:740] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:51.358951 32374 consensus_queue.cc:260] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.359642 32452 raft_consensus.cc:515] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.360313 32374 raft_consensus.cc:3060] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.361649 32452 leader_election.cc:290] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:51.362422 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:51.362859 32377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:51.363087 32662 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.363489 32377 raft_consensus.cc:3055] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.363811 32377 raft_consensus.cc:740] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:51.364719 32377 consensus_queue.cc:260] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.365554 32663 raft_consensus.cc:2468] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 2.
I20260709 13:11:51.365901 32377 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.367925 32417 leader_election.cc:304] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:51.368816 32606 raft_consensus.cc:2804] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:51.369481 32606 raft_consensus.cc:697] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:51.369357 32374 raft_consensus.cc:2468] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 2.
I20260709 13:11:51.370410 32606 consensus_queue.cc:237] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.373912 32377 raft_consensus.cc:2468] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 2.
I20260709 13:11:51.375595 32415 leader_election.cc:304] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:51.376508 32606 raft_consensus.cc:2804] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:51.377040 32606 raft_consensus.cc:697] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:51.377076 32662 raft_consensus.cc:2468] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 2.
I20260709 13:11:51.377982 32606 consensus_queue.cc:237] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.379768 32200 catalog_manager.cc:5697] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 1 to 2, leader changed from cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.397792 32200 catalog_manager.cc:5697] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 1 to 2, leader changed from cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.502559 32606 raft_consensus.cc:993] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:51.503199 32719 raft_consensus.cc:1081] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:51.505076 32377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffa187132503479db4b2c3e326e75550"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:51.505617 32377 raft_consensus.cc:493] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:51.505883 32377 raft_consensus.cc:3060] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.511749 32377 raft_consensus.cc:515] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.513613 32377 leader_election.cc:290] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:51.515201 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:51.515864 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa187132503479db4b2c3e326e75550" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:51.516068 32662 raft_consensus.cc:3060] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.516636 32452 raft_consensus.cc:3055] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.517024 32452 raft_consensus.cc:740] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:51.517928 32452 consensus_queue.cc:260] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.518930 32452 raft_consensus.cc:3060] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.522948 32662 raft_consensus.cc:2468] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:51.524374 32343 leader_election.cc:304] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:51.525271 32596 raft_consensus.cc:2804] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:51.525856 32596 raft_consensus.cc:697] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:51.526742 32596 consensus_queue.cc:237] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:51.527355 32452 raft_consensus.cc:2468] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:51.534518 32200 catalog_manager.cc:5697] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 1 to 2, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.844111 32377 raft_consensus.cc:1275] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:51.846004 32719 consensus_queue.cc:1048] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.861114 32662 raft_consensus.cc:1275] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:51.866690 32719 consensus_queue.cc:1048] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:51.949340 32662 raft_consensus.cc:1275] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:51.951035 32705 consensus_queue.cc:1048] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.965512 32375 raft_consensus.cc:1275] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:51.968089 32719 consensus_queue.cc:1048] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:52.006665 32662 raft_consensus.cc:1275] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.008271 32596 consensus_queue.cc:1048] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.019920 32452 raft_consensus.cc:1275] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.021471 32596 consensus_queue.cc:1048] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.047528 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:52.057118 32375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
mode: GRACEFUL
new_leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:41040
I20260709 13:11:52.057852 32375 raft_consensus.cc:606] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Received request to transfer leadership to TS 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:52.062351 32452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:52.063189 32452 raft_consensus.cc:606] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:52.067086 32452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:52.068100 32452 raft_consensus.cc:606] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:52.070151 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:52.070842 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:52.071501 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:52.230705 32606 raft_consensus.cc:993] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:52.231273 32719 raft_consensus.cc:1081] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:52.233080 32375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:52.233629 32375 raft_consensus.cc:493] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.233920 32375 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.242002 32375 raft_consensus.cc:515] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.244165 32375 leader_election.cc:290] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:52.245435 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:52.245929 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:52.246274 32662 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.246567 32452 raft_consensus.cc:3055] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.246956 32452 raft_consensus.cc:740] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:52.248073 32452 consensus_queue.cc:260] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.249764 32452 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.256803 32662 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:52.258291 32343 leader_election.cc:304] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:52.259119 32596 raft_consensus.cc:2804] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.259567 32596 raft_consensus.cc:697] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:52.260064 32452 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:52.261035 32596 consensus_queue.cc:237] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.273650 32197 catalog_manager.cc:5697] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 1 to 2, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:52.297340 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:52.320245 32723 raft_consensus.cc:993] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036: : Instructing follower 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:52.320782 32596 raft_consensus.cc:1081] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Signalling peer 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:52.322315 32452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:51862
I20260709 13:11:52.322751 32452 raft_consensus.cc:493] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.322985 32452 raft_consensus.cc:3060] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.328593 32452 raft_consensus.cc:515] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.330158 32452 leader_election.cc:290] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:52.331112 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:52.331434 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f9202219c4863a5ab7d2db1a31400" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:52.331789 32662 raft_consensus.cc:3060] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.332086 32375 raft_consensus.cc:3055] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.332461 32375 raft_consensus.cc:740] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:52.333386 32375 consensus_queue.cc:260] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.334570 32375 raft_consensus.cc:3060] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.338197 32662 raft_consensus.cc:2468] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 2.
I20260709 13:11:52.339533 32417 leader_election.cc:304] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:52.340479 32719 raft_consensus.cc:2804] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.340988 32719 raft_consensus.cc:697] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:52.341784 32375 raft_consensus.cc:2468] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 2.
I20260709 13:11:52.341964 32719 consensus_queue.cc:237] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.350353 32740 raft_consensus.cc:993] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:52.350916 32705 raft_consensus.cc:1081] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:52.350690 32197 catalog_manager.cc:5697] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 1 to 2, leader changed from cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.352917 32375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:52.353497 32375 raft_consensus.cc:493] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:52.353835 32375 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.359691 32375 raft_consensus.cc:515] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.361593 32375 leader_election.cc:290] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 3 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:52.363070 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:52.363646 32452 raft_consensus.cc:3055] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:52.363889 32452 raft_consensus.cc:740] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:52.364742 32452 consensus_queue.cc:260] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.366463 32452 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.367146 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa329ca8824a98ad9b655cc38d6f32" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:52.367995 32662 raft_consensus.cc:3060] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.372639 32452 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 3.
I20260709 13:11:52.373826 32343 leader_election.cc:304] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a77032aa8a4a30b2990dee8acfaca3, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:52.374552 32596 raft_consensus.cc:2804] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:52.374876 32662 raft_consensus.cc:2468] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 3.
I20260709 13:11:52.375044 32596 raft_consensus.cc:697] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 3 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:52.376259 32596 consensus_queue.cc:237] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:52.383471 32197 catalog_manager.cc:5697] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 2 to 3, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.725363 32662 raft_consensus.cc:1275] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.726682 32723 consensus_queue.cc:1048] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.739696 32452 raft_consensus.cc:1275] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.741080 32723 consensus_queue.cc:1048] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:52.798069 32452 raft_consensus.cc:1275] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:52.799353 32723 consensus_queue.cc:1048] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:52.810158 32663 raft_consensus.cc:1275] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:52.812599 32751 consensus_queue.cc:1048] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.890535 32375 raft_consensus.cc:1275] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.892016 32740 consensus_queue.cc:1048] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.906129 32663 raft_consensus.cc:1275] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.908592 32606 consensus_queue.cc:1048] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.078050 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:53.085497 32375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
mode: GRACEFUL
new_leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:41040
I20260709 13:11:53.086133 32375 raft_consensus.cc:606] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Received request to transfer leadership to TS 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:53.089062 32452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:53.089599 32452 raft_consensus.cc:606] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:53.092172 32375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
mode: GRACEFUL
new_leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:41040
I20260709 13:11:53.092651 32375 raft_consensus.cc:606] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Received request to transfer leadership to TS 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:53.094096 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:53.094681 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:53.095268 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:53.150578 32723 raft_consensus.cc:993] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036: : Instructing follower 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:53.151160 32723 raft_consensus.cc:1081] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Signalling peer 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:53.152793 32452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:51862
I20260709 13:11:53.153489 32452 raft_consensus.cc:493] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:53.153765 32452 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.159199 32452 raft_consensus.cc:515] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:53.160751 32452 leader_election.cc:290] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:53.161999 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:53.162360 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:53.162756 32375 raft_consensus.cc:3055] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:53.162992 32663 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.163264 32375 raft_consensus.cc:740] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:53.164304 32375 consensus_queue.cc:260] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:53.166111 32375 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.173882 32663 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:53.174475 32375 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:53.175244 32417 leader_election.cc:304] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:53.176120 32606 raft_consensus.cc:2804] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:53.176618 32606 raft_consensus.cc:697] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:53.177560 32606 consensus_queue.cc:237] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:53.185910 32200 catalog_manager.cc:5697] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 2 to 3, leader changed from cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:53.298447 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:53.436012 32751 raft_consensus.cc:993] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036: : Instructing follower 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:53.436558 32723 raft_consensus.cc:1081] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Signalling peer 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:53.438414 32452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:51862
I20260709 13:11:53.438910 32452 raft_consensus.cc:493] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:53.439211 32452 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.444674 32452 raft_consensus.cc:515] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:53.446205 32452 leader_election.cc:290] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:53.447335 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:53.447208 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ec8e9c59a94bc999b69215e72dd3e5" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:53.448074 32375 raft_consensus.cc:3055] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:53.448128 32663 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.448553 32375 raft_consensus.cc:740] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:53.449608 32375 consensus_queue.cc:260] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:53.451092 32375 raft_consensus.cc:3060] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.456436 32663 raft_consensus.cc:2468] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:53.457962 32417 leader_election.cc:304] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:53.458541 32375 raft_consensus.cc:2468] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:53.458933 32606 raft_consensus.cc:2804] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:53.459652 32606 raft_consensus.cc:697] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:53.460822 32606 consensus_queue.cc:237] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:53.468956 32200 catalog_manager.cc:5697] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 2 to 3, leader changed from cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:53.554402 32761 raft_consensus.cc:993] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:53.555105 32606 raft_consensus.cc:1081] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:53.556726 32375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:53.557307 32375 raft_consensus.cc:493] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:53.557631 32375 raft_consensus.cc:3060] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.563176 32375 raft_consensus.cc:515] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:53.565014 32375 leader_election.cc:290] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Requested vote from peers 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985), 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247)
I20260709 13:11:53.565748 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:53.565941 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffb3af1bd274ab8a6cda32a41ecced3" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:53.566479 32452 raft_consensus.cc:3055] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:53.566571 32663 raft_consensus.cc:3060] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.566929 32452 raft_consensus.cc:740] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:53.568099 32452 consensus_queue.cc:260] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:53.569285 32452 raft_consensus.cc:3060] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.572456 32663 raft_consensus.cc:2468] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:53.573961 32343 leader_election.cc:304] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:53.574683 32452 raft_consensus.cc:2468] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 2.
I20260709 13:11:53.574738 32723 raft_consensus.cc:2804] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:53.575613 32723 raft_consensus.cc:697] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:53.576776 32723 consensus_queue.cc:237] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } }
I20260709 13:11:53.584025 32200 catalog_manager.cc:5697] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 1 to 2, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.693370 32663 raft_consensus.cc:1275] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:53.694707 32606 consensus_queue.cc:1048] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:53.706316 32375 raft_consensus.cc:1275] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:53.708743 32705 consensus_queue.cc:1048] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:53.997126 32663 raft_consensus.cc:1275] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:53.998549 32606 consensus_queue.cc:1048] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.010316 32375 raft_consensus.cc:1275] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.012023 32705 consensus_queue.cc:1048] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.043852 32452 raft_consensus.cc:1275] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.045513 32723 consensus_queue.cc:1048] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.056254 32663 raft_consensus.cc:1275] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.062022 32751 consensus_queue.cc:1048] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:54.101766 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:54.109470 32452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:54.110252 32452 raft_consensus.cc:606] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:54.113027 32452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
mode: GRACEFUL
new_leader_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:49592
I20260709 13:11:54.113500 32452 raft_consensus.cc:606] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Received request to transfer leadership to TS cc71c80513f5482cbdebb30e26a1b036
I20260709 13:11:54.116272 32375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
mode: GRACEFUL
new_leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:41040
I20260709 13:11:54.116780 32375 raft_consensus.cc:606] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Received request to transfer leadership to TS 94a77032aa8a4a30b2990dee8acfaca3
I20260709 13:11:54.118068 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:54.118566 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:54.119100 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:54.149715   310 raft_consensus.cc:993] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036: : Instructing follower 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:54.150275   311 raft_consensus.cc:1081] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Signalling peer 94a77032aa8a4a30b2990dee8acfaca3 to start an election
I20260709 13:11:54.151816 32452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6"
dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
 from {username='slave'} at 127.0.0.1:51862
I20260709 13:11:54.152316 32452 raft_consensus.cc:493] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.152663 32452 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.157513 32452 raft_consensus.cc:515] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.159118 32452 leader_election.cc:290] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683)
I20260709 13:11:54.160283 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:54.160279 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1118f0289484c9b711321d835a5b6" candidate_uuid: "94a77032aa8a4a30b2990dee8acfaca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
I20260709 13:11:54.161203 32663 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.161243 32375 raft_consensus.cc:3055] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.161804 32375 raft_consensus.cc:740] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:54.162621 32375 consensus_queue.cc:260] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.163857 32375 raft_consensus.cc:3060] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.169389 32663 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:54.170806 32417 leader_election.cc:304] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, 94a77032aa8a4a30b2990dee8acfaca3; no voters: 
I20260709 13:11:54.170969 32375 raft_consensus.cc:2468] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a77032aa8a4a30b2990dee8acfaca3 in term 3.
I20260709 13:11:54.171597 32761 raft_consensus.cc:2804] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.172138 32761 raft_consensus.cc:697] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Becoming Leader. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:54.173002 32761 consensus_queue.cc:237] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.180744 32197 catalog_manager.cc:5697] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 reported cstate change: term changed from 2 to 3, leader changed from cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130) to 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "94a77032aa8a4a30b2990dee8acfaca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:54.299497 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:54.455699 32761 raft_consensus.cc:993] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:54.456689 32606 raft_consensus.cc:1081] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:54.459041 32375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:54.459605 32375 raft_consensus.cc:493] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.459870 32375 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.465281 32375 raft_consensus.cc:515] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.466933 32375 leader_election.cc:290] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 3 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:54.468022 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:54.468278 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a20f668b5454d68b790e14540ed7286" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:54.468734 32663 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.468830 32452 raft_consensus.cc:3055] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.469305 32452 raft_consensus.cc:740] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:54.470017 32452 consensus_queue.cc:260] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.471004 32452 raft_consensus.cc:3060] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.475286 32663 raft_consensus.cc:2468] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 3.
I20260709 13:11:54.476236 32452 raft_consensus.cc:2468] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 3.
I20260709 13:11:54.476545 32343 leader_election.cc:304] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:54.477510   311 raft_consensus.cc:2804] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.477957   311 raft_consensus.cc:697] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 3 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:54.478806   311 consensus_queue.cc:237] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.487221 32197 catalog_manager.cc:5697] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 2 to 3, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.637636 32375 raft_consensus.cc:1275] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.638962 32761 consensus_queue.cc:1048] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.649170 32663 raft_consensus.cc:1275] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Refusing update from remote peer 94a77032aa8a4a30b2990dee8acfaca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.651007 32705 consensus_queue.cc:1048] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.660221 32761 raft_consensus.cc:993] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: : Instructing follower cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:54.660743 32705 raft_consensus.cc:1081] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Signalling peer cc71c80513f5482cbdebb30e26a1b036 to start an election
I20260709 13:11:54.662535 32375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d"
dest_uuid: "cc71c80513f5482cbdebb30e26a1b036"
 from {username='slave'} at 127.0.0.1:36322
I20260709 13:11:54.663112 32375 raft_consensus.cc:493] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.663424 32375 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.670137 32375 raft_consensus.cc:515] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.671608 32375 leader_election.cc:290] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 4 election: Requested vote from peers 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247), 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131:33985)
I20260709 13:11:54.672528 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "832164ed3f67429e9b6b55f10cab1e19"
I20260709 13:11:54.672785 32452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729640c1a04e414f80ba63e6e185718d" candidate_uuid: "cc71c80513f5482cbdebb30e26a1b036" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94a77032aa8a4a30b2990dee8acfaca3"
I20260709 13:11:54.673331 32663 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.673482 32452 raft_consensus.cc:3055] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:54.673887 32452 raft_consensus.cc:740] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 94a77032aa8a4a30b2990dee8acfaca3, State: Running, Role: LEADER
I20260709 13:11:54.674552 32452 consensus_queue.cc:260] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.675817 32452 raft_consensus.cc:3060] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.679638 32663 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 4.
I20260709 13:11:54.681005 32343 leader_election.cc:304] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832164ed3f67429e9b6b55f10cab1e19, cc71c80513f5482cbdebb30e26a1b036; no voters: 
I20260709 13:11:54.681818   318 raft_consensus.cc:2804] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:54.682302   318 raft_consensus.cc:697] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 4 LEADER]: Becoming Leader. State: Replica: cc71c80513f5482cbdebb30e26a1b036, State: Running, Role: LEADER
I20260709 13:11:54.683135 32452 raft_consensus.cc:2468] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc71c80513f5482cbdebb30e26a1b036 in term 4.
I20260709 13:11:54.683102   318 consensus_queue.cc:237] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } }
I20260709 13:11:54.689628 32200 catalog_manager.cc:5697] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 reported cstate change: term changed from 3 to 4, leader changed from 94a77032aa8a4a30b2990dee8acfaca3 (127.20.227.131) to cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130). New cstate: current_term: 4 leader_uuid: "cc71c80513f5482cbdebb30e26a1b036" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc71c80513f5482cbdebb30e26a1b036" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.926816 32452 raft_consensus.cc:1275] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.928099   318 consensus_queue.cc:1048] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:54.939961 32663 raft_consensus.cc:1275] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.942134   310 consensus_queue.cc:1048] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "832164ed3f67429e9b6b55f10cab1e19" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:55.125583 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:55.156934 21390 tablet_server.cc:179] TabletServer@127.20.227.129:34247 shutting down...
W20260709 13:11:55.161120 32343 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 99 similar messages]
W20260709 13:11:55.180075 32343 consensus_peers.cc:597] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.197598 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:55.198819 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.199827 21390 raft_consensus.cc:2243] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.200340 21390 raft_consensus.cc:2272] T 729640c1a04e414f80ba63e6e185718d P 832164ed3f67429e9b6b55f10cab1e19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.202913 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.203512 21390 raft_consensus.cc:2243] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.203905 21390 raft_consensus.cc:2272] T 8f575d45c8cf493da4bd68e56b8fb765 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.206635 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.207190 21390 raft_consensus.cc:2243] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.207602 21390 raft_consensus.cc:2272] T 95aa329ca8824a98ad9b655cc38d6f32 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.209820 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.210332 21390 raft_consensus.cc:2243] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.210769 21390 raft_consensus.cc:2272] T 5ca5cf4a68f349019aabcf63baf5f72e P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.214098 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.214658 21390 raft_consensus.cc:2243] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:55.215005 32343 consensus_peers.cc:597] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.215127 21390 raft_consensus.cc:2272] T a0b1118f0289484c9b711321d835a5b6 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.218252 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.218811 21390 raft_consensus.cc:2243] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.219271 21390 raft_consensus.cc:2272] T d2ec8e9c59a94bc999b69215e72dd3e5 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.221891 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.222842 21390 raft_consensus.cc:2243] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.223381 21390 raft_consensus.cc:2272] T 509f9202219c4863a5ab7d2db1a31400 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.223539 32452 raft_consensus.cc:1275] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 4 FOLLOWER]: Refusing update from remote peer cc71c80513f5482cbdebb30e26a1b036: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:55.225215   310 consensus_queue.cc:1048] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a77032aa8a4a30b2990dee8acfaca3" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 33985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:55.226629 32417 consensus_peers.cc:597] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.227963 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.228773 21390 raft_consensus.cc:2243] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.229665 21390 raft_consensus.cc:2272] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.232823 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.233825 21390 raft_consensus.cc:2243] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.234484 21390 raft_consensus.cc:2272] T ffa187132503479db4b2c3e326e75550 P 832164ed3f67429e9b6b55f10cab1e19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.237936 21390 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:55.238466 21390 raft_consensus.cc:2243] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.238981 21390 raft_consensus.cc:2272] T 1a20f668b5454d68b790e14540ed7286 P 832164ed3f67429e9b6b55f10cab1e19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.273726 21390 tablet_server.cc:196] TabletServer@127.20.227.129:34247 shutdown complete.
W20260709 13:11:55.300706 32248 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:55.301365 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
I20260709 13:11:55.327625 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:55.328627 21390 tablet_replica.cc:333] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.329829 21390 raft_consensus.cc:2243] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.330365 21390 raft_consensus.cc:2272] T a0b1118f0289484c9b711321d835a5b6 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.334057 21390 tablet_replica.cc:333] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.334728 21390 raft_consensus.cc:2243] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.335572 21390 raft_consensus.cc:2272] T 1a20f668b5454d68b790e14540ed7286 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.338600 21390 tablet_replica.cc:333] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.339222 21390 raft_consensus.cc:2243] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.340052 21390 raft_consensus.cc:2272] T 729640c1a04e414f80ba63e6e185718d P cc71c80513f5482cbdebb30e26a1b036 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.342949 21390 tablet_replica.cc:333] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.343603 21390 raft_consensus.cc:2243] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.344398 21390 raft_consensus.cc:2272] T 95aa329ca8824a98ad9b655cc38d6f32 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.346665 21390 tablet_replica.cc:333] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.347258 21390 raft_consensus.cc:2243] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.347819 21390 raft_consensus.cc:2272] T 5ca5cf4a68f349019aabcf63baf5f72e P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.350054 21390 tablet_replica.cc:333] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.350633 21390 raft_consensus.cc:2243] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.351074 21390 raft_consensus.cc:2272] T d2ec8e9c59a94bc999b69215e72dd3e5 P cc71c80513f5482cbdebb30e26a1b036 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.353330 21390 tablet_replica.cc:333] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.354056 21390 raft_consensus.cc:2243] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.354506 21390 raft_consensus.cc:2272] T 509f9202219c4863a5ab7d2db1a31400 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.356760 21390 tablet_replica.cc:333] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.357407 21390 raft_consensus.cc:2243] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.358223 21390 raft_consensus.cc:2272] T 7ffb3af1bd274ab8a6cda32a41ecced3 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.360777 21390 tablet_replica.cc:333] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
I20260709 13:11:55.361804 21390 raft_consensus.cc:2243] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.362951 21390 raft_consensus.cc:2272] T ffa187132503479db4b2c3e326e75550 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.365762 21390 tablet_replica.cc:333] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036: stopping tablet replica
W20260709 13:11:55.365607 32415 consensus_peers.cc:597] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683): Couldn't send request to peer cc71c80513f5482cbdebb30e26a1b036. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.366564 21390 raft_consensus.cc:2243] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.367158 21390 raft_consensus.cc:2272] T 8f575d45c8cf493da4bd68e56b8fb765 P cc71c80513f5482cbdebb30e26a1b036 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.401707 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
W20260709 13:11:55.422899 32417 consensus_peers.cc:597] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.430640 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
W20260709 13:11:55.437932 32415 consensus_peers.cc:597] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer cc71c80513f5482cbdebb30e26a1b036 (127.20.227.130:37683): Couldn't send request to peer cc71c80513f5482cbdebb30e26a1b036. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37683: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.466151 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:11:55.466192 32417 consensus_peers.cc:597] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 -> Peer 832164ed3f67429e9b6b55f10cab1e19 (127.20.227.129:34247): Couldn't send request to peer 832164ed3f67429e9b6b55f10cab1e19. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:34247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.467154 21390 tablet_replica.cc:333] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.468003 21390 raft_consensus.cc:2243] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.468961 21390 raft_consensus.cc:2272] T a0b1118f0289484c9b711321d835a5b6 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.471611 21390 tablet_replica.cc:333] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.472254 21390 raft_consensus.cc:2243] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.472712 21390 raft_consensus.cc:2272] T 1a20f668b5454d68b790e14540ed7286 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.475785 21390 tablet_replica.cc:333] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.476449 21390 raft_consensus.cc:2243] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.477331 21390 raft_consensus.cc:2272] T 8f575d45c8cf493da4bd68e56b8fb765 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.479538 21390 tablet_replica.cc:333] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.480158 21390 raft_consensus.cc:2243] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.481021 21390 raft_consensus.cc:2272] T d2ec8e9c59a94bc999b69215e72dd3e5 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.483311 21390 tablet_replica.cc:333] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.483892 21390 raft_consensus.cc:2243] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.484705 21390 raft_consensus.cc:2272] T 509f9202219c4863a5ab7d2db1a31400 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.486882 21390 tablet_replica.cc:333] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.487437 21390 raft_consensus.cc:2243] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.487867 21390 raft_consensus.cc:2272] T 7ffb3af1bd274ab8a6cda32a41ecced3 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.490070 21390 tablet_replica.cc:333] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.490670 21390 raft_consensus.cc:2243] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.491187 21390 raft_consensus.cc:2272] T ffa187132503479db4b2c3e326e75550 P 94a77032aa8a4a30b2990dee8acfaca3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.493382 21390 tablet_replica.cc:333] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.493884 21390 raft_consensus.cc:2243] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.494305 21390 raft_consensus.cc:2272] T 729640c1a04e414f80ba63e6e185718d P 94a77032aa8a4a30b2990dee8acfaca3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.496820 21390 tablet_replica.cc:333] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.497407 21390 raft_consensus.cc:2243] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.497839 21390 raft_consensus.cc:2272] T 95aa329ca8824a98ad9b655cc38d6f32 P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.499796 21390 tablet_replica.cc:333] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3: stopping tablet replica
I20260709 13:11:55.500276 21390 raft_consensus.cc:2243] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.501133 21390 raft_consensus.cc:2272] T 5ca5cf4a68f349019aabcf63baf5f72e P 94a77032aa8a4a30b2990dee8acfaca3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.527377 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
I20260709 13:11:55.555923 21390 master.cc:562] Master@127.20.227.190:35793 shutting down...
I20260709 13:11:55.586241 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.586771 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.587072 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P f0edec0ffdb149258ebbac27d3f9478d: stopping tablet replica
I20260709 13:11:55.608686 21390 master.cc:584] Master@127.20.227.190:35793 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14518 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:11:55.654868 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:34195
I20260709 13:11:55.656072 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:55.662358   335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.662487   334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.663929   337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:55.664933 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:55.665947 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:55.666167 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:55.666373 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602715666340 us; error 0 us; skew 500 ppm
I20260709 13:11:55.666947 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:55.669788 21390 webserver.cc:533] Webserver started at http://127.20.227.190:38395/ using document root <none> and password file <none>
I20260709 13:11:55.670323 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:55.670521 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:55.670833 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:55.671993 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "a096973305ed4dbdbe90b81b842001e0"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-078m"
I20260709 13:11:55.676785 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 13:11:55.680635   342 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.681631 21390 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:55.682044 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "a096973305ed4dbdbe90b81b842001e0"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-078m"
I20260709 13:11:55.682307 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:55.700228 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:55.701568 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:55.744136 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:34195
I20260709 13:11:55.744220   393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:34195 every 8 connection(s)
I20260709 13:11:55.749042   394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.762244   394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0: Bootstrap starting.
I20260709 13:11:55.768146   394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.772964   394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0: No bootstrap required, opened a new log
I20260709 13:11:55.775157   394 raft_consensus.cc:359] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a096973305ed4dbdbe90b81b842001e0" member_type: VOTER }
I20260709 13:11:55.775590   394 raft_consensus.cc:385] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.775772   394 raft_consensus.cc:740] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a096973305ed4dbdbe90b81b842001e0, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.776461   394 consensus_queue.cc:260] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a096973305ed4dbdbe90b81b842001e0" member_type: VOTER }
I20260709 13:11:55.777233   394 raft_consensus.cc:399] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:55.777477   394 raft_consensus.cc:493] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:55.777904   394 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.783119   394 raft_consensus.cc:515] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a096973305ed4dbdbe90b81b842001e0" member_type: VOTER }
I20260709 13:11:55.783761   394 leader_election.cc:304] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a096973305ed4dbdbe90b81b842001e0; no voters: 
I20260709 13:11:55.785115   394 leader_election.cc:290] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:55.785517   397 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:55.787293   397 raft_consensus.cc:697] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 1 LEADER]: Becoming Leader. State: Replica: a096973305ed4dbdbe90b81b842001e0, State: Running, Role: LEADER
I20260709 13:11:55.788061   397 consensus_queue.cc:237] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a096973305ed4dbdbe90b81b842001e0" member_type: VOTER }
I20260709 13:11:55.788808   394 sys_catalog.cc:565] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:55.793294   399 sys_catalog.cc:455] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a096973305ed4dbdbe90b81b842001e0. Latest consensus state: current_term: 1 leader_uuid: "a096973305ed4dbdbe90b81b842001e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a096973305ed4dbdbe90b81b842001e0" member_type: VOTER } }
I20260709 13:11:55.794117   399 sys_catalog.cc:458] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:55.794600   398 sys_catalog.cc:455] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a096973305ed4dbdbe90b81b842001e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a096973305ed4dbdbe90b81b842001e0" member_type: VOTER } }
I20260709 13:11:55.796244   398 sys_catalog.cc:458] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:55.798864   404 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:55.806137   404 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:55.807945 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:55.816165   404 catalog_manager.cc:1383] Generated new cluster ID: 19f40718af2f4b12866f763b4bcc0d93
I20260709 13:11:55.816517   404 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:55.840167   404 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:55.841771   404 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:55.857241   404 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0: Generated new TSK 0
I20260709 13:11:55.857916   404 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:55.875303 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:55.882812   415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.884152   416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.886325   418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:55.886904 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:55.890141 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:55.890411 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:55.890621 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602715890595 us; error 0 us; skew 500 ppm
I20260709 13:11:55.891296 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:55.894164 21390 webserver.cc:533] Webserver started at http://127.20.227.129:41489/ using document root <none> and password file <none>
I20260709 13:11:55.894753 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:55.894991 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:55.895294 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:55.896586 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "c7a0d8721a524018aa35f1f4fd498109"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-078m"
I20260709 13:11:55.901969 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:55.905535   423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.906519 21390 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:11:55.906838 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "c7a0d8721a524018aa35f1f4fd498109"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-078m"
I20260709 13:11:55.907189 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:55.924091 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:55.925437 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:55.926921 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:55.929757 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:55.930034 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.930292 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:55.930487 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.975255 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:37255
I20260709 13:11:55.975380   486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:37255 every 8 connection(s)
I20260709 13:11:55.980640 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:55.988957   491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.992060   492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.995816   494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:55.996376 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:55.996301   487 heartbeater.cc:344] Connected to a master server at 127.20.227.190:34195
I20260709 13:11:55.997164   487 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:55.997882 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:55.998183 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:55.998024   487 heartbeater.cc:507] Master 127.20.227.190:34195 requested a full tablet report, sending...
I20260709 13:11:55.998449 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602715998415 us; error 0 us; skew 500 ppm
I20260709 13:11:55.999116 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:56.000661   359 ts_manager.cc:194] Registered new tserver with Master: c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255)
I20260709 13:11:56.001978 21390 webserver.cc:533] Webserver started at http://127.20.227.130:46369/ using document root <none> and password file <none>
I20260709 13:11:56.002688 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:56.002902 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:56.003137   359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52780
I20260709 13:11:56.003180 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:56.004694 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "d578184e603c4fdd83920c4b56e3dda7"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-078m"
I20260709 13:11:56.010293 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:56.014365   499 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:56.015611 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:56.015961 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "d578184e603c4fdd83920c4b56e3dda7"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-078m"
I20260709 13:11:56.016258 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:56.045413 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:56.046782 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:56.048419 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:56.050899 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:56.051152 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:56.051424 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:56.051620 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:56.096071 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:39819
I20260709 13:11:56.096184   561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:39819 every 8 connection(s)
I20260709 13:11:56.101166 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:56.109913   565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:56.110905   566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:56.113637   568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:56.114275 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:56.115339 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:56.115644 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:56.115782 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602716115770 us; error 0 us; skew 500 ppm
I20260709 13:11:56.115913   562 heartbeater.cc:344] Connected to a master server at 127.20.227.190:34195
I20260709 13:11:56.116339   562 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:56.116532 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:56.117462   562 heartbeater.cc:507] Master 127.20.227.190:34195 requested a full tablet report, sending...
I20260709 13:11:56.119786 21390 webserver.cc:533] Webserver started at http://127.20.227.131:42465/ using document root <none> and password file <none>
I20260709 13:11:56.120277   359 ts_manager.cc:194] Registered new tserver with Master: d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819)
I20260709 13:11:56.120523 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:56.120838 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:56.121193 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:56.122304   359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52782
I20260709 13:11:56.122810 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
format_stamp: "Formatted at 2026-07-09 13:11:56 on dist-test-slave-078m"
I20260709 13:11:56.128353 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:11:56.132639   573 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:56.133725 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:56.134063 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
format_stamp: "Formatted at 2026-07-09 13:11:56 on dist-test-slave-078m"
I20260709 13:11:56.134346 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:56.151679 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:56.152948 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:56.154414 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:56.156704 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:56.156953 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:56.157210 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:56.157361 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:56.202109 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:41401
I20260709 13:11:56.202256   635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:41401 every 8 connection(s)
I20260709 13:11:56.218324   636 heartbeater.cc:344] Connected to a master server at 127.20.227.190:34195
I20260709 13:11:56.218848   636 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:56.219652   636 heartbeater.cc:507] Master 127.20.227.190:34195 requested a full tablet report, sending...
I20260709 13:11:56.221874   359 ts_manager.cc:194] Registered new tserver with Master: 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:56.221995 21390 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016341467s
I20260709 13:11:56.223402   359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52786
I20260709 13:11:56.251405   359 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52798:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:56.253559   359 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:56.309623   527 tablet_service.cc:1511] Processing CreateTablet for tablet b9de70cb2a9b4da1aab0c95eb9a90d73 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c2fffbe5c4014ce5aab844d65d3d698c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:56.311338   527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9de70cb2a9b4da1aab0c95eb9a90d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.311002   526 tablet_service.cc:1511] Processing CreateTablet for tablet a04773ce996a49148c980c99ad66586a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c2fffbe5c4014ce5aab844d65d3d698c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:56.312546   526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04773ce996a49148c980c99ad66586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.327527   601 tablet_service.cc:1511] Processing CreateTablet for tablet b9de70cb2a9b4da1aab0c95eb9a90d73 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c2fffbe5c4014ce5aab844d65d3d698c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:56.328647   600 tablet_service.cc:1511] Processing CreateTablet for tablet a04773ce996a49148c980c99ad66586a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c2fffbe5c4014ce5aab844d65d3d698c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:56.329151   601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9de70cb2a9b4da1aab0c95eb9a90d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.330183   600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04773ce996a49148c980c99ad66586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.330701   452 tablet_service.cc:1511] Processing CreateTablet for tablet b9de70cb2a9b4da1aab0c95eb9a90d73 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c2fffbe5c4014ce5aab844d65d3d698c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:56.332213   452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9de70cb2a9b4da1aab0c95eb9a90d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.337049   451 tablet_service.cc:1511] Processing CreateTablet for tablet a04773ce996a49148c980c99ad66586a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c2fffbe5c4014ce5aab844d65d3d698c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:56.338771   451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04773ce996a49148c980c99ad66586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.340896   651 tablet_bootstrap.cc:492] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7: Bootstrap starting.
I20260709 13:11:56.348171   651 tablet_bootstrap.cc:654] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.358157   652 tablet_bootstrap.cc:492] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: Bootstrap starting.
I20260709 13:11:56.361843   651 tablet_bootstrap.cc:492] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7: No bootstrap required, opened a new log
I20260709 13:11:56.362550   651 ts_tablet_manager.cc:1403] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:11:56.366459   651 raft_consensus.cc:359] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.367432   651 raft_consensus.cc:385] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.367822   651 raft_consensus.cc:740] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.369131   652 tablet_bootstrap.cc:654] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.369283   651 consensus_queue.cc:260] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.374125   654 tablet_bootstrap.cc:492] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72: Bootstrap starting.
I20260709 13:11:56.379145   651 ts_tablet_manager.cc:1434] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:11:56.380113   562 heartbeater.cc:499] Master 127.20.227.190:34195 was elected leader, sending a full tablet report...
I20260709 13:11:56.384102   651 tablet_bootstrap.cc:492] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7: Bootstrap starting.
I20260709 13:11:56.384441   654 tablet_bootstrap.cc:654] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.392481   651 tablet_bootstrap.cc:654] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.406145   652 tablet_bootstrap.cc:492] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: No bootstrap required, opened a new log
I20260709 13:11:56.406800   652 ts_tablet_manager.cc:1403] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.023s
I20260709 13:11:56.407238   651 tablet_bootstrap.cc:492] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7: No bootstrap required, opened a new log
I20260709 13:11:56.407855   651 ts_tablet_manager.cc:1403] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 13:11:56.410100   652 raft_consensus.cc:359] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.410996   652 raft_consensus.cc:385] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.411360   652 raft_consensus.cc:740] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.412199   652 consensus_queue.cc:260] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.415621   651 raft_consensus.cc:359] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.416733   651 raft_consensus.cc:385] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.417158   651 raft_consensus.cc:740] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.419296   487 heartbeater.cc:499] Master 127.20.227.190:34195 was elected leader, sending a full tablet report...
I20260709 13:11:56.419389   651 consensus_queue.cc:260] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.420583   654 tablet_bootstrap.cc:492] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72: No bootstrap required, opened a new log
I20260709 13:11:56.421177   654 ts_tablet_manager.cc:1403] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.024s
I20260709 13:11:56.422096   652 ts_tablet_manager.cc:1434] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:11:56.422279   651 ts_tablet_manager.cc:1434] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:11:56.423125   652 tablet_bootstrap.cc:492] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109: Bootstrap starting.
I20260709 13:11:56.424381   654 raft_consensus.cc:359] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.425182   654 raft_consensus.cc:385] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.425477   654 raft_consensus.cc:740] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b7c213e6bb4805b2c73cd57cf67e72, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.426448   654 consensus_queue.cc:260] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.433393   652 tablet_bootstrap.cc:654] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.439039   654 ts_tablet_manager.cc:1434] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:11:56.439838   652 tablet_bootstrap.cc:492] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109: No bootstrap required, opened a new log
I20260709 13:11:56.439908   636 heartbeater.cc:499] Master 127.20.227.190:34195 was elected leader, sending a full tablet report...
I20260709 13:11:56.440452   654 tablet_bootstrap.cc:492] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72: Bootstrap starting.
I20260709 13:11:56.440580   652 ts_tablet_manager.cc:1403] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:11:56.444111   652 raft_consensus.cc:359] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.444986   652 raft_consensus.cc:385] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.445309   652 raft_consensus.cc:740] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.446079   652 consensus_queue.cc:260] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.448518   652 ts_tablet_manager.cc:1434] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:11:56.449831   654 tablet_bootstrap.cc:654] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.455919   654 tablet_bootstrap.cc:492] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72: No bootstrap required, opened a new log
I20260709 13:11:56.456449   654 ts_tablet_manager.cc:1403] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:11:56.459085   654 raft_consensus.cc:359] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.459872   654 raft_consensus.cc:385] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.460098   654 raft_consensus.cc:740] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b7c213e6bb4805b2c73cd57cf67e72, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.460681   654 consensus_queue.cc:260] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.462383   654 ts_tablet_manager.cc:1434] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:56.488467   660 raft_consensus.cc:493] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.488981   660 raft_consensus.cc:515] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.491401   660 leader_election.cc:290] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255), d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819)
I20260709 13:11:56.502403   462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04773ce996a49148c980c99ad66586a" candidate_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a0d8721a524018aa35f1f4fd498109" is_pre_election: true
I20260709 13:11:56.503258   462 raft_consensus.cc:2468] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97b7c213e6bb4805b2c73cd57cf67e72 in term 0.
I20260709 13:11:56.503530   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04773ce996a49148c980c99ad66586a" candidate_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d578184e603c4fdd83920c4b56e3dda7" is_pre_election: true
I20260709 13:11:56.504205   537 raft_consensus.cc:2468] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97b7c213e6bb4805b2c73cd57cf67e72 in term 0.
I20260709 13:11:56.504633   574 leader_election.cc:304] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97b7c213e6bb4805b2c73cd57cf67e72, c7a0d8721a524018aa35f1f4fd498109; no voters: 
I20260709 13:11:56.505579   660 raft_consensus.cc:2804] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.506013   660 raft_consensus.cc:493] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.506350   660 raft_consensus.cc:3060] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.512553   660 raft_consensus.cc:515] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.514345   660 leader_election.cc:290] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [CANDIDATE]: Term 1 election: Requested vote from peers c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255), d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819)
I20260709 13:11:56.515342   462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04773ce996a49148c980c99ad66586a" candidate_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a0d8721a524018aa35f1f4fd498109"
I20260709 13:11:56.515460   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04773ce996a49148c980c99ad66586a" candidate_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
I20260709 13:11:56.515971   462 raft_consensus.cc:3060] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.516156   537 raft_consensus.cc:3060] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.521914   537 raft_consensus.cc:2468] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97b7c213e6bb4805b2c73cd57cf67e72 in term 1.
I20260709 13:11:56.522023   462 raft_consensus.cc:2468] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97b7c213e6bb4805b2c73cd57cf67e72 in term 1.
I20260709 13:11:56.523180   575 leader_election.cc:304] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97b7c213e6bb4805b2c73cd57cf67e72, d578184e603c4fdd83920c4b56e3dda7; no voters: 
I20260709 13:11:56.524091   660 raft_consensus.cc:2804] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.525128   660 raft_consensus.cc:697] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 LEADER]: Becoming Leader. State: Replica: 97b7c213e6bb4805b2c73cd57cf67e72, State: Running, Role: LEADER
I20260709 13:11:56.526021   660 consensus_queue.cc:237] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:56.532827   357 catalog_manager.cc:5697] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:56.802461   407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:56.809573   655 raft_consensus.cc:493] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.810243   655 raft_consensus.cc:515] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.812314   655 leader_election.cc:290] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401), c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255)
I20260709 13:11:56.816306   659 raft_consensus.cc:493] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.816977   659 raft_consensus.cc:515] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.826327   659 leader_election.cc:290] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:56.827656   462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a0d8721a524018aa35f1f4fd498109" is_pre_election: true
I20260709 13:11:56.827656   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" is_pre_election: true
I20260709 13:11:56.828675   462 raft_consensus.cc:2468] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 0.
I20260709 13:11:56.828949   611 raft_consensus.cc:2468] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 0.
I20260709 13:11:56.830124   500 leader_election.cc:304] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7a0d8721a524018aa35f1f4fd498109, d578184e603c4fdd83920c4b56e3dda7; no voters: 
I20260709 13:11:56.831096   655 raft_consensus.cc:2804] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.831497   655 raft_consensus.cc:493] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.831889   655 raft_consensus.cc:3060] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.836285   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d578184e603c4fdd83920c4b56e3dda7" is_pre_election: true
I20260709 13:11:56.839313   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" is_pre_election: true
I20260709 13:11:56.839339   655 raft_consensus.cc:515] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.839960   611 raft_consensus.cc:2468] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 0.
I20260709 13:11:56.840850   537 raft_consensus.cc:2393] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7a0d8721a524018aa35f1f4fd498109 in current term 1: Already voted for candidate d578184e603c4fdd83920c4b56e3dda7 in this term.
I20260709 13:11:56.841519   424 leader_election.cc:304] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97b7c213e6bb4805b2c73cd57cf67e72, c7a0d8721a524018aa35f1f4fd498109; no voters: 
I20260709 13:11:56.841893   655 leader_election.cc:290] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 election: Requested vote from peers 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401), c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255)
I20260709 13:11:56.842614   659 raft_consensus.cc:2804] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.843003   659 raft_consensus.cc:493] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.843116   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
I20260709 13:11:56.843394   659 raft_consensus.cc:3060] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.843763   611 raft_consensus.cc:3060] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.844416   462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a0d8721a524018aa35f1f4fd498109"
I20260709 13:11:56.851372   611 raft_consensus.cc:2468] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 1.
I20260709 13:11:56.851401   659 raft_consensus.cc:515] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.852849   462 raft_consensus.cc:2393] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d578184e603c4fdd83920c4b56e3dda7 in current term 1: Already voted for candidate c7a0d8721a524018aa35f1f4fd498109 in this term.
I20260709 13:11:56.852973   500 leader_election.cc:304] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97b7c213e6bb4805b2c73cd57cf67e72, d578184e603c4fdd83920c4b56e3dda7; no voters: 
I20260709 13:11:56.853976   655 raft_consensus.cc:2804] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.854784   659 leader_election.cc:290] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 election: Requested vote from peers d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:56.854899   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
I20260709 13:11:56.855731   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
I20260709 13:11:56.856469   611 raft_consensus.cc:2393] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7a0d8721a524018aa35f1f4fd498109 in current term 1: Already voted for candidate d578184e603c4fdd83920c4b56e3dda7 in this term.
I20260709 13:11:56.856389   655 raft_consensus.cc:697] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Becoming Leader. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Running, Role: LEADER
I20260709 13:11:56.857564   655 consensus_queue.cc:237] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:56.862882   425 leader_election.cc:304] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7a0d8721a524018aa35f1f4fd498109; no voters: 97b7c213e6bb4805b2c73cd57cf67e72, d578184e603c4fdd83920c4b56e3dda7
I20260709 13:11:56.863893   659 raft_consensus.cc:2749] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.866621   357 catalog_manager.cc:5697] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "d578184e603c4fdd83920c4b56e3dda7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.916750   357 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50816:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:11:56.918154   660 consensus_queue.cc:1048] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:56.919052   357 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:56.939280   660 consensus_queue.cc:1048] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:56.963506   451 tablet_service.cc:1511] Processing CreateTablet for tablet cfb9c1dbc2644b639d5f96435acdf6a8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=69da4f3e6c5342efa1dc359d8e58cd3d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:56.964941   451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb9c1dbc2644b639d5f96435acdf6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.971199   526 tablet_service.cc:1511] Processing CreateTablet for tablet cfb9c1dbc2644b639d5f96435acdf6a8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=69da4f3e6c5342efa1dc359d8e58cd3d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:56.971459   527 tablet_service.cc:1511] Processing CreateTablet for tablet 634c4bde7572441d96c5ce58004e96ec (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=69da4f3e6c5342efa1dc359d8e58cd3d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:56.972671   526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb9c1dbc2644b639d5f96435acdf6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.972855   601 tablet_service.cc:1511] Processing CreateTablet for tablet cfb9c1dbc2644b639d5f96435acdf6a8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=69da4f3e6c5342efa1dc359d8e58cd3d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:56.973361   527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634c4bde7572441d96c5ce58004e96ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.974221   601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb9c1dbc2644b639d5f96435acdf6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.978111   600 tablet_service.cc:1511] Processing CreateTablet for tablet 634c4bde7572441d96c5ce58004e96ec (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=69da4f3e6c5342efa1dc359d8e58cd3d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:56.979616   600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634c4bde7572441d96c5ce58004e96ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.982930   452 tablet_service.cc:1511] Processing CreateTablet for tablet 634c4bde7572441d96c5ce58004e96ec (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=69da4f3e6c5342efa1dc359d8e58cd3d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:56.984338   452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634c4bde7572441d96c5ce58004e96ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:57.002483   685 tablet_bootstrap.cc:492] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: Bootstrap starting.
I20260709 13:11:57.009979   686 tablet_bootstrap.cc:492] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72: Bootstrap starting.
I20260709 13:11:57.015506   685 tablet_bootstrap.cc:654] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:57.017441   686 tablet_bootstrap.cc:654] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:57.021644   687 tablet_bootstrap.cc:492] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109: Bootstrap starting.
I20260709 13:11:57.025547   686 tablet_bootstrap.cc:492] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72: No bootstrap required, opened a new log
I20260709 13:11:57.025590   685 tablet_bootstrap.cc:492] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: No bootstrap required, opened a new log
I20260709 13:11:57.026573   686 ts_tablet_manager.cc:1403] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:11:57.026620   685 ts_tablet_manager.cc:1403] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.010s
I20260709 13:11:57.028435   687 tablet_bootstrap.cc:654] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:57.029407   686 raft_consensus.cc:359] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.030131   686 raft_consensus.cc:385] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:57.030385   686 raft_consensus.cc:740] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b7c213e6bb4805b2c73cd57cf67e72, State: Initialized, Role: FOLLOWER
I20260709 13:11:57.031200   686 consensus_queue.cc:260] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.032068   685 raft_consensus.cc:359] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.033151   685 raft_consensus.cc:385] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:57.033345   686 ts_tablet_manager.cc:1434] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:11:57.034595   686 tablet_bootstrap.cc:492] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72: Bootstrap starting.
I20260709 13:11:57.033602   685 raft_consensus.cc:740] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Initialized, Role: FOLLOWER
I20260709 13:11:57.037689   685 consensus_queue.cc:260] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.041427   685 ts_tablet_manager.cc:1434] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:11:57.042281   686 tablet_bootstrap.cc:654] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:57.043612   685 tablet_bootstrap.cc:492] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7: Bootstrap starting.
I20260709 13:11:57.049158   687 tablet_bootstrap.cc:492] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109: No bootstrap required, opened a new log
I20260709 13:11:57.049808   687 ts_tablet_manager.cc:1403] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.019s
I20260709 13:11:57.053233   685 tablet_bootstrap.cc:654] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:57.052985   687 raft_consensus.cc:359] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.054972   687 raft_consensus.cc:385] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:57.055311   687 raft_consensus.cc:740] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Initialized, Role: FOLLOWER
I20260709 13:11:57.056442   686 tablet_bootstrap.cc:492] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72: No bootstrap required, opened a new log
I20260709 13:11:57.056183   687 consensus_queue.cc:260] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.057348   686 ts_tablet_manager.cc:1403] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.014s
I20260709 13:11:57.061920   686 raft_consensus.cc:359] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.062987   686 raft_consensus.cc:385] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:57.063388   686 raft_consensus.cc:740] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b7c213e6bb4805b2c73cd57cf67e72, State: Initialized, Role: FOLLOWER
I20260709 13:11:57.064563   686 consensus_queue.cc:260] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.066079   687 ts_tablet_manager.cc:1434] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:11:57.068019   686 ts_tablet_manager.cc:1434] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:11:57.070360   687 tablet_bootstrap.cc:492] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: Bootstrap starting.
I20260709 13:11:57.078722   687 tablet_bootstrap.cc:654] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:57.081982   685 tablet_bootstrap.cc:492] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7: No bootstrap required, opened a new log
I20260709 13:11:57.082485   685 ts_tablet_manager.cc:1403] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.011s
I20260709 13:11:57.084503   687 tablet_bootstrap.cc:492] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: No bootstrap required, opened a new log
I20260709 13:11:57.085180   687 ts_tablet_manager.cc:1403] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:11:57.085525   685 raft_consensus.cc:359] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.086354   685 raft_consensus.cc:385] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:57.086658   685 raft_consensus.cc:740] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Initialized, Role: FOLLOWER
I20260709 13:11:57.087397   685 consensus_queue.cc:260] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.088377   687 raft_consensus.cc:359] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.089166   687 raft_consensus.cc:385] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:57.089466   687 raft_consensus.cc:740] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Initialized, Role: FOLLOWER
I20260709 13:11:57.089818   685 ts_tablet_manager.cc:1434] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:57.090224   687 consensus_queue.cc:260] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.092573   687 ts_tablet_manager.cc:1434] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:57.133172   655 raft_consensus.cc:493] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.133788   655 raft_consensus.cc:515] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.135432   655 leader_election.cc:290] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:57.136512   462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a0d8721a524018aa35f1f4fd498109" is_pre_election: true
I20260709 13:11:57.137034   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" is_pre_election: true
I20260709 13:11:57.137367   462 raft_consensus.cc:2468] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 0.
I20260709 13:11:57.137730   611 raft_consensus.cc:2468] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 0.
I20260709 13:11:57.138536   500 leader_election.cc:304] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7a0d8721a524018aa35f1f4fd498109, d578184e603c4fdd83920c4b56e3dda7; no voters: 
I20260709 13:11:57.139279   655 raft_consensus.cc:2804] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:57.139596   655 raft_consensus.cc:493] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.140021   655 raft_consensus.cc:3060] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.145434   655 raft_consensus.cc:515] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.147297   655 leader_election.cc:290] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 election: Requested vote from peers c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:57.148255   462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a0d8721a524018aa35f1f4fd498109"
I20260709 13:11:57.148559   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
I20260709 13:11:57.149024   462 raft_consensus.cc:3060] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.149369   611 raft_consensus.cc:3060] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.155040   462 raft_consensus.cc:2468] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 1.
I20260709 13:11:57.155031   611 raft_consensus.cc:2468] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 1.
I20260709 13:11:57.156327   500 leader_election.cc:304] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7a0d8721a524018aa35f1f4fd498109, d578184e603c4fdd83920c4b56e3dda7; no voters: 
I20260709 13:11:57.157042   655 raft_consensus.cc:2804] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:57.157541   655 raft_consensus.cc:697] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Becoming Leader. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Running, Role: LEADER
I20260709 13:11:57.158367   655 consensus_queue.cc:237] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.165386   356 catalog_manager.cc:5697] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "d578184e603c4fdd83920c4b56e3dda7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.213979   659 raft_consensus.cc:493] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.214582   659 raft_consensus.cc:515] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.216329   659 leader_election.cc:290] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:57.217434   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d578184e603c4fdd83920c4b56e3dda7" is_pre_election: true
I20260709 13:11:57.217711   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" is_pre_election: true
I20260709 13:11:57.218272   537 raft_consensus.cc:2468] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 0.
I20260709 13:11:57.218477   611 raft_consensus.cc:2468] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 0.
I20260709 13:11:57.219492   425 leader_election.cc:304] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7a0d8721a524018aa35f1f4fd498109, d578184e603c4fdd83920c4b56e3dda7; no voters: 
I20260709 13:11:57.220352   659 raft_consensus.cc:2804] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:57.220690   659 raft_consensus.cc:493] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.221082   659 raft_consensus.cc:3060] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.226428   659 raft_consensus.cc:515] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.228137   659 leader_election.cc:290] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 election: Requested vote from peers d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:57.229236   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
I20260709 13:11:57.229236   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
I20260709 13:11:57.230124   611 raft_consensus.cc:3060] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.230168   537 raft_consensus.cc:3060] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.237565   611 raft_consensus.cc:2468] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 1.
I20260709 13:11:57.237565   537 raft_consensus.cc:2468] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 1.
I20260709 13:11:57.238930   424 leader_election.cc:304] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97b7c213e6bb4805b2c73cd57cf67e72, c7a0d8721a524018aa35f1f4fd498109; no voters: 
I20260709 13:11:57.239614   659 raft_consensus.cc:2804] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:57.240890   659 raft_consensus.cc:697] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 LEADER]: Becoming Leader. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Running, Role: LEADER
I20260709 13:11:57.241822   659 consensus_queue.cc:237] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.248989   356 catalog_manager.cc:5697] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "c7a0d8721a524018aa35f1f4fd498109" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.283510   537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73"
dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
mode: GRACEFUL
new_leader_uuid: "c7a0d8721a524018aa35f1f4fd498109"
 from {username='slave'} at 127.0.0.1:46454
I20260709 13:11:57.284118   537 raft_consensus.cc:606] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Received request to transfer leadership to TS c7a0d8721a524018aa35f1f4fd498109
I20260709 13:11:57.294286   537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8"
dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
mode: GRACEFUL
new_leader_uuid: "c7a0d8721a524018aa35f1f4fd498109"
 from {username='slave'} at 127.0.0.1:46454
I20260709 13:11:57.294771   537 raft_consensus.cc:606] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Received request to transfer leadership to TS c7a0d8721a524018aa35f1f4fd498109
I20260709 13:11:57.412514   655 consensus_queue.cc:1048] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.425808   699 consensus_queue.cc:1048] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:57.437126   671 raft_consensus.cc:993] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7: : Instructing follower c7a0d8721a524018aa35f1f4fd498109 to start an election
I20260709 13:11:57.437654   699 raft_consensus.cc:1081] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Signalling peer c7a0d8721a524018aa35f1f4fd498109 to start an election
I20260709 13:11:57.439630   462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73"
dest_uuid: "c7a0d8721a524018aa35f1f4fd498109"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:11:57.440358   462 raft_consensus.cc:493] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.440843   462 raft_consensus.cc:3060] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.447187   462 raft_consensus.cc:515] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:57.449700   462 leader_election.cc:290] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 2 election: Requested vote from peers d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:57.450027   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
I20260709 13:11:57.450383   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9de70cb2a9b4da1aab0c95eb9a90d73" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
I20260709 13:11:57.450822   537 raft_consensus.cc:3055] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.451012   611 raft_consensus.cc:3060] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.451223   537 raft_consensus.cc:740] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Running, Role: LEADER
I20260709 13:11:57.452106   537 consensus_queue.cc:260] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:57.453428   537 raft_consensus.cc:3060] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.458472   611 raft_consensus.cc:2468] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 2.
I20260709 13:11:57.459869   424 leader_election.cc:304] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97b7c213e6bb4805b2c73cd57cf67e72, c7a0d8721a524018aa35f1f4fd498109; no voters: 
I20260709 13:11:57.459964   537 raft_consensus.cc:2468] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 2.
I20260709 13:11:57.460758   659 raft_consensus.cc:2804] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.461326   659 raft_consensus.cc:697] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 2 LEADER]: Becoming Leader. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Running, Role: LEADER
I20260709 13:11:57.462229   659 consensus_queue.cc:237] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } }
I20260709 13:11:57.469935   355 catalog_manager.cc:5697] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 reported cstate change: term changed from 1 to 2, leader changed from d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130) to c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "c7a0d8721a524018aa35f1f4fd498109" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.627055   699 consensus_queue.cc:1048] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.634032   671 raft_consensus.cc:993] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7: : Instructing follower c7a0d8721a524018aa35f1f4fd498109 to start an election
I20260709 13:11:57.634507   671 raft_consensus.cc:1081] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Signalling peer c7a0d8721a524018aa35f1f4fd498109 to start an election
I20260709 13:11:57.638616   461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8"
dest_uuid: "c7a0d8721a524018aa35f1f4fd498109"
 from {username='slave'} at 127.0.0.1:33772
I20260709 13:11:57.639263   461 raft_consensus.cc:493] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.639681   461 raft_consensus.cc:3060] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.641148   699 consensus_queue.cc:1048] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:57.648767   461 raft_consensus.cc:515] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.650651   461 leader_election.cc:290] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 2 election: Requested vote from peers d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130:39819), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:57.651628   537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
I20260709 13:11:57.652194   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb9c1dbc2644b639d5f96435acdf6a8" candidate_uuid: "c7a0d8721a524018aa35f1f4fd498109" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
I20260709 13:11:57.652328   537 raft_consensus.cc:3055] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.652803   537 raft_consensus.cc:740] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Running, Role: LEADER
I20260709 13:11:57.652827   611 raft_consensus.cc:3060] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.653738   537 consensus_queue.cc:260] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.654891   537 raft_consensus.cc:3060] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.659281   611 raft_consensus.cc:2468] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 2.
I20260709 13:11:57.660465   424 leader_election.cc:304] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97b7c213e6bb4805b2c73cd57cf67e72, c7a0d8721a524018aa35f1f4fd498109; no voters: 
I20260709 13:11:57.660389   537 raft_consensus.cc:2468] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7a0d8721a524018aa35f1f4fd498109 in term 2.
I20260709 13:11:57.661512   659 raft_consensus.cc:2804] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.662020   659 raft_consensus.cc:697] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 2 LEADER]: Becoming Leader. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Running, Role: LEADER
I20260709 13:11:57.662786   659 consensus_queue.cc:237] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.669410   356 catalog_manager.cc:5697] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 reported cstate change: term changed from 1 to 2, leader changed from d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130) to c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "c7a0d8721a524018aa35f1f4fd498109" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.766152 21390 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:11:57.767804 21390 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:11:57.768237 21390 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:11:57.780602   461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec"
dest_uuid: "c7a0d8721a524018aa35f1f4fd498109"
mode: GRACEFUL
new_leader_uuid: "d578184e603c4fdd83920c4b56e3dda7"
 from {username='slave'} at 127.0.0.1:33784
I20260709 13:11:57.781280   461 raft_consensus.cc:606] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 LEADER]: Received request to transfer leadership to TS d578184e603c4fdd83920c4b56e3dda7
I20260709 13:11:57.782706 21390 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:11:57.810016   659 consensus_queue.cc:1048] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.817620   695 raft_consensus.cc:993] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109: : Instructing follower d578184e603c4fdd83920c4b56e3dda7 to start an election
I20260709 13:11:57.818439   659 raft_consensus.cc:1081] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 LEADER]: Signalling peer d578184e603c4fdd83920c4b56e3dda7 to start an election
I20260709 13:11:57.821144   536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec"
dest_uuid: "d578184e603c4fdd83920c4b56e3dda7"
 from {username='slave'} at 127.0.0.1:46452
I20260709 13:11:57.821795   536 raft_consensus.cc:493] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.822175   536 raft_consensus.cc:3060] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.826735   708 consensus_queue.cc:1048] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:57.830276   536 raft_consensus.cc:515] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.835847   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7a0d8721a524018aa35f1f4fd498109"
I20260709 13:11:57.836588   461 raft_consensus.cc:3055] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.837015   461 raft_consensus.cc:740] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7a0d8721a524018aa35f1f4fd498109, State: Running, Role: LEADER
I20260709 13:11:57.839675   461 consensus_queue.cc:260] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.840852   461 raft_consensus.cc:3060] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.839598   536 leader_election.cc:290] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 2 election: Requested vote from peers c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255), 97b7c213e6bb4805b2c73cd57cf67e72 (127.20.227.131:41401)
I20260709 13:11:57.845422   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634c4bde7572441d96c5ce58004e96ec" candidate_uuid: "d578184e603c4fdd83920c4b56e3dda7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97b7c213e6bb4805b2c73cd57cf67e72"
I20260709 13:11:57.846176   611 raft_consensus.cc:3060] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:57.849156   461 raft_consensus.cc:2468] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 2.
I20260709 13:11:57.850222   500 leader_election.cc:304] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7a0d8721a524018aa35f1f4fd498109, d578184e603c4fdd83920c4b56e3dda7; no voters: 
I20260709 13:11:57.850945   671 raft_consensus.cc:2804] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:57.851441   671 raft_consensus.cc:697] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 2 LEADER]: Becoming Leader. State: Replica: d578184e603c4fdd83920c4b56e3dda7, State: Running, Role: LEADER
I20260709 13:11:57.852006   611 raft_consensus.cc:2468] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d578184e603c4fdd83920c4b56e3dda7 in term 2.
I20260709 13:11:57.852288   671 consensus_queue.cc:237] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } }
I20260709 13:11:57.859083   355 catalog_manager.cc:5697] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 reported cstate change: term changed from 1 to 2, leader changed from c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129) to d578184e603c4fdd83920c4b56e3dda7 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "d578184e603c4fdd83920c4b56e3dda7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a0d8721a524018aa35f1f4fd498109" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d578184e603c4fdd83920c4b56e3dda7" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 39819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97b7c213e6bb4805b2c73cd57cf67e72" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 41401 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.894063 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
I20260709 13:11:57.916574 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:57.917351 21390 tablet_replica.cc:333] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109: stopping tablet replica
I20260709 13:11:57.917881 21390 raft_consensus.cc:2243] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.918380 21390 raft_consensus.cc:2272] T a04773ce996a49148c980c99ad66586a P c7a0d8721a524018aa35f1f4fd498109 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.920571 21390 tablet_replica.cc:333] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: stopping tablet replica
I20260709 13:11:57.921144 21390 raft_consensus.cc:2243] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.921720 21390 pending_rounds.cc:70] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: Trying to abort 1 pending ops.
I20260709 13:11:57.921869 21390 pending_rounds.cc:77] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636731553955840 op_type: NO_OP noop_request { }
I20260709 13:11:57.922129 21390 raft_consensus.cc:2889] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:57.922428 21390 raft_consensus.cc:2272] T cfb9c1dbc2644b639d5f96435acdf6a8 P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.924726 21390 tablet_replica.cc:333] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109: stopping tablet replica
I20260709 13:11:57.925298 21390 raft_consensus.cc:2243] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.925678 21390 raft_consensus.cc:2272] T 634c4bde7572441d96c5ce58004e96ec P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.927649 21390 tablet_replica.cc:333] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: stopping tablet replica
I20260709 13:11:57.928099 21390 raft_consensus.cc:2243] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.928647 21390 pending_rounds.cc:70] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: Trying to abort 1 pending ops.
I20260709 13:11:57.928815 21390 pending_rounds.cc:77] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636730736623616 op_type: NO_OP noop_request { }
I20260709 13:11:57.929133 21390 raft_consensus.cc:2889] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:57.929363 21390 raft_consensus.cc:2272] T b9de70cb2a9b4da1aab0c95eb9a90d73 P c7a0d8721a524018aa35f1f4fd498109 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.943749 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
I20260709 13:11:57.956701 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
W20260709 13:11:57.966979   574 consensus_peers.cc:597] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 -> Peer c7a0d8721a524018aa35f1f4fd498109 (127.20.227.129:37255): Couldn't send request to peer c7a0d8721a524018aa35f1f4fd498109. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:37255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.980063 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:57.980816 21390 tablet_replica.cc:333] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7: stopping tablet replica
I20260709 13:11:57.981491 21390 raft_consensus.cc:2243] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.981968 21390 raft_consensus.cc:2272] T a04773ce996a49148c980c99ad66586a P d578184e603c4fdd83920c4b56e3dda7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.984014 21390 tablet_replica.cc:333] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7: stopping tablet replica
I20260709 13:11:57.984622 21390 raft_consensus.cc:2243] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.985105 21390 raft_consensus.cc:2272] T cfb9c1dbc2644b639d5f96435acdf6a8 P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.987241 21390 tablet_replica.cc:333] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: stopping tablet replica
I20260709 13:11:57.987779 21390 raft_consensus.cc:2243] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.988404 21390 pending_rounds.cc:70] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: Trying to abort 1 pending ops.
I20260709 13:11:57.988595 21390 pending_rounds.cc:77] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636732331331584 op_type: NO_OP noop_request { }
I20260709 13:11:57.988909 21390 raft_consensus.cc:2889] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:57.989176 21390 raft_consensus.cc:2272] T 634c4bde7572441d96c5ce58004e96ec P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.991525 21390 tablet_replica.cc:333] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7: stopping tablet replica
I20260709 13:11:57.991989 21390 raft_consensus.cc:2243] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.992349 21390 raft_consensus.cc:2272] T b9de70cb2a9b4da1aab0c95eb9a90d73 P d578184e603c4fdd83920c4b56e3dda7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.015363 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
I20260709 13:11:58.027639 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
I20260709 13:11:58.046622 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:58.047284 21390 tablet_replica.cc:333] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72: stopping tablet replica
I20260709 13:11:58.047816 21390 raft_consensus.cc:2243] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.048231 21390 raft_consensus.cc:2272] T 634c4bde7572441d96c5ce58004e96ec P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.050781 21390 tablet_replica.cc:333] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72: stopping tablet replica
I20260709 13:11:58.051294 21390 raft_consensus.cc:2243] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.051676 21390 raft_consensus.cc:2272] T cfb9c1dbc2644b639d5f96435acdf6a8 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.053948 21390 tablet_replica.cc:333] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72: stopping tablet replica
I20260709 13:11:58.054427 21390 raft_consensus.cc:2243] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.055159 21390 raft_consensus.cc:2272] T b9de70cb2a9b4da1aab0c95eb9a90d73 P 97b7c213e6bb4805b2c73cd57cf67e72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.057742 21390 tablet_replica.cc:333] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72: stopping tablet replica
I20260709 13:11:58.058209 21390 raft_consensus.cc:2243] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.058945 21390 raft_consensus.cc:2272] T a04773ce996a49148c980c99ad66586a P 97b7c213e6bb4805b2c73cd57cf67e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.082533 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
I20260709 13:11:58.095587 21390 master.cc:562] Master@127.20.227.190:34195 shutting down...
I20260709 13:11:58.113152 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.113763 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.114113 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P a096973305ed4dbdbe90b81b842001e0: stopping tablet replica
I20260709 13:11:58.134361 21390 master.cc:584] Master@127.20.227.190:34195 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2509 ms)
[----------] 6 tests from LeaderRebalancerTest (338276 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:11:58.164644 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:46483
I20260709 13:11:58.165822 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:58.171623   712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.172077   713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.173103   715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:58.174037 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:58.174925 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:58.175109 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:58.175221 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602718175211 us; error 0 us; skew 500 ppm
I20260709 13:11:58.175709 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:58.178503 21390 webserver.cc:533] Webserver started at http://127.20.227.190:37015/ using document root <none> and password file <none>
I20260709 13:11:58.178989 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:58.179148 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:58.179358 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:58.180404 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "9f3c162a46a241c58935c2d95c7adad4"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.185516 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:58.189380   720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.190315 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:11:58.190641 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "9f3c162a46a241c58935c2d95c7adad4"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.191071 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:58.212456 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:58.213656 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:58.253473 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:46483
I20260709 13:11:58.253580   771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:46483 every 8 connection(s)
I20260709 13:11:58.257495   772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.268635   772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4: Bootstrap starting.
I20260709 13:11:58.273360   772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:58.277668   772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4: No bootstrap required, opened a new log
I20260709 13:11:58.279790   772 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3c162a46a241c58935c2d95c7adad4" member_type: VOTER }
I20260709 13:11:58.280195   772 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:58.280469   772 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3c162a46a241c58935c2d95c7adad4, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.281163   772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3c162a46a241c58935c2d95c7adad4" member_type: VOTER }
I20260709 13:11:58.281616   772 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:58.281855   772 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:58.282145   772 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:58.287006   772 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3c162a46a241c58935c2d95c7adad4" member_type: VOTER }
I20260709 13:11:58.287567   772 leader_election.cc:304] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f3c162a46a241c58935c2d95c7adad4; no voters: 
I20260709 13:11:58.288738   772 leader_election.cc:290] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:58.289150   775 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:58.290639   775 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3c162a46a241c58935c2d95c7adad4, State: Running, Role: LEADER
I20260709 13:11:58.291325   775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3c162a46a241c58935c2d95c7adad4" member_type: VOTER }
I20260709 13:11:58.291687   772 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:58.294776   777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f3c162a46a241c58935c2d95c7adad4. Latest consensus state: current_term: 1 leader_uuid: "9f3c162a46a241c58935c2d95c7adad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3c162a46a241c58935c2d95c7adad4" member_type: VOTER } }
I20260709 13:11:58.294751   776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f3c162a46a241c58935c2d95c7adad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3c162a46a241c58935c2d95c7adad4" member_type: VOTER } }
I20260709 13:11:58.295552   777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:58.295624   776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:58.299763   780 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:58.305269   780 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:58.307796 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:58.314978   780 catalog_manager.cc:1383] Generated new cluster ID: 2c0d38b9992c43dbbb61d6530596a605
I20260709 13:11:58.315299   780 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:58.332046   780 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:58.333464   780 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:58.348537   780 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4: Generated new TSK 0
I20260709 13:11:58.349283   780 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:58.374675 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:58.381238   793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.382239   794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.384162   796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:58.384567 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:58.385653 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:58.385851 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:58.385986 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602718385975 us; error 0 us; skew 500 ppm
I20260709 13:11:58.386451 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:58.389263 21390 webserver.cc:533] Webserver started at http://127.20.227.129:44119/ using document root <none> and password file <none>
I20260709 13:11:58.389737 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:58.389905 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:58.390115 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:58.391219 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.396387 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:11:58.400226   801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.401449 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:58.401803 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.402077 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:58.440793 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:58.442013 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:58.443624 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:58.446045 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:58.446282 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.446549 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:58.446734 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.487113 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:42761
I20260709 13:11:58.487219   863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:42761 every 8 connection(s)
I20260709 13:11:58.492937 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:58.500279   868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.500721   869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.504592   871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:58.505075 21390 server_base.cc:1061] running on GCE node
I20260709 13:11:58.506237   864 heartbeater.cc:344] Connected to a master server at 127.20.227.190:46483
I20260709 13:11:58.506705   864 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:58.506839 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:58.507136 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:58.507314 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602718507280 us; error 0 us; skew 500 ppm
I20260709 13:11:58.507612   864 heartbeater.cc:507] Master 127.20.227.190:46483 requested a full tablet report, sending...
I20260709 13:11:58.507980 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:58.510171   737 ts_manager.cc:194] Registered new tserver with Master: 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761)
I20260709 13:11:58.510986 21390 webserver.cc:533] Webserver started at http://127.20.227.130:40401/ using document root <none> and password file <none>
I20260709 13:11:58.511698 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:58.511955 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:58.512261 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:58.512828   737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59126
I20260709 13:11:58.513751 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.518462 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:11:58.522001   876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.522912 21390 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:11:58.523222 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.523464 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:58.554948 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:58.555977 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:58.557452 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:58.559748 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:58.559995 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.560262 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:58.560436 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.603222 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:37205
I20260709 13:11:58.603386   938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:37205 every 8 connection(s)
I20260709 13:11:58.608320 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:58.615870   942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.616173   943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:58.619549 21390 server_base.cc:1061] running on GCE node
W20260709 13:11:58.620204   946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:58.620572   939 heartbeater.cc:344] Connected to a master server at 127.20.227.190:46483
I20260709 13:11:58.621192   939 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:58.621568 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:58.621848 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:58.622047 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602718622027 us; error 0 us; skew 500 ppm
I20260709 13:11:58.622099   939 heartbeater.cc:507] Master 127.20.227.190:46483 requested a full tablet report, sending...
I20260709 13:11:58.622851 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:58.624436   737 ts_manager.cc:194] Registered new tserver with Master: ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:58.626060   737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59136
I20260709 13:11:58.626176 21390 webserver.cc:533] Webserver started at http://127.20.227.131:42939/ using document root <none> and password file <none>
I20260709 13:11:58.626834 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:58.627045 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:58.627347 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:58.628455 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "0dad90a639f5494e80e9ab0313a8564c"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.633153 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:11:58.636556   950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.637575 21390 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:58.637949 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "0dad90a639f5494e80e9ab0313a8564c"
format_stamp: "Formatted at 2026-07-09 13:11:58 on dist-test-slave-078m"
I20260709 13:11:58.638310 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:58.664971 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:58.666081 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:58.667572 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:58.669952 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:58.670185 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.670434 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:58.670606 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.710583 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:36615
I20260709 13:11:58.710709  1012 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:36615 every 8 connection(s)
I20260709 13:11:58.724921  1013 heartbeater.cc:344] Connected to a master server at 127.20.227.190:46483
I20260709 13:11:58.725399  1013 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:58.726120  1013 heartbeater.cc:507] Master 127.20.227.190:46483 requested a full tablet report, sending...
I20260709 13:11:58.728456   737 ts_manager.cc:194] Registered new tserver with Master: 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:58.729001 21390 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015035793s
I20260709 13:11:58.730166   737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59140
I20260709 13:11:58.757148   737 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59142:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:58.759948   737 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:58.850018   903 tablet_service.cc:1511] Processing CreateTablet for tablet c34a35499f204fa6a5a12f6431b006c4 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:58.851464   903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34a35499f204fa6a5a12f6431b006c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.853894   902 tablet_service.cc:1511] Processing CreateTablet for tablet ae589d3521c749c2906110c3ec456473 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:58.855324   902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae589d3521c749c2906110c3ec456473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.858311   904 tablet_service.cc:1511] Processing CreateTablet for tablet 13990eea789945189ef0c7734989492b (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:58.859817   904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13990eea789945189ef0c7734989492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.862658   901 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa8b7c083524e0295372c88ef6cbc31 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:58.862865   900 tablet_service.cc:1511] Processing CreateTablet for tablet b9052cc0f80e4a3ba60f1df8649f3273 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:58.864305   901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa8b7c083524e0295372c88ef6cbc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.866114   829 tablet_service.cc:1511] Processing CreateTablet for tablet 13990eea789945189ef0c7734989492b (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:58.866775   823 tablet_service.cc:1511] Processing CreateTablet for tablet 06b33dbd605a4b71bd11f7ce3d473f30 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:58.867764   829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13990eea789945189ef0c7734989492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.868360   976 tablet_service.cc:1511] Processing CreateTablet for tablet ae589d3521c749c2906110c3ec456473 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:58.869129   899 tablet_service.cc:1511] Processing CreateTablet for tablet 042419458fba40b2b04cbeb9141076a9 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:58.869410   978 tablet_service.cc:1511] Processing CreateTablet for tablet 13990eea789945189ef0c7734989492b (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:58.870005   976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae589d3521c749c2906110c3ec456473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.870340   823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b33dbd605a4b71bd11f7ce3d473f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.870076   828 tablet_service.cc:1511] Processing CreateTablet for tablet c34a35499f204fa6a5a12f6431b006c4 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:58.871737   828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34a35499f204fa6a5a12f6431b006c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.871537   977 tablet_service.cc:1511] Processing CreateTablet for tablet c34a35499f204fa6a5a12f6431b006c4 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:58.873040   977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34a35499f204fa6a5a12f6431b006c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.874512   978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13990eea789945189ef0c7734989492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.874338   975 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa8b7c083524e0295372c88ef6cbc31 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:58.876185   975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa8b7c083524e0295372c88ef6cbc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.878345   974 tablet_service.cc:1511] Processing CreateTablet for tablet b9052cc0f80e4a3ba60f1df8649f3273 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:58.880111   974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9052cc0f80e4a3ba60f1df8649f3273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.882175   827 tablet_service.cc:1511] Processing CreateTablet for tablet ae589d3521c749c2906110c3ec456473 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:58.883792   827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae589d3521c749c2906110c3ec456473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.882175   973 tablet_service.cc:1511] Processing CreateTablet for tablet 042419458fba40b2b04cbeb9141076a9 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:58.885731   973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042419458fba40b2b04cbeb9141076a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.886263   826 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa8b7c083524e0295372c88ef6cbc31 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:58.887823   826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa8b7c083524e0295372c88ef6cbc31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.890518   825 tablet_service.cc:1511] Processing CreateTablet for tablet b9052cc0f80e4a3ba60f1df8649f3273 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:58.903689   824 tablet_service.cc:1511] Processing CreateTablet for tablet 042419458fba40b2b04cbeb9141076a9 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:58.905649   899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042419458fba40b2b04cbeb9141076a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.909557   900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9052cc0f80e4a3ba60f1df8649f3273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.916280  1028 tablet_bootstrap.cc:492] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:58.921398   898 tablet_service.cc:1511] Processing CreateTablet for tablet 06b33dbd605a4b71bd11f7ce3d473f30 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:58.922653   825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9052cc0f80e4a3ba60f1df8649f3273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.923085   898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b33dbd605a4b71bd11f7ce3d473f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.924612  1028 tablet_bootstrap.cc:654] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:58.925273   824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042419458fba40b2b04cbeb9141076a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.925050   822 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea7da111c844a37a40cafdd0ee54d70 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:58.926622   822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea7da111c844a37a40cafdd0ee54d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.936751  1028 tablet_bootstrap.cc:492] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:58.937450  1028 ts_tablet_manager.cc:1403] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:11:58.939277   977 tablet_service.cc:1511] Processing CreateTablet for tablet 06b33dbd605a4b71bd11f7ce3d473f30 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:58.940721   977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b33dbd605a4b71bd11f7ce3d473f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.950376  1028 raft_consensus.cc:359] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:58.951633  1028 raft_consensus.cc:385] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:58.952044  1028 raft_consensus.cc:740] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.952957  1028 consensus_queue.cc:260] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:58.969738  1013 heartbeater.cc:499] Master 127.20.227.190:46483 was elected leader, sending a full tablet report...
I20260709 13:11:58.971024  1028 ts_tablet_manager.cc:1434] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:11:58.972502  1028 tablet_bootstrap.cc:492] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:58.976418   897 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea7da111c844a37a40cafdd0ee54d70 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:58.977931   897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea7da111c844a37a40cafdd0ee54d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.979792  1028 tablet_bootstrap.cc:654] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:58.990056   821 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbb315b8bd64740934f693c0676962a (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:58.990746   977 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea7da111c844a37a40cafdd0ee54d70 (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:58.991477   821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbb315b8bd64740934f693c0676962a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:58.992101   977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea7da111c844a37a40cafdd0ee54d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:59.019672  1033 tablet_bootstrap.cc:492] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.022608   896 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbb315b8bd64740934f693c0676962a (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:59.024286   896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbb315b8bd64740934f693c0676962a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:59.035195  1033 tablet_bootstrap.cc:654] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.069780  1033 tablet_bootstrap.cc:492] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.070804  1033 ts_tablet_manager.cc:1403] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.000s
I20260709 13:11:59.074504  1033 raft_consensus.cc:359] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.077456  1033 raft_consensus.cc:385] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.079622  1028 tablet_bootstrap.cc:492] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.080309  1028 ts_tablet_manager.cc:1403] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.108s	user 0.026s	sys 0.020s
I20260709 13:11:59.083393  1028 raft_consensus.cc:359] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.084534  1028 raft_consensus.cc:385] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.084952  1028 raft_consensus.cc:740] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.077955  1033 raft_consensus.cc:740] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.086455  1033 consensus_queue.cc:260] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.077550  1032 tablet_bootstrap.cc:492] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.090880  1028 consensus_queue.cc:260] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.094527  1028 ts_tablet_manager.cc:1434] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:11:59.095780  1028 tablet_bootstrap.cc:492] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:59.095842   864 heartbeater.cc:499] Master 127.20.227.190:46483 was elected leader, sending a full tablet report...
I20260709 13:11:59.096678   976 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbb315b8bd64740934f693c0676962a (DEFAULT_TABLE table=test-workload [id=b0603e28379d4e389771f0fbaee9f300]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:59.098246   976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbb315b8bd64740934f693c0676962a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:59.103155  1028 tablet_bootstrap.cc:654] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.103593  1033 ts_tablet_manager.cc:1434] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:11:59.104755  1033 tablet_bootstrap.cc:492] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.113428  1033 tablet_bootstrap.cc:654] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.119046  1032 tablet_bootstrap.cc:654] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.136713  1028 tablet_bootstrap.cc:492] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.136895  1033 tablet_bootstrap.cc:492] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.136773  1032 tablet_bootstrap.cc:492] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.137462  1028 ts_tablet_manager.cc:1403] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.022s
I20260709 13:11:59.137823  1033 ts_tablet_manager.cc:1403] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.024s
I20260709 13:11:59.137894  1032 ts_tablet_manager.cc:1403] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.007s
I20260709 13:11:59.140196  1028 raft_consensus.cc:359] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.140908  1028 raft_consensus.cc:385] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.140944  1033 raft_consensus.cc:359] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.141260  1028 raft_consensus.cc:740] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.141223  1032 raft_consensus.cc:359] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.141844  1033 raft_consensus.cc:385] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.142221  1033 raft_consensus.cc:740] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.142127  1032 raft_consensus.cc:385] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.142737  1032 raft_consensus.cc:740] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.142431  1028 consensus_queue.cc:260] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.143110  1033 consensus_queue.cc:260] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.145287  1028 ts_tablet_manager.cc:1434] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:59.145421  1033 ts_tablet_manager.cc:1434] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:59.143589  1032 consensus_queue.cc:260] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.146494  1028 tablet_bootstrap.cc:492] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:59.146706  1033 tablet_bootstrap.cc:492] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.153517  1028 tablet_bootstrap.cc:654] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.155046  1033 tablet_bootstrap.cc:654] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.165642  1035 raft_consensus.cc:493] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.166476  1035 raft_consensus.cc:515] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.174908  1028 tablet_bootstrap.cc:492] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.175135  1032 ts_tablet_manager.cc:1434] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.010s
I20260709 13:11:59.175616  1028 ts_tablet_manager.cc:1403] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260709 13:11:59.175773  1033 tablet_bootstrap.cc:492] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.175969   939 heartbeater.cc:499] Master 127.20.227.190:46483 was elected leader, sending a full tablet report...
I20260709 13:11:59.176326  1033 ts_tablet_manager.cc:1403] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.020s
I20260709 13:11:59.176319  1032 tablet_bootstrap.cc:492] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.178861  1028 raft_consensus.cc:359] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.179726  1028 raft_consensus.cc:385] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.179489  1033 raft_consensus.cc:359] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.180138  1028 raft_consensus.cc:740] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.181144  1028 consensus_queue.cc:260] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.181953  1035 leader_election.cc:290] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.183421  1028 ts_tablet_manager.cc:1434] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:59.180363  1033 raft_consensus.cc:385] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.183900  1033 raft_consensus.cc:740] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.184544  1033 consensus_queue.cc:260] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.186738  1028 tablet_bootstrap.cc:492] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:59.189671  1033 ts_tablet_manager.cc:1434] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:11:59.190994  1033 tablet_bootstrap.cc:492] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.199163  1033 tablet_bootstrap.cc:654] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.199512  1032 tablet_bootstrap.cc:654] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.200565  1028 tablet_bootstrap.cc:654] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.201193  1030 raft_consensus.cc:493] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.210427  1030 raft_consensus.cc:515] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.221443  1033 tablet_bootstrap.cc:492] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.222177  1033 ts_tablet_manager.cc:1403] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.007s
I20260709 13:11:59.223701  1030 leader_election.cc:290] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.233022  1032 tablet_bootstrap.cc:492] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.233697  1032 ts_tablet_manager.cc:1403] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.011s
I20260709 13:11:59.226087  1033 raft_consensus.cc:359] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.237490   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.238061  1033 raft_consensus.cc:385] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.238476  1033 raft_consensus.cc:740] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.236819  1032 raft_consensus.cc:359] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.239312  1032 raft_consensus.cc:385] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.239234  1033 consensus_queue.cc:260] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.239256   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
W20260709 13:11:59.241501   954 leader_election.cc:343] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.241781  1033 ts_tablet_manager.cc:1434] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
W20260709 13:11:59.243296   805 leader_election.cc:343] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.239836  1032 raft_consensus.cc:740] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.243893  1028 tablet_bootstrap.cc:492] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.244447  1028 ts_tablet_manager.cc:1403] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.001s
I20260709 13:11:59.244460  1032 consensus_queue.cc:260] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.246915  1032 ts_tablet_manager.cc:1434] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:11:59.248443  1032 tablet_bootstrap.cc:492] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.249367  1028 raft_consensus.cc:359] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.250255  1028 raft_consensus.cc:385] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.250590  1028 raft_consensus.cc:740] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.251420  1028 consensus_queue.cc:260] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.255312  1028 ts_tablet_manager.cc:1434] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:59.255653  1032 tablet_bootstrap.cc:654] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.256409  1028 tablet_bootstrap.cc:492] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:59.252571   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.257262   839 raft_consensus.cc:2468] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
I20260709 13:11:59.253419  1033 tablet_bootstrap.cc:492] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.259361  1030 raft_consensus.cc:493] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.259756   952 leader_election.cc:304] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.259965  1030 raft_consensus.cc:515] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.262889  1030 leader_election.cc:290] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.263411  1030 raft_consensus.cc:2804] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.263751  1030 raft_consensus.cc:493] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.263623   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.264186  1030 raft_consensus.cc:3060] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.264421   913 raft_consensus.cc:2468] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
I20260709 13:11:59.264884  1028 tablet_bootstrap.cc:654] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.269352   954 leader_election.cc:304] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:11:59.274533   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.275313   988 raft_consensus.cc:2468] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:11:59.277321   804 leader_election.cc:304] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.278566  1035 raft_consensus.cc:2804] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.278941  1035 raft_consensus.cc:493] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.279258  1035 raft_consensus.cc:3060] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.281253  1033 tablet_bootstrap.cc:654] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.289299  1030 raft_consensus.cc:515] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.294623  1035 raft_consensus.cc:515] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.299484   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
W20260709 13:11:59.301316   954 leader_election.cc:343] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.301522   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:11:59.302078  1030 leader_election.cc:290] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
W20260709 13:11:59.302774   785 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:59.303045  1030 raft_consensus.cc:2804] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:59.303419   805 leader_election.cc:343] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.303781  1030 raft_consensus.cc:493] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.303447  1035 leader_election.cc:290] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.304720  1030 raft_consensus.cc:3060] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.306245   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:11:59.306876   988 raft_consensus.cc:3060] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.311852  1033 tablet_bootstrap.cc:492] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.312752  1033 ts_tablet_manager.cc:1403] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.005s
I20260709 13:11:59.314059  1052 raft_consensus.cc:493] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.315781  1052 raft_consensus.cc:515] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
W20260709 13:11:59.325034   952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.227.129:42761, user_credentials={real_user=slave}} blocked reactor thread for 65476.6us
I20260709 13:11:59.327185   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.328142   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:11:59.328747  1050 raft_consensus.cc:493] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.329097   838 raft_consensus.cc:3060] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.329468  1050 raft_consensus.cc:515] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.330895   988 raft_consensus.cc:2468] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
W20260709 13:11:59.328770   952 leader_election.cc:343] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.326771  1033 raft_consensus.cc:359] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.332366   804 leader_election.cc:304] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.333395  1033 raft_consensus.cc:385] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.333736  1033 raft_consensus.cc:740] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.334183  1035 raft_consensus.cc:2804] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.334672  1033 consensus_queue.cc:260] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.341393  1032 tablet_bootstrap.cc:492] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.343107   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.343797   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.344518   839 raft_consensus.cc:2468] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
W20260709 13:11:59.345299   954 leader_election.cc:343] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.342370  1032 ts_tablet_manager.cc:1403] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.095s	user 0.034s	sys 0.053s
I20260709 13:11:59.346647   952 leader_election.cc:304] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.346164  1050 leader_election.cc:290] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.348124  1050 raft_consensus.cc:2804] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.348269   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.348559  1050 raft_consensus.cc:493] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.348973  1050 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:59.350095   805 leader_election.cc:343] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.350492  1032 raft_consensus.cc:359] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.351689  1032 raft_consensus.cc:385] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.352286  1052 leader_election.cc:290] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.352720   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.346668   838 raft_consensus.cc:2468] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:11:59.353971  1032 raft_consensus.cc:740] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.355584  1030 raft_consensus.cc:515] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.360824   952 leader_election.cc:304] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.361245  1033 ts_tablet_manager.cc:1434] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 13:11:59.361912  1028 tablet_bootstrap.cc:492] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.361974  1056 raft_consensus.cc:2804] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.362820  1033 tablet_bootstrap.cc:492] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.363255   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:11:59.363561  1028 ts_tablet_manager.cc:1403] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.107s	user 0.029s	sys 0.050s
I20260709 13:11:59.357849  1035 raft_consensus.cc:697] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
W20260709 13:11:59.364683   952 leader_election.cc:343] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.364789  1035 consensus_queue.cc:237] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.355559  1032 consensus_queue.cc:260] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.367015  1028 raft_consensus.cc:359] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.368427  1032 ts_tablet_manager.cc:1434] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:11:59.369830  1033 tablet_bootstrap.cc:654] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.369621  1028 raft_consensus.cc:385] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.370849  1028 raft_consensus.cc:740] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.372304  1028 consensus_queue.cc:260] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.374661  1050 raft_consensus.cc:515] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.376896   987 raft_consensus.cc:2393] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72f0896fc4e24a7f879f826aa6d6bc70 in current term 1: Already voted for candidate 0dad90a639f5494e80e9ab0313a8564c in this term.
I20260709 13:11:59.369635  1032 tablet_bootstrap.cc:492] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.377882   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:11:59.380304   913 raft_consensus.cc:3060] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.380318   804 leader_election.cc:304] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.378806  1030 leader_election.cc:290] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.387101  1056 raft_consensus.cc:697] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:11:59.387913  1055 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.390367  1054 raft_consensus.cc:493] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.393199  1054 raft_consensus.cc:515] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.398461   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
W20260709 13:11:59.400988   954 leader_election.cc:343] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.402124  1054 leader_election.cc:290] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.402520   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae589d3521c749c2906110c3ec456473" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.403779   914 raft_consensus.cc:2468] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:11:59.404578   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae589d3521c749c2906110c3ec456473" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.406205   805 leader_election.cc:304] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
W20260709 13:11:59.408143   804 leader_election.cc:343] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.410214  1030 raft_consensus.cc:493] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.410648   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:11:59.410917  1030 raft_consensus.cc:515] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.417126  1054 raft_consensus.cc:2804] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.417788  1054 raft_consensus.cc:493] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.418227  1054 raft_consensus.cc:3060] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.426319  1030 leader_election.cc:290] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.388167  1056 consensus_queue.cc:237] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.426532   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b33dbd605a4b71bd11f7ce3d473f30" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.428026   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b33dbd605a4b71bd11f7ce3d473f30" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
W20260709 13:11:59.428309   952 leader_election.cc:343] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.431173   913 raft_consensus.cc:2468] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
W20260709 13:11:59.433064   954 leader_election.cc:343] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.433982   954 leader_election.cc:304] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c; no voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.435341   954 leader_election.cc:304] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:11:59.437287  1055 raft_consensus.cc:2749] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.392987  1050 leader_election.cc:290] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.439314  1059 raft_consensus.cc:2749] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.440310  1057 raft_consensus.cc:2804] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.443233  1032 tablet_bootstrap.cc:654] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.443243  1057 raft_consensus.cc:697] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:11:59.443743   735 catalog_manager.cc:5697] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 1 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.441679  1033 tablet_bootstrap.cc:492] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.444692  1057 consensus_queue.cc:237] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.446264  1033 ts_tablet_manager.cc:1403] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.084s	user 0.026s	sys 0.040s
I20260709 13:11:59.449283  1028 ts_tablet_manager.cc:1434] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.085s	user 0.018s	sys 0.030s
I20260709 13:11:59.450518  1028 tablet_bootstrap.cc:492] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:59.455724  1054 raft_consensus.cc:515] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.458161  1054 leader_election.cc:290] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.458768  1028 tablet_bootstrap.cc:654] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.458891   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae589d3521c749c2906110c3ec456473" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:11:59.459359   838 raft_consensus.cc:2468] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:11:59.459450   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae589d3521c749c2906110c3ec456473" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:11:59.459596   913 raft_consensus.cc:3060] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:59.461311   804 leader_election.cc:343] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.464066  1033 raft_consensus.cc:359] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.465241  1033 raft_consensus.cc:385] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.465315   952 leader_election.cc:304] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.465770  1033 raft_consensus.cc:740] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.467136  1056 raft_consensus.cc:2804] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.467660  1056 raft_consensus.cc:697] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:11:59.468514  1056 consensus_queue.cc:237] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.472299  1033 consensus_queue.cc:260] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.474335   736 catalog_manager.cc:5697] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.475732  1033 ts_tablet_manager.cc:1434] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:11:59.477583  1033 tablet_bootstrap.cc:492] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.475868   913 raft_consensus.cc:2468] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:11:59.481062   805 leader_election.cc:304] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:11:59.482609  1054 raft_consensus.cc:2804] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.483242  1054 raft_consensus.cc:697] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:11:59.484328  1054 consensus_queue.cc:237] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.493002  1032 tablet_bootstrap.cc:492] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.493698  1033 tablet_bootstrap.cc:654] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.494678  1028 tablet_bootstrap.cc:492] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.495230  1028 ts_tablet_manager.cc:1403] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.019s
I20260709 13:11:59.493723  1032 ts_tablet_manager.cc:1403] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.004s
I20260709 13:11:59.498811  1028 raft_consensus.cc:359] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.499944  1028 raft_consensus.cc:385] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.500376  1028 raft_consensus.cc:740] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.501554  1028 consensus_queue.cc:260] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.505116  1028 ts_tablet_manager.cc:1434] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:11:59.505322  1032 raft_consensus.cc:359] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.506222  1032 raft_consensus.cc:385] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.506561  1032 raft_consensus.cc:740] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.506606  1028 tablet_bootstrap.cc:492] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:59.507530  1032 consensus_queue.cc:260] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.506235  1033 tablet_bootstrap.cc:492] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.509254  1033 ts_tablet_manager.cc:1403] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.004s
I20260709 13:11:59.515591  1028 tablet_bootstrap.cc:654] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.516710  1032 ts_tablet_manager.cc:1434] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:11:59.517722  1032 tablet_bootstrap.cc:492] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.521114  1028 tablet_bootstrap.cc:492] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.521853  1028 ts_tablet_manager.cc:1403] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:11:59.521123  1033 raft_consensus.cc:359] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.522805  1033 raft_consensus.cc:385] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.523255  1033 raft_consensus.cc:740] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.524266  1032 tablet_bootstrap.cc:654] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.524065  1033 consensus_queue.cc:260] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.524704  1028 raft_consensus.cc:359] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.525478  1028 raft_consensus.cc:385] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.525772  1028 raft_consensus.cc:740] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.526602  1033 ts_tablet_manager.cc:1434] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:59.526454  1028 consensus_queue.cc:260] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.528110  1033 tablet_bootstrap.cc:492] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.528482  1028 ts_tablet_manager.cc:1434] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:59.529532  1028 tablet_bootstrap.cc:492] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:11:59.530437   736 catalog_manager.cc:5697] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.535300  1028 tablet_bootstrap.cc:654] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.536687  1032 tablet_bootstrap.cc:492] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.536890  1033 tablet_bootstrap.cc:654] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.537271  1032 ts_tablet_manager.cc:1403] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:11:59.538875  1056 raft_consensus.cc:493] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.539600  1056 raft_consensus.cc:515] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.542918  1056 leader_election.cc:290] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.546008   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae589d3521c749c2906110c3ec456473" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.549275  1054 raft_consensus.cc:493] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.548209   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae589d3521c749c2906110c3ec456473" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.550037  1054 raft_consensus.cc:515] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.551259   913 raft_consensus.cc:2393] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0dad90a639f5494e80e9ab0313a8564c in current term 1: Already voted for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in this term.
I20260709 13:11:59.553205   954 leader_election.cc:304] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c; no voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.555306   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa8b7c083524e0295372c88ef6cbc31" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.556320   987 raft_consensus.cc:2468] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:11:59.558272   804 leader_election.cc:304] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:11:59.559526  1035 raft_consensus.cc:2804] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.560016  1035 raft_consensus.cc:493] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.560494   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa8b7c083524e0295372c88ef6cbc31" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.561053  1054 leader_election.cc:290] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.560487  1035 raft_consensus.cc:3060] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:59.565793   805 leader_election.cc:343] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.567678  1054 raft_consensus.cc:493] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.568308  1054 raft_consensus.cc:515] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.571657  1056 raft_consensus.cc:3060] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.572501   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.573827   913 raft_consensus.cc:2393] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72f0896fc4e24a7f879f826aa6d6bc70 in current term 1: Already voted for candidate 0dad90a639f5494e80e9ab0313a8564c in this term.
I20260709 13:11:59.578413   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.581197   804 leader_election.cc:304] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.582583  1055 raft_consensus.cc:3060] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.587405  1032 raft_consensus.cc:359] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.588696  1032 raft_consensus.cc:385] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.592720  1054 leader_election.cc:290] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.584614  1035 raft_consensus.cc:515] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.596972  1055 raft_consensus.cc:2749] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.597293   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa8b7c083524e0295372c88ef6cbc31" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
W20260709 13:11:59.598961   805 leader_election.cc:343] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.593207  1032 raft_consensus.cc:740] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.602624  1032 consensus_queue.cc:260] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.602274   737 catalog_manager.cc:5697] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 1 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.605070  1035 leader_election.cc:290] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.607280   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa8b7c083524e0295372c88ef6cbc31" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:11:59.607688  1056 raft_consensus.cc:2749] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.608247   987 raft_consensus.cc:3060] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.615190  1032 ts_tablet_manager.cc:1434] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 13:11:59.616982  1032 tablet_bootstrap.cc:492] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.616443   737 catalog_manager.cc:5697] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 1 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.623085   987 raft_consensus.cc:2468] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:11:59.629515  1032 tablet_bootstrap.cc:654] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.626401  1033 tablet_bootstrap.cc:492] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.630625   804 leader_election.cc:304] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.630975  1033 ts_tablet_manager.cc:1403] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.060s
I20260709 13:11:59.631955  1035 raft_consensus.cc:2804] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.632483  1028 tablet_bootstrap.cc:492] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:11:59.632431  1035 raft_consensus.cc:697] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:11:59.633090  1028 ts_tablet_manager.cc:1403] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.104s	user 0.027s	sys 0.052s
I20260709 13:11:59.633621  1035 consensus_queue.cc:237] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.633921  1033 raft_consensus.cc:359] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.634547  1033 raft_consensus.cc:385] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.634809  1033 raft_consensus.cc:740] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.636234  1033 consensus_queue.cc:260] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.636296  1028 raft_consensus.cc:359] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.637158  1028 raft_consensus.cc:385] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.637449  1028 raft_consensus.cc:740] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.638460  1033 ts_tablet_manager.cc:1434] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:11:59.638206  1028 consensus_queue.cc:260] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.639598  1033 tablet_bootstrap.cc:492] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:11:59.640679  1028 ts_tablet_manager.cc:1434] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:59.642133  1056 raft_consensus.cc:493] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.642685  1056 raft_consensus.cc:515] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.644996  1056 leader_election.cc:290] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.646755  1033 tablet_bootstrap.cc:654] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.646663   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.648171   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.649386   913 raft_consensus.cc:2468] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
I20260709 13:11:59.651144   954 leader_election.cc:304] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
W20260709 13:11:59.652642   952 leader_election.cc:343] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:59.654011  1056 raft_consensus.cc:2804] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.654685  1056 raft_consensus.cc:493] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.655224  1056 raft_consensus.cc:3060] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.658317  1033 tablet_bootstrap.cc:492] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:11:59.658872  1033 ts_tablet_manager.cc:1403] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:11:59.661651  1033 raft_consensus.cc:359] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.662256  1039 raft_consensus.cc:493] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.662379  1033 raft_consensus.cc:385] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.662845  1033 raft_consensus.cc:740] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.662890  1039 raft_consensus.cc:515] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.663739  1033 consensus_queue.cc:260] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.666218  1033 ts_tablet_manager.cc:1434] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:11:59.667181  1039 leader_election.cc:290] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.675416  1056 raft_consensus.cc:515] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.683435  1056 leader_election.cc:290] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:11:59.684684   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:11:59.685461   838 raft_consensus.cc:3060] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.686743  1032 tablet_bootstrap.cc:492] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.687310  1032 ts_tablet_manager.cc:1403] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.030s
I20260709 13:11:59.689271   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:11:59.689976   913 raft_consensus.cc:3060] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.690649  1032 raft_consensus.cc:359] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.691450  1032 raft_consensus.cc:385] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.691758  1032 raft_consensus.cc:740] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.692543  1032 consensus_queue.cc:260] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.695122  1032 ts_tablet_manager.cc:1434] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:59.696089   737 catalog_manager.cc:5697] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.698377  1032 tablet_bootstrap.cc:492] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.696988   838 raft_consensus.cc:2468] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:11:59.699925   952 leader_election.cc:304] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:11:59.700973  1056 raft_consensus.cc:2804] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.702637  1056 raft_consensus.cc:697] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:11:59.704188  1056 consensus_queue.cc:237] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.706470   913 raft_consensus.cc:2468] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:11:59.711067   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.713574   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.715893   987 raft_consensus.cc:2393] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in current term 1: Already voted for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in this term.
I20260709 13:11:59.717413  1032 tablet_bootstrap.cc:654] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.717365   879 leader_election.cc:304] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:11:59.720391  1039 raft_consensus.cc:3060] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.726611  1032 tablet_bootstrap.cc:492] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.727819  1032 ts_tablet_manager.cc:1403] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.009s
I20260709 13:11:59.727510   737 catalog_manager.cc:5697] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 1 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.729041  1039 raft_consensus.cc:2749] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.731269  1032 raft_consensus.cc:359] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.731880  1032 raft_consensus.cc:385] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.732137  1032 raft_consensus.cc:740] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.732841  1032 consensus_queue.cc:260] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.735085  1032 ts_tablet_manager.cc:1434] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:11:59.736096  1032 tablet_bootstrap.cc:492] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.743224  1032 tablet_bootstrap.cc:654] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.747345  1032 tablet_bootstrap.cc:492] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.747818  1032 ts_tablet_manager.cc:1403] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:11:59.749893  1032 raft_consensus.cc:359] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.750407  1032 raft_consensus.cc:385] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.750635  1032 raft_consensus.cc:740] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.751274  1032 consensus_queue.cc:260] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.753177  1032 ts_tablet_manager.cc:1434] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:11:59.754218  1032 tablet_bootstrap.cc:492] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:11:59.758266  1032 tablet_bootstrap.cc:654] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:59.762398  1032 tablet_bootstrap.cc:492] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:11:59.762890  1032 ts_tablet_manager.cc:1403] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:59.763850  1039 raft_consensus.cc:493] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.764423  1039 raft_consensus.cc:515] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.765585  1032 raft_consensus.cc:359] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.766319  1032 raft_consensus.cc:385] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:59.766600  1032 raft_consensus.cc:740] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:11:59.766749  1039 leader_election.cc:290] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.767426  1035 consensus_queue.cc:1048] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:59.767323  1032 consensus_queue.cc:260] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.767875   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa8b7c083524e0295372c88ef6cbc31" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.768689   987 raft_consensus.cc:2393] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in current term 1: Already voted for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in this term.
I20260709 13:11:59.767479   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa8b7c083524e0295372c88ef6cbc31" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.769609  1032 ts_tablet_manager.cc:1434] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:59.770848   878 leader_election.cc:304] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:11:59.771592  1039 raft_consensus.cc:3060] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.778759  1039 raft_consensus.cc:2749] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.780290  1054 raft_consensus.cc:493] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.780750  1054 raft_consensus.cc:515] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.782593  1054 leader_election.cc:290] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.784186   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.784798   988 raft_consensus.cc:2468] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:11:59.785229  1054 consensus_queue.cc:1048] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:59.786091   804 leader_election.cc:304] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:11:59.787338   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:11:59.788039   914 raft_consensus.cc:2468] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:11:59.790297  1054 raft_consensus.cc:2804] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.790972  1054 raft_consensus.cc:493] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.791455  1054 raft_consensus.cc:3060] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.801563  1054 raft_consensus.cc:515] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.803902  1054 leader_election.cc:290] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.804793   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:11:59.805521   913 raft_consensus.cc:3060] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.805636   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:11:59.806373   988 raft_consensus.cc:3060] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.806532  1039 raft_consensus.cc:493] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.807087  1039 raft_consensus.cc:515] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.809320  1039 leader_election.cc:290] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.811089   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b33dbd605a4b71bd11f7ce3d473f30" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.811841   987 raft_consensus.cc:2468] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 0.
I20260709 13:11:59.812067   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b33dbd605a4b71bd11f7ce3d473f30" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.812796   838 raft_consensus.cc:2468] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 0.
I20260709 13:11:59.813256   879 leader_election.cc:304] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:11:59.813556   913 raft_consensus.cc:2468] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:11:59.814862   805 leader_election.cc:304] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:11:59.815371   988 raft_consensus.cc:2468] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:11:59.815725  1054 raft_consensus.cc:2804] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.816215  1039 raft_consensus.cc:2804] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:59.816637  1039 raft_consensus.cc:493] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.816990  1039 raft_consensus.cc:3060] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.817096  1054 raft_consensus.cc:697] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:11:59.818087  1054 consensus_queue.cc:237] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.823117  1039 raft_consensus.cc:515] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.825618  1039 leader_election.cc:290] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.826329   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b33dbd605a4b71bd11f7ce3d473f30" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:11:59.826680   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b33dbd605a4b71bd11f7ce3d473f30" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:11:59.827046   838 raft_consensus.cc:3060] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.827370   988 raft_consensus.cc:3060] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.827811   736 catalog_manager.cc:5697] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.834622   838 raft_consensus.cc:2468] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 1.
I20260709 13:11:59.834622   988 raft_consensus.cc:2468] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 1.
I20260709 13:11:59.836189   879 leader_election.cc:304] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:11:59.838845  1039 raft_consensus.cc:2804] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:59.839236  1039 raft_consensus.cc:697] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:11:59.840014  1039 consensus_queue.cc:237] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.847149   736 catalog_manager.cc:5697] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.899724   988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13990eea789945189ef0c7734989492b"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
mode: GRACEFUL
new_leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:11:59.899935  1039 raft_consensus.cc:493] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.900518   988 raft_consensus.cc:606] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Received request to transfer leadership to TS 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:11:59.900720  1056 consensus_queue.cc:1048] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:59.900576  1039 raft_consensus.cc:515] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.903522   913 raft_consensus.cc:3060] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.904479  1039 leader_election.cc:290] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.904945   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.905794   838 raft_consensus.cc:2393] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in current term 1: Already voted for candidate 0dad90a639f5494e80e9ab0313a8564c in this term.
I20260709 13:11:59.907223   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.909227   878 leader_election.cc:304] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:11:59.909700  1054 consensus_queue.cc:1048] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:59.912917  1039 raft_consensus.cc:2749] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.913353  1056 consensus_queue.cc:1048] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:59.923906   988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
mode: GRACEFUL
new_leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:11:59.924600   988 raft_consensus.cc:606] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Received request to transfer leadership to TS ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.928076  1050 raft_consensus.cc:993] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c: : Instructing follower ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:11:59.928601  1050 raft_consensus.cc:1081] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Signalling peer ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:11:59.931298   913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37244
I20260709 13:11:59.931910   913 raft_consensus.cc:493] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.934978   988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
mode: GRACEFUL
new_leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:11:59.935727   988 raft_consensus.cc:606] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Received request to transfer leadership to TS ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.934196   913 raft_consensus.cc:3060] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.940663  1055 consensus_queue.cc:1048] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:59.945119  1039 raft_consensus.cc:493] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.945710  1039 raft_consensus.cc:515] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.948758  1039 leader_election.cc:290] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.950237   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:11:59.951608   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:11:59.952476   839 raft_consensus.cc:2393] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in current term 1: Already voted for candidate 0dad90a639f5494e80e9ab0313a8564c in this term.
I20260709 13:11:59.952286   988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
mode: GRACEFUL
new_leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:11:59.953631   878 leader_election.cc:304] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:11:59.953811   988 raft_consensus.cc:606] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Received request to transfer leadership to TS ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:11:59.954728  1039 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:59.960562   913 raft_consensus.cc:515] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.963208  1039 raft_consensus.cc:2749] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:59.968181   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:11:59.968466   913 leader_election.cc:290] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:11:59.968906   988 raft_consensus.cc:3055] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:59.969244   988 raft_consensus.cc:740] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:11:59.970228   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9052cc0f80e4a3ba60f1df8649f3273" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:11:59.970166   988 consensus_queue.cc:260] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.971060   839 raft_consensus.cc:3060] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.971499   988 raft_consensus.cc:3060] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.971917  1056 consensus_queue.cc:1048] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:59.978904   839 raft_consensus.cc:2468] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:11:59.979707   838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a"
dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
mode: GRACEFUL
new_leader_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:57594
I20260709 13:11:59.981499   838 raft_consensus.cc:606] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Received request to transfer leadership to TS 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:11:59.980391   988 raft_consensus.cc:2468] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:11:59.984019   879 leader_election.cc:304] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:11:59.985476  1039 raft_consensus.cc:2804] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:59.986034  1039 raft_consensus.cc:697] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:11:59.987455  1039 consensus_queue.cc:237] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:11:59.987994  1059 raft_consensus.cc:993] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c: : Instructing follower ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:11:59.988636  1059 raft_consensus.cc:1081] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Signalling peer ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:11:59.995682   913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37244
I20260709 13:11:59.996403   913 raft_consensus.cc:493] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.996909   913 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.996942  1057 consensus_queue.cc:1048] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:00.001324   735 catalog_manager.cc:5697] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 1 to 2, leader changed from 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131) to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.005682   913 raft_consensus.cc:515] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.009052   913 leader_election.cc:290] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:00.009904   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:00.010097   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:00.010810   988 raft_consensus.cc:3055] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:00.011149   988 raft_consensus.cc:740] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:00.012015   988 consensus_queue.cc:260] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.012972   988 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.019748   988 raft_consensus.cc:2468] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:00.021289   879 leader_election.cc:304] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:12:00.022222  1039 raft_consensus.cc:2804] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:00.022763  1039 raft_consensus.cc:697] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:00.023620  1039 consensus_queue.cc:237] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.031008   737 catalog_manager.cc:5697] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 1 to 2, leader changed from 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131) to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.052948  1050 consensus_queue.cc:1048] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.065305  1055 consensus_queue.cc:1048] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.066838  1050 consensus_queue.cc:1048] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:00.079216  1054 consensus_queue.cc:1048] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:00.083103  1059 raft_consensus.cc:993] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c: : Instructing follower 72f0896fc4e24a7f879f826aa6d6bc70 to start an election
I20260709 13:12:00.083706  1059 raft_consensus.cc:1081] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Signalling peer 72f0896fc4e24a7f879f826aa6d6bc70 to start an election
I20260709 13:12:00.086714   839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13990eea789945189ef0c7734989492b"
dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
 from {username='slave'} at 127.0.0.1:57578
I20260709 13:12:00.087502   839 raft_consensus.cc:493] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.087988   839 raft_consensus.cc:3060] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.095007   839 raft_consensus.cc:515] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.097157   839 leader_election.cc:290] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 2 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:00.098132   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:00.098433   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13990eea789945189ef0c7734989492b" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:00.098867   913 raft_consensus.cc:3060] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.099007   988 raft_consensus.cc:3055] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:00.099445   988 raft_consensus.cc:740] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:00.100535   988 consensus_queue.cc:260] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.102278   988 raft_consensus.cc:3060] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.106812   913 raft_consensus.cc:2468] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 2.
I20260709 13:12:00.108273   805 leader_election.cc:304] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:00.109081  1052 raft_consensus.cc:2804] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:00.109632  1052 raft_consensus.cc:697] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:00.109509   988 raft_consensus.cc:2468] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 2.
I20260709 13:12:00.110723  1052 consensus_queue.cc:237] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.118228   737 catalog_manager.cc:5697] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 1 to 2, leader changed from 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131) to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.166852  1056 consensus_queue.cc:1048] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.179137  1056 consensus_queue.cc:1048] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.187813  1050 raft_consensus.cc:993] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c: : Instructing follower ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:00.188318  1050 raft_consensus.cc:1081] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Signalling peer ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:00.190052   913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37244
I20260709 13:12:00.190670   913 raft_consensus.cc:493] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.191115   913 raft_consensus.cc:3060] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.198086   913 raft_consensus.cc:515] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.199728   913 leader_election.cc:290] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:00.200785   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:00.200829   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042419458fba40b2b04cbeb9141076a9" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:00.201711   839 raft_consensus.cc:3060] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.201793   988 raft_consensus.cc:3055] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:00.202463   988 raft_consensus.cc:740] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:00.203316   988 consensus_queue.cc:260] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.204707   988 raft_consensus.cc:3060] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.208999   839 raft_consensus.cc:2468] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:00.210243   878 leader_election.cc:304] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:00.211194  1039 raft_consensus.cc:2804] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:00.211642  1039 raft_consensus.cc:697] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:00.212582  1039 consensus_queue.cc:237] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.213018   988 raft_consensus.cc:2468] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:00.219601   736 catalog_manager.cc:5697] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 1 to 2, leader changed from 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131) to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.263672  1052 consensus_queue.cc:1048] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.276361  1054 consensus_queue.cc:1048] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.284142  1035 raft_consensus.cc:993] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70: : Instructing follower 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:00.284770  1054 raft_consensus.cc:1081] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Signalling peer 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:00.286412   988 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:37516
I20260709 13:12:00.287000   988 raft_consensus.cc:493] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.287386   988 raft_consensus.cc:3060] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.292783   988 raft_consensus.cc:515] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.295008   988 leader_election.cc:290] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:00.295830   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:00.296547   839 raft_consensus.cc:3055] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:00.296950   839 raft_consensus.cc:740] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:00.296774   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbb315b8bd64740934f693c0676962a" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:00.297684   913 raft_consensus.cc:3060] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.297945   839 consensus_queue.cc:260] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.299324   839 raft_consensus.cc:3060] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.305266   913 raft_consensus.cc:2468] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 2.
I20260709 13:12:00.306638   839 raft_consensus.cc:2468] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 2.
I20260709 13:12:00.306674   954 leader_election.cc:304] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:00.307721  1050 raft_consensus.cc:2804] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:00.308250  1050 raft_consensus.cc:697] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:00.309141  1050 consensus_queue.cc:237] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:00.317454   737 catalog_manager.cc:5697] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 1 to 2, leader changed from 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129) to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 2 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.341220  1039 consensus_queue.cc:1048] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.352676  1039 consensus_queue.cc:1048] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:00.445822   839 raft_consensus.cc:1275] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.447400  1039 consensus_queue.cc:1048] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.456811   988 raft_consensus.cc:1275] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.458299  1085 consensus_queue.cc:1048] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.519848   839 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.528484   839 raft_consensus.cc:1275] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.530062  1085 consensus_queue.cc:1048] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.540158   988 raft_consensus.cc:1275] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.542614  1109 consensus_queue.cc:1048] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.606377   987 raft_consensus.cc:1275] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer 72f0896fc4e24a7f879f826aa6d6bc70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.607854  1035 consensus_queue.cc:1048] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.615886   913 raft_consensus.cc:1275] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Refusing update from remote peer 72f0896fc4e24a7f879f826aa6d6bc70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.617733  1054 consensus_queue.cc:1048] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.665766   839 raft_consensus.cc:1275] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.667202  1109 consensus_queue.cc:1048] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.678725   987 raft_consensus.cc:1275] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.680224  1039 consensus_queue.cc:1048] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.731696   839 raft_consensus.cc:1275] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.733089  1050 consensus_queue.cc:1048] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.740825   913 raft_consensus.cc:1275] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.742637  1111 consensus_queue.cc:1048] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:03.020318   735 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59144:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:03.023219   735 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:03.086445   823 tablet_service.cc:1511] Processing CreateTablet for tablet f0c587a7f71b48df86869cb897cd5ae7 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:03.087324   896 tablet_service.cc:1511] Processing CreateTablet for tablet f0c587a7f71b48df86869cb897cd5ae7 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:03.088637   823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c587a7f71b48df86869cb897cd5ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.089319   896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c587a7f71b48df86869cb897cd5ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.090135   976 tablet_service.cc:1511] Processing CreateTablet for tablet f0c587a7f71b48df86869cb897cd5ae7 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:03.091127   824 tablet_service.cc:1511] Processing CreateTablet for tablet 616e071455d242b69d02909409b95f81 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:03.091952   976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c587a7f71b48df86869cb897cd5ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.093140   824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616e071455d242b69d02909409b95f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.107975   898 tablet_service.cc:1511] Processing CreateTablet for tablet 616e071455d242b69d02909409b95f81 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:03.109793   898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616e071455d242b69d02909409b95f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.114336   821 tablet_service.cc:1511] Processing CreateTablet for tablet 90cedb044cf74354b5f8475982ae3632 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:03.115999   821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cedb044cf74354b5f8475982ae3632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.109375   975 tablet_service.cc:1511] Processing CreateTablet for tablet 616e071455d242b69d02909409b95f81 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:03.117841   975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616e071455d242b69d02909409b95f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.132102   900 tablet_service.cc:1511] Processing CreateTablet for tablet 90cedb044cf74354b5f8475982ae3632 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:03.132895   973 tablet_service.cc:1511] Processing CreateTablet for tablet 90cedb044cf74354b5f8475982ae3632 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:03.134330   900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cedb044cf74354b5f8475982ae3632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.134464   973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cedb044cf74354b5f8475982ae3632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.156450   826 tablet_service.cc:1511] Processing CreateTablet for tablet 53e91fcb5e7244dd99c57918cf9758e4 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:03.158068   826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e91fcb5e7244dd99c57918cf9758e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.172298   901 tablet_service.cc:1511] Processing CreateTablet for tablet 53e91fcb5e7244dd99c57918cf9758e4 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:03.174489   901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e91fcb5e7244dd99c57918cf9758e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.176244   973 tablet_service.cc:1511] Processing CreateTablet for tablet 53e91fcb5e7244dd99c57918cf9758e4 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:03.180825   829 tablet_service.cc:1511] Processing CreateTablet for tablet 42437805d4224febb9e9b5ca537624d8 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:03.181749   973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e91fcb5e7244dd99c57918cf9758e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.182353   829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42437805d4224febb9e9b5ca537624d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.211575  1127 tablet_bootstrap.cc:492] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.212142   899 tablet_service.cc:1511] Processing CreateTablet for tablet 42437805d4224febb9e9b5ca537624d8 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:03.213797   899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42437805d4224febb9e9b5ca537624d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.235311   977 tablet_service.cc:1511] Processing CreateTablet for tablet 42437805d4224febb9e9b5ca537624d8 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:03.236981   977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42437805d4224febb9e9b5ca537624d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.242048   823 tablet_service.cc:1511] Processing CreateTablet for tablet a2e36fa38b284d8b92de0843c80b2e66 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:03.243489   823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e36fa38b284d8b92de0843c80b2e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.249130  1128 tablet_bootstrap.cc:492] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.254369  1126 tablet_bootstrap.cc:492] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.265358  1128 tablet_bootstrap.cc:654] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.266182   896 tablet_service.cc:1511] Processing CreateTablet for tablet a2e36fa38b284d8b92de0843c80b2e66 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:03.271591  1127 tablet_bootstrap.cc:654] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.274469   973 tablet_service.cc:1511] Processing CreateTablet for tablet a2e36fa38b284d8b92de0843c80b2e66 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:03.280025   973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e36fa38b284d8b92de0843c80b2e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.279897   826 tablet_service.cc:1511] Processing CreateTablet for tablet 76bdbbe2c37f413fbca8e88267682b30 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:03.281397   826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76bdbbe2c37f413fbca8e88267682b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.275956   896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e36fa38b284d8b92de0843c80b2e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.291599   898 tablet_service.cc:1511] Processing CreateTablet for tablet 76bdbbe2c37f413fbca8e88267682b30 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:03.292415  1126 tablet_bootstrap.cc:654] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.292510   976 tablet_service.cc:1511] Processing CreateTablet for tablet 76bdbbe2c37f413fbca8e88267682b30 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:03.293382   898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76bdbbe2c37f413fbca8e88267682b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.293998   976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76bdbbe2c37f413fbca8e88267682b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.304069  1128 tablet_bootstrap.cc:492] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.304618  1128 ts_tablet_manager.cc:1403] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.014s
I20260709 13:12:03.307854  1128 raft_consensus.cc:359] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.308790  1128 raft_consensus.cc:385] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.309382  1128 raft_consensus.cc:740] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.310407  1128 consensus_queue.cc:260] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.315864   900 tablet_service.cc:1511] Processing CreateTablet for tablet a8ef17140f29405883f006650c6c3178 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:03.317274   900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ef17140f29405883f006650c6c3178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.334375   824 tablet_service.cc:1511] Processing CreateTablet for tablet 90f58cc27c784257acefa53153eff18f (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:03.334895   901 tablet_service.cc:1511] Processing CreateTablet for tablet 90f58cc27c784257acefa53153eff18f (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:03.336211   901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f58cc27c784257acefa53153eff18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.336295   824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f58cc27c784257acefa53153eff18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.332537   977 tablet_service.cc:1511] Processing CreateTablet for tablet a8ef17140f29405883f006650c6c3178 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:03.338042   977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ef17140f29405883f006650c6c3178. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:03.347007   785 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:03.347648   823 tablet_service.cc:1511] Processing CreateTablet for tablet a8ef17140f29405883f006650c6c3178 (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:03.349612   823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ef17140f29405883f006650c6c3178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.349901  1128 ts_tablet_manager.cc:1434] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:12:03.351208  1128 tablet_bootstrap.cc:492] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.352063   973 tablet_service.cc:1511] Processing CreateTablet for tablet 90f58cc27c784257acefa53153eff18f (DEFAULT_TABLE table=soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:03.357235  1127 tablet_bootstrap.cc:492] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.358009  1127 ts_tablet_manager.cc:1403] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.150s	user 0.019s	sys 0.038s
I20260709 13:12:03.361896  1127 raft_consensus.cc:359] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.363896  1127 raft_consensus.cc:385] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.364303  1127 raft_consensus.cc:740] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.363451   973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f58cc27c784257acefa53153eff18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.365576  1128 tablet_bootstrap.cc:654] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.374460  1127 consensus_queue.cc:260] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.375020  1085 raft_consensus.cc:493] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.375854  1085 raft_consensus.cc:515] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.377586  1127 ts_tablet_manager.cc:1434] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:03.378759  1127 tablet_bootstrap.cc:492] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.380195   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cedb044cf74354b5f8475982ae3632" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.380213   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cedb044cf74354b5f8475982ae3632" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
W20260709 13:12:03.383174   879 leader_election.cc:343] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.384267  1085 leader_election.cc:290] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.386415  1127 tablet_bootstrap.cc:654] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:03.387437   878 leader_election.cc:343] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.389040   878 leader_election.cc:304] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:12:03.396256  1085 raft_consensus.cc:2749] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.415984  1128 tablet_bootstrap.cc:492] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.417142  1128 ts_tablet_manager.cc:1403] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.003s
I20260709 13:12:03.421087  1126 tablet_bootstrap.cc:492] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:03.421667  1126 ts_tablet_manager.cc:1403] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.168s	user 0.025s	sys 0.036s
I20260709 13:12:03.424158  1126 raft_consensus.cc:359] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.424952  1126 raft_consensus.cc:385] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.425448  1126 raft_consensus.cc:740] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.426462  1126 consensus_queue.cc:260] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.428001  1128 raft_consensus.cc:359] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.428838  1128 raft_consensus.cc:385] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.429198  1128 raft_consensus.cc:740] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.430239  1128 consensus_queue.cc:260] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.433213  1128 ts_tablet_manager.cc:1434] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.006s
I20260709 13:12:03.434271  1128 tablet_bootstrap.cc:492] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.435181  1127 tablet_bootstrap.cc:492] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.435853  1127 ts_tablet_manager.cc:1403] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.021s
I20260709 13:12:03.437000  1126 ts_tablet_manager.cc:1434] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:12:03.438259  1126 tablet_bootstrap.cc:492] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.441797  1128 tablet_bootstrap.cc:654] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.443219  1127 raft_consensus.cc:359] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.444113  1127 raft_consensus.cc:385] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.444444  1127 raft_consensus.cc:740] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.445407  1127 consensus_queue.cc:260] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.449777  1127 ts_tablet_manager.cc:1434] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:12:03.451071  1127 tablet_bootstrap.cc:492] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.455441  1126 tablet_bootstrap.cc:654] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.458379  1127 tablet_bootstrap.cc:654] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.470299  1127 tablet_bootstrap.cc:492] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.470556  1128 tablet_bootstrap.cc:492] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.470781  1126 tablet_bootstrap.cc:492] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:03.470984  1127 ts_tablet_manager.cc:1403] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:12:03.471279  1126 ts_tablet_manager.cc:1403] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.033s	user 0.003s	sys 0.018s
I20260709 13:12:03.472493  1128 ts_tablet_manager.cc:1403] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.003s
I20260709 13:12:03.473930  1127 raft_consensus.cc:359] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.474675  1127 raft_consensus.cc:385] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.474639  1126 raft_consensus.cc:359] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.475314  1127 raft_consensus.cc:740] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.475520  1126 raft_consensus.cc:385] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.475934  1126 raft_consensus.cc:740] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.476229  1127 consensus_queue.cc:260] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.476927  1126 consensus_queue.cc:260] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.478917  1127 ts_tablet_manager.cc:1434] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:12:03.480070  1127 tablet_bootstrap.cc:492] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.487040  1127 tablet_bootstrap.cc:654] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.491051  1126 ts_tablet_manager.cc:1434] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.008s
I20260709 13:12:03.492264  1126 tablet_bootstrap.cc:492] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.476632  1128 raft_consensus.cc:359] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.498481  1128 raft_consensus.cc:385] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.498855  1128 raft_consensus.cc:740] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.499519  1126 tablet_bootstrap.cc:654] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.499804  1128 consensus_queue.cc:260] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.505985  1128 ts_tablet_manager.cc:1434] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:12:03.513226  1128 tablet_bootstrap.cc:492] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.515869  1126 tablet_bootstrap.cc:492] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:03.516594  1126 ts_tablet_manager.cc:1403] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:12:03.522291  1128 tablet_bootstrap.cc:654] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.523950  1127 tablet_bootstrap.cc:492] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.524587  1127 ts_tablet_manager.cc:1403] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.010s
I20260709 13:12:03.522300  1126 raft_consensus.cc:359] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.525837  1126 raft_consensus.cc:385] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.525951  1111 raft_consensus.cc:493] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.526182  1126 raft_consensus.cc:740] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.526643  1111 raft_consensus.cc:515] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.527292  1126 consensus_queue.cc:260] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.528204  1127 raft_consensus.cc:359] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.528712  1111 leader_election.cc:290] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:03.529009  1127 raft_consensus.cc:385] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.529368  1127 raft_consensus.cc:740] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.529521   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:03.530215   839 raft_consensus.cc:2468] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
I20260709 13:12:03.530220  1127 consensus_queue.cc:260] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.531224  1126 ts_tablet_manager.cc:1434] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:12:03.532327  1126 tablet_bootstrap.cc:492] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.533113  1127 ts_tablet_manager.cc:1434] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:12:03.534269  1127 tablet_bootstrap.cc:492] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.535068   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.535722   913 raft_consensus.cc:2468] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
I20260709 13:12:03.538986   954 leader_election.cc:304] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:03.540097  1126 tablet_bootstrap.cc:654] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.540149  1137 raft_consensus.cc:2804] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.540802  1137 raft_consensus.cc:493] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.541145  1137 raft_consensus.cc:3060] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.541478  1127 tablet_bootstrap.cc:654] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.549660  1128 tablet_bootstrap.cc:492] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.550204  1128 ts_tablet_manager.cc:1403] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.009s
I20260709 13:12:03.550519  1127 tablet_bootstrap.cc:492] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.551082  1127 ts_tablet_manager.cc:1403] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:12:03.556565  1137 raft_consensus.cc:515] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.559036  1128 raft_consensus.cc:359] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.560145  1128 raft_consensus.cc:385] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.560541  1128 raft_consensus.cc:740] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.565495   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:03.565917  1137 leader_election.cc:290] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:03.565205  1127 raft_consensus.cc:359] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.566285   839 raft_consensus.cc:3060] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.566589  1127 raft_consensus.cc:385] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.567075  1127 raft_consensus.cc:740] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.567735   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.569247   913 raft_consensus.cc:3060] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.567695  1128 consensus_queue.cc:260] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.569478  1127 consensus_queue.cc:260] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.571589  1128 ts_tablet_manager.cc:1434] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:12:03.572130  1127 ts_tablet_manager.cc:1434] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:12:03.572798  1128 tablet_bootstrap.cc:492] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.573397  1127 tablet_bootstrap.cc:492] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.580098  1128 tablet_bootstrap.cc:654] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.581126  1127 tablet_bootstrap.cc:654] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.581133   913 raft_consensus.cc:2468] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:12:03.583647   954 leader_election.cc:304] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:03.584157  1126 tablet_bootstrap.cc:492] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:03.584753  1137 raft_consensus.cc:2804] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.584929  1126 ts_tablet_manager.cc:1403] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.017s
I20260709 13:12:03.585402  1137 raft_consensus.cc:697] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:03.586532  1137 consensus_queue.cc:237] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.589648  1054 raft_consensus.cc:493] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.589620  1126 raft_consensus.cc:359] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.590900  1126 raft_consensus.cc:385] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.590853  1054 raft_consensus.cc:515] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.591382  1126 raft_consensus.cc:740] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.593629  1054 leader_election.cc:290] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.592314  1126 consensus_queue.cc:260] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.593900  1127 tablet_bootstrap.cc:492] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.594491  1127 ts_tablet_manager.cc:1403] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 13:12:03.594223  1054 raft_consensus.cc:493] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.596096  1126 ts_tablet_manager.cc:1434] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:03.597298  1126 tablet_bootstrap.cc:492] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.598031  1127 raft_consensus.cc:359] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.598323   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.598929  1127 raft_consensus.cc:385] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.599339  1127 raft_consensus.cc:740] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
W20260709 13:12:03.600400   804 leader_election.cc:343] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.601089  1127 consensus_queue.cc:260] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.602960   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.604192  1127 ts_tablet_manager.cc:1434] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
W20260709 13:12:03.604918   805 leader_election.cc:343] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.605432   805 leader_election.cc:304] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:03.606367  1144 raft_consensus.cc:2749] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.605885  1127 tablet_bootstrap.cc:492] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.615516  1127 tablet_bootstrap.cc:654] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.596148  1054 raft_consensus.cc:515] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.615708  1126 tablet_bootstrap.cc:654] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.618021  1054 leader_election.cc:290] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.619155   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616e071455d242b69d02909409b95f81" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.619887   987 raft_consensus.cc:2468] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.621310   804 leader_election.cc:304] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:03.624179  1054 raft_consensus.cc:2804] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.625598  1054 raft_consensus.cc:493] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.626044  1054 raft_consensus.cc:3060] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.630040  1127 tablet_bootstrap.cc:492] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.631065  1127 ts_tablet_manager.cc:1403] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:12:03.630044  1126 tablet_bootstrap.cc:492] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:03.632174  1126 ts_tablet_manager.cc:1403] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.005s
I20260709 13:12:03.634905  1127 raft_consensus.cc:359] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.635823  1127 raft_consensus.cc:385] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.636200  1127 raft_consensus.cc:740] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.635987  1126 raft_consensus.cc:359] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.624953   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616e071455d242b69d02909409b95f81" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.639204  1126 raft_consensus.cc:385] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.639379   913 raft_consensus.cc:2468] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.639613  1126 raft_consensus.cc:740] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.636708  1054 raft_consensus.cc:515] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.637162  1127 consensus_queue.cc:260] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.638779  1128 tablet_bootstrap.cc:492] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.641680  1128 ts_tablet_manager.cc:1403] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.006s
I20260709 13:12:03.642546  1054 leader_election.cc:290] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.624337   839 raft_consensus.cc:2468] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:12:03.643030   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616e071455d242b69d02909409b95f81" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.643630   913 raft_consensus.cc:3060] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.641026   735 catalog_manager.cc:5697] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 1 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:03.645682   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616e071455d242b69d02909409b95f81" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:03.646356   987 raft_consensus.cc:3060] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.651252   913 raft_consensus.cc:2468] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:03.652595   805 leader_election.cc:304] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:03.653088  1128 raft_consensus.cc:359] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.653599  1054 raft_consensus.cc:2804] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.653900  1128 raft_consensus.cc:385] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.654134  1054 raft_consensus.cc:697] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:03.654249  1128 raft_consensus.cc:740] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.654422  1127 ts_tablet_manager.cc:1434] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:12:03.655651  1127 tablet_bootstrap.cc:492] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.655212  1128 consensus_queue.cc:260] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.655364  1054 consensus_queue.cc:237] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.657945  1128 ts_tablet_manager.cc:1434] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:03.640635  1126 consensus_queue.cc:260] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.663038  1127 tablet_bootstrap.cc:654] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.667161  1126 ts_tablet_manager.cc:1434] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
I20260709 13:12:03.668283  1126 tablet_bootstrap.cc:492] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.668743   987 raft_consensus.cc:2468] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:03.670527  1127 tablet_bootstrap.cc:492] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.670524  1128 tablet_bootstrap.cc:492] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.671428  1127 ts_tablet_manager.cc:1403] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:12:03.677752  1144 raft_consensus.cc:493] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.678001  1127 raft_consensus.cc:359] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.678877  1128 tablet_bootstrap.cc:654] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.678859  1127 raft_consensus.cc:385] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.678514  1144 raft_consensus.cc:515] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.679538  1127 raft_consensus.cc:740] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.680763  1127 consensus_queue.cc:260] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.682405   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cedb044cf74354b5f8475982ae3632" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.682937  1054 raft_consensus.cc:493] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.683333   913 raft_consensus.cc:2468] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.683449  1127 ts_tablet_manager.cc:1434] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:12:03.684960  1127 tablet_bootstrap.cc:492] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: Bootstrap starting.
I20260709 13:12:03.685065   805 leader_election.cc:304] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:03.686578  1144 leader_election.cc:290] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.687176  1144 raft_consensus.cc:2804] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.687557  1144 raft_consensus.cc:493] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.688108  1144 raft_consensus.cc:3060] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.695429  1127 tablet_bootstrap.cc:654] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.683473  1054 raft_consensus.cc:515] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.699361  1126 tablet_bootstrap.cc:654] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.702101   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e91fcb5e7244dd99c57918cf9758e4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.704907  1054 leader_election.cc:290] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.709702   913 raft_consensus.cc:2468] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.710286  1127 tablet_bootstrap.cc:492] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: No bootstrap required, opened a new log
I20260709 13:12:03.711217  1127 ts_tablet_manager.cc:1403] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 13:12:03.711615   805 leader_election.cc:304] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:03.712821  1054 raft_consensus.cc:2804] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.713490  1054 raft_consensus.cc:493] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.713946  1054 raft_consensus.cc:3060] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.715266  1127 raft_consensus.cc:359] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.716517  1127 raft_consensus.cc:385] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.717172  1127 raft_consensus.cc:740] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.718284  1127 consensus_queue.cc:260] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.722442   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cedb044cf74354b5f8475982ae3632" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.723248   987 raft_consensus.cc:2468] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.724184  1127 ts_tablet_manager.cc:1434] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:12:03.725569   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e91fcb5e7244dd99c57918cf9758e4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.726269   987 raft_consensus.cc:2468] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.730479  1144 raft_consensus.cc:515] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.735044  1154 raft_consensus.cc:493] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.735855  1154 raft_consensus.cc:515] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.739149   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cedb044cf74354b5f8475982ae3632" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.739765   913 raft_consensus.cc:3060] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.739890  1128 tablet_bootstrap.cc:492] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.740671  1128 ts_tablet_manager.cc:1403] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.070s	user 0.042s	sys 0.025s
I20260709 13:12:03.741356  1154 leader_election.cc:290] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
W20260709 13:12:03.738914   879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:36615, user_credentials={real_user=slave}} blocked reactor thread for 50225.3us
I20260709 13:12:03.742424   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
W20260709 13:12:03.744066   805 leader_election.cc:343] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.743904  1128 raft_consensus.cc:359] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.744731  1128 raft_consensus.cc:385] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.745139  1128 raft_consensus.cc:740] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.746084  1144 leader_election.cc:290] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.745934  1128 consensus_queue.cc:260] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.748438   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cedb044cf74354b5f8475982ae3632" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:03.749189   988 raft_consensus.cc:3060] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.749439  1128 ts_tablet_manager.cc:1434] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:03.749806  1054 raft_consensus.cc:515] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.750557  1128 tablet_bootstrap.cc:492] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.752374  1054 leader_election.cc:290] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.753024  1137 raft_consensus.cc:493] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.753559  1137 raft_consensus.cc:515] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.753970   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e91fcb5e7244dd99c57918cf9758e4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:03.747107  1126 tablet_bootstrap.cc:492] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:03.754838   986 raft_consensus.cc:3060] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.755017  1126 ts_tablet_manager.cc:1403] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.005s
I20260709 13:12:03.755774  1137 leader_election.cc:290] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:03.754135   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e91fcb5e7244dd99c57918cf9758e4" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.758299   914 raft_consensus.cc:3060] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.758452   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:03.759184   839 raft_consensus.cc:2468] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
I20260709 13:12:03.760732   952 leader_election.cc:304] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:03.746814   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.761507   912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.764745  1128 tablet_bootstrap.cc:654] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.761790   987 raft_consensus.cc:2468] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
W20260709 13:12:03.765664   954 leader_election.cc:343] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.766712  1137 raft_consensus.cc:2804] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.766778   804 leader_election.cc:304] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:03.768308  1054 raft_consensus.cc:2804] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.768792  1054 raft_consensus.cc:493] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.769223  1054 raft_consensus.cc:3060] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.769434  1137 raft_consensus.cc:493] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.769996  1137 raft_consensus.cc:3060] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.758513  1126 raft_consensus.cc:359] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.771324  1126 raft_consensus.cc:385] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.771644  1126 raft_consensus.cc:740] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.770553   986 raft_consensus.cc:2468] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:03.773530   804 leader_election.cc:304] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:03.776010   988 raft_consensus.cc:2468] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:03.777000  1144 raft_consensus.cc:2804] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.783133   804 leader_election.cc:304] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:03.784060  1054 raft_consensus.cc:515] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.772531  1126 consensus_queue.cc:260] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.787871  1054 leader_election.cc:290] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.788769  1054 raft_consensus.cc:493] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.789438  1054 raft_consensus.cc:515] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.792035  1054 leader_election.cc:290] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.793056   734 catalog_manager.cc:5697] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.794345  1154 raft_consensus.cc:2804] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.804062  1154 raft_consensus.cc:697] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:03.805038  1154 consensus_queue.cc:237] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.807489   912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.800722  1144 raft_consensus.cc:697] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:03.799163  1137 raft_consensus.cc:515] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.784205   913 raft_consensus.cc:2468] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:03.809594   911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.809345  1144 consensus_queue.cc:237] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.810451   911 raft_consensus.cc:2468] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.810863  1137 leader_election.cc:290] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:03.812163   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:03.813084   839 raft_consensus.cc:2393] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0dad90a639f5494e80e9ab0313a8564c in current term 1: Already voted for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in this term.
I20260709 13:12:03.807876   914 raft_consensus.cc:2468] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:03.813606  1128 tablet_bootstrap.cc:492] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.814203  1128 ts_tablet_manager.cc:1403] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.031s
I20260709 13:12:03.803170  1126 ts_tablet_manager.cc:1434] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 13:12:03.818403  1128 raft_consensus.cc:359] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
W20260709 13:12:03.819473   805 leader_election.cc:343] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.820762   805 leader_election.cc:304] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:03.822624  1162 raft_consensus.cc:2804] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.822685   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:03.823220  1162 raft_consensus.cc:493] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.823697   988 raft_consensus.cc:2393] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 72f0896fc4e24a7f879f826aa6d6bc70 in current term 1: Already voted for candidate 0dad90a639f5494e80e9ab0313a8564c in this term.
I20260709 13:12:03.823635  1162 raft_consensus.cc:3060] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.818627  1126 tablet_bootstrap.cc:492] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.836448  1085 raft_consensus.cc:493] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.837080  1085 raft_consensus.cc:515] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.819531  1128 raft_consensus.cc:385] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.840343  1128 raft_consensus.cc:740] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.840940   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.841215  1128 consensus_queue.cc:260] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.842553  1085 leader_election.cc:290] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.843843  1128 ts_tablet_manager.cc:1434] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
W20260709 13:12:03.843995   879 leader_election.cc:343] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.845167  1128 tablet_bootstrap.cc:492] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.846282  1162 raft_consensus.cc:515] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.848299   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:03.849104   839 raft_consensus.cc:2468] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 0.
I20260709 13:12:03.850509  1162 leader_election.cc:290] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.850927   878 leader_election.cc:304] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:03.852303  1128 tablet_bootstrap.cc:654] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.852371   804 leader_election.cc:304] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:03.853237   911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.853911   911 raft_consensus.cc:3060] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.854548   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.855172   914 raft_consensus.cc:3060] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.853957  1144 raft_consensus.cc:2749] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.857295   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:03.863649  1156 raft_consensus.cc:2804] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.864795   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:03.865029  1156 raft_consensus.cc:493] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.867471  1137 raft_consensus.cc:493] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.868009  1137 raft_consensus.cc:515] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.870143   914 raft_consensus.cc:2468] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:12:03.870556  1137 leader_election.cc:290] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:03.867105  1156 raft_consensus.cc:3060] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.872177  1126 tablet_bootstrap.cc:654] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.874301   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:03.875103   839 raft_consensus.cc:2468] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 0.
I20260709 13:12:03.872469   954 leader_election.cc:304] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:12:03.862995   737 catalog_manager.cc:5697] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.877425   952 leader_election.cc:304] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:03.878474  1111 raft_consensus.cc:2804] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.878427   737 catalog_manager.cc:5697] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.880149  1137 raft_consensus.cc:2804] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.880672  1137 raft_consensus.cc:493] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.884137  1137 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.891896  1128 tablet_bootstrap.cc:492] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.892732  1128 ts_tablet_manager.cc:1403] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.012s
W20260709 13:12:03.893335   804 leader_election.cc:343] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:03.894203   804 leader_election.cc:343] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.896799  1128 raft_consensus.cc:359] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.897943  1128 raft_consensus.cc:385] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.898310  1128 raft_consensus.cc:740] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.881420   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.899501  1128 consensus_queue.cc:260] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
W20260709 13:12:03.901240   954 leader_election.cc:343] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.903060  1128 ts_tablet_manager.cc:1434] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:03.904387  1111 raft_consensus.cc:697] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:03.905201  1128 tablet_bootstrap.cc:492] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: Bootstrap starting.
I20260709 13:12:03.905645  1111 consensus_queue.cc:237] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.910609  1137 raft_consensus.cc:515] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.913686  1137 leader_election.cc:290] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:03.915490   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:03.916558   839 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.919723  1128 tablet_bootstrap.cc:654] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.882791  1156 raft_consensus.cc:515] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.873494   911 raft_consensus.cc:2468] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:03.922143   911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:03.923029  1156 leader_election.cc:290] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.924947  1126 tablet_bootstrap.cc:492] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:03.925580  1126 ts_tablet_manager.cc:1403] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.026s
I20260709 13:12:03.929992  1126 raft_consensus.cc:359] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.931041   805 leader_election.cc:304] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:03.931378  1126 raft_consensus.cc:385] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.931636   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:03.932055  1126 raft_consensus.cc:740] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.932595   838 raft_consensus.cc:3060] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.933382  1126 consensus_queue.cc:260] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
W20260709 13:12:03.936054   954 leader_election.cc:343] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.937058  1162 raft_consensus.cc:2804] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.937420  1126 ts_tablet_manager.cc:1434] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:12:03.937659  1162 raft_consensus.cc:697] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:03.938935  1126 tablet_bootstrap.cc:492] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:03.938675  1162 consensus_queue.cc:237] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.941416   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
W20260709 13:12:03.945382   879 leader_election.cc:343] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.951321  1126 tablet_bootstrap.cc:654] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.952706   838 raft_consensus.cc:2468] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 1.
I20260709 13:12:03.957988   878 leader_election.cc:304] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:03.960052  1156 raft_consensus.cc:2804] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.960620  1156 raft_consensus.cc:697] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:03.961767  1156 consensus_queue.cc:237] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.954535   839 raft_consensus.cc:2468] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 1.
I20260709 13:12:03.968933   952 leader_election.cc:304] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:03.969816   735 catalog_manager.cc:5697] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.971129  1137 raft_consensus.cc:2804] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.972309  1162 raft_consensus.cc:493] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.973837  1162 raft_consensus.cc:515] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.978525  1162 leader_election.cc:290] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:03.979211   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
W20260709 13:12:03.981297   804 leader_election.cc:343] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.984126   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:03.984413  1137 raft_consensus.cc:697] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:03.985096   914 raft_consensus.cc:2468] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 0.
I20260709 13:12:03.985437  1137 consensus_queue.cc:237] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.985114  1128 tablet_bootstrap.cc:492] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: No bootstrap required, opened a new log
I20260709 13:12:03.987241  1128 ts_tablet_manager.cc:1403] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent bootstrapping tablet: real 0.082s	user 0.050s	sys 0.006s
I20260709 13:12:03.987547   805 leader_election.cc:304] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:03.986861   734 catalog_manager.cc:5697] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.990490  1128 raft_consensus.cc:359] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.991371  1128 raft_consensus.cc:385] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.991715  1128 raft_consensus.cc:740] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.992646  1128 consensus_queue.cc:260] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:03.990877  1144 raft_consensus.cc:2804] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.995173  1128 ts_tablet_manager.cc:1434] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:03.995133  1144 raft_consensus.cc:493] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.995718  1144 raft_consensus.cc:3060] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.001673  1126 tablet_bootstrap.cc:492] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:04.002449  1126 ts_tablet_manager.cc:1403] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.029s
I20260709 13:12:04.003095   737 catalog_manager.cc:5697] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 1 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.004817  1144 raft_consensus.cc:515] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.005888  1126 raft_consensus.cc:359] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.006721  1126 raft_consensus.cc:385] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.007064  1126 raft_consensus.cc:740] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.007906  1126 consensus_queue.cc:260] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.008183   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:04.008940   914 raft_consensus.cc:3060] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.009174   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:04.010386  1126 ts_tablet_manager.cc:1434] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:12:04.010778   804 leader_election.cc:343] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.011476  1126 tablet_bootstrap.cc:492] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: Bootstrap starting.
I20260709 13:12:04.011392  1144 leader_election.cc:290] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:04.017483   914 raft_consensus.cc:2468] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 1.
I20260709 13:12:04.018446  1126 tablet_bootstrap.cc:654] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.018882   805 leader_election.cc:304] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:04.020205  1144 raft_consensus.cc:2804] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.020764  1144 raft_consensus.cc:697] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:04.021662  1144 consensus_queue.cc:237] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.024432  1126 tablet_bootstrap.cc:492] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: No bootstrap required, opened a new log
I20260709 13:12:04.025152  1126 ts_tablet_manager.cc:1403] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:12:04.025693   734 catalog_manager.cc:5697] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 1 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.028353  1126 raft_consensus.cc:359] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.029228  1126 raft_consensus.cc:385] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.029552  1126 raft_consensus.cc:740] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.030408  1126 consensus_queue.cc:260] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.031122   735 catalog_manager.cc:5697] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 1 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.032506  1137 consensus_queue.cc:1048] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.033634  1126 ts_tablet_manager.cc:1434] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:04.054392  1137 consensus_queue.cc:1048] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.062244   986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
mode: GRACEFUL
new_leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:12:04.070302   986 raft_consensus.cc:606] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Received request to transfer leadership to TS 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:12:04.090703  1137 raft_consensus.cc:993] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: : Instructing follower 72f0896fc4e24a7f879f826aa6d6bc70 to start an election
I20260709 13:12:04.091228  1137 raft_consensus.cc:1081] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Signalling peer 72f0896fc4e24a7f879f826aa6d6bc70 to start an election
I20260709 13:12:04.092980   839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7"
dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
 from {username='slave'} at 127.0.0.1:57578
I20260709 13:12:04.093900   839 raft_consensus.cc:493] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.094305   839 raft_consensus.cc:3060] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.102298   839 raft_consensus.cc:515] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.105343   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:04.105639   839 leader_election.cc:290] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 2 election: Requested vote from peers ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:04.106081   914 raft_consensus.cc:3060] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.106290   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c587a7f71b48df86869cb897cd5ae7" candidate_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:04.106997   986 raft_consensus.cc:3055] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:04.107347   986 raft_consensus.cc:740] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:04.108477   988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
mode: GRACEFUL
new_leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:12:04.108263   986 consensus_queue.cc:260] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.109133   988 raft_consensus.cc:606] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Received request to transfer leadership to TS ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:04.109702   986 raft_consensus.cc:3060] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.116190   988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
mode: GRACEFUL
new_leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:12:04.116546   914 raft_consensus.cc:2468] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 2.
I20260709 13:12:04.116567   986 raft_consensus.cc:2468] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in term 2.
I20260709 13:12:04.117053   988 raft_consensus.cc:606] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Received request to transfer leadership to TS ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:04.118151   804 leader_election.cc:304] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:04.119055  1144 raft_consensus.cc:2804] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:04.119531  1144 raft_consensus.cc:697] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 LEADER]: Becoming Leader. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:04.120332  1144 consensus_queue.cc:237] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.124248   839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30"
dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
mode: GRACEFUL
new_leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:57594
I20260709 13:12:04.124907   839 raft_consensus.cc:606] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Received request to transfer leadership to TS ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:04.131263  1111 raft_consensus.cc:493] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.131374   839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8ef17140f29405883f006650c6c3178"
dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
mode: GRACEFUL
new_leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:57594
I20260709 13:12:04.132145  1111 raft_consensus.cc:515] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.132673   839 raft_consensus.cc:606] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Received request to transfer leadership to TS ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:04.131266   735 catalog_manager.cc:5697] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 reported cstate change: term changed from 1 to 2, leader changed from 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131) to 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129). New cstate: current_term: 2 leader_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.135089   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:04.135370  1111 leader_election.cc:290] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:04.135967   838 raft_consensus.cc:2393] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0dad90a639f5494e80e9ab0313a8564c in current term 1: Already voted for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in this term.
I20260709 13:12:04.136585   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:04.138947   952 leader_election.cc:304] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c; no voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:04.141152  1111 raft_consensus.cc:3060] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.147758  1144 consensus_queue.cc:1048] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.155315  1111 raft_consensus.cc:2749] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.162993   911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90f58cc27c784257acefa53153eff18f"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
mode: GRACEFUL
new_leader_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:37258
I20260709 13:12:04.163643   911 raft_consensus.cc:606] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 LEADER]: Received request to transfer leadership to TS 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:04.164697  1144 consensus_queue.cc:1048] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.236418  1111 raft_consensus.cc:493] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.237172  1111 raft_consensus.cc:515] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.239099  1111 leader_election.cc:290] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:04.239908   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:04.240453   911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:04.241283   911 raft_consensus.cc:2393] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0dad90a639f5494e80e9ab0313a8564c in current term 1: Already voted for candidate 72f0896fc4e24a7f879f826aa6d6bc70 in this term.
I20260709 13:12:04.242225   954 leader_election.cc:304] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c; no voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:04.242890  1111 raft_consensus.cc:3060] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.248145  1111 raft_consensus.cc:2749] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.282193  1144 consensus_queue.cc:1048] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.288154  1144 consensus_queue.cc:1048] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.295091  1054 consensus_queue.cc:1048] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.310182  1144 consensus_queue.cc:1048] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.343294  1111 consensus_queue.cc:1048] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.350586  1137 raft_consensus.cc:993] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: : Instructing follower ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.351084  1137 raft_consensus.cc:1081] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Signalling peer ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.352174  1156 raft_consensus.cc:493] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.352824  1156 raft_consensus.cc:515] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.353214   911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37244
I20260709 13:12:04.354754   911 raft_consensus.cc:493] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.355219   911 raft_consensus.cc:3060] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.358490  1156 leader_election.cc:290] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:04.359398   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad90a639f5494e80e9ab0313a8564c" is_pre_election: true
I20260709 13:12:04.360105   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:04.360962   839 raft_consensus.cc:2393] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in current term 1: Already voted for candidate 0dad90a639f5494e80e9ab0313a8564c in this term.
I20260709 13:12:04.361436  1111 consensus_queue.cc:1048] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.366683   911 raft_consensus.cc:515] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.367813   878 leader_election.cc:304] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:12:04.368705  1156 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.372674   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:04.373471   988 raft_consensus.cc:3055] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:04.373787   988 raft_consensus.cc:740] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:04.375149   988 consensus_queue.cc:260] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.376108   988 raft_consensus.cc:3060] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.376168   838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42437805d4224febb9e9b5ca537624d8" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:04.376930   838 raft_consensus.cc:3060] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.379887   911 leader_election.cc:290] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:04.386719   988 raft_consensus.cc:2468] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:04.388032   879 leader_election.cc:304] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:04.388084  1085 consensus_queue.cc:1048] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.389878  1085 raft_consensus.cc:2804] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:04.388095   838 raft_consensus.cc:2468] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:04.390647  1085 raft_consensus.cc:697] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:04.392102  1085 consensus_queue.cc:237] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.389998  1156 raft_consensus.cc:2749] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.403600  1144 consensus_queue.cc:1048] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.404543   736 catalog_manager.cc:5697] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 1 to 2, leader changed from 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131) to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.413357  1144 raft_consensus.cc:993] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: : Instructing follower ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.413955  1144 raft_consensus.cc:1081] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Signalling peer ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.415001  1192 raft_consensus.cc:993] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: : Instructing follower 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:04.415495  1192 raft_consensus.cc:1081] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 LEADER]: Signalling peer 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:04.418195   986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90f58cc27c784257acefa53153eff18f"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:37518
I20260709 13:12:04.418767   986 raft_consensus.cc:493] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.419148   986 raft_consensus.cc:3060] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.420933  1111 consensus_queue.cc:1048] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.421721   987 raft_consensus.cc:3060] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.425441   914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8ef17140f29405883f006650c6c3178"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37238
I20260709 13:12:04.426095   914 raft_consensus.cc:493] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.426494   914 raft_consensus.cc:3060] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.427484  1085 consensus_queue.cc:1048] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.434291   914 raft_consensus.cc:515] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.435532   986 raft_consensus.cc:515] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.436669   988 raft_consensus.cc:1240] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Rejecting Update request from peer ebe7c3c7645b4c5caaad65cfe77fbd89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:04.437600   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:04.438176   839 raft_consensus.cc:3055] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:04.438504   839 raft_consensus.cc:740] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:04.439572  1137 raft_consensus.cc:993] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: : Instructing follower ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.439378   839 consensus_queue.cc:260] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.440037  1137 raft_consensus.cc:1081] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Signalling peer ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.440275   839 raft_consensus.cc:3060] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.441025  1156 consensus_queue.cc:1059] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.442124  1156 raft_consensus.cc:3055] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:04.442406   912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37244
I20260709 13:12:04.443698   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:04.448133   986 leader_election.cc:290] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:04.449054   912 raft_consensus.cc:493] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.449272   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:04.449570   912 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.438365   914 leader_election.cc:290] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:04.442499  1156 raft_consensus.cc:740] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:04.452275  1156 consensus_queue.cc:260] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.455005  1111 consensus_queue.cc:1048] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.455192   837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f58cc27c784257acefa53153eff18f" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:04.457230  1156 raft_consensus.cc:3060] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.458981   912 raft_consensus.cc:515] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.464287   836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:04.468703   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:04.469391   986 raft_consensus.cc:3055] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:04.469755   986 raft_consensus.cc:740] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:04.470595   986 consensus_queue.cc:260] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.471654   986 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.479476   839 raft_consensus.cc:2468] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:04.482180   878 leader_election.cc:304] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:04.483119  1192 raft_consensus.cc:2804] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:04.483630  1192 raft_consensus.cc:697] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:04.484517  1192 consensus_queue.cc:237] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.484841   912 leader_election.cc:290] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:04.487072   913 raft_consensus.cc:2468] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 2.
I20260709 13:12:04.491328   954 leader_election.cc:304] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:12:04.492331  1111 raft_consensus.cc:2804] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:04.492684   986 raft_consensus.cc:2468] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:04.493880  1111 raft_consensus.cc:697] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:04.494021   879 leader_election.cc:304] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 72f0896fc4e24a7f879f826aa6d6bc70
I20260709 13:12:04.495340  1156 raft_consensus.cc:2804] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:04.495188  1111 consensus_queue.cc:237] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.496037  1156 raft_consensus.cc:697] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:04.495172   736 catalog_manager.cc:5697] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 1 to 2, leader changed from 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129) to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.497046  1156 consensus_queue.cc:237] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.506364   735 catalog_manager.cc:5697] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 1 to 2, leader changed from ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130) to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 2 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.511049  1144 consensus_queue.cc:1048] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.511998   736 catalog_manager.cc:5697] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 1 to 2, leader changed from 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131) to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.517076  1111 raft_consensus.cc:493] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.517748  1111 raft_consensus.cc:515] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.520932  1111 leader_election.cc:290] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:04.521106   837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" is_pre_election: true
I20260709 13:12:04.521835   913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ef17140f29405883f006650c6c3178" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" is_pre_election: true
I20260709 13:12:04.522070  1160 raft_consensus.cc:993] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: : Instructing follower ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.522019   837 raft_consensus.cc:2393] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0dad90a639f5494e80e9ab0313a8564c in current term 2: Already voted for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in this term.
I20260709 13:12:04.523680  1054 raft_consensus.cc:1081] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Signalling peer ebe7c3c7645b4c5caaad65cfe77fbd89 to start an election
I20260709 13:12:04.524597   952 leader_election.cc:304] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c; no voters: 72f0896fc4e24a7f879f826aa6d6bc70, ebe7c3c7645b4c5caaad65cfe77fbd89
I20260709 13:12:04.525604  1111 raft_consensus.cc:3060] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.532727   912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
 from {username='slave'} at 127.0.0.1:37238
I20260709 13:12:04.533412  1111 raft_consensus.cc:2749] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:04.533631  1154 consensus_queue.cc:1048] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.536103   912 raft_consensus.cc:493] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.536408   912 raft_consensus.cc:3060] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.543746   912 raft_consensus.cc:515] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.548122   837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:04.548448   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76bdbbe2c37f413fbca8e88267682b30" candidate_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
I20260709 13:12:04.548969   837 raft_consensus.cc:3055] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:04.549086   986 raft_consensus.cc:3060] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.549381   837 raft_consensus.cc:740] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:04.550262   837 consensus_queue.cc:260] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.555181   837 raft_consensus.cc:3060] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.556691   986 raft_consensus.cc:2468] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:04.556981   912 leader_election.cc:290] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131:36615)
I20260709 13:12:04.557898   879 leader_election.cc:304] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:04.558741  1156 raft_consensus.cc:2804] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:04.559186  1156 raft_consensus.cc:697] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Leader. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:04.559950  1156 consensus_queue.cc:237] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:04.562779   837 raft_consensus.cc:2468] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebe7c3c7645b4c5caaad65cfe77fbd89 in term 2.
I20260709 13:12:04.567266   736 catalog_manager.cc:5697] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 reported cstate change: term changed from 1 to 2, leader changed from 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129) to ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.596149   912 raft_consensus.cc:1275] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Refusing update from remote peer 72f0896fc4e24a7f879f826aa6d6bc70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:04.597674  1162 consensus_queue.cc:1048] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:04.606815   986 raft_consensus.cc:1275] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer 72f0896fc4e24a7f879f826aa6d6bc70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:04.608584  1054 consensus_queue.cc:1048] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:04.931317   839 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.936614   839 raft_consensus.cc:1275] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:04.938303  1192 consensus_queue.cc:1048] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:04.947750   987 raft_consensus.cc:1275] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:04.949462  1192 consensus_queue.cc:1048] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:04.968922   839 raft_consensus.cc:1275] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:04.970144  1192 consensus_queue.cc:1048] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:04.978135   987 raft_consensus.cc:1275] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:04.979838  1085 consensus_queue.cc:1048] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.020352   839 raft_consensus.cc:3060] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.025971   839 raft_consensus.cc:1275] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:05.027460  1111 consensus_queue.cc:1048] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.032449   912 raft_consensus.cc:1275] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:05.036911  1111 consensus_queue.cc:1048] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:05.043634   987 raft_consensus.cc:1275] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:05.045495  1156 consensus_queue.cc:1048] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.058282   839 raft_consensus.cc:1275] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:05.060141  1202 consensus_queue.cc:1048] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:05.104305   987 raft_consensus.cc:1275] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:05.106542  1202 consensus_queue.cc:1048] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:05.116006   839 raft_consensus.cc:1275] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer ebe7c3c7645b4c5caaad65cfe77fbd89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:05.118320  1192 consensus_queue.cc:1048] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:07.167754   736 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59144:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:12:07.188585   736 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59144:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:12:07.245515 21390 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:12:07.515445  1249 log.cc:927] Time spent T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:12:07.491005  1257 tablet.cc:1724] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.404532  1247 tablet.cc:1724] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:07.538185  1251 log.cc:927] Time spent T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: Append to log took a long time: real 0.114s	user 0.003s	sys 0.000s
I20260709 13:12:07.497570  1254 tablet.cc:1724] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:07.586735   865 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:42437805d4224febb9e9b5ca537624d8)
W20260709 13:12:07.599231   865 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:42437805d4224febb9e9b5ca537624d8)
I20260709 13:12:07.571185  1262 tablet.cc:1724] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.600083  1264 tablet.cc:1724] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:07.601589  1250 log.cc:927] Time spent T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: Append to log took a long time: real 0.079s	user 0.000s	sys 0.002s
W20260709 13:12:07.603283  1252 log.cc:927] Time spent T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 13:12:07.560467  1256 tablet.cc:1724] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:07.622087   940 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:42437805d4224febb9e9b5ca537624d8)
W20260709 13:12:07.634613   878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:42761, user_credentials={real_user=slave}} blocked reactor thread for 59704.1us
I20260709 13:12:07.652496  1273 tablet.cc:1724] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.669569  1275 tablet.cc:1724] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.669718  1247 tablet.cc:1724] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.674386  1257 tablet.cc:1724] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.595695  1267 tablet.cc:1724] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:07.677501  1261 log.cc:927] Time spent T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:12:07.629145  1263 tablet.cc:1724] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.672112  1272 tablet.cc:1724] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.687305  1274 tablet.cc:1724] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.705071  1254 tablet.cc:1724] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.698575  1256 tablet.cc:1724] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.715459  1273 tablet.cc:1724] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.717023   836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "616e071455d242b69d02909409b95f81"
dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
mode: GRACEFUL
new_leader_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:33676
I20260709 13:12:07.724548   836 raft_consensus.cc:606] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Received request to transfer leadership to TS 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:07.729710  1247 tablet.cc:1724] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.738890  1264 tablet.cc:1724] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.744035  1274 tablet.cc:1724] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.746635  1263 tablet.cc:1724] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.754437  1257 tablet.cc:1724] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.761448  1262 tablet.cc:1724] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.763170  1267 tablet.cc:1724] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.765551  1274 tablet.cc:1724] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.758107  1275 tablet.cc:1724] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.787268  1272 tablet.cc:1724] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:07.816502   914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
mode: GRACEFUL
new_leader_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:36222
I20260709 13:12:07.817142   914 raft_consensus.cc:606] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Received request to transfer leadership to TS 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:07.818805 21390 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:12:07.819466 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:07.827909   737 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4: soft_deleted_table [id=1246343e87cc4706bb240ef1cd90708a] alter complete (version 1)
I20260709 13:12:07.832456   914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70"
dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
mode: GRACEFUL
new_leader_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:36222
I20260709 13:12:07.833117   914 raft_consensus.cc:606] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Received request to transfer leadership to TS 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:07.837452   836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4"
dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
mode: GRACEFUL
new_leader_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:33676
I20260709 13:12:07.838073   836 raft_consensus.cc:606] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Received request to transfer leadership to TS 0dad90a639f5494e80e9ab0313a8564c
I20260709 13:12:07.839466 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:07.840548 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:07.924243  1235 raft_consensus.cc:993] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89: : Instructing follower 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:07.925086  1270 raft_consensus.cc:1081] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Signalling peer 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:07.926862   985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:37518
I20260709 13:12:07.927379   985 raft_consensus.cc:493] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:07.927650   985 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.933611   985 raft_consensus.cc:515] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:07.936041   985 leader_election.cc:290] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 3 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:07.937351   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:07.937536   836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea7da111c844a37a40cafdd0ee54d70" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:07.938385   914 raft_consensus.cc:3055] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:07.938401   836 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.939011   914 raft_consensus.cc:740] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:07.940232   914 consensus_queue.cc:260] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:07.941941   914 raft_consensus.cc:3060] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.948945   836 raft_consensus.cc:2468] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 3.
I20260709 13:12:07.950592   914 raft_consensus.cc:2468] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 3.
I20260709 13:12:07.950637   952 leader_election.cc:304] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:07.951987  1260 raft_consensus.cc:2804] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:07.952520  1260 raft_consensus.cc:697] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 3 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:07.953398  1260 consensus_queue.cc:237] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:07.962947   737 catalog_manager.cc:5697] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 2 to 3, leader changed from ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130) to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 3 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.033102  1270 raft_consensus.cc:993] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: : Instructing follower 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:08.033684  1235 raft_consensus.cc:1081] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Signalling peer 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:08.035584   985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:37518
I20260709 13:12:08.036274   985 raft_consensus.cc:493] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:08.036655   985 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:08.042397   985 raft_consensus.cc:515] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.044612   985 leader_election.cc:290] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 3 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:08.045581   836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:08.045921   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e36fa38b284d8b92de0843c80b2e66" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:08.046267   836 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:08.046630   914 raft_consensus.cc:3055] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:08.047009   914 raft_consensus.cc:740] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ebe7c3c7645b4c5caaad65cfe77fbd89, State: Running, Role: LEADER
I20260709 13:12:08.047812   914 consensus_queue.cc:260] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.048920   914 raft_consensus.cc:3060] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:08.052071   836 raft_consensus.cc:2468] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 3.
I20260709 13:12:08.053500   952 leader_election.cc:304] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, 72f0896fc4e24a7f879f826aa6d6bc70; no voters: 
I20260709 13:12:08.054318  1260 raft_consensus.cc:2804] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:08.054754  1260 raft_consensus.cc:697] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 3 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:08.054808   914 raft_consensus.cc:2468] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 3.
I20260709 13:12:08.055619  1260 consensus_queue.cc:237] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.063642   737 catalog_manager.cc:5697] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 2 to 3, leader changed from ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130) to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 3 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.100530  1204 raft_consensus.cc:993] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: : Instructing follower 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:08.101171  1265 raft_consensus.cc:1081] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Signalling peer 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:08.102874   982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "616e071455d242b69d02909409b95f81"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:37516
I20260709 13:12:08.103518   982 raft_consensus.cc:493] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:08.103832   982 raft_consensus.cc:3060] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.109361   982 raft_consensus.cc:515] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.111297   982 leader_election.cc:290] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:08.112655   836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616e071455d242b69d02909409b95f81" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:08.112674   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616e071455d242b69d02909409b95f81" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:08.113524   836 raft_consensus.cc:3055] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:08.113592   914 raft_consensus.cc:3060] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.113884   836 raft_consensus.cc:740] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:08.114763   836 consensus_queue.cc:260] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.115792   836 raft_consensus.cc:3060] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.121140   914 raft_consensus.cc:2468] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 2.
I20260709 13:12:08.122769   954 leader_election.cc:304] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:08.122983   836 raft_consensus.cc:2468] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 2.
I20260709 13:12:08.123854  1260 raft_consensus.cc:2804] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:08.124500  1260 raft_consensus.cc:697] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:08.126866  1260 consensus_queue.cc:237] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.167752  1271 raft_consensus.cc:993] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70: : Instructing follower 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:08.168287  1265 raft_consensus.cc:1081] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Signalling peer 0dad90a639f5494e80e9ab0313a8564c to start an election
I20260709 13:12:08.171001   982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4"
dest_uuid: "0dad90a639f5494e80e9ab0313a8564c"
 from {username='slave'} at 127.0.0.1:37516
I20260709 13:12:08.171732   982 raft_consensus.cc:493] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:08.172571   982 raft_consensus.cc:3060] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.205132   982 raft_consensus.cc:515] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.214689   982 leader_election.cc:290] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Requested vote from peers 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761), ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205)
I20260709 13:12:08.568306   737 catalog_manager.cc:5697] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 1 to 2, leader changed from 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129) to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 2 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.583818   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89"
I20260709 13:12:08.586328   913 raft_consensus.cc:1275] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:12:08.590121   914 raft_consensus.cc:3060] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.591384   913 raft_consensus.cc:1275] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:08.593983  1111 consensus_queue.cc:1048] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:08.602936  1111 consensus_queue.cc:1048] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:08.655488   914 raft_consensus.cc:2468] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 2.
I20260709 13:12:08.658694   839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a35499f204fa6a5a12f6431b006c4" candidate_uuid: "0dad90a639f5494e80e9ab0313a8564c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72f0896fc4e24a7f879f826aa6d6bc70"
I20260709 13:12:08.662971   839 raft_consensus.cc:3055] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:08.663327   839 raft_consensus.cc:740] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72f0896fc4e24a7f879f826aa6d6bc70, State: Running, Role: LEADER
I20260709 13:12:08.664171   839 consensus_queue.cc:260] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
I20260709 13:12:08.665035   839 raft_consensus.cc:3060] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.659232   912 raft_consensus.cc:1275] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:08.660295   838 raft_consensus.cc:1275] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:08.661768   837 raft_consensus.cc:1275] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:12:08.681672   839 raft_consensus.cc:2468] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dad90a639f5494e80e9ab0313a8564c in term 2.
I20260709 13:12:08.682844   913 raft_consensus.cc:1240] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Rejecting Update request from peer 72f0896fc4e24a7f879f826aa6d6bc70 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:08.697471   954 leader_election.cc:304] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad90a639f5494e80e9ab0313a8564c, ebe7c3c7645b4c5caaad65cfe77fbd89; no voters: 
I20260709 13:12:08.698527  1290 raft_consensus.cc:2804] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:08.699541  1290 raft_consensus.cc:697] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Becoming Leader. State: Replica: 0dad90a639f5494e80e9ab0313a8564c, State: Running, Role: LEADER
I20260709 13:12:08.700330  1298 consensus_queue.cc:1048] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:08.700831  1290 consensus_queue.cc:237] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } }
W20260709 13:12:08.711941   952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:42761, user_credentials={real_user=slave}} blocked reactor thread for 46828.7us
I20260709 13:12:08.737567  1296 consensus_queue.cc:1048] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:08.739993   837 raft_consensus.cc:1275] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:08.741786  1298 consensus_queue.cc:1048] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:08.755681  1297 consensus_queue.cc:1048] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:12:08.793192   804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:36615, user_credentials={real_user=slave}} blocked reactor thread for 69661.2us
I20260709 13:12:08.808670   737 catalog_manager.cc:5697] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c reported cstate change: term changed from 1 to 2, leader changed from 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129) to 0dad90a639f5494e80e9ab0313a8564c (127.20.227.131). New cstate: current_term: 2 leader_uuid: "0dad90a639f5494e80e9ab0313a8564c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dad90a639f5494e80e9ab0313a8564c" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.940734 21390 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:12:08.945680 21390 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:12:08.946142 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:08.950763 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:12:08.951220 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:09.122047   839 raft_consensus.cc:1275] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.123852  1290 consensus_queue.cc:1048] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72f0896fc4e24a7f879f826aa6d6bc70" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 42761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:09.135717   914 raft_consensus.cc:1275] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Refusing update from remote peer 0dad90a639f5494e80e9ab0313a8564c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.137166  1290 consensus_queue.cc:1048] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebe7c3c7645b4c5caaad65cfe77fbd89" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 37205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:09.260936   768 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec500 after lost signal to thread 21393
W20260709 13:12:09.262421   768 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0f20 after lost signal to thread 771
W20260709 13:12:09.263616   768 debug-util.cc:398] Leaking SignalData structure 0x7b08002410c0 after lost signal to thread 863
W20260709 13:12:09.264925   768 debug-util.cc:398] Leaking SignalData structure 0x7b080021ce00 after lost signal to thread 938
W20260709 13:12:09.265954   768 debug-util.cc:398] Leaking SignalData structure 0x7b08001509a0 after lost signal to thread 1012
W20260709 13:12:10.716701   953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.003s
W20260709 13:12:10.717271   953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.012s	sys 0.003s
I20260709 13:12:10.786360 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
W20260709 13:12:10.845564   952 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:12:10.850005   952 consensus_peers.cc:597] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.851862 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:10.852974 21390 tablet_replica.cc:333] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.854024 21390 raft_consensus.cc:2243] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.854699 21390 raft_consensus.cc:2272] T 42437805d4224febb9e9b5ca537624d8 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.857800 21390 tablet_replica.cc:333] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.858772 21390 raft_consensus.cc:2243] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.859433 21390 raft_consensus.cc:2272] T 76bdbbe2c37f413fbca8e88267682b30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.862143 21390 tablet_replica.cc:333] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.863001 21390 raft_consensus.cc:2243] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:10.864074 21390 raft_consensus.cc:2272] T 53e91fcb5e7244dd99c57918cf9758e4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.866851 21390 tablet_replica.cc:333] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.867699 21390 raft_consensus.cc:2243] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:10.868753 21390 raft_consensus.cc:2272] T f0c587a7f71b48df86869cb897cd5ae7 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.871570 21390 tablet_replica.cc:333] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.872411 21390 raft_consensus.cc:2243] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.872973 21390 raft_consensus.cc:2272] T 616e071455d242b69d02909409b95f81 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.875573 21390 tablet_replica.cc:333] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.876366 21390 raft_consensus.cc:2243] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:10.877452 21390 raft_consensus.cc:2272] T 90cedb044cf74354b5f8475982ae3632 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.880298 21390 tablet_replica.cc:333] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.881265 21390 raft_consensus.cc:2243] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:10.882455 21390 raft_consensus.cc:2272] T 13990eea789945189ef0c7734989492b P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.885730 21390 tablet_replica.cc:333] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.886626 21390 raft_consensus.cc:2243] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.887308 21390 raft_consensus.cc:2272] T 042419458fba40b2b04cbeb9141076a9 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.890758 21390 tablet_replica.cc:333] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.891697 21390 raft_consensus.cc:2243] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.892343 21390 raft_consensus.cc:2272] T 06b33dbd605a4b71bd11f7ce3d473f30 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.896018 21390 tablet_replica.cc:333] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.896958 21390 raft_consensus.cc:2243] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.897562 21390 raft_consensus.cc:2272] T 90f58cc27c784257acefa53153eff18f P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.900393 21390 tablet_replica.cc:333] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.901369 21390 raft_consensus.cc:2243] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.903321 21390 raft_consensus.cc:2272] T 2dbb315b8bd64740934f693c0676962a P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.906730 21390 tablet_replica.cc:333] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
W20260709 13:12:10.907195   952 consensus_peers.cc:597] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.907678 21390 raft_consensus.cc:2243] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.908488 21390 raft_consensus.cc:2272] T b9052cc0f80e4a3ba60f1df8649f3273 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.912133 21390 tablet_replica.cc:333] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.913122 21390 raft_consensus.cc:2243] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.913781 21390 raft_consensus.cc:2272] T 3ea7da111c844a37a40cafdd0ee54d70 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.917128 21390 tablet_replica.cc:333] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.918020 21390 raft_consensus.cc:2243] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:10.919435 21390 raft_consensus.cc:2272] T 3fa8b7c083524e0295372c88ef6cbc31 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.922770 21390 tablet_replica.cc:333] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.923789 21390 raft_consensus.cc:2243] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:10.925063 21390 raft_consensus.cc:2272] T ae589d3521c749c2906110c3ec456473 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.928702 21390 tablet_replica.cc:333] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.929710 21390 raft_consensus.cc:2243] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.930421 21390 raft_consensus.cc:2272] T a8ef17140f29405883f006650c6c3178 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.933271 21390 tablet_replica.cc:333] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
I20260709 13:12:10.934093 21390 raft_consensus.cc:2243] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.934801 21390 raft_consensus.cc:2272] T a2e36fa38b284d8b92de0843c80b2e66 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:10.937664 21390 tablet_replica.cc:333] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70: stopping tablet replica
W20260709 13:12:10.938092   878 consensus_peers.cc:597] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.938545 21390 raft_consensus.cc:2243] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:10.939430 21390 raft_consensus.cc:2272] T c34a35499f204fa6a5a12f6431b006c4 P 72f0896fc4e24a7f879f826aa6d6bc70 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:10.963142   952 consensus_peers.cc:597] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:10.993741   878 consensus_peers.cc:597] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:42761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.999455 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
W20260709 13:12:11.054981   878 consensus_peers.cc:597] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:42761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.056310 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
W20260709 13:12:11.068399   878 consensus_peers.cc:597] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:42761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.073868   954 consensus_peers.cc:597] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c -> Peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Couldn't send request to peer ebe7c3c7645b4c5caaad65cfe77fbd89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.098009   954 consensus_peers.cc:597] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c -> Peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Couldn't send request to peer ebe7c3c7645b4c5caaad65cfe77fbd89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.105410   952 consensus_peers.cc:597] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:42761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.136523 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:11.137604 21390 tablet_replica.cc:333] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.138585 21390 raft_consensus.cc:2243] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.139721 21390 raft_consensus.cc:2272] T 42437805d4224febb9e9b5ca537624d8 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.142609 21390 tablet_replica.cc:333] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.143540 21390 raft_consensus.cc:2243] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.144704 21390 raft_consensus.cc:2272] T 76bdbbe2c37f413fbca8e88267682b30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.147703 21390 tablet_replica.cc:333] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
W20260709 13:12:11.147729   952 consensus_peers.cc:597] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:42761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.148605 21390 raft_consensus.cc:2243] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.149358 21390 raft_consensus.cc:2272] T 53e91fcb5e7244dd99c57918cf9758e4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.152386 21390 tablet_replica.cc:333] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.153295 21390 raft_consensus.cc:2243] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.154436 21390 raft_consensus.cc:2272] T b9052cc0f80e4a3ba60f1df8649f3273 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.157456 21390 tablet_replica.cc:333] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.158270 21390 raft_consensus.cc:2243] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.158819 21390 raft_consensus.cc:2272] T 616e071455d242b69d02909409b95f81 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.161510 21390 tablet_replica.cc:333] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.162333 21390 raft_consensus.cc:2243] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.162916 21390 raft_consensus.cc:2272] T f0c587a7f71b48df86869cb897cd5ae7 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.165602 21390 tablet_replica.cc:333] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.166476 21390 raft_consensus.cc:2243] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.167083 21390 raft_consensus.cc:2272] T 13990eea789945189ef0c7734989492b P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.170034 21390 tablet_replica.cc:333] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.170908 21390 raft_consensus.cc:2243] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.171581 21390 raft_consensus.cc:2272] T 90cedb044cf74354b5f8475982ae3632 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.174284 21390 tablet_replica.cc:333] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.175113 21390 raft_consensus.cc:2243] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.175674 21390 raft_consensus.cc:2272] T 90f58cc27c784257acefa53153eff18f P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.178368 21390 tablet_replica.cc:333] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.179205 21390 raft_consensus.cc:2243] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.179831 21390 raft_consensus.cc:2272] T 2dbb315b8bd64740934f693c0676962a P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.183058 21390 tablet_replica.cc:333] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.183876 21390 raft_consensus.cc:2243] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.184973 21390 raft_consensus.cc:2272] T 06b33dbd605a4b71bd11f7ce3d473f30 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.187980 21390 tablet_replica.cc:333] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.188784 21390 raft_consensus.cc:2243] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.189864 21390 raft_consensus.cc:2272] T 042419458fba40b2b04cbeb9141076a9 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.193073 21390 tablet_replica.cc:333] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.193866 21390 raft_consensus.cc:2243] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.194432 21390 raft_consensus.cc:2272] T 3ea7da111c844a37a40cafdd0ee54d70 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.197723 21390 tablet_replica.cc:333] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.198473 21390 raft_consensus.cc:2243] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.199091 21390 raft_consensus.cc:2272] T 3fa8b7c083524e0295372c88ef6cbc31 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.202160 21390 tablet_replica.cc:333] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.203063 21390 raft_consensus.cc:2243] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.203639 21390 raft_consensus.cc:2272] T ae589d3521c749c2906110c3ec456473 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.206766 21390 tablet_replica.cc:333] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.207487 21390 raft_consensus.cc:2243] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.208057 21390 raft_consensus.cc:2272] T a2e36fa38b284d8b92de0843c80b2e66 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.210661 21390 tablet_replica.cc:333] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.211427 21390 raft_consensus.cc:2243] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.212486 21390 raft_consensus.cc:2272] T a8ef17140f29405883f006650c6c3178 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.215317 21390 tablet_replica.cc:333] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89: stopping tablet replica
I20260709 13:12:11.215987 21390 raft_consensus.cc:2243] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.216521 21390 raft_consensus.cc:2272] T c34a35499f204fa6a5a12f6431b006c4 P ebe7c3c7645b4c5caaad65cfe77fbd89 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.248154   952 consensus_peers.cc:597] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c -> Peer 72f0896fc4e24a7f879f826aa6d6bc70 (127.20.227.129:42761): Couldn't send request to peer 72f0896fc4e24a7f879f826aa6d6bc70. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:42761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.251636 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
I20260709 13:12:11.287161 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
W20260709 13:12:11.296154   954 consensus_peers.cc:597] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c -> Peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Couldn't send request to peer ebe7c3c7645b4c5caaad65cfe77fbd89. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.330438 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:11.334414 21390 tablet_replica.cc:333] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.335305 21390 raft_consensus.cc:2243] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.336117 21390 raft_consensus.cc:2272] T 76bdbbe2c37f413fbca8e88267682b30 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.338786 21390 tablet_replica.cc:333] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.339550 21390 raft_consensus.cc:2243] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.340162 21390 raft_consensus.cc:2272] T 42437805d4224febb9e9b5ca537624d8 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.342437 21390 tablet_replica.cc:333] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.343245 21390 raft_consensus.cc:2243] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.343842 21390 raft_consensus.cc:2272] T 53e91fcb5e7244dd99c57918cf9758e4 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.345572   954 consensus_peers.cc:597] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c -> Peer ebe7c3c7645b4c5caaad65cfe77fbd89 (127.20.227.130:37205): Couldn't send request to peer ebe7c3c7645b4c5caaad65cfe77fbd89. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:37205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.346341 21390 tablet_replica.cc:333] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.347064 21390 raft_consensus.cc:2243] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.347610 21390 raft_consensus.cc:2272] T 3fa8b7c083524e0295372c88ef6cbc31 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.350095 21390 tablet_replica.cc:333] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.350739 21390 raft_consensus.cc:2243] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.351372 21390 raft_consensus.cc:2272] T ae589d3521c749c2906110c3ec456473 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.353744 21390 tablet_replica.cc:333] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.354334 21390 raft_consensus.cc:2243] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.355132 21390 raft_consensus.cc:2272] T 3ea7da111c844a37a40cafdd0ee54d70 P 0dad90a639f5494e80e9ab0313a8564c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.357484 21390 tablet_replica.cc:333] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.358067 21390 raft_consensus.cc:2243] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.358656 21390 raft_consensus.cc:2272] T b9052cc0f80e4a3ba60f1df8649f3273 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.360918 21390 tablet_replica.cc:333] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.361543 21390 raft_consensus.cc:2243] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.362064 21390 raft_consensus.cc:2272] T 13990eea789945189ef0c7734989492b P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.364419 21390 tablet_replica.cc:333] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.365064 21390 raft_consensus.cc:2243] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.365525 21390 raft_consensus.cc:2272] T 90cedb044cf74354b5f8475982ae3632 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.367398 21390 tablet_replica.cc:333] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.367997 21390 raft_consensus.cc:2243] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.368800 21390 raft_consensus.cc:2272] T 616e071455d242b69d02909409b95f81 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.371327 21390 tablet_replica.cc:333] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.372152 21390 raft_consensus.cc:2243] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.373131 21390 raft_consensus.cc:2272] T f0c587a7f71b48df86869cb897cd5ae7 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.375648 21390 tablet_replica.cc:333] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.376360 21390 raft_consensus.cc:2243] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.377547 21390 raft_consensus.cc:2272] T 90f58cc27c784257acefa53153eff18f P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.379853 21390 tablet_replica.cc:333] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.380517 21390 raft_consensus.cc:2243] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.381528 21390 raft_consensus.cc:2272] T 2dbb315b8bd64740934f693c0676962a P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.384028 21390 tablet_replica.cc:333] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.384663 21390 raft_consensus.cc:2243] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.385213 21390 raft_consensus.cc:2272] T 042419458fba40b2b04cbeb9141076a9 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.388003 21390 tablet_replica.cc:333] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.388931 21390 raft_consensus.cc:2243] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.389581 21390 raft_consensus.cc:2272] T 06b33dbd605a4b71bd11f7ce3d473f30 P 0dad90a639f5494e80e9ab0313a8564c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.392357 21390 tablet_replica.cc:333] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.392963 21390 raft_consensus.cc:2243] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.393435 21390 raft_consensus.cc:2272] T a8ef17140f29405883f006650c6c3178 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.395205 21390 tablet_replica.cc:333] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.395711 21390 raft_consensus.cc:2243] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.396500 21390 raft_consensus.cc:2272] T a2e36fa38b284d8b92de0843c80b2e66 P 0dad90a639f5494e80e9ab0313a8564c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.398499 21390 tablet_replica.cc:333] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c: stopping tablet replica
I20260709 13:12:11.399030 21390 raft_consensus.cc:2243] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.399895 21390 raft_consensus.cc:2272] T c34a35499f204fa6a5a12f6431b006c4 P 0dad90a639f5494e80e9ab0313a8564c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.615986  1009 debug-util.cc:398] Leaking SignalData structure 0x7b08001f58c0 after lost signal to thread 21393
W20260709 13:12:11.617190  1009 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5f20 after lost signal to thread 771
W20260709 13:12:11.618422  1009 debug-util.cc:398] Leaking SignalData structure 0x7b08001a30a0 after lost signal to thread 863
W20260709 13:12:11.619424  1009 debug-util.cc:398] Leaking SignalData structure 0x7b080020ad20 after lost signal to thread 938
W20260709 13:12:11.620373  1009 debug-util.cc:398] Leaking SignalData structure 0x7b08002f38c0 after lost signal to thread 1012
W20260709 13:12:12.441421 21390 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1009)
W20260709 13:12:13.442301 21390 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1009)
W20260709 13:12:14.443202 21390 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1009)
I20260709 13:12:14.936290 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
I20260709 13:12:15.003968 21390 master.cc:562] Master@127.20.227.190:46483 shutting down...
I20260709 13:12:15.035966 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.036777 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.037307 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f3c162a46a241c58935c2d95c7adad4: stopping tablet replica
I20260709 13:12:15.077687 21390 master.cc:584] Master@127.20.227.190:46483 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (16976 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:12:15.142005 21390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.227.190:34431
I20260709 13:12:15.143178 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:15.149403  1325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:15.149693  1326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:15.150409  1328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:15.151909 21390 server_base.cc:1061] running on GCE node
I20260709 13:12:15.153072 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:15.153280 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:15.153429 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602735153416 us; error 0 us; skew 500 ppm
I20260709 13:12:15.154006 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:15.156635 21390 webserver.cc:533] Webserver started at http://127.20.227.190:44351/ using document root <none> and password file <none>
I20260709 13:12:15.157196 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:15.157399 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:15.157673 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:15.158931 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/master-0-root/instance:
uuid: "5d2aeab6131b41bb8b526c612416686a"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.163950 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:15.167727  1333 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.168615 21390 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:15.169111 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/master-0-root
uuid: "5d2aeab6131b41bb8b526c612416686a"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.169435 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:15.200281 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:15.201699 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:15.246770 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.190:34431
I20260709 13:12:15.246879  1384 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.190:34431 every 8 connection(s)
I20260709 13:12:15.251423  1385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.266006  1385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a: Bootstrap starting.
I20260709 13:12:15.271147  1385 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:15.275892  1385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a: No bootstrap required, opened a new log
I20260709 13:12:15.278218  1385 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2aeab6131b41bb8b526c612416686a" member_type: VOTER }
I20260709 13:12:15.278671  1385 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.278864  1385 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d2aeab6131b41bb8b526c612416686a, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.279366  1385 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2aeab6131b41bb8b526c612416686a" member_type: VOTER }
I20260709 13:12:15.279801  1385 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:15.280006  1385 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:15.280222  1385 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.285426  1385 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2aeab6131b41bb8b526c612416686a" member_type: VOTER }
I20260709 13:12:15.285948  1385 leader_election.cc:304] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d2aeab6131b41bb8b526c612416686a; no voters: 
I20260709 13:12:15.287052  1385 leader_election.cc:290] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:15.287534  1388 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:15.289095  1388 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 1 LEADER]: Becoming Leader. State: Replica: 5d2aeab6131b41bb8b526c612416686a, State: Running, Role: LEADER
I20260709 13:12:15.289817  1388 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2aeab6131b41bb8b526c612416686a" member_type: VOTER }
I20260709 13:12:15.290114  1385 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:15.297564  1389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d2aeab6131b41bb8b526c612416686a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2aeab6131b41bb8b526c612416686a" member_type: VOTER } }
I20260709 13:12:15.297677  1390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d2aeab6131b41bb8b526c612416686a. Latest consensus state: current_term: 1 leader_uuid: "5d2aeab6131b41bb8b526c612416686a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2aeab6131b41bb8b526c612416686a" member_type: VOTER } }
I20260709 13:12:15.298424  1389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:15.298810  1390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:15.300426  1398 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:15.308312  1398 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:15.309523 21390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:15.318367  1398 catalog_manager.cc:1383] Generated new cluster ID: d78e50f6e14b4208a8973a00d1d8beb5
I20260709 13:12:15.318830  1398 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:15.338372  1398 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:15.339959  1398 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:15.359243  1398 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a: Generated new TSK 0
I20260709 13:12:15.359966  1398 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:15.376506 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:15.383605  1406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:15.384843  1407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:15.387126  1409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:15.389350 21390 server_base.cc:1061] running on GCE node
I20260709 13:12:15.392159 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:15.392379 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:15.392575 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602735392559 us; error 0 us; skew 500 ppm
I20260709 13:12:15.393203 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:15.395671 21390 webserver.cc:533] Webserver started at http://127.20.227.129:34485/ using document root <none> and password file <none>
I20260709 13:12:15.396245 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:15.396443 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:15.396737 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:15.398051 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-0-root/instance:
uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.402861 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:15.406625  1414 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.407538 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:15.407814 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-0-root
uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.408069 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:15.423569 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:15.424806 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:15.426362 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:15.428750 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:15.429024 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.429306 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:15.429490 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.475426 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.129:39379
I20260709 13:12:15.475646  1476 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.129:39379 every 8 connection(s)
I20260709 13:12:15.481017 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:15.489820  1481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:15.493175  1482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:15.497116 21390 server_base.cc:1061] running on GCE node
I20260709 13:12:15.497504  1477 heartbeater.cc:344] Connected to a master server at 127.20.227.190:34431
I20260709 13:12:15.497879  1477 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:15.497890  1484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:15.498838  1477 heartbeater.cc:507] Master 127.20.227.190:34431 requested a full tablet report, sending...
I20260709 13:12:15.499019 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:15.499255 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:15.499373 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602735499362 us; error 0 us; skew 500 ppm
I20260709 13:12:15.500198 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:15.501190  1350 ts_manager.cc:194] Registered new tserver with Master: 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379)
I20260709 13:12:15.502970 21390 webserver.cc:533] Webserver started at http://127.20.227.130:36011/ using document root <none> and password file <none>
I20260709 13:12:15.503509  1350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52258
I20260709 13:12:15.503554 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:15.505046 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:15.505389 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:15.507124 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-1-root/instance:
uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.511739 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:15.515583  1489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.516551 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:12:15.517087 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-1-root
uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.517472 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:15.532492 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:15.533816 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:15.535342 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:15.537719 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:15.537955 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.538218 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:15.538398 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.584434 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.130:44467
I20260709 13:12:15.584568  1551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.130:44467 every 8 connection(s)
I20260709 13:12:15.590132 21390 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:15.598412  1555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:15.599617  1556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:15.603299  1558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:15.604283  1552 heartbeater.cc:344] Connected to a master server at 127.20.227.190:34431
I20260709 13:12:15.604708 21390 server_base.cc:1061] running on GCE node
I20260709 13:12:15.604756  1552 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:15.605786 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:15.605902  1552 heartbeater.cc:507] Master 127.20.227.190:34431 requested a full tablet report, sending...
W20260709 13:12:15.605996 21390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:15.606477 21390 hybrid_clock.cc:648] HybridClock initialized: now 1783602735606455 us; error 0 us; skew 500 ppm
I20260709 13:12:15.607322 21390 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:15.608440  1350 ts_manager.cc:194] Registered new tserver with Master: 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:15.610235 21390 webserver.cc:533] Webserver started at http://127.20.227.131:38029/ using document root <none> and password file <none>
I20260709 13:12:15.610340  1350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52274
I20260709 13:12:15.610884 21390 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:15.611256 21390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:15.611617 21390 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:15.613090 21390 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-2-root/instance:
uuid: "ba7692cb58a64f9bb21890b89f5ea915"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.617900 21390 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:12:15.621909  1563 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.622838 21390 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:15.623188 21390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-2-root
uuid: "ba7692cb58a64f9bb21890b89f5ea915"
format_stamp: "Formatted at 2026-07-09 13:12:15 on dist-test-slave-078m"
I20260709 13:12:15.623486 21390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp6cmnG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602379708834-21390-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:15.650568 21390 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:15.651911 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:15.653708 21390 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:15.656289 21390 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:15.656534 21390 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:15.656848 21390 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:15.657088 21390 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:15.704517 21390 rpc_server.cc:307] RPC server started. Bound to: 127.20.227.131:37119
I20260709 13:12:15.704643  1625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.227.131:37119 every 8 connection(s)
I20260709 13:12:15.721004  1626 heartbeater.cc:344] Connected to a master server at 127.20.227.190:34431
I20260709 13:12:15.721526  1626 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:15.722397  1626 heartbeater.cc:507] Master 127.20.227.190:34431 requested a full tablet report, sending...
I20260709 13:12:15.724723  1350 ts_manager.cc:194] Registered new tserver with Master: ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:15.725788 21390 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017794906s
I20260709 13:12:15.726351  1350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52276
I20260709 13:12:15.754747  1350 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52288:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:15.757863  1350 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:15.839130  1591 tablet_service.cc:1511] Processing CreateTablet for tablet c7dd4e914fe9427ba3af4e10afe7e962 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:15.840798  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7dd4e914fe9427ba3af4e10afe7e962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.842239  1590 tablet_service.cc:1511] Processing CreateTablet for tablet ea58dd6223114365b183cce2cbafb89b (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:15.845824  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea58dd6223114365b183cce2cbafb89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.847708  1589 tablet_service.cc:1511] Processing CreateTablet for tablet ffe5e498fdcb408dbd8df7aca39fbef0 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:15.849294  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe5e498fdcb408dbd8df7aca39fbef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.851795  1588 tablet_service.cc:1511] Processing CreateTablet for tablet 1093cce09b304d6da8fe9c86cb5d077e (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:15.853623  1515 tablet_service.cc:1511] Processing CreateTablet for tablet ffe5e498fdcb408dbd8df7aca39fbef0 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:15.854136  1586 tablet_service.cc:1511] Processing CreateTablet for tablet 3358e95d6baf4b71a770b59c369a2017 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:15.855252  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe5e498fdcb408dbd8df7aca39fbef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.855338  1513 tablet_service.cc:1511] Processing CreateTablet for tablet de4dfbcb9c43417fb9b6c8ae38ed076b (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:15.855922  1512 tablet_service.cc:1511] Processing CreateTablet for tablet 3358e95d6baf4b71a770b59c369a2017 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:15.856482  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4dfbcb9c43417fb9b6c8ae38ed076b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.857367  1512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3358e95d6baf4b71a770b59c369a2017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.858249  1585 tablet_service.cc:1511] Processing CreateTablet for tablet 382edc1be0f242f8849304dc6047d56c (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:15.858789  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 1093cce09b304d6da8fe9c86cb5d077e (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:15.860280  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1093cce09b304d6da8fe9c86cb5d077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.860481  1517 tablet_service.cc:1511] Processing CreateTablet for tablet c7dd4e914fe9427ba3af4e10afe7e962 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:15.861910  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7dd4e914fe9427ba3af4e10afe7e962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.869225  1587 tablet_service.cc:1511] Processing CreateTablet for tablet de4dfbcb9c43417fb9b6c8ae38ed076b (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:15.871079  1516 tablet_service.cc:1511] Processing CreateTablet for tablet ea58dd6223114365b183cce2cbafb89b (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:15.872660  1583 tablet_service.cc:1511] Processing CreateTablet for tablet 39449a9626834a4597837e1938a877d1 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:15.876498  1509 tablet_service.cc:1511] Processing CreateTablet for tablet 39449a9626834a4597837e1938a877d1 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:15.870950  1584 tablet_service.cc:1511] Processing CreateTablet for tablet eda3ef7361a5452eb696c0cd602eeaf3 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:15.882805  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1093cce09b304d6da8fe9c86cb5d077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.868193  1511 tablet_service.cc:1511] Processing CreateTablet for tablet 382edc1be0f242f8849304dc6047d56c (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:15.873879  1510 tablet_service.cc:1511] Processing CreateTablet for tablet eda3ef7361a5452eb696c0cd602eeaf3 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:15.884588  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3358e95d6baf4b71a770b59c369a2017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.884456  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea58dd6223114365b183cce2cbafb89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.885679  1510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda3ef7361a5452eb696c0cd602eeaf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.886155  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382edc1be0f242f8849304dc6047d56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.887719  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4dfbcb9c43417fb9b6c8ae38ed076b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.886955  1509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39449a9626834a4597837e1938a877d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.889252  1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda3ef7361a5452eb696c0cd602eeaf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.890753  1511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382edc1be0f242f8849304dc6047d56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.894115  1442 tablet_service.cc:1511] Processing CreateTablet for tablet c7dd4e914fe9427ba3af4e10afe7e962 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:15.894116  1436 tablet_service.cc:1511] Processing CreateTablet for tablet 382edc1be0f242f8849304dc6047d56c (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:15.895864  1442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7dd4e914fe9427ba3af4e10afe7e962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.896525  1436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382edc1be0f242f8849304dc6047d56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.898200  1441 tablet_service.cc:1511] Processing CreateTablet for tablet ea58dd6223114365b183cce2cbafb89b (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:15.899847  1441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea58dd6223114365b183cce2cbafb89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.902101  1440 tablet_service.cc:1511] Processing CreateTablet for tablet ffe5e498fdcb408dbd8df7aca39fbef0 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:15.907457  1435 tablet_service.cc:1511] Processing CreateTablet for tablet eda3ef7361a5452eb696c0cd602eeaf3 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:15.908275  1440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe5e498fdcb408dbd8df7aca39fbef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.904070  1438 tablet_service.cc:1511] Processing CreateTablet for tablet de4dfbcb9c43417fb9b6c8ae38ed076b (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:15.912218  1438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4dfbcb9c43417fb9b6c8ae38ed076b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.913396  1435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda3ef7361a5452eb696c0cd602eeaf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.905571  1437 tablet_service.cc:1511] Processing CreateTablet for tablet 3358e95d6baf4b71a770b59c369a2017 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:15.914547  1437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3358e95d6baf4b71a770b59c369a2017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.903585  1439 tablet_service.cc:1511] Processing CreateTablet for tablet 1093cce09b304d6da8fe9c86cb5d077e (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:15.918196  1439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1093cce09b304d6da8fe9c86cb5d077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.924949  1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39449a9626834a4597837e1938a877d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:15.931617  1434 tablet_service.cc:1511] Processing CreateTablet for tablet 39449a9626834a4597837e1938a877d1 (DEFAULT_TABLE table=test-workload [id=fd9f3bfd679941c1afcd1ca32ed1be9a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:15.933874  1434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39449a9626834a4597837e1938a877d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:16.026435  1642 tablet_bootstrap.cc:492] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.026539  1641 tablet_bootstrap.cc:492] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.034482  1640 tablet_bootstrap.cc:492] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.059711  1641 tablet_bootstrap.cc:654] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.036484  1642 tablet_bootstrap.cc:654] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.068413  1641 tablet_bootstrap.cc:492] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.069154  1641 ts_tablet_manager.cc:1403] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.011s
I20260709 13:12:16.072467  1641 raft_consensus.cc:359] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.073365  1641 raft_consensus.cc:385] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.073872  1640 tablet_bootstrap.cc:654] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.073735  1641 raft_consensus.cc:740] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.074873  1641 consensus_queue.cc:260] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.077467  1642 tablet_bootstrap.cc:492] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.077349  1477 heartbeater.cc:499] Master 127.20.227.190:34431 was elected leader, sending a full tablet report...
I20260709 13:12:16.077857  1641 ts_tablet_manager.cc:1434] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:12:16.078047  1642 ts_tablet_manager.cc:1403] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.000s
I20260709 13:12:16.079013  1641 tablet_bootstrap.cc:492] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.080683  1642 raft_consensus.cc:359] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.081779  1642 raft_consensus.cc:385] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.082187  1642 raft_consensus.cc:740] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.083190  1642 consensus_queue.cc:260] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.086426  1641 tablet_bootstrap.cc:654] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.090679  1552 heartbeater.cc:499] Master 127.20.227.190:34431 was elected leader, sending a full tablet report...
I20260709 13:12:16.091747  1642 ts_tablet_manager.cc:1434] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.010s
I20260709 13:12:16.093147  1642 tablet_bootstrap.cc:492] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.102378  1640 tablet_bootstrap.cc:492] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.103147  1640 ts_tablet_manager.cc:1403] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.008s
I20260709 13:12:16.103629  1641 tablet_bootstrap.cc:492] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.104277  1641 ts_tablet_manager.cc:1403] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.015s
I20260709 13:12:16.104290  1642 tablet_bootstrap.cc:654] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.106889  1640 raft_consensus.cc:359] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.107867  1640 raft_consensus.cc:385] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.107600  1641 raft_consensus.cc:359] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.108294  1640 raft_consensus.cc:740] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.108474  1641 raft_consensus.cc:385] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.109011  1641 raft_consensus.cc:740] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.109490  1640 consensus_queue.cc:260] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.109833  1641 consensus_queue.cc:260] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.112497  1641 ts_tablet_manager.cc:1434] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:16.113663  1641 tablet_bootstrap.cc:492] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.121347  1641 tablet_bootstrap.cc:654] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.131253  1626 heartbeater.cc:499] Master 127.20.227.190:34431 was elected leader, sending a full tablet report...
I20260709 13:12:16.131685  1642 tablet_bootstrap.cc:492] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.131825  1641 tablet_bootstrap.cc:492] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.131902  1640 ts_tablet_manager.cc:1434] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.015s
I20260709 13:12:16.132480  1642 ts_tablet_manager.cc:1403] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.007s
I20260709 13:12:16.132493  1641 ts_tablet_manager.cc:1403] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:12:16.133590  1640 tablet_bootstrap.cc:492] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.135995  1642 raft_consensus.cc:359] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.136808  1642 raft_consensus.cc:385] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.136368  1641 raft_consensus.cc:359] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.137192  1642 raft_consensus.cc:740] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.137326  1641 raft_consensus.cc:385] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.137816  1641 raft_consensus.cc:740] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.138299  1642 consensus_queue.cc:260] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.138659  1641 consensus_queue.cc:260] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.141027  1641 ts_tablet_manager.cc:1434] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:16.142150  1641 tablet_bootstrap.cc:492] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.145113  1642 ts_tablet_manager.cc:1434] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:12:16.146086  1640 tablet_bootstrap.cc:654] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.148398  1642 tablet_bootstrap.cc:492] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.150103  1641 tablet_bootstrap.cc:654] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.160435  1645 raft_consensus.cc:493] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.161204  1642 tablet_bootstrap.cc:654] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.161164  1645 raft_consensus.cc:515] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.167229  1645 leader_election.cc:290] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:16.174005  1640 tablet_bootstrap.cc:492] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.174081  1641 tablet_bootstrap.cc:492] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.175026  1640 ts_tablet_manager.cc:1403] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.013s
I20260709 13:12:16.175098  1641 ts_tablet_manager.cc:1403] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.007s
I20260709 13:12:16.178683  1640 raft_consensus.cc:359] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.178916  1641 raft_consensus.cc:359] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.179517  1640 raft_consensus.cc:385] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.179757  1641 raft_consensus.cc:385] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.179905  1640 raft_consensus.cc:740] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.180171  1641 raft_consensus.cc:740] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.181066  1641 consensus_queue.cc:260] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.181838  1640 consensus_queue.cc:260] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.183501  1641 ts_tablet_manager.cc:1434] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:16.184656  1641 tablet_bootstrap.cc:492] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.185441  1642 tablet_bootstrap.cc:492] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.185956  1642 ts_tablet_manager.cc:1403] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.009s
I20260709 13:12:16.185988  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7dd4e914fe9427ba3af4e10afe7e962" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.186852  1601 raft_consensus.cc:2468] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 0.
I20260709 13:12:16.188325  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7dd4e914fe9427ba3af4e10afe7e962" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:16.188462  1418 leader_election.cc:304] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:16.188966  1642 raft_consensus.cc:359] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.189783  1642 raft_consensus.cc:385] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.189640  1645 raft_consensus.cc:2804] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.190239  1642 raft_consensus.cc:740] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.190325  1645 raft_consensus.cc:493] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.190774  1645 raft_consensus.cc:3060] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.191599  1641 tablet_bootstrap.cc:654] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:16.197314  1418 leader_election.cc:343] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.200543  1645 raft_consensus.cc:515] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.202673  1640 ts_tablet_manager.cc:1434] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:12:16.204344  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7dd4e914fe9427ba3af4e10afe7e962" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.204530  1642 consensus_queue.cc:260] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.205204  1601 raft_consensus.cc:3060] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.207073  1642 ts_tablet_manager.cc:1434] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:12:16.207551  1645 leader_election.cc:290] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Requested vote from peers ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
W20260709 13:12:16.209640  1627 tablet.cc:2406] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:16.210048  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7dd4e914fe9427ba3af4e10afe7e962" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
W20260709 13:12:16.212147  1418 leader_election.cc:343] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.214129  1640 tablet_bootstrap.cc:492] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.223218  1640 tablet_bootstrap.cc:654] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.223488  1601 raft_consensus.cc:2468] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 1.
I20260709 13:12:16.223862  1642 tablet_bootstrap.cc:492] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.224792  1418 leader_election.cc:304] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:16.226100  1645 raft_consensus.cc:2804] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.227540  1647 raft_consensus.cc:493] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.228276  1647 raft_consensus.cc:515] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.233711  1645 raft_consensus.cc:697] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:16.235256  1645 consensus_queue.cc:237] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.239115  1647 leader_election.cc:290] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.241535  1641 tablet_bootstrap.cc:492] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.241581  1642 tablet_bootstrap.cc:654] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.242544  1641 ts_tablet_manager.cc:1403] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.020s
I20260709 13:12:16.249677  1641 raft_consensus.cc:359] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.250753  1641 raft_consensus.cc:385] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.251179  1641 raft_consensus.cc:740] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.254216  1658 raft_consensus.cc:493] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.254113  1641 consensus_queue.cc:260] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.255101  1658 raft_consensus.cc:515] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.260782  1640 tablet_bootstrap.cc:492] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.261790  1640 ts_tablet_manager.cc:1403] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.022s
I20260709 13:12:16.263129  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
W20260709 13:12:16.264881  1418 leader_election.cc:343] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.265725  1350 catalog_manager.cc:5697] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 1 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.266415  1640 raft_consensus.cc:359] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.267366  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.267925  1658 leader_election.cc:290] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
W20260709 13:12:16.269412  1418 leader_election.cc:343] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.270110  1418 leader_election.cc:304] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:16.271821  1640 raft_consensus.cc:385] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.272354  1640 raft_consensus.cc:740] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.273597  1640 consensus_queue.cc:260] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.276383  1640 ts_tablet_manager.cc:1434] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:12:16.277591  1640 tablet_bootstrap.cc:492] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.277650  1645 raft_consensus.cc:2749] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.282424  1642 tablet_bootstrap.cc:492] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.283061  1642 ts_tablet_manager.cc:1403] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.016s
I20260709 13:12:16.285400  1640 tablet_bootstrap.cc:654] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.286274  1642 raft_consensus.cc:359] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.287089  1642 raft_consensus.cc:385] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.287387  1642 raft_consensus.cc:740] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.292380  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4dfbcb9c43417fb9b6c8ae38ed076b" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
W20260709 13:12:16.294044  1493 leader_election.cc:343] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.297917  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4dfbcb9c43417fb9b6c8ae38ed076b" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.297725  1642 consensus_queue.cc:260] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.298333  1641 ts_tablet_manager.cc:1434] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.055s	user 0.022s	sys 0.014s
I20260709 13:12:16.298709  1452 raft_consensus.cc:2468] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.300369  1642 ts_tablet_manager.cc:1434] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:12:16.301601  1642 tablet_bootstrap.cc:492] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
W20260709 13:12:16.302959  1397 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:16.303395  1641 tablet_bootstrap.cc:492] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.306275  1493 leader_election.cc:304] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:16.307298  1647 raft_consensus.cc:2804] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.307713  1647 raft_consensus.cc:493] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.308050  1647 raft_consensus.cc:3060] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.311930  1641 tablet_bootstrap.cc:654] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.314153  1640 tablet_bootstrap.cc:492] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.314395  1642 tablet_bootstrap.cc:654] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.314920  1640 ts_tablet_manager.cc:1403] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.003s
I20260709 13:12:16.317739  1647 raft_consensus.cc:515] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.319705  1640 raft_consensus.cc:359] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.320946  1640 raft_consensus.cc:385] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.321411  1640 raft_consensus.cc:740] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.322456  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4dfbcb9c43417fb9b6c8ae38ed076b" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:16.323323  1452 raft_consensus.cc:3060] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.325578  1641 tablet_bootstrap.cc:492] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.325683  1642 tablet_bootstrap.cc:492] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.326617  1641 ts_tablet_manager.cc:1403] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.011s
I20260709 13:12:16.326707  1642 ts_tablet_manager.cc:1403] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.008s
I20260709 13:12:16.326951  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4dfbcb9c43417fb9b6c8ae38ed076b" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.322506  1640 consensus_queue.cc:260] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
W20260709 13:12:16.328855  1493 leader_election.cc:343] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.330171  1641 raft_consensus.cc:359] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.331075  1641 raft_consensus.cc:385] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.330596  1642 raft_consensus.cc:359] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.331434  1641 raft_consensus.cc:740] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.331878  1642 raft_consensus.cc:385] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.332291  1642 raft_consensus.cc:740] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.332449  1641 consensus_queue.cc:260] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.333775  1642 consensus_queue.cc:260] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.326993  1647 leader_election.cc:290] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.337816  1640 ts_tablet_manager.cc:1434] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:12:16.343451  1642 ts_tablet_manager.cc:1434] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:12:16.343832  1641 ts_tablet_manager.cc:1434] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:16.344010  1452 raft_consensus.cc:2468] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.345153  1642 tablet_bootstrap.cc:492] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.345966  1493 leader_election.cc:304] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:16.347249  1647 raft_consensus.cc:2804] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.350940  1647 raft_consensus.cc:697] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:16.348112  1641 tablet_bootstrap.cc:492] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.351935  1647 consensus_queue.cc:237] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.349714  1640 tablet_bootstrap.cc:492] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.353814  1642 tablet_bootstrap.cc:654] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.359320  1641 tablet_bootstrap.cc:654] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.361567  1640 tablet_bootstrap.cc:654] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.366279  1641 tablet_bootstrap.cc:492] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.367007  1641 ts_tablet_manager.cc:1403] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:12:16.368124  1642 tablet_bootstrap.cc:492] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.368752  1642 ts_tablet_manager.cc:1403] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 13:12:16.370894  1641 raft_consensus.cc:359] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.371802  1641 raft_consensus.cc:385] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.371400  1642 raft_consensus.cc:359] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.372185  1641 raft_consensus.cc:740] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.372303  1642 raft_consensus.cc:385] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.372707  1642 raft_consensus.cc:740] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.373270  1641 consensus_queue.cc:260] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.373633  1642 consensus_queue.cc:260] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.376750  1642 ts_tablet_manager.cc:1434] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:12:16.377918  1642 tablet_bootstrap.cc:492] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.379981  1641 ts_tablet_manager.cc:1434] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.006s
I20260709 13:12:16.381428  1641 tablet_bootstrap.cc:492] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.380964  1348 catalog_manager.cc:5697] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.386875  1664 raft_consensus.cc:493] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.387490  1664 raft_consensus.cc:515] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.392062  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea58dd6223114365b183cce2cbafb89b" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:16.392728  1527 raft_consensus.cc:2468] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 0.
I20260709 13:12:16.393608  1640 tablet_bootstrap.cc:492] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.394253  1640 ts_tablet_manager.cc:1403] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.009s
I20260709 13:12:16.395167  1641 tablet_bootstrap.cc:654] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.395828  1664 leader_election.cc:290] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.397857  1642 tablet_bootstrap.cc:654] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.398685  1640 raft_consensus.cc:359] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.399214  1418 leader_election.cc:304] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.399657  1640 raft_consensus.cc:385] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.400243  1640 raft_consensus.cc:740] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.401762  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea58dd6223114365b183cce2cbafb89b" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.403244  1601 raft_consensus.cc:2468] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 0.
I20260709 13:12:16.408802  1641 tablet_bootstrap.cc:492] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.401717  1640 consensus_queue.cc:260] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.409462  1641 ts_tablet_manager.cc:1403] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 13:12:16.413096  1664 raft_consensus.cc:2804] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.413658  1664 raft_consensus.cc:493] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.414106  1664 raft_consensus.cc:3060] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.414662  1668 raft_consensus.cc:493] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.415390  1668 raft_consensus.cc:515] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.419691  1640 ts_tablet_manager.cc:1434] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:12:16.423561  1664 raft_consensus.cc:515] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.424484  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39449a9626834a4597837e1938a877d1" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.425686  1452 raft_consensus.cc:2468] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.426038  1664 leader_election.cc:290] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.413559  1641 raft_consensus.cc:359] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.427336  1641 raft_consensus.cc:385] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.427646  1641 raft_consensus.cc:740] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.427544  1493 leader_election.cc:304] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.428892  1640 tablet_bootstrap.cc:492] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.428822  1641 consensus_queue.cc:260] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.429175  1647 raft_consensus.cc:2804] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.429983  1647 raft_consensus.cc:493] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.430354  1647 raft_consensus.cc:3060] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.431841  1668 leader_election.cc:290] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.434365  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39449a9626834a4597837e1938a877d1" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.435413  1601 raft_consensus.cc:2468] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.437196  1640 tablet_bootstrap.cc:654] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.439208  1647 raft_consensus.cc:515] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.441797  1647 leader_election.cc:290] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.442277  1641 ts_tablet_manager.cc:1434] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:12:16.442670  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea58dd6223114365b183cce2cbafb89b" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:16.443265  1641 tablet_bootstrap.cc:492] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:16.443732  1527 raft_consensus.cc:3060] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.448608  1641 tablet_bootstrap.cc:654] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.454758  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39449a9626834a4597837e1938a877d1" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.455827  1600 raft_consensus.cc:3060] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.457542  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39449a9626834a4597837e1938a877d1" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:16.458397  1452 raft_consensus.cc:3060] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.463511  1641 tablet_bootstrap.cc:492] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:16.464234  1641 ts_tablet_manager.cc:1403] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:12:16.467526  1664 raft_consensus.cc:493] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.470007  1664 raft_consensus.cc:515] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.467705  1641 raft_consensus.cc:359] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.472154  1641 raft_consensus.cc:385] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.472667  1664 leader_election.cc:290] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.473744  1641 raft_consensus.cc:740] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.474412  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:16.475255  1526 raft_consensus.cc:2468] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 0.
I20260709 13:12:16.475557  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.473165  1452 raft_consensus.cc:2468] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.475567  1641 consensus_queue.cc:260] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.477744  1493 leader_election.cc:304] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.478780  1647 raft_consensus.cc:2804] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.479331  1647 raft_consensus.cc:697] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:16.480710  1641 ts_tablet_manager.cc:1434] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:12:16.482380  1668 raft_consensus.cc:493] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.483083  1668 raft_consensus.cc:515] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.486207  1668 leader_election.cc:290] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.487282  1650 raft_consensus.cc:493] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.488133  1650 raft_consensus.cc:515] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.489392  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.490459  1451 raft_consensus.cc:2468] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.492026  1650 leader_election.cc:290] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:16.492615  1493 leader_election.cc:304] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.480319  1647 consensus_queue.cc:237] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.497474  1668 raft_consensus.cc:2804] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.471024  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea58dd6223114365b183cce2cbafb89b" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.501219  1601 raft_consensus.cc:3060] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.498067  1668 raft_consensus.cc:493] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:16.477927  1418 leader_election.cc:343] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.505208  1668 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.505828  1418 leader_election.cc:304] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:16.507404  1664 raft_consensus.cc:2804] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.508050  1664 raft_consensus.cc:493] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.508705  1664 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.523321  1664 raft_consensus.cc:515] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.527558  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:16.528448  1526 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.549257  1600 raft_consensus.cc:2468] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.560209  1668 raft_consensus.cc:515] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.561445  1640 tablet_bootstrap.cc:492] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.562052  1640 ts_tablet_manager.cc:1403] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.133s	user 0.046s	sys 0.057s
I20260709 13:12:16.563740  1664 leader_election.cc:290] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.564793  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.565696  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.565954  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:16.562595  1668 leader_election.cc:290] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.569070  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:16.569568  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.558030  1527 raft_consensus.cc:2468] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 1.
W20260709 13:12:16.569866  1418 leader_election.cc:343] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.571480  1452 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:16.574559  1567 leader_election.cc:343] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.574651  1601 raft_consensus.cc:2468] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 1.
I20260709 13:12:16.571449  1668 raft_consensus.cc:493] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.579517  1418 leader_election.cc:304] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.579566  1668 raft_consensus.cc:515] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.582346  1664 raft_consensus.cc:2804] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.583655  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.583737  1664 raft_consensus.cc:697] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:16.584398  1451 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.585052  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.585813  1601 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.586257  1349 catalog_manager.cc:5697] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.585904  1493 leader_election.cc:304] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.585786  1664 consensus_queue.cc:237] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.588706  1647 raft_consensus.cc:2804] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.589160  1647 raft_consensus.cc:493] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.589241  1642 tablet_bootstrap.cc:492] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.590014  1642 ts_tablet_manager.cc:1403] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.212s	user 0.049s	sys 0.115s
I20260709 13:12:16.585906  1668 leader_election.cc:290] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.589586  1647 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.595214  1452 raft_consensus.cc:2468] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.591100  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.598560  1493 leader_election.cc:304] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.599463  1642 raft_consensus.cc:359] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.600425  1642 raft_consensus.cc:385] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.597229  1451 raft_consensus.cc:2468] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 0.
I20260709 13:12:16.578414  1526 raft_consensus.cc:2468] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 1.
W20260709 13:12:16.601774  1493 leader_election.cc:343] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.601858  1668 raft_consensus.cc:2804] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.602290  1642 raft_consensus.cc:740] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
W20260709 13:12:16.604625  1493 leader_election.cc:343] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.605316  1567 leader_election.cc:304] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:16.605553  1642 consensus_queue.cc:260] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.606602  1650 raft_consensus.cc:2804] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.607020  1650 raft_consensus.cc:493] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.606704  1418 leader_election.cc:304] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:16.606829  1640 raft_consensus.cc:359] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.604374  1668 raft_consensus.cc:697] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:16.607580  1650 raft_consensus.cc:3060] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.607991  1640 raft_consensus.cc:385] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.608322  1640 raft_consensus.cc:740] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.608654  1645 raft_consensus.cc:2804] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.609484  1645 raft_consensus.cc:697] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:16.609282  1640 consensus_queue.cc:260] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.610855  1645 consensus_queue.cc:237] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.613888  1668 consensus_queue.cc:237] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.637475  1647 raft_consensus.cc:515] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.642396  1349 catalog_manager.cc:5697] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 1 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.643941  1650 raft_consensus.cc:515] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.647816  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:16.648456  1451 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.649855  1650 leader_election.cc:290] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:16.655413  1642 ts_tablet_manager.cc:1434] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.063s	user 0.029s	sys 0.025s
I20260709 13:12:16.656423  1640 ts_tablet_manager.cc:1434] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.094s	user 0.024s	sys 0.018s
I20260709 13:12:16.657081  1642 tablet_bootstrap.cc:492] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.657639  1640 tablet_bootstrap.cc:492] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.658651  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:16.659332  1526 raft_consensus.cc:3060] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.666136  1640 tablet_bootstrap.cc:654] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.666009  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:16.667273  1452 raft_consensus.cc:3060] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.679203  1640 tablet_bootstrap.cc:492] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.679423  1642 tablet_bootstrap.cc:654] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.679859  1640 ts_tablet_manager.cc:1403] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:12:16.683374  1640 raft_consensus.cc:359] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.684259  1452 raft_consensus.cc:2468] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 1.
I20260709 13:12:16.684245  1640 raft_consensus.cc:385] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.686152  1640 raft_consensus.cc:740] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.687170  1640 consensus_queue.cc:260] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.687788  1567 leader_election.cc:304] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:16.689858  1664 consensus_queue.cc:1048] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:16.692345  1683 raft_consensus.cc:2804] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.692740  1642 tablet_bootstrap.cc:492] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.693197  1683 raft_consensus.cc:697] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:16.693452  1642 ts_tablet_manager.cc:1403] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.011s
I20260709 13:12:16.693660  1526 raft_consensus.cc:2468] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 1.
I20260709 13:12:16.694275  1683 consensus_queue.cc:237] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.697638  1642 raft_consensus.cc:359] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.689877  1640 ts_tablet_manager.cc:1434] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:12:16.698792  1642 raft_consensus.cc:385] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.699415  1642 raft_consensus.cc:740] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.700044  1640 tablet_bootstrap.cc:492] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.700340  1642 consensus_queue.cc:260] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } }
I20260709 13:12:16.706024  1642 ts_tablet_manager.cc:1434] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:12:16.707135  1642 tablet_bootstrap.cc:492] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:16.708146  1451 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.709988  1493 leader_election.cc:304] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.712584  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.713579  1599 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.715101  1640 tablet_bootstrap.cc:654] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.710026  1647 leader_election.cc:290] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.712905  1668 raft_consensus.cc:2804] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.721773  1668 raft_consensus.cc:697] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:16.722687  1668 consensus_queue.cc:237] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.724618  1349 catalog_manager.cc:5697] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 1 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.726707  1642 tablet_bootstrap.cc:654] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.736737  1348 catalog_manager.cc:5697] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.745282  1640 tablet_bootstrap.cc:492] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.745913  1640 ts_tablet_manager.cc:1403] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.006s
W20260709 13:12:16.755699  1493 consensus_peers.cc:597] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 -> Peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Couldn't send request to peer ba7692cb58a64f9bb21890b89f5ea915. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.765065  1647 consensus_queue.cc:1048] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:16.766932  1350 catalog_manager.cc:5697] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.769076  1640 raft_consensus.cc:359] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.770467  1640 raft_consensus.cc:385] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.770747  1640 raft_consensus.cc:740] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.772428  1526 raft_consensus.cc:3060] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.772359  1640 consensus_queue.cc:260] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.775432  1640 ts_tablet_manager.cc:1434] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:16.776412  1640 tablet_bootstrap.cc:492] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:16.777769  1599 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.783939  1658 consensus_queue.cc:1048] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:16.786628  1642 tablet_bootstrap.cc:492] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:16.787690  1642 ts_tablet_manager.cc:1403] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.081s	user 0.024s	sys 0.021s
I20260709 13:12:16.791047  1640 tablet_bootstrap.cc:654] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.791085  1642 raft_consensus.cc:359] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.792305  1642 raft_consensus.cc:385] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.792675  1642 raft_consensus.cc:740] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.793632  1642 consensus_queue.cc:260] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.797046  1642 ts_tablet_manager.cc:1434] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:16.801543  1640 tablet_bootstrap.cc:492] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:16.802150  1640 ts_tablet_manager.cc:1403] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:12:16.804777  1640 raft_consensus.cc:359] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.805620  1640 raft_consensus.cc:385] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.805896  1640 raft_consensus.cc:740] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.810688  1640 consensus_queue.cc:260] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.811983  1350 catalog_manager.cc:5697] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.813303  1640 ts_tablet_manager.cc:1434] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:16.818284  1683 raft_consensus.cc:493] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.818917  1683 raft_consensus.cc:515] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.821470  1683 leader_election.cc:290] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:16.822932  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4dfbcb9c43417fb9b6c8ae38ed076b" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.824939  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4dfbcb9c43417fb9b6c8ae38ed076b" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:16.826894  1567 leader_election.cc:304] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:16.828105  1683 raft_consensus.cc:2749] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.899634  1683 raft_consensus.cc:493] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.900163  1683 raft_consensus.cc:515] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.902184  1682 raft_consensus.cc:493] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.902228  1683 leader_election.cc:290] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:16.903246  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.903092  1682 raft_consensus.cc:515] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.903610  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:16.904493  1526 raft_consensus.cc:2393] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba7692cb58a64f9bb21890b89f5ea915 in current term 1: Already voted for candidate 0cfba139dd0142718bdc8cd4391d4a7a in this term.
I20260709 13:12:16.905704  1682 leader_election.cc:290] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.905572  1567 leader_election.cc:304] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:16.906332  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:16.906558  1683 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.907204  1451 raft_consensus.cc:2468] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.907617  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:16.908281  1600 raft_consensus.cc:2468] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:16.908341  1493 leader_election.cc:304] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.909567  1682 raft_consensus.cc:2804] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.909932  1682 raft_consensus.cc:493] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.910267  1682 raft_consensus.cc:3060] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.915036  1683 raft_consensus.cc:2749] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.917725  1682 raft_consensus.cc:515] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.919375  1682 leader_election.cc:290] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:16.920393  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:16.920742  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:16.921013  1451 raft_consensus.cc:3060] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.921417  1600 raft_consensus.cc:3060] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.926614  1451 raft_consensus.cc:2468] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.926985  1600 raft_consensus.cc:2468] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:16.928050  1493 leader_election.cc:304] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:16.928788  1682 raft_consensus.cc:2804] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.929492  1682 raft_consensus.cc:697] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:16.930430  1682 consensus_queue.cc:237] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:16.931996  1668 consensus_queue.cc:1048] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:16.943898  1349 catalog_manager.cc:5697] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.947969  1680 consensus_queue.cc:1048] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:17.015949  1645 consensus_queue.cc:1048] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.030622  1664 consensus_queue.cc:1048] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.087970  1664 consensus_queue.cc:1048] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.093997  1599 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.095969  1683 consensus_queue.cc:1048] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:17.104579  1680 consensus_queue.cc:1048] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:17.105418  1645 consensus_queue.cc:1048] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:17.106068  1688 raft_consensus.cc:493] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.106691  1688 raft_consensus.cc:515] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.112382  1688 leader_election.cc:290] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:17.113454  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:17.114815  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:17.115617  1451 raft_consensus.cc:2468] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 1.
I20260709 13:12:17.121047  1650 consensus_queue.cc:1048] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:17.134052  1567 leader_election.cc:304] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:17.139436  1668 consensus_queue.cc:1048] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.145270  1650 raft_consensus.cc:2804] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.147754  1650 raft_consensus.cc:493] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3842b034b3e24e5e8bdf35d6ce06ab73)
I20260709 13:12:17.148240  1650 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.151239  1599 raft_consensus.cc:3060] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.152552  1680 consensus_queue.cc:1048] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:17.156683  1650 raft_consensus.cc:515] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.158326  1601 raft_consensus.cc:1240] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Rejecting Update request from peer 3842b034b3e24e5e8bdf35d6ce06ab73 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:17.164585  1647 consensus_queue.cc:1059] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:17.166428  1680 raft_consensus.cc:3055] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.166921  1680 raft_consensus.cc:740] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:17.168217  1650 leader_election.cc:290] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:17.168042  1680 consensus_queue.cc:260] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.178341  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:17.185151  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:17.188009  1668 consensus_queue.cc:1048] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.188905  1680 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.208509  1526 raft_consensus.cc:2468] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 2.
I20260709 13:12:17.212333  1567 leader_election.cc:304] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:17.213310  1650 raft_consensus.cc:2804] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.213901  1650 raft_consensus.cc:697] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:17.214843  1650 consensus_queue.cc:237] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.223398  1348 catalog_manager.cc:5697] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.241150  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:47746
I20260709 13:12:17.241777  1526 raft_consensus.cc:606] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Received request to transfer leadership to TS 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:17.247689  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:47746
I20260709 13:12:17.248301  1526 raft_consensus.cc:606] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Received request to transfer leadership to TS 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:17.266925  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
mode: GRACEFUL
new_leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:33360
I20260709 13:12:17.267518  1599 raft_consensus.cc:606] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Received request to transfer leadership to TS 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:17.273129  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
mode: GRACEFUL
new_leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:33360
I20260709 13:12:17.273742  1599 raft_consensus.cc:606] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Received request to transfer leadership to TS 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:17.288476  1452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3"
dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
mode: GRACEFUL
new_leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:38084
I20260709 13:12:17.289131  1452 raft_consensus.cc:606] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Received request to transfer leadership to TS 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:17.295094  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39449a9626834a4597837e1938a877d1"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:47746
I20260709 13:12:17.295694  1526 raft_consensus.cc:606] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Received request to transfer leadership to TS ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:17.332383  1680 consensus_queue.cc:1048] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.339844  1647 raft_consensus.cc:993] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:17.340418  1682 raft_consensus.cc:1081] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Signalling peer 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:17.342322  1452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e"
dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:37568
I20260709 13:12:17.343060  1452 raft_consensus.cc:493] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.343565  1452 raft_consensus.cc:3060] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.346715  1680 consensus_queue.cc:1048] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.351428  1452 raft_consensus.cc:515] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.352741  1451 raft_consensus.cc:1240] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Rejecting Update request from peer 3842b034b3e24e5e8bdf35d6ce06ab73 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:17.354803  1452 leader_election.cc:290] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:17.355592  1680 consensus_queue.cc:1059] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.356422  1682 raft_consensus.cc:3055] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.356760  1682 raft_consensus.cc:740] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:17.357604  1682 consensus_queue.cc:260] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.358570  1682 raft_consensus.cc:3060] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.359356  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:17.359978  1599 raft_consensus.cc:3060] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.360211  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1093cce09b304d6da8fe9c86cb5d077e" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:17.366091  1599 raft_consensus.cc:2468] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:17.367564  1418 leader_election.cc:304] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:17.368443  1645 raft_consensus.cc:2804] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.368958  1645 raft_consensus.cc:697] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:17.369827  1645 consensus_queue.cc:237] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.372198  1526 raft_consensus.cc:2468] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:17.377579  1348 catalog_manager.cc:5697] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 2 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.490145  1680 raft_consensus.cc:993] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:17.490623  1647 raft_consensus.cc:1081] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Signalling peer ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:17.490775  1658 raft_consensus.cc:993] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a: : Instructing follower 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:17.491321  1645 raft_consensus.cc:1081] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Signalling peer 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:17.492451  1599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39449a9626834a4597837e1938a877d1"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:42390
I20260709 13:12:17.492985  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:44614
I20260709 13:12:17.493142  1599 raft_consensus.cc:493] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.493592  1526 raft_consensus.cc:493] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.493595  1599 raft_consensus.cc:3060] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.494163  1526 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.501413  1599 raft_consensus.cc:515] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.502586  1526 raft_consensus.cc:515] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.503484  1599 leader_election.cc:290] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:17.504348  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39449a9626834a4597837e1938a877d1" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:17.504586  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39449a9626834a4597837e1938a877d1" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:17.505046  1452 raft_consensus.cc:3060] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.505206  1526 leader_election.cc:290] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:17.505303  1527 raft_consensus.cc:3055] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.505940  1527 raft_consensus.cc:740] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:17.506085  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:17.506752  1451 raft_consensus.cc:3055] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.507125  1451 raft_consensus.cc:740] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:17.506881  1527 consensus_queue.cc:260] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.508047  1451 consensus_queue.cc:260] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.508350  1527 raft_consensus.cc:3060] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.508422  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:17.509213  1599 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.509477  1451 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.514186  1452 raft_consensus.cc:2468] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 2.
I20260709 13:12:17.515693  1567 leader_election.cc:304] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:17.516676  1650 raft_consensus.cc:2804] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.516942  1527 raft_consensus.cc:2468] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 2.
I20260709 13:12:17.517051  1599 raft_consensus.cc:2468] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:17.517225  1650 raft_consensus.cc:697] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:17.518247  1650 consensus_queue.cc:237] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.519222  1493 leader_election.cc:304] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:17.520290  1647 raft_consensus.cc:2804] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.522234  1647 raft_consensus.cc:697] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:17.523114  1647 consensus_queue.cc:237] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.523910  1688 raft_consensus.cc:993] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915: : Instructing follower 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:17.524420  1720 raft_consensus.cc:1081] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Signalling peer 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:17.523471  1451 raft_consensus.cc:2468] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:17.526273  1527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:47734
I20260709 13:12:17.526876  1527 raft_consensus.cc:493] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.527290  1527 raft_consensus.cc:3060] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.528220  1348 catalog_manager.cc:5697] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.532104  1346 catalog_manager.cc:5697] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 1 to 2, leader changed from 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129) to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.533933  1527 raft_consensus.cc:515] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.536126  1527 leader_election.cc:290] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:17.537310  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:17.537559  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382edc1be0f242f8849304dc6047d56c" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:17.538242  1599 raft_consensus.cc:3055] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.538321  1451 raft_consensus.cc:3060] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.538741  1599 raft_consensus.cc:740] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:17.539767  1599 consensus_queue.cc:260] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.541157  1599 raft_consensus.cc:3060] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.546023  1451 raft_consensus.cc:2468] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:17.546967  1599 raft_consensus.cc:2468] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:17.547463  1493 leader_election.cc:304] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:17.548424  1647 raft_consensus.cc:2804] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.548931  1647 raft_consensus.cc:697] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:17.549749  1647 consensus_queue.cc:237] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.556999  1346 catalog_manager.cc:5697] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 1 to 2, leader changed from ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131) to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.739463  1527 raft_consensus.cc:1275] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.741014  1720 consensus_queue.cc:1048] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.746975  1688 raft_consensus.cc:993] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915: : Instructing follower 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:17.747565  1650 raft_consensus.cc:1081] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Signalling peer 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:17.751752  1451 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.753317  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:47734
I20260709 13:12:17.754016  1526 raft_consensus.cc:493] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.754374  1526 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.761193  1451 raft_consensus.cc:1275] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.762364  1682 raft_consensus.cc:993] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:17.762069  1526 raft_consensus.cc:515] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.762887  1647 raft_consensus.cc:1081] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Signalling peer 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:17.763057  1720 consensus_queue.cc:1048] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.764573  1526 leader_election.cc:290] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 3 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:17.769894  1452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0"
dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:37568
I20260709 13:12:17.770763  1452 raft_consensus.cc:493] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.771047  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:17.771958  1599 raft_consensus.cc:3055] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:17.772272  1599 raft_consensus.cc:740] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:17.771396  1452 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.773069  1599 consensus_queue.cc:260] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.776651  1599 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.774507  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3358e95d6baf4b71a770b59c369a2017" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:17.781529  1451 raft_consensus.cc:3060] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.784654  1599 raft_consensus.cc:2468] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 3.
I20260709 13:12:17.785746  1452 raft_consensus.cc:515] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.786021  1493 leader_election.cc:304] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:17.787081  1647 raft_consensus.cc:2804] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.787575  1647 raft_consensus.cc:697] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:17.788445  1647 consensus_queue.cc:237] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.788911  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:17.789325  1451 raft_consensus.cc:2468] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 3.
I20260709 13:12:17.789434  1452 leader_election.cc:290] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:17.789618  1526 raft_consensus.cc:3055] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.790066  1526 raft_consensus.cc:740] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:17.790633  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:17.791270  1599 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.790885  1526 consensus_queue.cc:260] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.793118  1526 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.799135  1599 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:17.798961  1350 catalog_manager.cc:5697] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 2 to 3, leader changed from ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131) to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 3 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.800406  1418 leader_election.cc:304] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:17.800843  1526 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:17.801258  1645 raft_consensus.cc:2804] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.801867  1645 raft_consensus.cc:697] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:17.802729  1645 consensus_queue.cc:237] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:17.810961  1348 catalog_manager.cc:5697] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 2 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.868709  1599 raft_consensus.cc:1275] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.870370  1645 consensus_queue.cc:1048] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.881461  1526 raft_consensus.cc:1275] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.883082  1722 consensus_queue.cc:1048] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.988615  1599 raft_consensus.cc:1275] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.990113  1647 consensus_queue.cc:1048] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.000484  1451 raft_consensus.cc:1275] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.001600  1452 raft_consensus.cc:1275] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.002532  1723 consensus_queue.cc:1048] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.003362  1720 consensus_queue.cc:1048] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.012606  1452 raft_consensus.cc:1275] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.013967  1723 consensus_queue.cc:1048] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.018963  1526 raft_consensus.cc:1275] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.021932  1688 consensus_queue.cc:1048] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.027629  1599 raft_consensus.cc:1275] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.030258  1723 consensus_queue.cc:1048] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.222754  1451 raft_consensus.cc:1275] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:18.224085  1682 consensus_queue.cc:1048] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:18.235117  1599 raft_consensus.cc:1275] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:18.238332  1680 consensus_queue.cc:1048] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:18.320322  1526 raft_consensus.cc:1275] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.321848  1645 consensus_queue.cc:1048] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.334131  1599 raft_consensus.cc:1275] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.335737  1722 consensus_queue.cc:1048] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.591020  1348 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52686:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:20.594476  1348 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:20.741096  1436 tablet_service.cc:1511] Processing CreateTablet for tablet 0317bbcf623f4ecfa69384dba23548c7 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:20.741986  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 0317bbcf623f4ecfa69384dba23548c7 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:20.742681  1436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0317bbcf623f4ecfa69384dba23548c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.742971  1587 tablet_service.cc:1511] Processing CreateTablet for tablet 0317bbcf623f4ecfa69384dba23548c7 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:20.744292  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0317bbcf623f4ecfa69384dba23548c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.743346  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0317bbcf623f4ecfa69384dba23548c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.748292  1437 tablet_service.cc:1511] Processing CreateTablet for tablet 1ace73d406d741f2a9f0dc5bfd31092d (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:20.749763  1437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ace73d406d741f2a9f0dc5bfd31092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.752797  1588 tablet_service.cc:1511] Processing CreateTablet for tablet 1ace73d406d741f2a9f0dc5bfd31092d (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:20.754210  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ace73d406d741f2a9f0dc5bfd31092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.758813  1511 tablet_service.cc:1511] Processing CreateTablet for tablet 1ace73d406d741f2a9f0dc5bfd31092d (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:20.759567  1584 tablet_service.cc:1511] Processing CreateTablet for tablet 851bbbeb812c4167ad6c8fbbd4d49d68 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:20.760283  1511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ace73d406d741f2a9f0dc5bfd31092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.760928  1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851bbbeb812c4167ad6c8fbbd4d49d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.761852  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 851bbbeb812c4167ad6c8fbbd4d49d68 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:20.763145  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851bbbeb812c4167ad6c8fbbd4d49d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.767086  1438 tablet_service.cc:1511] Processing CreateTablet for tablet 851bbbeb812c4167ad6c8fbbd4d49d68 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:20.768599  1438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851bbbeb812c4167ad6c8fbbd4d49d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.768765  1590 tablet_service.cc:1511] Processing CreateTablet for tablet c331f5a61ad6470ab70c88bae988b2eb (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:20.769879  1440 tablet_service.cc:1511] Processing CreateTablet for tablet c331f5a61ad6470ab70c88bae988b2eb (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:20.770646  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c331f5a61ad6470ab70c88bae988b2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.773919  1440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c331f5a61ad6470ab70c88bae988b2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.782989  1434 tablet_service.cc:1511] Processing CreateTablet for tablet 16d127f1573a4555ad015fcdb822de49 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:20.788317  1586 tablet_service.cc:1511] Processing CreateTablet for tablet 16d127f1573a4555ad015fcdb822de49 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:20.790126  1434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d127f1573a4555ad015fcdb822de49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.790290  1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d127f1573a4555ad015fcdb822de49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.794082  1746 tablet_bootstrap.cc:492] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:20.805335  1746 tablet_bootstrap.cc:654] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.808842  1516 tablet_service.cc:1511] Processing CreateTablet for tablet c331f5a61ad6470ab70c88bae988b2eb (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:20.810595  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c331f5a61ad6470ab70c88bae988b2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.810385  1510 tablet_service.cc:1511] Processing CreateTablet for tablet 16d127f1573a4555ad015fcdb822de49 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:20.811980  1510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d127f1573a4555ad015fcdb822de49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.818852  1512 tablet_service.cc:1511] Processing CreateTablet for tablet a58c6ffde28c4dc3b3016fcfd3ead84e (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:20.820502  1512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58c6ffde28c4dc3b3016fcfd3ead84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.831734  1436 tablet_service.cc:1511] Processing CreateTablet for tablet a58c6ffde28c4dc3b3016fcfd3ead84e (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:20.835479  1589 tablet_service.cc:1511] Processing CreateTablet for tablet a58c6ffde28c4dc3b3016fcfd3ead84e (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:20.837045  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58c6ffde28c4dc3b3016fcfd3ead84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.839496  1439 tablet_service.cc:1511] Processing CreateTablet for tablet d9de744344f445bb9cb73ecf9e2c7abe (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:20.845319  1509 tablet_service.cc:1511] Processing CreateTablet for tablet d9de744344f445bb9cb73ecf9e2c7abe (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:20.846958  1509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9de744344f445bb9cb73ecf9e2c7abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.846588  1585 tablet_service.cc:1511] Processing CreateTablet for tablet d9de744344f445bb9cb73ecf9e2c7abe (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:20.848483  1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9de744344f445bb9cb73ecf9e2c7abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.859606  1435 tablet_service.cc:1511] Processing CreateTablet for tablet 699d125c04774cceae3f5b142afb5e61 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:20.864814  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 699d125c04774cceae3f5b142afb5e61 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:20.866403  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699d125c04774cceae3f5b142afb5e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.867128  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 699d125c04774cceae3f5b142afb5e61 (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:20.871160  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699d125c04774cceae3f5b142afb5e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.872675  1439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9de744344f445bb9cb73ecf9e2c7abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.874820  1436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58c6ffde28c4dc3b3016fcfd3ead84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.877521  1435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699d125c04774cceae3f5b142afb5e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.912272  1746 tablet_bootstrap.cc:492] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:20.912910  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 333c0d1f6dee4aa885e402b86e26b7fd (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:20.922423  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333c0d1f6dee4aa885e402b86e26b7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.924489  1746 ts_tablet_manager.cc:1403] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.131s	user 0.025s	sys 0.033s
I20260709 13:12:20.913686  1583 tablet_service.cc:1511] Processing CreateTablet for tablet 333c0d1f6dee4aa885e402b86e26b7fd (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:20.926910  1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333c0d1f6dee4aa885e402b86e26b7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.928085  1746 raft_consensus.cc:359] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:20.928993  1746 raft_consensus.cc:385] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.929327  1746 raft_consensus.cc:740] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.928512  1437 tablet_service.cc:1511] Processing CreateTablet for tablet 333c0d1f6dee4aa885e402b86e26b7fd (DEFAULT_TABLE table=soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:20.931361  1437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333c0d1f6dee4aa885e402b86e26b7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.940577  1746 consensus_queue.cc:260] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:20.943259  1746 ts_tablet_manager.cc:1434] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:20.986708  1748 tablet_bootstrap.cc:492] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:20.989383  1746 tablet_bootstrap.cc:492] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:21.002207  1746 tablet_bootstrap.cc:654] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.004400  1749 tablet_bootstrap.cc:492] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.026268  1748 tablet_bootstrap.cc:654] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.028405  1749 tablet_bootstrap.cc:654] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.031443  1746 tablet_bootstrap.cc:492] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.032051  1746 ts_tablet_manager.cc:1403] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.043s	user 0.002s	sys 0.009s
I20260709 13:12:21.033151  1748 tablet_bootstrap.cc:492] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.033677  1748 ts_tablet_manager.cc:1403] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 13:12:21.035337  1749 tablet_bootstrap.cc:492] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.035475  1746 raft_consensus.cc:359] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.036019  1749 ts_tablet_manager.cc:1403] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 13:12:21.036404  1746 raft_consensus.cc:385] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.036113  1748 raft_consensus.cc:359] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.036978  1746 raft_consensus.cc:740] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.037145  1748 raft_consensus.cc:385] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.037556  1748 raft_consensus.cc:740] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.038031  1746 consensus_queue.cc:260] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.038424  1748 consensus_queue.cc:260] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.039436  1749 raft_consensus.cc:359] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.040203  1749 raft_consensus.cc:385] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.040485  1749 raft_consensus.cc:740] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.041380  1749 consensus_queue.cc:260] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.043722  1749 ts_tablet_manager.cc:1434] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:21.044837  1749 tablet_bootstrap.cc:492] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.047215  1746 ts_tablet_manager.cc:1434] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.005s
I20260709 13:12:21.048439  1746 tablet_bootstrap.cc:492] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:21.052233  1749 tablet_bootstrap.cc:654] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.055529  1746 tablet_bootstrap.cc:654] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.066179  1749 tablet_bootstrap.cc:492] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.067237  1749 ts_tablet_manager.cc:1403] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:12:21.070209  1748 ts_tablet_manager.cc:1434] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:12:21.071400  1749 raft_consensus.cc:359] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.072556  1749 raft_consensus.cc:385] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.072991  1749 raft_consensus.cc:740] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.074018  1749 consensus_queue.cc:260] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.075429  1748 tablet_bootstrap.cc:492] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:21.076905  1749 ts_tablet_manager.cc:1434] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:12:21.078321  1749 tablet_bootstrap.cc:492] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.086258  1749 tablet_bootstrap.cc:654] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.088449  1746 tablet_bootstrap.cc:492] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.089079  1746 ts_tablet_manager.cc:1403] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.016s
I20260709 13:12:21.083730  1748 tablet_bootstrap.cc:654] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.092891  1746 raft_consensus.cc:359] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.093676  1746 raft_consensus.cc:385] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.093988  1746 raft_consensus.cc:740] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.095003  1746 consensus_queue.cc:260] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.098384  1746 ts_tablet_manager.cc:1434] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:21.099653  1746 tablet_bootstrap.cc:492] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:21.106474  1746 tablet_bootstrap.cc:654] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.112146  1645 raft_consensus.cc:493] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.112798  1645 raft_consensus.cc:515] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.114969  1645 leader_election.cc:290] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.117071  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699d125c04774cceae3f5b142afb5e61" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.119405  1748 tablet_bootstrap.cc:492] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.119405  1749 tablet_bootstrap.cc:492] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.120245  1748 ts_tablet_manager.cc:1403] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.028s
I20260709 13:12:21.120245  1749 ts_tablet_manager.cc:1403] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.012s
I20260709 13:12:21.117245  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699d125c04774cceae3f5b142afb5e61" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
W20260709 13:12:21.122922  1418 leader_election.cc:343] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:21.123665  1418 leader_election.cc:343] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.124466  1746 tablet_bootstrap.cc:492] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.124078  1748 raft_consensus.cc:359] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.125274  1746 ts_tablet_manager.cc:1403] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:12:21.125316  1748 raft_consensus.cc:385] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.124078  1749 raft_consensus.cc:359] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.125921  1748 raft_consensus.cc:740] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.126349  1749 raft_consensus.cc:385] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.126674  1749 raft_consensus.cc:740] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.124125  1418 leader_election.cc:304] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:21.127009  1748 consensus_queue.cc:260] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.128381  1645 raft_consensus.cc:2749] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.127604  1749 consensus_queue.cc:260] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.130025  1746 raft_consensus.cc:359] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.130915  1746 raft_consensus.cc:385] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.131006  1748 ts_tablet_manager.cc:1434] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:12:21.131311  1746 raft_consensus.cc:740] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.132200  1748 tablet_bootstrap.cc:492] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:21.132166  1746 consensus_queue.cc:260] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.133038  1749 ts_tablet_manager.cc:1434] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 13:12:21.134310  1749 tablet_bootstrap.cc:492] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.134990  1746 ts_tablet_manager.cc:1434] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:12:21.136160  1746 tablet_bootstrap.cc:492] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:21.141592  1749 tablet_bootstrap.cc:654] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.143069  1746 tablet_bootstrap.cc:654] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.143175  1748 tablet_bootstrap.cc:654] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.153832  1749 tablet_bootstrap.cc:492] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.154429  1749 ts_tablet_manager.cc:1403] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:12:21.157887  1749 raft_consensus.cc:359] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.158871  1749 raft_consensus.cc:385] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.159232  1749 raft_consensus.cc:740] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.160221  1749 consensus_queue.cc:260] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.163182  1749 ts_tablet_manager.cc:1434] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:12:21.164192  1749 tablet_bootstrap.cc:492] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.171041  1749 tablet_bootstrap.cc:654] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.201681  1748 tablet_bootstrap.cc:492] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.201974  1749 tablet_bootstrap.cc:492] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.202250  1748 ts_tablet_manager.cc:1403] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.039s
I20260709 13:12:21.202566  1749 ts_tablet_manager.cc:1403] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.012s
I20260709 13:12:21.203071  1746 tablet_bootstrap.cc:492] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.203635  1746 ts_tablet_manager.cc:1403] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.036s
I20260709 13:12:21.205663  1748 raft_consensus.cc:359] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.206497  1748 raft_consensus.cc:385] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.206794  1748 raft_consensus.cc:740] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.206784  1746 raft_consensus.cc:359] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.207685  1746 raft_consensus.cc:385] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.208042  1746 raft_consensus.cc:740] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.207818  1748 consensus_queue.cc:260] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.208420  1749 raft_consensus.cc:359] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.209247  1749 raft_consensus.cc:385] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.209622  1749 raft_consensus.cc:740] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.208935  1746 consensus_queue.cc:260] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.210604  1749 consensus_queue.cc:260] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.213101  1749 ts_tablet_manager.cc:1434] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:21.213600  1748 ts_tablet_manager.cc:1434] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:12:21.214247  1749 tablet_bootstrap.cc:492] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.214563  1746 ts_tablet_manager.cc:1434] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:12:21.214687  1748 tablet_bootstrap.cc:492] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:21.215683  1746 tablet_bootstrap.cc:492] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:21.222014  1749 tablet_bootstrap.cc:654] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.223048  1746 tablet_bootstrap.cc:654] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.229049  1748 tablet_bootstrap.cc:654] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.248265  1748 tablet_bootstrap.cc:492] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.249046  1748 ts_tablet_manager.cc:1403] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.011s
I20260709 13:12:21.254815  1729 raft_consensus.cc:493] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.255622  1729 raft_consensus.cc:515] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.259353  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.260298  1450 raft_consensus.cc:2468] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.262157  1493 leader_election.cc:304] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:21.263236  1741 raft_consensus.cc:2804] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.263659  1741 raft_consensus.cc:493] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.264065  1741 raft_consensus.cc:3060] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.268699  1729 leader_election.cc:290] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.270766  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.271782  1599 raft_consensus.cc:2468] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.281838  1741 raft_consensus.cc:515] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.283340  1746 tablet_bootstrap.cc:492] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.283565  1749 tablet_bootstrap.cc:492] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.283906  1746 ts_tablet_manager.cc:1403] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.038s
I20260709 13:12:21.284124  1749 ts_tablet_manager.cc:1403] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.038s
I20260709 13:12:21.253674  1748 raft_consensus.cc:359] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.284575  1748 raft_consensus.cc:385] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.284947  1748 raft_consensus.cc:740] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.285082  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.285760  1450 raft_consensus.cc:3060] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.285892  1748 consensus_queue.cc:260] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.287339  1746 raft_consensus.cc:359] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.288138  1746 raft_consensus.cc:385] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.287860  1749 raft_consensus.cc:359] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.288452  1746 raft_consensus.cc:740] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.288676  1749 raft_consensus.cc:385] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.289052  1749 raft_consensus.cc:740] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.289315  1746 consensus_queue.cc:260] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.289816  1749 consensus_queue.cc:260] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.291793  1746 ts_tablet_manager.cc:1434] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:21.292268  1749 ts_tablet_manager.cc:1434] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:21.292830  1746 tablet_bootstrap.cc:492] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:21.293352  1749 tablet_bootstrap.cc:492] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.295284  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:21.295907  1599 raft_consensus.cc:3060] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.299775  1746 tablet_bootstrap.cc:654] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.301151  1749 tablet_bootstrap.cc:654] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.302562  1728 raft_consensus.cc:493] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.303246  1728 raft_consensus.cc:515] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.303964  1599 raft_consensus.cc:2468] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.305951  1493 leader_election.cc:304] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:21.306190  1728 leader_election.cc:290] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:21.307264  1729 raft_consensus.cc:2804] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.312933  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.313012  1741 leader_election.cc:290] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.314188  1526 raft_consensus.cc:2468] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 0.
I20260709 13:12:21.288532  1748 ts_tablet_manager.cc:1434] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:12:21.316915  1748 tablet_bootstrap.cc:492] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:21.317600  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
W20260709 13:12:21.320022  1567 leader_election.cc:343] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.321154  1567 leader_election.cc:304] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:21.324311  1729 raft_consensus.cc:697] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:21.325891  1729 consensus_queue.cc:237] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.340790  1748 tablet_bootstrap.cc:654] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.340967  1728 raft_consensus.cc:2804] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.349730  1728 raft_consensus.cc:493] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.350232  1728 raft_consensus.cc:3060] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.353189  1737 raft_consensus.cc:493] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.354040  1737 raft_consensus.cc:515] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.356194  1450 raft_consensus.cc:2468] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.362244  1749 tablet_bootstrap.cc:492] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.363103  1749 ts_tablet_manager.cc:1403] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.035s
I20260709 13:12:21.365481  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.367668  1749 raft_consensus.cc:359] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.368245  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.368700  1749 raft_consensus.cc:385] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.369289  1749 raft_consensus.cc:740] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
W20260709 13:12:21.370076  1418 leader_election.cc:343] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.370348  1749 consensus_queue.cc:260] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
W20260709 13:12:21.372377  1418 leader_election.cc:343] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.357110  1737 leader_election.cc:290] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.372905  1418 leader_election.cc:304] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:21.375639  1749 ts_tablet_manager.cc:1434] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.002s
I20260709 13:12:21.374547  1737 raft_consensus.cc:2749] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.377525  1749 tablet_bootstrap.cc:492] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.377490  1728 raft_consensus.cc:515] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.392827  1749 tablet_bootstrap.cc:654] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.393534  1349 catalog_manager.cc:5697] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.396188  1728 leader_election.cc:290] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:21.397176  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.397917  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:21.398697  1526 raft_consensus.cc:3060] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:21.400214  1567 leader_election.cc:343] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.400405  1746 tablet_bootstrap.cc:492] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.403789  1748 tablet_bootstrap.cc:492] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.404603  1746 ts_tablet_manager.cc:1403] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.112s	user 0.037s	sys 0.040s
I20260709 13:12:21.404747  1748 ts_tablet_manager.cc:1403] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.010s
I20260709 13:12:21.408555  1748 raft_consensus.cc:359] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.409510  1748 raft_consensus.cc:385] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.410034  1748 raft_consensus.cc:740] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.410028  1746 raft_consensus.cc:359] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.411149  1746 raft_consensus.cc:385] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.411484  1746 raft_consensus.cc:740] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.411522  1737 raft_consensus.cc:493] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.412250  1737 raft_consensus.cc:515] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.412557  1728 raft_consensus.cc:493] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.412390  1746 consensus_queue.cc:260] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.413160  1728 raft_consensus.cc:515] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.415304  1746 ts_tablet_manager.cc:1434] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:21.415388  1728 leader_election.cc:290] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:21.411535  1748 consensus_queue.cc:260] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.418032  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.418669  1450 raft_consensus.cc:2468] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 0.
I20260709 13:12:21.418442  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851bbbeb812c4167ad6c8fbbd4d49d68" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.419935  1737 leader_election.cc:290] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.420042  1527 raft_consensus.cc:2468] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 0.
I20260709 13:12:21.419407  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.420936  1526 raft_consensus.cc:2468] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 1.
I20260709 13:12:21.421195  1525 raft_consensus.cc:2468] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 0.
I20260709 13:12:21.422776  1567 leader_election.cc:304] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:21.423056  1418 leader_election.cc:304] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:21.423485  1749 tablet_bootstrap.cc:492] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.423714  1729 raft_consensus.cc:493] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.423808  1567 leader_election.cc:304] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:21.424309  1729 raft_consensus.cc:515] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.425185  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851bbbeb812c4167ad6c8fbbd4d49d68" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.425700  1737 raft_consensus.cc:2804] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.424060  1749 ts_tablet_manager.cc:1403] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.008s
I20260709 13:12:21.426246  1728 raft_consensus.cc:2804] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.428292  1728 raft_consensus.cc:493] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.428750  1728 raft_consensus.cc:3060] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.427977  1737 raft_consensus.cc:493] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.430297  1737 raft_consensus.cc:3060] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.427769  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d127f1573a4555ad015fcdb822de49" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.437249  1450 raft_consensus.cc:2468] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.437565  1749 raft_consensus.cc:359] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.438268  1749 raft_consensus.cc:385] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.438546  1749 raft_consensus.cc:740] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.426487  1729 leader_election.cc:290] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.432322  1773 raft_consensus.cc:2804] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:21.434571  1418 leader_election.cc:343] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.433208  1748 ts_tablet_manager.cc:1434] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 13:12:21.440876  1748 tablet_bootstrap.cc:492] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:21.435971  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d127f1573a4555ad015fcdb822de49" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.441990  1599 raft_consensus.cc:2468] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.438637  1493 leader_election.cc:304] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:21.443845  1729 raft_consensus.cc:2804] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.444245  1729 raft_consensus.cc:493] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.444593  1729 raft_consensus.cc:3060] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.448559  1737 raft_consensus.cc:515] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.450086  1746 tablet_bootstrap.cc:492] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
I20260709 13:12:21.452105  1749 consensus_queue.cc:260] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.454439  1749 ts_tablet_manager.cc:1434] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:12:21.451345  1748 tablet_bootstrap.cc:654] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.455097  1773 raft_consensus.cc:697] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:21.456108  1773 consensus_queue.cc:237] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.451435  1728 raft_consensus.cc:515] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.460968  1749 tablet_bootstrap.cc:492] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73: Bootstrap starting.
I20260709 13:12:21.468173  1737 leader_election.cc:290] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.468375  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851bbbeb812c4167ad6c8fbbd4d49d68" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:21.469842  1746 tablet_bootstrap.cc:654] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:21.469985  1418 leader_election.cc:343] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.461735  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.471285  1450 raft_consensus.cc:3060] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.463001  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851bbbeb812c4167ad6c8fbbd4d49d68" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:21.473647  1525 raft_consensus.cc:3060] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.458774  1728 leader_election.cc:290] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:21.462822  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:21.476572  1526 raft_consensus.cc:3060] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.491479  1728 raft_consensus.cc:493] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.492559  1728 raft_consensus.cc:515] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.491938  1767 raft_consensus.cc:493] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.495615  1767 raft_consensus.cc:515] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.497871  1767 leader_election.cc:290] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.498080  1450 raft_consensus.cc:2468] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 1.
I20260709 13:12:21.499330  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.499898  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.500046  1599 raft_consensus.cc:2468] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.500226  1567 leader_election.cc:304] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:21.502802  1775 raft_consensus.cc:2804] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.503334  1775 raft_consensus.cc:697] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
W20260709 13:12:21.503674  1567 leader_election.cc:343] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.504546  1493 leader_election.cc:304] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:21.504156  1775 consensus_queue.cc:237] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.505498  1767 raft_consensus.cc:2804] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.505968  1767 raft_consensus.cc:493] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.506426  1767 raft_consensus.cc:3060] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.507166  1749 tablet_bootstrap.cc:654] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.515882  1729 raft_consensus.cc:515] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.516330  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.518165  1729 leader_election.cc:290] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.519155  1346 catalog_manager.cc:5697] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.520664  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d127f1573a4555ad015fcdb822de49" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:21.521559  1599 raft_consensus.cc:3060] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.525067  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.526144  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d127f1573a4555ad015fcdb822de49" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.526829  1452 raft_consensus.cc:3060] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.514611  1728 leader_election.cc:290] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:21.531126  1526 raft_consensus.cc:2468] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 1.
W20260709 13:12:21.531432  1493 leader_election.cc:343] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.548192  1599 raft_consensus.cc:2468] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.550657  1493 leader_election.cc:304] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:21.534979  1767 raft_consensus.cc:515] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.556641  1729 raft_consensus.cc:2804] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.560052  1748 tablet_bootstrap.cc:492] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.563397  1729 raft_consensus.cc:697] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:21.563544  1748 ts_tablet_manager.cc:1403] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.123s	user 0.041s	sys 0.024s
I20260709 13:12:21.564625  1525 raft_consensus.cc:2468] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 1.
I20260709 13:12:21.564373  1729 consensus_queue.cc:237] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.567325  1418 leader_election.cc:304] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:21.567063  1748 raft_consensus.cc:359] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.562286  1452 raft_consensus.cc:2468] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.568486  1748 raft_consensus.cc:385] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.568681  1737 raft_consensus.cc:2804] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.569010  1748 raft_consensus.cc:740] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.569249  1737 raft_consensus.cc:697] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:21.570047  1748 consensus_queue.cc:260] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.570145  1737 consensus_queue.cc:237] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
W20260709 13:12:21.572239  1622 debug-util.cc:398] Leaking SignalData structure 0x7b080039d2e0 after lost signal to thread 21393
I20260709 13:12:21.572032  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:21.572710  1748 ts_tablet_manager.cc:1434] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:12:21.573076  1599 raft_consensus.cc:3060] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:21.573575  1622 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae0c0 after lost signal to thread 1384
I20260709 13:12:21.573861  1748 tablet_bootstrap.cc:492] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
W20260709 13:12:21.575187  1622 debug-util.cc:398] Leaking SignalData structure 0x7b0800418000 after lost signal to thread 1476
W20260709 13:12:21.576562  1622 debug-util.cc:398] Leaking SignalData structure 0x7b0800137100 after lost signal to thread 1551
I20260709 13:12:21.567597  1527 raft_consensus.cc:2393] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba7692cb58a64f9bb21890b89f5ea915 in current term 1: Already voted for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in this term.
I20260709 13:12:21.581177  1749 tablet_bootstrap.cc:492] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73: No bootstrap required, opened a new log
I20260709 13:12:21.581769  1749 ts_tablet_manager.cc:1403] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.003s
I20260709 13:12:21.583551  1567 leader_election.cc:304] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:21.583839  1599 raft_consensus.cc:2468] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.584656  1749 raft_consensus.cc:359] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.585655  1773 raft_consensus.cc:2749] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.585824  1767 leader_election.cc:290] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.585654  1749 raft_consensus.cc:385] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.586931  1749 raft_consensus.cc:740] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.587937  1748 tablet_bootstrap.cc:654] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.588625  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.589114  1749 consensus_queue.cc:260] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.589936  1746 tablet_bootstrap.cc:492] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.590689  1746 ts_tablet_manager.cc:1403] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.027s
I20260709 13:12:21.591465  1749 ts_tablet_manager.cc:1434] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
W20260709 13:12:21.593178  1622 debug-util.cc:398] Leaking SignalData structure 0x7b0800288600 after lost signal to thread 1625
W20260709 13:12:21.594292  1493 leader_election.cc:343] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.598835  1493 leader_election.cc:304] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:21.600915  1748 tablet_bootstrap.cc:492] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.601670  1748 ts_tablet_manager.cc:1403] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.002s
I20260709 13:12:21.601533  1346 catalog_manager.cc:5697] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 1 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.604523  1741 raft_consensus.cc:2804] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.605684  1748 raft_consensus.cc:359] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.606869  1767 raft_consensus.cc:493] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.606915  1748 raft_consensus.cc:385] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.607788  1748 raft_consensus.cc:740] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.608945  1748 consensus_queue.cc:260] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.595305  1746 raft_consensus.cc:359] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.611914  1746 raft_consensus.cc:385] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.612255  1746 raft_consensus.cc:740] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.612375  1748 ts_tablet_manager.cc:1434] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:12:21.613817  1748 tablet_bootstrap.cc:492] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:21.614382  1746 consensus_queue.cc:260] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.622172  1746 ts_tablet_manager.cc:1434] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:12:21.607595  1767 raft_consensus.cc:515] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.626467  1746 tablet_bootstrap.cc:492] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a: Bootstrap starting.
W20260709 13:12:21.635382  1397 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:21.634939  1348 catalog_manager.cc:5697] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 1 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.642738  1746 tablet_bootstrap.cc:654] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.648219  1767 leader_election.cc:290] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.649273  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.650049  1452 raft_consensus.cc:2468] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.651690  1748 tablet_bootstrap.cc:654] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.645622  1741 raft_consensus.cc:697] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:21.655972  1741 consensus_queue.cc:237] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.658013  1493 leader_election.cc:304] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:21.671419  1767 raft_consensus.cc:2804] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.671804  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.671885  1767 raft_consensus.cc:493] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.673763  1767 raft_consensus.cc:3060] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:21.679994  1493 leader_election.cc:343] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.685117  1350 catalog_manager.cc:5697] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.694239  1775 raft_consensus.cc:493] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.694916  1775 raft_consensus.cc:515] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.697364  1775 leader_election.cc:290] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:21.699200  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851bbbeb812c4167ad6c8fbbd4d49d68" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.700125  1527 raft_consensus.cc:2393] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba7692cb58a64f9bb21890b89f5ea915 in current term 1: Already voted for candidate 0cfba139dd0142718bdc8cd4391d4a7a in this term.
I20260709 13:12:21.702847  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851bbbeb812c4167ad6c8fbbd4d49d68" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.705142  1567 leader_election.cc:304] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:21.704715  1767 raft_consensus.cc:515] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.706153  1775 raft_consensus.cc:3060] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.719485  1349 catalog_manager.cc:5697] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.722412  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.723126  1452 raft_consensus.cc:3060] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.723690  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:21.724736  1748 tablet_bootstrap.cc:492] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
W20260709 13:12:21.725256  1493 leader_election.cc:343] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.725492  1748 ts_tablet_manager.cc:1403] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.024s
I20260709 13:12:21.726027  1767 leader_election.cc:290] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.719485  1775 raft_consensus.cc:2749] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.730949  1748 raft_consensus.cc:359] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.732004  1748 raft_consensus.cc:385] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.732381  1748 raft_consensus.cc:740] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.733412  1748 consensus_queue.cc:260] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.736268  1748 ts_tablet_manager.cc:1434] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:12:21.737200  1746 tablet_bootstrap.cc:492] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a: No bootstrap required, opened a new log
I20260709 13:12:21.737771  1746 ts_tablet_manager.cc:1403] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent bootstrapping tablet: real 0.112s	user 0.035s	sys 0.002s
I20260709 13:12:21.740698  1746 raft_consensus.cc:359] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.741390  1746 raft_consensus.cc:385] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.741663  1746 raft_consensus.cc:740] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.742271  1746 consensus_queue.cc:260] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.744452  1746 ts_tablet_manager.cc:1434] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:21.745589  1748 tablet_bootstrap.cc:492] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915: Bootstrap starting.
I20260709 13:12:21.742542  1452 raft_consensus.cc:2468] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.755415  1741 consensus_queue.cc:1048] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:21.763855  1493 leader_election.cc:304] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:21.765087  1741 raft_consensus.cc:2804] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.765682  1741 raft_consensus.cc:697] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:21.766572  1748 tablet_bootstrap.cc:654] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.766614  1741 consensus_queue.cc:237] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.780601  1775 raft_consensus.cc:493] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.781406  1785 raft_consensus.cc:493] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.781252  1775 raft_consensus.cc:515] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.782159  1785 raft_consensus.cc:515] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.784395  1775 leader_election.cc:290] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:21.784966  1785 leader_election.cc:290] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.787668  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.788332  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699d125c04774cceae3f5b142afb5e61" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.789183  1452 raft_consensus.cc:2468] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.790191  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699d125c04774cceae3f5b142afb5e61" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.788368  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.793613  1450 raft_consensus.cc:2393] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba7692cb58a64f9bb21890b89f5ea915 in current term 1: Already voted for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in this term.
I20260709 13:12:21.794679  1567 leader_election.cc:304] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba7692cb58a64f9bb21890b89f5ea915; no voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:21.794919  1748 tablet_bootstrap.cc:492] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915: No bootstrap required, opened a new log
I20260709 13:12:21.795562  1748 ts_tablet_manager.cc:1403] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.020s
I20260709 13:12:21.796033  1775 raft_consensus.cc:3060] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.796675  1767 raft_consensus.cc:493] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.798543  1748 raft_consensus.cc:359] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.799357  1748 raft_consensus.cc:385] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.799666  1748 raft_consensus.cc:740] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.800675  1748 consensus_queue.cc:260] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.802377  1748 ts_tablet_manager.cc:1434] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:21.797245  1767 raft_consensus.cc:515] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.805181  1767 leader_election.cc:290] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.806243  1775 raft_consensus.cc:2749] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.807595  1493 leader_election.cc:304] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:21.809098  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" is_pre_election: true
I20260709 13:12:21.831250  1450 raft_consensus.cc:2468] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
W20260709 13:12:21.831542  1493 leader_election.cc:343] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.832912  1767 raft_consensus.cc:2804] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.833354  1767 raft_consensus.cc:493] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.833384  1493 leader_election.cc:304] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:21.834754  1729 raft_consensus.cc:2804] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.834679  1785 consensus_queue.cc:1048] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.835239  1729 raft_consensus.cc:493] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.835659  1729 raft_consensus.cc:3060] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.833837  1767 raft_consensus.cc:3060] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.839375  1350 catalog_manager.cc:5697] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.809448  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.841291  1600 raft_consensus.cc:2468] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 0.
I20260709 13:12:21.846752  1767 raft_consensus.cc:515] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.847540  1729 raft_consensus.cc:515] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.851441  1767 leader_election.cc:290] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.851670  1729 leader_election.cc:290] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.852277  1645 raft_consensus.cc:493] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.852939  1645 raft_consensus.cc:515] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.855420  1645 leader_election.cc:290] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.857016  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.858202  1527 raft_consensus.cc:2393] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cfba139dd0142718bdc8cd4391d4a7a in current term 1: Already voted for candidate ba7692cb58a64f9bb21890b89f5ea915 in this term.
I20260709 13:12:21.858412  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.858880  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:21.859172  1451 raft_consensus.cc:3060] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.859275  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699d125c04774cceae3f5b142afb5e61" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:21.859606  1601 raft_consensus.cc:3060] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.860055  1599 raft_consensus.cc:3060] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.857959  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.858033  1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699d125c04774cceae3f5b142afb5e61" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:21.861918  1452 raft_consensus.cc:3060] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.863631  1418 leader_election.cc:304] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:21.865453  1645 raft_consensus.cc:3060] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.871758  1601 raft_consensus.cc:2468] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.873195  1737 raft_consensus.cc:493] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.873974  1493 leader_election.cc:304] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:21.873819  1737 raft_consensus.cc:515] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.875325  1729 raft_consensus.cc:2804] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.875824  1729 raft_consensus.cc:697] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:21.876622  1729 consensus_queue.cc:237] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.878810  1599 raft_consensus.cc:2468] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.879778  1452 raft_consensus.cc:2468] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.881263  1737 leader_election.cc:290] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:21.885200  1493 leader_election.cc:304] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:21.889608  1786 raft_consensus.cc:2804] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.890266  1786 raft_consensus.cc:697] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:21.891512  1786 consensus_queue.cc:237] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:21.885583  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" is_pre_election: true
I20260709 13:12:21.898698  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915" is_pre_election: true
I20260709 13:12:21.903050  1599 raft_consensus.cc:2393] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cfba139dd0142718bdc8cd4391d4a7a in current term 1: Already voted for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in this term.
I20260709 13:12:21.905625  1418 leader_election.cc:304] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a; no voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:21.907747  1737 raft_consensus.cc:3060] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.907953  1645 raft_consensus.cc:2749] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.911052  1451 raft_consensus.cc:2468] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 1.
I20260709 13:12:21.925029  1775 consensus_queue.cc:1048] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.925586  1737 raft_consensus.cc:2749] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.928781  1775 consensus_queue.cc:1048] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:21.949496  1349 catalog_manager.cc:5697] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.951246  1349 catalog_manager.cc:5697] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 1 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.965354  1775 consensus_queue.cc:1048] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:22.037118  1775 consensus_queue.cc:1048] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:22.045585  1786 consensus_queue.cc:1048] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.064451  1729 consensus_queue.cc:1048] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.124023  1803 consensus_queue.cc:1048] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.134262  1767 consensus_queue.cc:1048] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.142069  1803 consensus_queue.cc:1048] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.145920  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:47746
I20260709 13:12:22.147044  1527 raft_consensus.cc:606] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Received request to transfer leadership to TS 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:22.179042  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:47746
I20260709 13:12:22.179880  1525 raft_consensus.cc:606] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Received request to transfer leadership to TS 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:22.194450  1729 consensus_queue.cc:1048] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.220877  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:47746
I20260709 13:12:22.221696  1525 raft_consensus.cc:606] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Received request to transfer leadership to TS 0cfba139dd0142718bdc8cd4391d4a7a
I20260709 13:12:22.241189  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
mode: GRACEFUL
new_leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:33360
I20260709 13:12:22.241897  1600 raft_consensus.cc:606] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Received request to transfer leadership to TS 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:22.250584  1599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
mode: GRACEFUL
new_leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:33360
I20260709 13:12:22.251304  1599 raft_consensus.cc:606] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Received request to transfer leadership to TS 3842b034b3e24e5e8bdf35d6ce06ab73
I20260709 13:12:22.252889  1729 consensus_queue.cc:1048] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.262862  1525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:47746
I20260709 13:12:22.263581  1525 raft_consensus.cc:606] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Received request to transfer leadership to TS ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:22.276372  1767 consensus_queue.cc:1048] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:22.288517  1767 raft_consensus.cc:993] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:22.289093  1767 raft_consensus.cc:1081] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Signalling peer 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:22.291429  1450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d"
dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:37568
I20260709 13:12:22.292166  1450 raft_consensus.cc:493] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.292582  1450 raft_consensus.cc:3060] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.301565  1450 raft_consensus.cc:515] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.303786  1450 leader_election.cc:290] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:22.305368  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:22.306221  1525 raft_consensus.cc:3055] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:22.306321  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ace73d406d741f2a9f0dc5bfd31092d" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:22.306627  1525 raft_consensus.cc:740] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:22.307013  1599 raft_consensus.cc:3060] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.307799  1525 consensus_queue.cc:260] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.309526  1525 raft_consensus.cc:3060] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.318109  1599 raft_consensus.cc:2468] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:22.319612  1525 raft_consensus.cc:2468] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:22.320101  1418 leader_election.cc:304] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:22.321174  1803 raft_consensus.cc:2804] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:22.321666  1803 raft_consensus.cc:697] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:22.322721  1803 consensus_queue.cc:237] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.330560  1350 catalog_manager.cc:5697] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 2 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.338718  1767 consensus_queue.cc:1048] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.351330  1767 raft_consensus.cc:993] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:22.351845  1767 raft_consensus.cc:1081] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Signalling peer ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:22.355006  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:42390
I20260709 13:12:22.355713  1600 raft_consensus.cc:493] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.356264  1600 raft_consensus.cc:3060] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.363916  1786 consensus_queue.cc:1048] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.378022  1786 consensus_queue.cc:1048] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.387658  1600 raft_consensus.cc:515] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.393019  1786 consensus_queue.cc:1048] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.402881  1600 leader_election.cc:290] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:22.404153  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:22.404489  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333c0d1f6dee4aa885e402b86e26b7fd" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:22.404835  1525 raft_consensus.cc:3055] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:22.405248  1451 raft_consensus.cc:3060] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.405258  1525 raft_consensus.cc:740] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:22.416638  1451 raft_consensus.cc:2468] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 2.
I20260709 13:12:22.418910  1567 leader_election.cc:304] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:22.420342  1775 raft_consensus.cc:2804] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:22.421063  1775 raft_consensus.cc:697] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:22.421161  1786 raft_consensus.cc:993] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:22.421854  1786 raft_consensus.cc:1081] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Signalling peer 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:22.422554  1775 consensus_queue.cc:237] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.427534  1451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7"
dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:37568
I20260709 13:12:22.428381  1451 raft_consensus.cc:493] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.428813  1451 raft_consensus.cc:3060] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.417047  1525 consensus_queue.cc:260] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.441538  1525 raft_consensus.cc:3060] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.450840  1525 raft_consensus.cc:2468] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 2.
I20260709 13:12:22.439543  1451 raft_consensus.cc:515] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.455348  1451 leader_election.cc:290] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:22.456679  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:22.457562  1527 raft_consensus.cc:3055] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:22.457894  1527 raft_consensus.cc:740] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:22.458842  1527 consensus_queue.cc:260] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.462484  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317bbcf623f4ecfa69384dba23548c7" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:22.463361  1600 raft_consensus.cc:3060] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.469183  1348 catalog_manager.cc:5697] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 2 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:22.472397  1527 raft_consensus.cc:3060] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.473094  1600 raft_consensus.cc:2468] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:22.474447  1418 leader_election.cc:304] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:22.475559  1803 raft_consensus.cc:2804] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:22.476074  1803 raft_consensus.cc:697] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:22.477138  1803 consensus_queue.cc:237] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.488224  1527 raft_consensus.cc:2468] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:22.495111  1346 catalog_manager.cc:5697] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 2 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.542888  1776 raft_consensus.cc:993] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: : Instructing follower 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:22.543568  1773 raft_consensus.cc:1081] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Signalling peer 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:22.545353  1527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:47734
I20260709 13:12:22.545890  1527 raft_consensus.cc:493] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.546226  1527 raft_consensus.cc:3060] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.553555  1776 raft_consensus.cc:993] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: : Instructing follower 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:22.553781  1527 raft_consensus.cc:515] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.554160  1773 raft_consensus.cc:1081] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Signalling peer 3842b034b3e24e5e8bdf35d6ce06ab73 to start an election
I20260709 13:12:22.555959  1527 leader_election.cc:290] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:22.556219  1525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
 from {username='slave'} at 127.0.0.1:47734
I20260709 13:12:22.556980  1525 raft_consensus.cc:493] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.557337  1525 raft_consensus.cc:3060] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.557806  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:22.558525  1600 raft_consensus.cc:3055] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:22.558861  1600 raft_consensus.cc:740] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:22.558928  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9de744344f445bb9cb73ecf9e2c7abe" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:22.559590  1450 raft_consensus.cc:3060] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.559986  1600 consensus_queue.cc:260] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.561465  1600 raft_consensus.cc:3060] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.565850  1525 raft_consensus.cc:515] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.568360  1450 raft_consensus.cc:2468] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:22.569130  1525 leader_election.cc:290] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:22.570910  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:22.571553  1601 raft_consensus.cc:3055] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:22.571513  1451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58c6ffde28c4dc3b3016fcfd3ead84e" candidate_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:22.572137  1601 raft_consensus.cc:740] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:22.572356  1451 raft_consensus.cc:3060] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.573424  1601 consensus_queue.cc:260] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.574975  1601 raft_consensus.cc:3060] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.576050  1600 raft_consensus.cc:2468] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:22.577474  1493 leader_election.cc:304] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:22.579281  1785 raft_consensus.cc:2804] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:22.580647  1785 raft_consensus.cc:697] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:22.581825  1785 consensus_queue.cc:237] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.584677  1601 raft_consensus.cc:2468] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:22.585103  1451 raft_consensus.cc:2468] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3842b034b3e24e5e8bdf35d6ce06ab73 in term 2.
I20260709 13:12:22.586570  1493 leader_election.cc:304] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, 3842b034b3e24e5e8bdf35d6ce06ab73; no voters: 
I20260709 13:12:22.587502  1729 raft_consensus.cc:2804] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:22.588050  1729 raft_consensus.cc:697] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Becoming Leader. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:22.589159  1729 consensus_queue.cc:237] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.592469  1346 catalog_manager.cc:5697] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 1 to 2, leader changed from ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131) to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.606840  1346 catalog_manager.cc:5697] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 reported cstate change: term changed from 1 to 2, leader changed from ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131) to 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130). New cstate: current_term: 2 leader_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.665951  1729 raft_consensus.cc:993] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:22.666486  1786 raft_consensus.cc:1081] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Signalling peer 0cfba139dd0142718bdc8cd4391d4a7a to start an election
I20260709 13:12:22.668354  1451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb"
dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
 from {username='slave'} at 127.0.0.1:37568
I20260709 13:12:22.669020  1451 raft_consensus.cc:493] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.669427  1451 raft_consensus.cc:3060] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.674932  1451 raft_consensus.cc:515] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.676653  1451 leader_election.cc:290] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Requested vote from peers 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467), ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131:37119)
I20260709 13:12:22.677985  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:22.678169  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331f5a61ad6470ab70c88bae988b2eb" candidate_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
I20260709 13:12:22.678742  1525 raft_consensus.cc:3055] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:22.678764  1601 raft_consensus.cc:3060] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.679247  1525 raft_consensus.cc:740] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:22.680262  1525 consensus_queue.cc:260] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.681761  1525 raft_consensus.cc:3060] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.687201  1601 raft_consensus.cc:2468] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:22.688596  1418 leader_election.cc:304] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfba139dd0142718bdc8cd4391d4a7a, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:22.689555  1803 raft_consensus.cc:2804] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:22.689836  1525 raft_consensus.cc:2468] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfba139dd0142718bdc8cd4391d4a7a in term 2.
I20260709 13:12:22.690079  1803 raft_consensus.cc:697] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Becoming Leader. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:22.691288  1803 consensus_queue.cc:237] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:22.698395  1346 catalog_manager.cc:5697] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a reported cstate change: term changed from 1 to 2, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129). New cstate: current_term: 2 leader_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.835794  1525 raft_consensus.cc:1275] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.837244  1773 consensus_queue.cc:1048] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:22.855351  1451 raft_consensus.cc:1275] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.857035  1773 consensus_queue.cc:1048] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:22.921206  1525 raft_consensus.cc:1275] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.922729  1803 consensus_queue.cc:1048] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:22.931519  1601 raft_consensus.cc:1275] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.933391  1803 consensus_queue.cc:1048] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:22.961812  1451 raft_consensus.cc:1275] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.963029  1786 consensus_queue.cc:1048] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:22.973961  1601 raft_consensus.cc:1275] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:22.976099  1785 consensus_queue.cc:1048] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:22.998459  1525 raft_consensus.cc:1275] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:23.000313  1818 consensus_queue.cc:1048] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:23.015117  1601 raft_consensus.cc:1275] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:23.018150  1645 consensus_queue.cc:1048] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:23.146844  1601 raft_consensus.cc:1275] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:23.148571  1645 consensus_queue.cc:1048] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:23.162388  1525 raft_consensus.cc:1275] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Refusing update from remote peer 0cfba139dd0142718bdc8cd4391d4a7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:23.164358  1818 consensus_queue.cc:1048] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:23.174299  1601 raft_consensus.cc:1275] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:23.176024  1785 consensus_queue.cc:1048] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:23.193789  1451 raft_consensus.cc:1275] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Refusing update from remote peer 3842b034b3e24e5e8bdf35d6ce06ab73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:23.195560  1786 consensus_queue.cc:1048] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.267905  1350 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52686:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:12:25.289510  1350 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52686:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:12:25.367612 21390 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:25.455776  1418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:37119, user_credentials={real_user=slave}} blocked reactor thread for 44321.3us
I20260709 13:12:25.485252  1860 tablet.cc:1724] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.572422  1881 tablet.cc:1724] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.607666  1875 tablet.cc:1724] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:25.663959  1871 log.cc:927] Time spent T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
W20260709 13:12:25.658876  1493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.129:39379, user_credentials={real_user=slave}} blocked reactor thread for 73100.3us
I20260709 13:12:25.667896  1882 tablet.cc:1724] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.664563  1869 tablet.cc:1724] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.643348  1878 tablet.cc:1724] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.731750  1893 tablet.cc:1724] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.733399  1888 tablet.cc:1724] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:25.754199  1884 log.cc:927] Time spent T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:12:25.727141  1883 tablet.cc:1724] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:25.760782  1493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.227.131:37119, user_credentials={real_user=slave}} blocked reactor thread for 89209.3us
W20260709 13:12:25.778486  1873 log.cc:927] Time spent T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:12:25.808125  1886 log.cc:927] Time spent T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:12:25.809782  1869 tablet.cc:1724] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.811992  1881 tablet.cc:1724] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.823559  1882 tablet.cc:1724] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.864270  1860 tablet.cc:1724] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.864960  1889 tablet.cc:1724] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.866331  1898 tablet.cc:1724] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.872988  1893 tablet.cc:1724] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.880312  1869 tablet.cc:1724] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.884311  1524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3"
dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
mode: GRACEFUL
new_leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:12:25.885030  1524 raft_consensus.cc:606] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Received request to transfer leadership to TS ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:25.882524  1899 tablet.cc:1724] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.888446  1881 tablet.cc:1724] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.891018  1830 raft_consensus.cc:993] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73: : Instructing follower ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:25.891616  1830 raft_consensus.cc:1081] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Signalling peer ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:25.894728  1597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:42390
I20260709 13:12:25.895435  1597 raft_consensus.cc:493] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.895824  1597 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:25.903551  1875 tablet.cc:1724] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.905328  1881 tablet.cc:1724] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.917834  1878 tablet.cc:1724] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.918844  1881 tablet.cc:1724] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.923996  1350 catalog_manager.cc:5789] TS 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467) does not have the latest schema for tablet d9de744344f445bb9cb73ecf9e2c7abe (table soft_deleted_table [id=9a86ef6f75744e69966312d371c61800]). Expected version 1 got 0
I20260709 13:12:25.924657  1597 raft_consensus.cc:515] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:25.933171  1860 tablet.cc:1724] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.929941  1888 tablet.cc:1724] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.936035  1597 leader_election.cc:290] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 3 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:25.951690  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:25.952299  1526 raft_consensus.cc:3055] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:25.952592  1526 raft_consensus.cc:740] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3842b034b3e24e5e8bdf35d6ce06ab73, State: Running, Role: LEADER
I20260709 13:12:25.953413  1526 consensus_queue.cc:260] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:25.954514  1526 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:25.958570  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda3ef7361a5452eb696c0cd602eeaf3" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:25.959408  1450 raft_consensus.cc:3060] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:25.958379  1882 tablet.cc:1724] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.967500  1889 tablet.cc:1724] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:25.984827  1526 raft_consensus.cc:2468] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 3.
I20260709 13:12:25.986316  1567 leader_election.cc:304] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:25.987336  1829 raft_consensus.cc:2804] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:25.987884  1829 raft_consensus.cc:697] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:25.988794  1829 consensus_queue.cc:237] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:25.989393  1450 raft_consensus.cc:2468] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 3.
I20260709 13:12:26.004510  1450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0"
dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
mode: GRACEFUL
new_leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:38094
I20260709 13:12:26.005187  1450 raft_consensus.cc:606] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Received request to transfer leadership to TS ba7692cb58a64f9bb21890b89f5ea915
I20260709 13:12:26.011600 21390 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:26.012313 21390 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:26.028441  1349 catalog_manager.cc:5697] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 2 to 3, leader changed from 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130) to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.032482  1346 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a: soft_deleted_table [id=9a86ef6f75744e69966312d371c61800] alter complete (version 1)
I20260709 13:12:26.081656  1858 raft_consensus.cc:993] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a: : Instructing follower ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:26.082387  1865 raft_consensus.cc:1081] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Signalling peer ba7692cb58a64f9bb21890b89f5ea915 to start an election
I20260709 13:12:26.084275  1597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0"
dest_uuid: "ba7692cb58a64f9bb21890b89f5ea915"
 from {username='slave'} at 127.0.0.1:42380
I20260709 13:12:26.084952  1597 raft_consensus.cc:493] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:26.085399  1597 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:26.092393  1597 raft_consensus.cc:515] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:26.094089  1597 leader_election.cc:290] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 3 election: Requested vote from peers 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379), 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467)
I20260709 13:12:26.095394  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73"
I20260709 13:12:26.095212  1450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe5e498fdcb408dbd8df7aca39fbef0" candidate_uuid: "ba7692cb58a64f9bb21890b89f5ea915" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cfba139dd0142718bdc8cd4391d4a7a"
I20260709 13:12:26.096174  1526 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:26.096406  1450 raft_consensus.cc:3055] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:26.097275  1450 raft_consensus.cc:740] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cfba139dd0142718bdc8cd4391d4a7a, State: Running, Role: LEADER
I20260709 13:12:26.098258  1450 consensus_queue.cc:260] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:26.099743  1450 raft_consensus.cc:3060] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:26.102062  1526 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 3.
I20260709 13:12:26.103425  1567 leader_election.cc:304] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3842b034b3e24e5e8bdf35d6ce06ab73, ba7692cb58a64f9bb21890b89f5ea915; no voters: 
I20260709 13:12:26.104482  1829 raft_consensus.cc:2804] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:26.105082  1829 raft_consensus.cc:697] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 LEADER]: Becoming Leader. State: Replica: ba7692cb58a64f9bb21890b89f5ea915, State: Running, Role: LEADER
I20260709 13:12:26.105975  1829 consensus_queue.cc:237] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } }
I20260709 13:12:26.107476  1450 raft_consensus.cc:2468] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7692cb58a64f9bb21890b89f5ea915 in term 3.
I20260709 13:12:26.116451  1346 catalog_manager.cc:5697] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 reported cstate change: term changed from 2 to 3, leader changed from 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129) to ba7692cb58a64f9bb21890b89f5ea915 (127.20.227.131). New cstate: current_term: 3 leader_uuid: "ba7692cb58a64f9bb21890b89f5ea915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7692cb58a64f9bb21890b89f5ea915" member_type: VOTER last_known_addr { host: "127.20.227.131" port: 37119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.532626  1524 raft_consensus.cc:1275] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:26.534245  1829 consensus_queue.cc:1048] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:26.553700  1450 raft_consensus.cc:1275] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:26.555255  1909 consensus_queue.cc:1048] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:26.567385  1524 raft_consensus.cc:1275] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:26.569298  1909 consensus_queue.cc:1048] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3842b034b3e24e5e8bdf35d6ce06ab73" member_type: VOTER last_known_addr { host: "127.20.227.130" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:26.579170  1450 raft_consensus.cc:1275] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Refusing update from remote peer ba7692cb58a64f9bb21890b89f5ea915: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:26.582176  1890 consensus_queue.cc:1048] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfba139dd0142718bdc8cd4391d4a7a" member_type: VOTER last_known_addr { host: "127.20.227.129" port: 39379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:27.084492 21390 tablet_server.cc:179] TabletServer@127.20.227.129:0 shutting down...
I20260709 13:12:27.117995 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:27.118893 21390 tablet_replica.cc:333] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.119951 21390 raft_consensus.cc:2243] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.120537 21390 raft_consensus.cc:2272] T 333c0d1f6dee4aa885e402b86e26b7fd P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.123389 21390 tablet_replica.cc:333] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.124183 21390 raft_consensus.cc:2243] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.125258 21390 raft_consensus.cc:2272] T c331f5a61ad6470ab70c88bae988b2eb P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.129384 21390 tablet_replica.cc:333] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.130239 21390 raft_consensus.cc:2243] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.131134 21390 raft_consensus.cc:2272] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.133484 21390 tablet_replica.cc:333] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.134107 21390 raft_consensus.cc:2243] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.134562 21390 raft_consensus.cc:2272] T d9de744344f445bb9cb73ecf9e2c7abe P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.136647 21390 tablet_replica.cc:333] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.137320 21390 raft_consensus.cc:2243] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.138295 21390 raft_consensus.cc:2272] T 1ace73d406d741f2a9f0dc5bfd31092d P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.140532 21390 tablet_replica.cc:333] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.141342 21390 raft_consensus.cc:2243] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.141944 21390 raft_consensus.cc:2272] T a58c6ffde28c4dc3b3016fcfd3ead84e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.144348 21390 tablet_replica.cc:333] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.145299 21390 raft_consensus.cc:2243] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.145825 21390 raft_consensus.cc:2272] T 382edc1be0f242f8849304dc6047d56c P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.148315 21390 tablet_replica.cc:333] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.149019 21390 raft_consensus.cc:2243] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.149523 21390 raft_consensus.cc:2272] T 3358e95d6baf4b71a770b59c369a2017 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.151731 21390 tablet_replica.cc:333] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.152347 21390 raft_consensus.cc:2243] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.152832 21390 raft_consensus.cc:2272] T 39449a9626834a4597837e1938a877d1 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.155107 21390 tablet_replica.cc:333] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.155680 21390 raft_consensus.cc:2243] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.156288 21390 raft_consensus.cc:2272] T 16d127f1573a4555ad015fcdb822de49 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.159142 21390 tablet_replica.cc:333] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.159850 21390 raft_consensus.cc:2243] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.160341 21390 raft_consensus.cc:2272] T ffe5e498fdcb408dbd8df7aca39fbef0 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.164949 21390 tablet_replica.cc:333] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.165875 21390 raft_consensus.cc:2243] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.166844 21390 raft_consensus.cc:2272] T 0317bbcf623f4ecfa69384dba23548c7 P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.169427 21390 tablet_replica.cc:333] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.170058 21390 raft_consensus.cc:2243] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.170548 21390 raft_consensus.cc:2272] T de4dfbcb9c43417fb9b6c8ae38ed076b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.172708 21390 tablet_replica.cc:333] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.173329 21390 raft_consensus.cc:2243] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.173805 21390 raft_consensus.cc:2272] T 699d125c04774cceae3f5b142afb5e61 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.175880 21390 tablet_replica.cc:333] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.176457 21390 raft_consensus.cc:2243] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.177376 21390 raft_consensus.cc:2272] T 1093cce09b304d6da8fe9c86cb5d077e P 0cfba139dd0142718bdc8cd4391d4a7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.180223 21390 tablet_replica.cc:333] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.181067 21390 raft_consensus.cc:2243] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.181983 21390 raft_consensus.cc:2272] T c7dd4e914fe9427ba3af4e10afe7e962 P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.184273 21390 tablet_replica.cc:333] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.184818 21390 raft_consensus.cc:2243] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.185809 21390 raft_consensus.cc:2272] T ea58dd6223114365b183cce2cbafb89b P 0cfba139dd0142718bdc8cd4391d4a7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.188725 21390 tablet_replica.cc:333] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a: stopping tablet replica
I20260709 13:12:27.189458 21390 raft_consensus.cc:2243] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.190106 21390 raft_consensus.cc:2272] T eda3ef7361a5452eb696c0cd602eeaf3 P 0cfba139dd0142718bdc8cd4391d4a7a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:27.191128  1493 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
W20260709 13:12:27.194271  1493 consensus_peers.cc:597] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 -> Peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Couldn't send request to peer 0cfba139dd0142718bdc8cd4391d4a7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:27.201887  1493 consensus_peers.cc:597] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 -> Peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Couldn't send request to peer 0cfba139dd0142718bdc8cd4391d4a7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.235224 21390 tablet_server.cc:196] TabletServer@127.20.227.129:0 shutdown complete.
I20260709 13:12:27.275712 21390 tablet_server.cc:179] TabletServer@127.20.227.130:0 shutting down...
W20260709 13:12:27.280164  1567 consensus_peers.cc:597] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 -> Peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Couldn't send request to peer 0cfba139dd0142718bdc8cd4391d4a7a. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:39379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:27.298879  1567 consensus_peers.cc:597] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 -> Peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Couldn't send request to peer 0cfba139dd0142718bdc8cd4391d4a7a. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:39379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:27.308132  1493 consensus_peers.cc:597] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 -> Peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Couldn't send request to peer 0cfba139dd0142718bdc8cd4391d4a7a. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:39379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.317162 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:27.318090 21390 tablet_replica.cc:333] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.318890 21390 raft_consensus.cc:2243] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.319433 21390 raft_consensus.cc:2272] T 333c0d1f6dee4aa885e402b86e26b7fd P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.321616 21390 tablet_replica.cc:333] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.322206 21390 raft_consensus.cc:2243] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.322676 21390 raft_consensus.cc:2272] T 1ace73d406d741f2a9f0dc5bfd31092d P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.324613 21390 tablet_replica.cc:333] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.325404 21390 raft_consensus.cc:2243] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.325886 21390 raft_consensus.cc:2272] T 851bbbeb812c4167ad6c8fbbd4d49d68 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.328378 21390 tablet_replica.cc:333] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.329344 21390 raft_consensus.cc:2243] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.330178 21390 raft_consensus.cc:2272] T d9de744344f445bb9cb73ecf9e2c7abe P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.332505 21390 tablet_replica.cc:333] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.333211 21390 raft_consensus.cc:2243] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.333688 21390 raft_consensus.cc:2272] T c331f5a61ad6470ab70c88bae988b2eb P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.335834 21390 tablet_replica.cc:333] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.336452 21390 raft_consensus.cc:2243] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.336971 21390 raft_consensus.cc:2272] T ffe5e498fdcb408dbd8df7aca39fbef0 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.340150 21390 tablet_replica.cc:333] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.340911 21390 raft_consensus.cc:2243] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.341774 21390 raft_consensus.cc:2272] T 16d127f1573a4555ad015fcdb822de49 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.344028 21390 tablet_replica.cc:333] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.344638 21390 raft_consensus.cc:2243] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.345548 21390 raft_consensus.cc:2272] T a58c6ffde28c4dc3b3016fcfd3ead84e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.347630 21390 tablet_replica.cc:333] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.348280 21390 raft_consensus.cc:2243] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.349390 21390 raft_consensus.cc:2272] T 382edc1be0f242f8849304dc6047d56c P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.352123 21390 tablet_replica.cc:333] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.352792 21390 raft_consensus.cc:2243] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.353399 21390 raft_consensus.cc:2272] T c7dd4e914fe9427ba3af4e10afe7e962 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:27.354255  1493 consensus_peers.cc:597] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 -> Peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Couldn't send request to peer 0cfba139dd0142718bdc8cd4391d4a7a. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:39379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.355705 21390 tablet_replica.cc:333] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.356444 21390 raft_consensus.cc:2243] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.356981 21390 raft_consensus.cc:2272] T ea58dd6223114365b183cce2cbafb89b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.359380 21390 tablet_replica.cc:333] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.359977 21390 raft_consensus.cc:2243] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.360419 21390 raft_consensus.cc:2272] T eda3ef7361a5452eb696c0cd602eeaf3 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.363713 21390 tablet_replica.cc:333] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.364305 21390 raft_consensus.cc:2243] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.364791 21390 raft_consensus.cc:2272] T 39449a9626834a4597837e1938a877d1 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.366919 21390 tablet_replica.cc:333] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.367503 21390 raft_consensus.cc:2243] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.367965 21390 raft_consensus.cc:2272] T 0317bbcf623f4ecfa69384dba23548c7 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.370118 21390 tablet_replica.cc:333] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.370632 21390 raft_consensus.cc:2243] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.371444 21390 raft_consensus.cc:2272] T 699d125c04774cceae3f5b142afb5e61 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.373648 21390 tablet_replica.cc:333] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.374186 21390 raft_consensus.cc:2243] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.374785 21390 raft_consensus.cc:2272] T 1093cce09b304d6da8fe9c86cb5d077e P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.377002 21390 tablet_replica.cc:333] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.377519 21390 raft_consensus.cc:2243] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.378331 21390 raft_consensus.cc:2272] T de4dfbcb9c43417fb9b6c8ae38ed076b P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.380571 21390 tablet_replica.cc:333] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73: stopping tablet replica
I20260709 13:12:27.381167 21390 raft_consensus.cc:2243] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.381980 21390 raft_consensus.cc:2272] T 3358e95d6baf4b71a770b59c369a2017 P 3842b034b3e24e5e8bdf35d6ce06ab73 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:27.402560  1567 consensus_peers.cc:597] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 -> Peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Couldn't send request to peer 3842b034b3e24e5e8bdf35d6ce06ab73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.425555 21390 tablet_server.cc:196] TabletServer@127.20.227.130:0 shutdown complete.
I20260709 13:12:27.461997 21390 tablet_server.cc:179] TabletServer@127.20.227.131:0 shutting down...
W20260709 13:12:27.491369  1567 consensus_peers.cc:597] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 -> Peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Couldn't send request to peer 3842b034b3e24e5e8bdf35d6ce06ab73. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:44467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.492441 21390 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:27.493278 21390 tablet_replica.cc:333] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.494330 21390 raft_consensus.cc:2243] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.494994 21390 raft_consensus.cc:2272] T 1ace73d406d741f2a9f0dc5bfd31092d P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.497414 21390 tablet_replica.cc:333] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.498041 21390 raft_consensus.cc:2243] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.498890 21390 raft_consensus.cc:2272] T 333c0d1f6dee4aa885e402b86e26b7fd P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:27.500301  1567 consensus_peers.cc:597] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 -> Peer 0cfba139dd0142718bdc8cd4391d4a7a (127.20.227.129:39379): Couldn't send request to peer 0cfba139dd0142718bdc8cd4391d4a7a. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.129:39379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.501473 21390 tablet_replica.cc:333] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.502169 21390 raft_consensus.cc:2243] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.502641 21390 raft_consensus.cc:2272] T 851bbbeb812c4167ad6c8fbbd4d49d68 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.504688 21390 tablet_replica.cc:333] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.505328 21390 raft_consensus.cc:2243] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.505793 21390 raft_consensus.cc:2272] T c331f5a61ad6470ab70c88bae988b2eb P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.507848 21390 tablet_replica.cc:333] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.508515 21390 raft_consensus.cc:2243] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.509024 21390 raft_consensus.cc:2272] T d9de744344f445bb9cb73ecf9e2c7abe P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.511010 21390 tablet_replica.cc:333] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.511657 21390 raft_consensus.cc:2243] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.512109 21390 raft_consensus.cc:2272] T 0317bbcf623f4ecfa69384dba23548c7 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.514156 21390 tablet_replica.cc:333] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.514837 21390 raft_consensus.cc:2243] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.515334 21390 raft_consensus.cc:2272] T de4dfbcb9c43417fb9b6c8ae38ed076b P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.517575 21390 tablet_replica.cc:333] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.518160 21390 raft_consensus.cc:2243] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.518626 21390 raft_consensus.cc:2272] T 699d125c04774cceae3f5b142afb5e61 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.520532 21390 tablet_replica.cc:333] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.521153 21390 raft_consensus.cc:2243] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.521595 21390 raft_consensus.cc:2272] T 1093cce09b304d6da8fe9c86cb5d077e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.523648 21390 tablet_replica.cc:333] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.524230 21390 raft_consensus.cc:2243] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.525032 21390 raft_consensus.cc:2272] T eda3ef7361a5452eb696c0cd602eeaf3 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.528731 21390 tablet_replica.cc:333] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.529534 21390 raft_consensus.cc:2243] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.530128 21390 raft_consensus.cc:2272] T 3358e95d6baf4b71a770b59c369a2017 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:27.530473  1567 consensus_peers.cc:597] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 -> Peer 3842b034b3e24e5e8bdf35d6ce06ab73 (127.20.227.130:44467): Couldn't send request to peer 3842b034b3e24e5e8bdf35d6ce06ab73. Status: Network error: Client connection negotiation failed: client connection to 127.20.227.130:44467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.532598 21390 tablet_replica.cc:333] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.533286 21390 raft_consensus.cc:2243] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.533696 21390 raft_consensus.cc:2272] T c7dd4e914fe9427ba3af4e10afe7e962 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.535766 21390 tablet_replica.cc:333] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.536274 21390 raft_consensus.cc:2243] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.536676 21390 raft_consensus.cc:2272] T ea58dd6223114365b183cce2cbafb89b P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.538813 21390 tablet_replica.cc:333] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.539273 21390 raft_consensus.cc:2243] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.539672 21390 raft_consensus.cc:2272] T 16d127f1573a4555ad015fcdb822de49 P ba7692cb58a64f9bb21890b89f5ea915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.541709 21390 tablet_replica.cc:333] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.542200 21390 raft_consensus.cc:2243] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.542928 21390 raft_consensus.cc:2272] T ffe5e498fdcb408dbd8df7aca39fbef0 P ba7692cb58a64f9bb21890b89f5ea915 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.545746 21390 tablet_replica.cc:333] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.546222 21390 raft_consensus.cc:2243] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.546977 21390 raft_consensus.cc:2272] T 39449a9626834a4597837e1938a877d1 P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.549088 21390 tablet_replica.cc:333] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.549520 21390 raft_consensus.cc:2243] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.549916 21390 raft_consensus.cc:2272] T a58c6ffde28c4dc3b3016fcfd3ead84e P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.551779 21390 tablet_replica.cc:333] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915: stopping tablet replica
I20260709 13:12:27.552165 21390 raft_consensus.cc:2243] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.552549 21390 raft_consensus.cc:2272] T 382edc1be0f242f8849304dc6047d56c P ba7692cb58a64f9bb21890b89f5ea915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.611312 21390 tablet_server.cc:196] TabletServer@127.20.227.131:0 shutdown complete.
I20260709 13:12:27.646142 21390 master.cc:562] Master@127.20.227.190:34431 shutting down...
I20260709 13:12:27.672585 21390 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.673288 21390 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.673681 21390 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5d2aeab6131b41bb8b526c612416686a: stopping tablet replica
I20260709 13:12:27.694497 21390 master.cc:584] Master@127.20.227.190:34431 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12606 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (29583 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (367860 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:12:27.751613 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 418 messages since previous log ~20 seconds ago
I20260709 13:12:27.751899 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 424 messages since previous log ~20 seconds ago
I20260709 13:12:27.752133 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 424 messages since previous log ~20 seconds ago
I20260709 13:12:27.752425 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:12:27.752606 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:12:27.752841 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 7 messages since previous log ~157 seconds ago
I20260709 13:12:27.753047 21390 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 7 messages since previous log ~251 seconds ago
I20260709 13:12:27.753250 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 5 messages since previous log ~250 seconds ago
I20260709 13:12:27.753448 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 2 messages since previous log ~257 seconds ago
I20260709 13:12:27.753728 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:12:27.754004 21390 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~11 seconds ago
